From my last post here, I had this list of items to work on: Get the voice commands working. Wire the OAK-D as an option in the camera pool – and properties so the OAK-D could be the primary camera if a developer wanted – I do, so of course this is an option – …
Serinda Graceland Update
I've spent the last couple of weeks working with the OAK-D. It has saved me so much time in development, where I had to figure out cameras, 3D layers, etc. The OAK-D and support libraries make using a LeapMotion obsolete and really sets up a prototype environment that I had to create. I don't have …
XR – MR – How Did I Get To This Point?
At age 5, I knew only two things - I wanted to be a firefighter and fly helicopters. I knew exactly what led to me wanting to be a firefighter. I don't remember how I found out about helicopters and pilots. It was probably a TV show my parents watched or a movie, and I …
SERINDA V3 – “Graceland”
I've decided to name this version "Graceland" - IYKYK. While the original intent of SERINDA was to provide many open-source and cheap options for AR/MR/XR, those endeavors have proven quite expensive time-wise. This next version will explore different cameras for SLAM (VSLAM/ORB SLAM/etc.) and OpenCV AI Kit (OAK-D). I have an original, clunky OAK-D, and …
SERINDA OpenCV and BabylonJS Integration
One of the big issues I've been working on has been translating OpenCV detection points to BabylonJS coordinates. Up to this point, I've had some success getting a marker to track an object. I decided to take a look at the JSArtoolkit5 examples and see what I could glean from them. The idea was to …
Headset FOV
I was asked about the FOV for each of the headsets. Haori I call this the Johnny Mnemonic and is the one I'm using the most right now. It has 50-degree FOV.https://www.amazon.com/gp/product/B07C2B22GG/ Mad Gaze Glow I call this the Roy Orbison and has a 53-degree FOVhttps://www.amazon.com/gp/product/B08G1H7X61 Chengzi This has the same viewscreen used by the …
Architecture Rewrite
I'd taken the Serinda project and split it out into a basic project so I could convert the Python work over to Javascript so all of the work is processed on the front-end. I don't want to remove all of the work I've done so right now the branch I'm working on is all of …
SERINDA Optics Update
The last couple weeks have been pretty focused on the 3D GUI/HUD (we'll just call it HUD from now on). I already have LeapMotion integration, OpenCV integration, and BabylonJS integration. All three are separate pieces. With the HUD I wanted to make sure I had pieces in place so that the OpenCV detection coordinates could …
Python 3 cv2 Has No Attribute Aruco
Osiyo. Dohiju? ᎣᏏᏲ. ᏙᎯᏧ? Hey, welcome back. I don't use Aruco in my work. I haven't had a need for Hiro or Aruco markers. However, I was testing some code and came across this error: AttributeError: module 'cv2.cv2' has no attribute 'aruco' Sometimes my pip installs get munged when I install other packages. So I …
Transparent Overlay
Osiyo. Dohiju? Hey, welcome back. Since finding the Triton project I've been working on a side project with it. The idea is to take the SERINDA work I've done and integrate some of it with Triton. For example, the webspeech work, the OpenCV work, dynamic layouts, etc. In order to do that, I can either …