SERINDA V2 Display

Osiyo. Dohiju? Hey welcome back.

The usefulness of SERINDA relies on a couple of elements. The first element being that the HUD/HMD is AR/MX. The second element is that the coding is done in Python and HTML. I have covered some of this before, however, here’s the brief rundown. Python and HTML because they are quick prototyping and implementations especially using OpenCV for filters, etc. HTML is easy to manipulate using Javascript for the layouts. Python also handles the speech portion (natively) better than the browser did. The AR/MX portion is because I want to be able to see the view in a HUD/HMD. The simplest example is the ability to overlay some text or video while able to see the rest of the world. In this way, while walking I could read a book or watch a video. This is an overly simplistic use case, however, it is one that is realistic and if that can be accomplished then all of the rest of my work could be as well.

Here’s the problem I’ve run into. It seems that no one has tackled this idea. Well, almost no one. I did find a developer who used an Android device and Unity to kind of work with a browser in AR space. This seems like a good first step for me so I’ll explore that a bit more since that was my next logical progression if I couldn’t get the browser to have a “transparent” background while displaying the HTML. As it turns out a transparent browser is a “bad thing” because that means you could have spam and malware that isn’t seen. So, that I could find, there are no implementations of a transparent browser. That leaves rendering a web page in sections in AR in some way that I like. At this point, I’m unsure of how to go about that. I mean, using an example I found I could put the browser in AR space… but my display may not be the way I want it so I’ll have to experiment with it using a PC instead of an Android device. Or maybe an Android tablet to test my work with. Especially since the server portion of this app will be displaying up to 6 cameras (so far) at one time and processing some OpenCV code… and that code may include some AR work. So it seems like inception for the moment. We’ll see. Is it possible that I can use the <meta name=”transparent” content=”true”> to do what I want? And do I need something special for this?

It seems like I could go a few different routes – such as a React or React Native app, Unity involved display with a web browser, and a few other ways. I am going to try WebXR first and if that doesn’t work then look at more involved examples. I’d really like to not have to redo the entire front end in another framework.

Wish me luck.

Until next time. Dodadagohvi.