Anyone tried development using an Oculus?
A few months ago I bought an Oculus Quest 2 with the vague idea that I'm going to set up a development environment inside it.
It is a bit heavier than I expected, and while I had some fun with Beat Saber, I have not used the thing for work.
I mostly do web development - Nuxt on the frontend, Rails on the backend. My standard development environment is Visual Studio Code.
I'm curious if anyone found a place for the Quest in their work processes.
I got an Oculus Rift CV1 In 2016 and started developing VR interactive sims using the Unity Engine and found the dev process tedious. There are many times you need to wear the HMD and take it off, look at code, then into unity UI and back to 3D modelling app etc. It's a slow repetitive pattern.
As others have mentioned, the eyes / camera motion sensors and telemetry tracking HMD felt like invasion of my privacy too.
Everytime i finished a session of dev for VR or playing some VR games I would use home made cardboard caps to cover the motion sensors and disconnect the HMD after use. It was a chore to do this every time though.
When facebook added their first firmware update to my Rift, It became sluggish to use. I returned it and was refunded. I then bought a 3D projector and use face tracking camera instead so i can look around still like you do in VR and have a higher fidelity experience playing racing sims etc. Also for space games, the big screen feels like I'm using a view screen on the starship enterprise.
Its convenient, It's more social too because others can share the experience. For now this suits my needs. Hopefully one day i will look forward to getting a true next gen VR HMD and hopefully one that competes with meta on pricing and without the privacy compromise.
The first thing I tried in VR when I got my Oculus DK1 was was to create a Javascript REPL in VR. I've experimented with many iterations since then and the biggest issue is the resolution of the headset in terms of pixels per degree. This is ~20 on modern headsets compared to the ~60ppd of human eyes. The low res means you need to constrain yourself to ~1024x1024px screens for text.
But if you're willing to use a low res programming environment, the easiest option is to use VNC or RDP for Android and connect to a PC. Alternatively, you can try setting up a Quest + termux + i3 + tmux + vim + ... environment on the Quest for a standalone experience. I haven't tried VSCode on the Quest, but I have notes on how to get a Linux workflow setup at https://www.reddit.com/r/cyberDeck/comments/fc5sfr/oculus_qu...
https://old.reddit.com/r/HMDprogramming/ also has more links on this topic.
One headset I’ve heard of that is aimed at more office focused usage is the SimulaVR[1]. However, it’s still a work in progress and you’d have to preorder.
[1]: https://simulavr.com/
No. And I sold all the VR devices I had over time rather quickly again. Once the novelty wears off, they just became supremely impractical. For gaming it required the shuffling of furniture. For anything else, neither the resolution nor comfort are there. Even worse if you wear glasses. And in the summer time... think diving goggles, only inverted.
I’ve done almost exactly what you bought the Oculus for - results were promising, but not good enough currently.
Reason: resolution is too small. Hard to truly see the code, even when I bought lens inserts that matched my prescription.
I really like using Immersed VR though, it was cool to be able to have 5 different screens. Although, frankly, I’m probably more productive using a generic iMac with no other external monitors.
Its definitely a different experience, but using Immersed was the best. You can set portals to your keyboard and have extra portals as well (like that spot on the table you put your drink).
To help with ergonomics, I would recommend a Halo style strap and a fan facial interface to help with longer sessions. If you were glasses, or computer glasses normally I generally recommend getting the Occulus prescription lens.
I would recommend at least trying it, as mentioned it won't be for everyone, but it is definitely a cool experience. With a bit more innovation at the ergonomics, I can definitely see this being a thing in the future.
There was a guy on HN within the last year who was more or less F/T in VR. He posted about it and answered questions. I'm not sure if either of these are related but fine tuning searches might track them down:
https://news.ycombinator.com/item?id=28678041
https://news.ycombinator.com/item?id=29978036
Was thinking something similar, but my glasses make it impractical. A company now offers prescription inserts, which I plan to order.
https://www.vr-wave.store/products/oculus-quest-prescription...
However, even with my glasses on, the resolution is about 1/4 of what’s needed to perfectly render text. It’s also too heavy, and too hot for more than an hour.
But I’m interested in your experience.
It might be a bit of "faster horse" desire but I'd love to have a VR library if the fidelity was good enough. I mean virtual 1:1 representations of books, that I can make margin notes in etc.
Then when I move I don't have to get rid of a load of books or back up heavy boxes and when I die it can be easily passed on and not a burden to those I leave it to.
Arkady Martine's Teixcalaan series of sci-fi books have this concept of an imago machine, where a person has an implant that allows a compatible "not-quite-sentient" predecessor to live inside their head and give advice. And that predecessor would also have had an imago machine.
It would be neat to have access to the libraries of my ancestors (or anyone I guess) once they become digital and are almost costless to store and duplicate. All the books they read and wanted to read, the notes they made, when in their life they read them etc.
I bought an oculus for vr dev a few years ago but gradually got creeped out by Facebook having cameras in everyone’s homes. VR right now, especially due to oculus, is a surveillance horror story waiting to happen. I sold my headset
I am very interested in this use case since I travel frequently and would love a portable multi-monitor setup. The weight does not bother me and I have watched full movies before in comfort.
2 issues hold it back:
1. Typing and mousing require high res color passthrough cameras or high accuracy low latency hand and keyboard tracking. Neither is there yet.
2. The lenses have too much distortion and not a large enough sweet spot. Fine for gaming, they really don’t cut it when trying to work.
I would happily use a VR headset for a few hours of standing desk time a day if it were just a little more refined. The upcoming Quest Pro might have the needed features to make this a real option.
I tried, but am waiting for a resolution bump to do VR monitor stuff. The screen is large but ends up really low res. Its like working on a 1080p movie screen (or three) from the audience at a movie theater. Its better than working from a laptop screen, but not better than having multiple real-life monitors.
In theory, I should be able to have a laptop and headset and get good multiple monitors wherever I am located.
edit:
I like the separation between VR and irl that a lot of people are complaining about. It makes it hard to multitask between computers and real life, so you have to choose what you are doing instead of pretending to do both.
It's not particularly practical for this at the current oculus display resolution. Sure, there are tools discussed in the thread here with virtual monitors etc, but we'll have to wait for a future generation of hardware for those virtual monitors to have anywhere near the resolution of an actual monitor.
Perhaps a related or unrelated question. What is the easiest Oculus development environment. I want a very simple "hello world" thing. I'm an experienced web/backend developer. I just want 4 avatars in a room who can see each other and talk to each other. I don't care if the avatars are spheres or boxes, just that they can sell "Hello World".
My current best guess is Unity, but perhaps there is something simpler to start with?
I bought a Quest 2 in hopes of replacing my external monitor with it, but unfortunately the resolution simply isn’t adequate (in my opinion) for traditional, text-heavy desktop computing tasks like writing code. I think the concept has potential, but personally wouldn’t recommend it right now. It is something I do want to try again if/when higher resolution VR headsets come to market.
For fun I did with Horizon Workrooms, and it was quite the mind blowing experience.
My laptop's screen was streamed to the headset and looked larger than IRL.
I was sitting on my couch in my living room, and noticed an unexpected benefit of VR: no more screen glare from the sun behind me!
VR headsets are not yet a replacement for IRL screens, but I can see that happening one day.
I used a tool called Immersed[1] for a bit. It is neat and potentially useful, as from what I remember you can create more virtual monitors than you have actual monitors, but the novelty wore off and I stopped, since I wasn't particularly more productive.
[1]: https://immersed.com/
I have a quest2, I don't think it's anywhere near comfortable enough yet for prolonged use such as development. I've tried watching films in it and even that can get a bit too uncomfortable.
As you say they are still a bit heavy, it's tolerable for an hour of gaming but not work. Now that VR is mainstream I'm sure this will gradually improve, it would be nice to have something almost as light as a pair of glasses or maybe more realistically headphone weight, that would also make it feel a lot more convenient to take on and off without all the head strap paraphernalia. Might be worth revisiting the idea in a decade.
It is far from being a part of work processes. It just needs better material. But, I also suggest playing online FPS games in Quest 2. I think that's the future for FPS games. It promises and somehow delivers a better experience.
No, because I don't want to share my source code or anything I watch with Oculus/Meta. It is worse than a smart TV.
I have used nReal glasses for dev work - they are incredibly light, and are ideal for use outside in situations where a laptop screen would be washed out, or perhaps when travelling, especially if privacy is an issue. The audio is pretty good too, as their intended purpose is really to watch films. Plugs and plays with many, but not all devices. (Hilarious aside: the windows device driver identifies as something similar to 'US Naval research 7" screen'?!). ETA: Can optionally be fitted with spectacle lenses.
No, because the devices are awful at rendering text.
I bought one of these to use Immersed[0]. The software was fine, but the display was too blurry outside of a small area in the center, so I couldn't really use it.
0: https://immesed.com/
I've done it some and it shows promise but for me personally the tech is at the progressing-but-not-quite-there-yet stage.
Regarding weight: the headsets do need to become lighter, but right now the larger issue is the imbalance of the weight. If you attach an external battery on the back of the head strap*, it will greatly reduce neck strain from prolonged usage, and overall it actually feels lighter.
* BTW, for the Quest 2 specifically you should look around for a 3rd party replacement head strap because they can provide a better fit. Search for "bobovr" on Amazon to see the one I got.
Why would you buy a display device that requires registration?
As a consumer, you have to enforce limits and stop buying consumer goods that are against your best interest.
You deserve what you tolerate, and if you buy a product that you don't own, and you get mistakenly locked out of your account and end up with a bricked product, then you deserve it.
What's next? Food packaging that requires registration? If I am buying a product then I am the owner. Private property as a right must be protected.
I’m waiting for Project Cambria, aka Quest Pro, to do these kinds of experiments. It will be lighter with its pancake lenses and the color mixed reality cameras should make it more seamless to use my real keyboard and mouse. As you mentioned the Quest 2 is just too heavy for this kind of work, but I have high hopes for the Quest Pro (and perhaps Apples rumored headset for announcement in January 2023) to enable coding and work scenarios.
Check the subreddit /r/HMDprogramming
Yeah I can't keep it on for more than an hour. Otherwise I start getting headaches and feeling nauseous.
It's pretty easy, blender to design with, export to unity add your sdk (android will be one of them considering quest 2 is android 10 and quest 1 is android 8) Unity is C# and can export to Visual Studio. That should give ya your design engine right there.
Yes and I would strongly recommend not doing this.
The display resolution is too low and the motion blur, VAC, and other idiosyncratic VR problems all mean that you will most likely get a nasty headache. I would recommend buying another monitor instead.
I am in a similar boat. Thought it could be interesting to code in VR but the clunkiness of the whole setup (keyboard pass-through is limited) and the text resolution have held me back from trying and real work on my quest 2.
I have this idea for a chorded VR keyboard that's modeled after a drum kit or xylophone.
I predict that once you learn the chords enough with muscle memory, you'll be able to take off the headset and just type with the hand wands.
Immersed vr is a good app, but quest 2 can be unbearable after 15 ~ 20 mins in a seated sedintary position.