What New Findings Reveal About Valve Deckard

Steam VR had a notable replace on June 14th. Not a lot in what was launched within the patch notes itself. However within the backend: we acquired a ton of latest programs/strings associated to Valve Deckard. The following HMD from the corporate who runs Steam.

Be part of me as I stroll by means of essentially the most notable issues that me and my fellow dataminers have discovered.

New System Menu

Probably the most notable factor that was discovered within the strings (and later activated through some tweaks to the code) was a set of latest menus which are clearly meant for a product that doesn’t exist. First let’s speak about how Steam VR has a System menu. When you have ever used a Steam Deck, you would possibly acknowledge that the UI for this web page could be very related. The flexibility to replace a tool, see standing of an replace, and even select an OS Replace Channel are all copied over from the Steam Deck. Valve’s Moveable Handheld PC.

The OS Replace Channel would present you a wide range of completely different builds you may entry. Corresponding to a Beta OS construct that may allow you to check options forward of time. And a secure public construct. Probably extra. These replace programs don’t work. The code references json information wanted to have the ability to request what builds can be found from the central server (/linux_update/get_channels.json). However since we don’t have that JSON file, there is no such thing as a webserver routing, as of but, to obtain updates from. You may additionally discover a significant distinction to this menu from the Steam Deck UI is the very fact it is advisable to point out the place a PC has a Steam VR set up. You can not change something inside this immediate as of but. However as I’ll clarify quickly within the Valve Deckard Recap Web page – The bottom Deckard is probably going to make use of an ARM chip to change into a “sensible PC VR HMD.” And can nonetheless require routing to a PC. Whether or not that’s strapped immediately onto a headstrap mounted compute unit. Or wirelessly related. System Replace won’t change Steam VR itself. However possible the firmware on the Deckard

XRService Cal

On the System menu, there may be additionally our very first reference to an XRService Cal. That is the primary time we’ve got heard of such a system inside Steam VR. However it’s positively an vital layer that Deckard must function with. Our present hypothesis is that it’s a part of Valve’s new camera-based monitoring system. From my analysis, Valve has loads of curiosity into making use of some Combined Actuality cameras to their headset as nicely to do Video Passthrough AR. This curiosity comes from patents, plenty of driver updates associated to cameras on lighthouse HMDs, feedback from Gabe Newell, and confirmed partnership work with a pc imaginative and prescient firm often called Arcturus Industries. Should you watch their public demoes, they showcase loads of programs associated to utilizing cameras to do SLAM and digital reconstruction of areas.

This XRService Cal string within the menu will seemingly simply present the date and time of the final time you probably did the calibration. This may be helpful for builders solely. And a great way to trace to individuals like me: “hey we are literally doing this.”

You will need to observe that we’ve got speculated for a protracted time period that Valve would permit the power to trace with out lighthouse base stations. Sources from Ars Technica confirmed our suspicions as nicely. However Valve will not be giving up totally on the lighthouse monitoring system that many PC VR lovers like myself use for issues comparable to Full Physique Monitoring.

Deckard Devtools and Lighthouse Pairing

Lighthouse has been an extremely helpful monitoring system for VR HMDs and extra importantly: equipment. Purposes like VRChat thrive as a result of they adopted the power to make use of issues comparable to Vive Trackers to permit Full Physique Monitoring for avatar expression. The principle concern individuals have had with Lighthouse comes primarily from the issue in adoption. Particularly for individuals who can not drill holes in partitions. Or simply reside in small rooms in flats.

Valve is seemingly wanting to vary this by incorporating each Digicam based mostly monitoring AND the choice to nonetheless use Lighthouse base stations/peripherals with Deckard. Within the image posted above, we’ve got the very first reference to one thing referred to as “Deckard Devtools.” Dev clearly stands for developer. And there appears to be a subset of programs that will permit builders to tweak video games/overlays/providers to work in parity with the Deckard. We should not have the total listing of programs that these Deckard Devtools embody. Besides one: a completely fleshed out menu system that enables customers to pair lighthouses and lighthouse dongles to Deckard itself.

We aren’t certain how totally the performance goes for Deckard itself. However we did determine how one can entry the brand new menu inside VR. It’s one thing that individuals within the Steam VR group has needed anyway, and not using a new HMD. And it really features the best way we wish it to.

New Web Menu

One of many most important advantages of incorporating an SoC into Valve Deckard can be the addition to incorporate accessible wi-fi know-how. The Quest 2 makes up almost 50% of all headsets related to Steam VR and it’s not onerous to see why. It’s offered at a loss, but additionally: It has functions like Digital Desktop and Air Hyperlink that makes wi-fi PC VR simple and accessible.

One other new menu added (and activated with tweaks to the code) is the “Web” settings menu. It’s actually fairly self explanatory. Steam VR is including programs that may permit a PC to arrange a “Wi-Fi Hotspot” for Wi-Fi enabled HMDs like Deckard to simply connect with. At the moment it’s notable that the code largely is sure to Linux endpoints.

Surprisingly sufficient – the menu and code suggests the power to listing a number of HMDs related. I don’t know if this could be meant for Location Primarily based experiences that will possible allow simple multi-communication between headsets? However the performance is considerably there.

The final ultimate observe to this part is expounded to strings. These Entry Level options are plagued by references to a brand new set of drivers that don’t exist on the Public model of Steam VR. The set of drivers it’s on the lookout for is known as “cv_hmd.” I’m not going to take a position myself on what CV stands for. There are a pair apparent concepts you may lead your self to. One factor is for certain although: at some point, we are going to in all probability get a brand new folder in SteamsteamappscommonSteamVRdrivers that may allow this performance and probably give us a coronary heart assault.

Foxnet Returns

On October 1st, 2021: I did a reside stream the place I plainly set out all my predictions on what the Valve Deckard can be. And I’ve to notice: a lot of the issues I mentioned in that stream, nonetheless keep true for my predictions immediately (apart from Varifocal Optics).

The one ultimate piece that allowed me to string collectively an image of the Valve Deckard got here from a leaked Steam Deck Firmware backup by chance revealed by a Valve Developer. Inside this firmware, there was solely a pair information inside Steam OS 3 that talked about Deckard. They usually all had been in a folder named “foxnetstats”. On this folder was a set of Python information that had been named: coremodules.py , steamvr.py , and at last deckard.py. Throughout the Deckard named file, Valve by chance proven us what sort of SoC was inside a model of Valve’s upcoming HMD.

The image listed above reveals all of the cores that Valve was fascinated by recording thermal temps for. To the untrained eye, this won’t inform you numerous in regards to the SoC being logged. However for individuals who comply with this trade in ridiculous quantities: One factor is definite. It reveals proprietary cores that Qualcomm contains in all of their SoCs. Together with ones just like the XR1 and XR2. So we gathered that Valve was fascinated by considered one of these chips this for their very own Headsets. (We simply couldn’t inform if it was the Identical XR2 in Quest 2)

However wait, Valve has repeatedly mentioned that an x86 AMD APU just like the one within the Steam Deck would assist them run standalone VR? Effectively once more: they do have plans for that. However I believe as an improve path. I anticipate Valve will deal with modularity and their fanatic PC VR group first.

To get again on observe, we heard nothing of FoxNet since that leak. The Steam Deck got here out and had no references wherever throughout the code. I need to reiterate how fortunate we had been that the Valve worker seemingly backed up his personal firmware relatively than utilizing a clean slate. Deckard can be far more mysterious with out that mistake.

As of Steam VR 1.23.2, the backend code lastly has references to this Foxnet service. And we discover out that it’s based mostly on an software referred to as “WireGuard.” WireGuard is a safe VPN tunnel. The explanation for a VPN tunnel is one thing I’ll go away to your creativeness.

New Theater Mode

I’ve reported quite a bit in relation to a brand new Theater mode being labored on for Steam VR. For individuals who have no idea, Steam VR has used the identical methodology to permit gamers to play flat display screen video games in VR because the HTC Vive launched in 2016. It ran on Unity. Was sluggish and ugly. Nobody needed to make use of it. Six years later, they lastly determined a brand new system must be launched.

As an alternative of requiring a model new software to open alongside the non-VR recreation itself – Valve is utilizing the backend of their Steam VR desktop/overlay system to construct it. This isn’t solely far more performant, but additionally leads some actually neat prospects associated to Combined Actuality. One of the frequent talked about use circumstances for AR is the concept that it could substitute a big measurement TV that may be moved wherever at any time. The issue with this concept up till now has been the very fact nobody has needed to observe/play non-VR content material on cumbersome/massive + low decision HMDs. Nevertheless in the event you adopted my channel sufficient: you may be noticing that each of these issues are altering within the subsequent technology of XR {hardware}. Headsets are getting lighter, thinner, and far greater decision. And with the XRCalibration that alludes to having the ability to map out a Actual World surroundings for steady placement: I believe Valve is establishing the programs for this.

At the moment what’s constructed into Steam VR regarding the theater mode IS activatable through string tweaks. Nevertheless the expertise will not be polished by any means. I need to point out that my dream for a system like this could be to permit integration of Steam Distant Play. And a digital sofa to ask associates collectively to play sofa co-op in VR.  No allusion as to if that’s taking place. But it surely’s my dream.

SkyDome?

I haven’t talked a lot about this function being added throughout the information. It’s only a set of latest skybox-type pictures to Steam VR. And reflections they might give off as nicely. I assumed it was a alternative for the usual skybox you’ll see whereas loading in between apps/video games in Steam VR. However I’m not so certain.

To high particularly doesn’t match up with the present means that skyboxes are rendered. So we may be seeing a completely new function or are awaiting a tweak to how skybox information are stretched. In SteamsteamappscommonSteamVRresourcesbackgrounds – At the moment there’s a SkyDome texture that’s gradient black to grey, a SkyDome_Blue texture that’s gradient blue, and a reflections texture that relate to the blue shade extra.

New Steam VR Room Setup

Now that is embarrassing. This isn’t a function that was added in 1.23.2. It was added earlier, however all of us missed it. That being mentioned, it’s nonetheless a WIP and is completely a distinct means than how Room Setup presently works in Steam VR.

Should you skip to 1:58 on this video I made, it is going to present you precisely the way it works. The massive advantage of this setup system (though its unfinished) is that it allowed you to do it totally inside VR. In contrast to the present “official” Room Setup.

Standalone System Layer

That is the Valve Inner Menu. Identical to the System and Web menus: Its a hidden menu you may activate with some tweaks to the config information. That is the place we enabled one other menu that proven us the brand new WIP Room Setup. But it surely additionally lets you allow completely different experimental programs comparable to Prism (doesn’t work) and the Standalone System Layer.

For some time, the Standalone System layer didn’t do something besides crash Steam VR. However now it really does one thing… It disables the Steam VR Dashboard fully. As in, it doesn’t appear to run that total layer inside processes. Why would they do this?

Effectively to me: I speculate that Valve’s subsequent HMD may have it’s personal UI and “Dashboard” constructed into it’s firmware and SoC. However Deckard nonetheless depends on communication with Steam VR on PC to entry the function units and extra.

Patent and Wrap Up

This beautiful a lot ends my overview and clarification of all of the backend programs we discovered inside Steam VR 1.23.2 Beta. Once more, it’s a ridiculous quantity of stuff this time. And the stuff they purposefully set free to us feels eerily much like when Valve set free the information that permit xPaw determine that they had been making a handheld gaming PC often called SteamPal (later Steam Deck).

Valve additionally had a utility patent software revealed displaying off continued work on this idea of communication between the “entrance show housing” and the rear housing on the strap. I nonetheless stand by my predictions on how Deckard will at some point change into a full Standalone PC VR HMD. Even when it probably doesn’t launch with an x86 APU at launch.

Articles like this can proceed to be revealed. I relatively individuals use this as a useful resource for regurgitation/video scripts than my twitter. And I thank Valve for giving me and my different XR lovers one thing enjoyable to do from time to time. A lot Love from all of us.

---

Bradley Lynch is the creator of the SadlyItsBradley YouTube channel. He and others on his Discord incessantly analyze code in updates to SteamVR. His latest submit analyzing a June 14th replace is reprinted right here with permission.