Well, we did it. It was 2AM and the HTC VIVE Trackers just went live on the HTC VIVE accessories webpage at the end of March. We had ourselves an adventure since the trackers came out in the United States before Canada, and we drove down for some Target browsing (I personally enjoy their cosmetics section haha), and of course, a trip to the states isn’t complete without Mexican food. Kial is playing around with a lot of mocap (motion capture) and I’m really just along for the ride (and usual QA, calibration sorts).
— M. Lovecraft (@VRmyofDarkness) April 3, 2017
As another note, when the HTC VIVE Trackers were released in Canada, I was pleased to see that HTC changed its stance on its ludicrous standard $65 shipping, no matter what you purchase. Last year, I ordered an extra link cable, and cable box which were very small items, and HTC insisted that $65 was the standard shipping. At the time of writing this, I believe they changed their shipping to $35 for tracker shipping in Canada.
What’s in the box?
The boxes are in line with the HTC VIVE branding with an all-black exterior, and bright blue labelling.
The tracker was nicely packaged, with the tracker to greet you upon opening the box, and the dongle and appropriate technical literature sitting below the tracker’s cardboard tray.
One thing to note right away is that the dongles are essentially “married” to their tracker and it’s probably important to not mix them up. Similar to wireless mice and keyboards, if you buy two of the same wireless keyboard, the dongle that it comes with, will not work with any other keyboard other than the one it came with. Also it’s interesting that the dongles require 18 inches of space away from the computer. I kind of wish the technical guide said why that is, but perhaps we can chalk it up to interference, or reach.
Mounting the HTC VIVE Trackers
I had begged Steve Bowler of Cloud Gate Studio to reveal his secrets in mounting their trackers, but found that a lot of devs and makers are forced to create their own mounting solutions for the time being. It’s pretty awesome that HTC decided to go with the standard 1/4″ inch screws, which are compatible with a lot of camera tripod mounts and accessories. Steve recommended that I didn’t go his custom metal route as his team ended up with bouts of metal splinters, and that he is hoping to sell their metal mounting clips in the future.
While waiting for Steve and his team to hit the market with their solution, we had to find our own.
After hunting for hours on Amazon Canada, here’s what we’ve ordered:
- Luxebell Clip Mount, 360 Degree Rotating Backpack Hat Fast Clamp Rec-mounts for Gopro Hero 4, Session, Black, Silver, Hero+ LCD, 3+, 3, 2, 1 and Sj4000, Sj5000 Cameras
- Neewer Universal Conversion Adapter (1/4 Inch 20) Mini Tripod Screw Mount Fixing GoPro Accessories to Sony Olympus and Other Action Cameras(4 Pack)
- Neewer Stainless Steel D Shaft D-ring 1/4″ Mounting Screw 0.39″/10mm Shaft for Camera Tripod Monopod or Quick Release (QR) Plate -5 Pack
- 2X Black Buckle Basic Strap Mount For Gopro Hero 3 2 Camera Camcorder
(Note that we are still waiting for some of the items as some of the products weren’t available for Amazon Prime unfortunately.)
Initially we used the clip mounts to attach to regular shoes instead, but Kial found a “better” (ugh) solution. He found some knock-off crocs from the Japanese $2 store Daiso. As much as I had to admit, the solution was great as we only needed to use one mounting screw – very simple!
The one tracker clip mount we still have is still a very high profile, so hopefully one of the other items will allow us to lower that profile, creating less jittery movement when it’s mounted onto a belt clip. We’ll update later this month once it arrives!
Hoping this gives other folks some ideas for mounting their trackers, and if you have a better solution, please share it with us, we’d love to hear from you!
In the meantime, here’s our pal Ace doing some dancing to do some troubleshooting. Best troubleshooting ever:
Troubleshooting VR crocs always looks awesome. Dancing solution. pic.twitter.com/AG0uvMisre
— M. Lovecraft (@VRmyofDarkness) April 5, 2017
This weekend I got a small taste of how VR could impact communication on a game changing level. Long story short, I 3D modeled a world, uploaded it to my account and explored it with people from all over the world within the span of a few hours. This could really impact notions of ownership, property and material possessions in a huge (and I think beneficial) way. (But more on that later.)
We’ve been blown away by the community from Reddit, to UploadVR to Twitter to the Nerdist – our passion project surpassed beyond our wildest expectations and we decided to share it another way: on the social platform VRChat.
Speaking of, we’ll be guests on their upcoming show TONIGHT! – Tuesday, February 21st at 7PM Pacific. Keep in mind that you can install VRChat and watch, even without a headset! (Cool, eh?) You can check out archives of the show here and follow them on Twitter.
Why not re-purpose again?
I didn’t model the environment with game engines in mind. My work flow in porting it has largely been the path of least resistance (i.e. putting mesh colliders on any of the huge/complex object the players should be able to stand on and ignoring colliders on the thousands of individual objects). Exploring the map with an enthusiastic group on VR Chat showed me just how many places a user could get stuck in a pit or run into an invisible collider that stuck everyone to the ground like glue. Despite these bugs, running around the world still felt like a huge adventure, and made me reflect on a fast approaching future in which engineers or designers will explore structures collaboratively in a group. Or Minecraft.
The Unity hurdles and Experience with the VRChat SDK
Unfortunately we encountered some problems using our current Unity version 5.6, and found that we had to downgrade in order to use the VRChat SDK (which it kept telling me in a warning message, but I’m stubborn and getting really tired of computers telling me what to do).
— M. Lovecraft (@VRmyofDarkness) February 19, 2017
Luckily Unity keeps an archive of older versions of their application, and we were able to get it working fairly quickly. The VRChat SDK is really well designed and intuitive: its clear it was designed for creators of all skill levels, and I would highly recommend checking it out!
For this version of the model, I removed the post processing look and locomotion code from the scene (it’s good practice to make the build less than 200MB). VRChat has its own incredible locomotion options, so everything hooked right into that.
Gunter, a really great member of the VRChat community who has been helping me develop the map, suggested that I add portals, as well as a high vantage point to ease in allowing users to find each other, and facilitate easy movement across the vast expanse of digital space.
What struck me was that VR enables layers of communication that aren’t present in any other medium (or in life itself). Players changed their avatar to suit the environment: a huge area that would be well beyond cost prohibitive for me to build to scale in real life. We can design spaces, write code and alter ourselves in a really full expression of creativity. It’s not just virtual reality: it’s a shared reality, and it’s one that we can shape to our hearts’ content.
It’ll Be Fun They Said
One of my friends sent me a link to a sketchfab contest that challenged creators to make a VR-ready model inspired by the Legend of Zelda. I’m a big fan of the series, and I have been dying for an opportunity to port one of the MANY Game of Hyrule models I made into virtual reality. The project seemed like a perfect fit…
And it many ways it was, although in practice it was also a harrowing exercise in extreme tedium and madness.
The original map was painstakingly built up using manually drawn splines, extrusions and box modeling for each of the 50+ unique objects in the set. There might be a few errors, but nearly every element on the overworld map has been recreated and placed in 3D space. While this process was laborious, it doesn’t even compare with the optimization process. Well, I say that because I built the map a year ago and the pain is mostly gone. Mostly.
I got the impression that having over 5 thousand individual models, grouped under a multitude of nulls and hiearchies would probably kill real-time performance (gotta hit that 90 fps), so I decided to merge all the geometry that shared a common texture. This way, retexturing the model would also be way easier to do in subsequent engines, as you only had to apply one material per piece of geometry.
It turned out to be a huge ordeal to combine the thousands of individual meshes as some of my models had their own hierarchy, or polygon selections that applied two different materials to one object (perish the thought). In the end I had to manually combine, change texture tags, and clean individual objects for a full day. Luckily some of the objects were instances, so I could fix up and ungroup the original model, but even still there was a mountain of mind-numbing monotony ahead.
Even getting the file size down to the Sketchfab basic (‘I haz no monies’ version) requirement of below 50mbs was a horrifying task. I found that deleting some of my textures and UVs freed up just enough space for me to get a barely passable version up on Sketchfab. N-gons (polygons with more than 4 verticies) saved space, but became digital nightmare shards in my uploads to the site, so I had to convert critical objects to tris.
But hell, I slogged through hours of optimization and tidying, and I wanted to see it in it’s full VR glory. Unity to the rescue.
Help me Unity3D, you’re my only hope
I was able to rebuild the textures from my original Game of Hyrule map intro using the incredible UBER shader by Tomasz. I was expecting a performance hit from the complex, multi-texture shaders I built, but everything worked flawlessly… so I wasn’t satisfied until I threw as much post processing/image effects onto the camera as possible. I used the godlike Volumetric Fog & Mist by Kronnect to create some atmospheric perspective and even a subtle amount of sunshafts (dare I say ‘tasteful amount’). I added filmic post-processing from Scion to the camera, and found the performance hit acceptable for how cool it made everything look. Oh yeah, and I added AO because bitches love AO.
As far as the ‘coding’ I used VRTK for teleportation and Playmaker for the player scaling. I’ve been spending so much time working on learning ‘code’ and game logic for other projects that it was a welcome excursion to just make something look good (often the only requirement in 90% of my freelance work). Coming from a VFX background, I am still shocked at the real time performance of modern game engines. 1-3 hours per frame? What is this, 2015? I’ll render in Unity, thank you (well, Unity or Octane, OR BOTH #LaterThisYear #OctaneInUnityForever).
Anyways, all the boring, mindnumbing work was worth it if you guys enjoy playing around with the map! I hope I can export some other models for you to play around in soon… I just hope someone invents some crazy, flawless texturing baking solution for C4D/Octane in the meantime.
The final product
You can download the small Zelda map experience on itch.io, or navigate to the Downloads section. In the meantime, here’s a quick look:
A World Without Limits
Congratulations! You are one of the adventurous few, daring enough to explore the infinite reaches of VR: a bold new experiential platform that some have called ‘The Final Medium.’ No other art form I have seen requires as many disparate and varied skills to pull off, but it is my hope that through this series that I can elucidate some of the more powerful tools and techniques I have found that allow you to realize (a place others into) your vision as fast as possible. Before we get virtual, however, let’s take a moment to go over our unfortunate IRL (meat space) limitations.
Scope (A World With Some Limits)
The tools and pipeline of content creation will vary greatly on what kind of project you are making, but one of the consistent challenges is reflected in the inescapable triangle of compromise:
Anything you make costs something, but not all costs are worth taking. A project can cost your good health, finances, opportunity for growth/expansion, personal relationships or your confidence in the very fabric of reality. Limiting the scope of your project early on can hopefully prevent you from sacrificing anything of value down the line. Making something is almost ALWAYS better than making nothing unless you are endangering something important in your life.
The Tools (Each Software Has Its Limits)
Most VR experiences are developed using game engines such as Unreal or Unity. Coming from a VFX background, I was shocked to learn that these programs are essentially free to use, often only requiring a small licensing fee if you make over $100,000 in annual revenue from use of the program (sounds like it won’t be a problem for me). Personally, I use Unity for 3D animated experiences, and will speak to that pipeline throughout this series.
There are a ton of Unity tutorials out there, but I like Brackeys because he sounds nice: https://youtu.be/IlKaB1etrik
As impressive as these engines are, you often have to make art assets in an external app. I love using Cinema 4D for creating 3D models, but really you can use almost anything that exports a mesh to an obj or fbx (Unity can import a staggering amount of file types). If you aren’t comfortable with 3D asset creation or simply don’t have the time, there’s a ton of great places to find models like the Unity Asset store, Turbosquid and tf3dm.com. Costs, aesthetics and usage right might vary per model, but depending on where you sit with the triangle of compromise, these cheap/free assets can be your fastest way to a product or protoype. Hell, you could steal crayons from Denny’s, draw assets on toilet paper, scan them in at the library and have 2D cut-outs placed in 3D space for characters if you wanted to. This is VR. There are no limits (#ThereAreActuallyLimits #StupidTriangleOfComprimise).
To me, VR is about interacting with a digitally generated space, so I decided that I want to focus on roomscale experiences with head and hand tracking. Rather than learn a traditional scripting language, I opted to pick up Playmaker from the Unity Asset store which is an incredibly powerful visual scripting tool based on functional state machines. Some ‘pros’ swear against using visual coding add-ons, but I find the solution fits my typical fast/good triangle considerations and $65 dollars is a steal for such a robust and fun system. Who would have thought that making games feels a lot like playing a really satisfying puzzle game? In future articles I will elaborate on how you can use Playmaker, but if you are eager to learn about the system in a game design context I highly recommend Mdot’s incredible tutorial series: “The Strange School.” Just don’t parent the VR playspace to the character motor script (or go for it, #nolimitsVR2017).
I actually wouldn’t have learned 3D modeling if it wasn’t for M dot Strange, and I definitely wouldn’t have got into Unity without him! He’s a great guy who really seeks to empower the artist in everyone (on top of being an engaging/hilarious teacher).
I develop for the HTC Vive, so I use the SteamVR package on the Unity Asset store combined with Frame Tale Studios SteamVR Playmaker Toolkit, which allows you to easily map controller inputs to your state machines. This will allow you to shoot cats out of your hands when you press the trigger. It might have other uses, but for now that’s all I can think of (#TheOnlyLimitIsImaginationAndRentMoney). Another amazing tool is the community project headed by TheStoneFox, VRTK, which is a collection of scripts and interaction systems made by developers for developers. VR is challenging enough: why try to reinvent the wheel when you can focus attention on to making that deep-sea dating simulator you’ve always dreamed of making?
The World Is Yours (Within Limits)
Obviously, there are as many tools as there are workflows and aims, but with a VR Headset and $100 USD you can get started developing VR RIGHT NOW (even cheaper if you learn C# code)! The experience of walking through the halls of your own digital creation is exhilarating, cathartic and mind blowing. Subjecting other people to the horrors of your digital Garfield and Saved by the Bell Crossover Museum: priceless. Follow along with this blog as we delve more into my ever-evolving workflow, and specific tools that help you git’er done. Just remember to design responsibly, because…