Maggie Lane Contributor Share on Twitter Maggie Lane is a writer and producer of virtual reality experiences and covers the industry for various publications. More posts by this contributor Does Ready Player One reveal the future of VR? Last month at San Diego Comic Con, I fulfilled my childhood (and let’s be honest, current) dream of stepping inside a NickToon. In Nickelodeon Entertainment Lab’s Rise of the Teenage Mutant Ninja Turtles VR Interview Experienc e, I interacted with turtles Mikey and Donnie—voiced live by series talent, Brandon Mychal Smith and Josh Brener, respectively. I stood against a green screen, selected an avatar (I chose Arnold from Hey Arnold! ), put on an Oculus Rift headset, and was transported onto a New York City rooftop. I inhabited a 3D form, but as I looked ahead, I saw two 2D turtles. I interviewed the characters in real time, and their movements perfectly corresponded to their answers–there was no discernable lag. Given that AI isn’t able to match the conversational speed and nimbleness of real humans just yet, companies like Oculus are experimenting with using live actors in their VR experiences to approximate in-person interactions. However, this was the first time I’ve experienced a live melding of 3D and 2D worlds in VR. Behind the scenes, this “magic” was made possible by four computers, two puppeteers, two voice actors and a team of eight people running the various stations. (The crew were all wearing ninja bandanas, naturally). Adobe Character Animator , Epic Unreal Engine , and NewTeK NDI were all used to create the interview experience. The pièce de résistance was the bright purple keyboard that was piloted by two team members (one for each turtle). Each key featured a different animated pose, and so the actions of the turtles could be “animated” in real time, akin to playing a symbol piano. According to Chris Young, SVP of the Entertainment Lab, the impetus of the activation was that his team was looking for an innovative way to help socialize Nickelodeon’s Rise of the Teenage Mutant Ninja Turtles at SDCC and so they came up with the idea of a VR press junket.
Read the original:
Inside Nickelodeon’s Teenage Mutant Ninja Turtles VR Interview Experience