Tuesday, 1 February, 2022 UTC


Summary

Ad Content by Sony

Sony wows with the-future-is-now entertainment tech
Sony’s innovative technologies are fusing virtual reality and the “real world” — and leveling the playing field for young creatives.
by Mashable BrandX and Sony

The start of the new year makes for big tech announcements at CES 2022, and leading innovators can own the conversation by launching major tech initiatives. This year, Sony brought serious heat to 2022 with UNLOCK with Sony: CES 2022 Edition, comprised of two online sessions in early January. Day 1’s Visual Session and Day 2’s Sound Session each focused on virtual entertainment tech — and they both promised huge shifts in the way we create and experience entertainment. We’ve got the lowdown on everything you need to know about these exciting new technologies.
Day 1: The Visual Session
The first session focused on how Sony is leveraging virtual technologies to transform the visual side of the filmmaking process. Panelists included Youna, the technician for CodeMiko VTuber, Streamer, and Animator, and Jeff Cannata, a podcaster and actor. The two creators pretty much geeked out on how Sony is changing content as we know it and making it easier for new creatives to get on board.
Bye-bye, green screen
One hot topic worth mentioning was Sony’s virtual production technology. Essentially, it lets creators capture a real-world 3D space or location — like a dank ancient tomb, for example — and then project it onto LED screens where actors can interact with the space as if it were real.
“We basically don’t need sets anymore,” Youna said. “You can have one gigantic LED stage and you can be wherever you want to be.”
The fact that virtual sets give actors more to interact with was a huge highlight for Cannata. “I think back to when it was a couple of actors sitting in a big green space with ping-pong balls,“ he said. “This technology seems like a level up.”
More access means more diversity
Sony’s technologies might make production more accessible — you don’t have to shoot in Tokyo when you can LED screen it in — and, if that’s the case, Youna thinks it will really open the floodgates for younger and more diverse creators. “More indie developers will pop up,” she said, “and I think we’ll have a lot more niche content.”
Day 2: The Sound Session
After exploring virtual tech in the visual realm, the next UNLOCK with Sony session explored the topic as it applies to sound. Hanna Rad, On-Air Talent, DJ, and Content Producer, Ovilee May, G4 Host, Esports Personality, and Streamer, and Toft Willingham, Composer, Music Produce and 360 Reality Audio Specialist, were all hyped on Sony’s 360 Reality Audio technology. 
Lose your L and R earbuds
Traditionally, audio has been heard in left and right stereo, but Sony’s spatial sound tech moves sound all around you — behind you and in front, above you and swooshing past. The panelists unanimously agreed this is a huge game changer for both creators and consumers.
“As a DJ, I can make a mix that’s a 360-degree experience,” Rad said. “To be able to create in a new way like that, it’s paramount.”
Willingham explained how spatial sound has opened up the audio landscape for music producers, as well. “If I have a guitar with a lot of low frequencies, I usually want to carve those out so they don’t interfere with the bass,” he said. “But with this 360 technology, I can create that space by placing the guitar sounds behind you and around you.”
From a gaming perspective, May also jumped in. “If you can hear audio cues in 3D, like where the footsteps are coming from, it would be a huge advantage because then you know exactly where to look.”
Concert sound minus the crowds
The session also explored Sony’s 360 Virtual Mixing Environment (VME) tech, which is pretty mind-blowing. Basically, 360 VME replicates the acoustics of a specific location — like a professional mixing studio or a concert hall. By measuring how people’s ears respond to a space and by creating a ‘hearing standard,’ the tech allows a listener to put on a pair of headphones at home and hear a concert at the Sydney Opera House exactly how it would sound as if they were really there. It’s powerful stuff.
Rad was eager to use 360 VME both as a creator and as a consumer. “I want to be that person that doesn’t have to go to the theater,” she said. “I want to stream from home and have the theater’s same audio experience.”
Welcome to a new creative world
The UNLOCK with Sony: CES 2022 Edition sessions proved that entertainment is launching full-throttle into a world that embraces the promise of virtual reality. The host of both panels, Coy Jandreau, pretty much nailed it when he called everything we’ve been watching and listening to up until now, “prehistoric.” Bring on the future, Sony.
  • Written by
    Michelle Kehm
  • Photos and videos from
    Sony