Google’s ‘Project Starline’ uses AI to make remote meetings 3D

calico 05/30/2023

Simpler Trading Director of Options Danielle Shay takes a closer look at the impact of AI on technology on Making Money.

Google is looking to make video calls more realistic with its “Project Starline” telepresence system, which uses artificial intelligence (AI) to build a realistic 3D model of the person you’re talking to.

The tech giant has been working on Project Starline since 2021 and revealed its latest prototype this month, which trims down on the size of the system and simplifies the technology needed to make it work. Andrew Nartker, Google’s GM for Project Starline, explained in a blog post that it “works like a magic window where you can talk, gesture and make eye contact with another person, life-size and in three dimensions.”

“The system uses advanced AI to build a photorealistic model of the person you’re talking to, and projects that onto a light field display with a unique sense of volume and depth. The result is a lifelike image of the other person as if they were right in front of you,” Nartker added.

GOOGLE INTRODUCES NEW AI FEATURES, PIXEL FOLD SMARTPHONE

Google’s latest iteration of its Project Starline telepresence system uses standard cameras, a monitor the size of a flat-screen TV and AI to generate lifelike 3D video of meeting participants. (AP Photo/Jeff Chiu, File / AP Newsroom)

Earlier versions of the Project Starline telepresence technology were roughly the size of a small room or a booth at a restaurant and required hardware that might be harder for many businesses to acquire, such as special cameras and infrared light emitters that were used to create the live 3D model of a person on the call.

Google’s latest iteration of Project Starline requires only a few standard cameras to produce higher-quality 3D images and takes up about as much space as a flat-screen TV — making it much easier to deploy. The YouTube video from Google below showcases the new prototype:

GENERATIVE AI TOOLS LEAD TO RISING DEEPFAKE FRAUD

Google provided prototypes to several companies – including Salesforce, T-Mobile and WeWork — to get real-world data on how Project Starline can be used by distributed workforces with employees around the country and world.

“Trust and innovation are at the heart of Salesforce’s values,” said Andy White, SVP of business technology at Salesforce. “Project Starline has the potential to help create authentic and immersive connections that foster deeper relationships with both our employees and customers, enhance trust and transparency, and drive productivity and efficiency.”