The SIGGRAPH 2024 conference set the stage for an impressive array of technological advancements, highlighting the future of digital interaction, creativity, and artificial intelligence. The hot topic was generative AI and its potential to advance our future. NVIDIA had a significant presence at the conference this year, here’s a look at cutting-edge technologies on display at the Exhibition Hall and out of the NVIDIA Inception Innovation Zone at this year’s event
Moverse AI presented the company’s innovations in quality, portable motion capture and digital performances for 3D virtual characters. The cost-effective SaaS technology enhances the accuracy and fluidity of actor to character animations. Moverse solutions offer a more realistic portrayal of movement for many use-cases. On show was Moverse Capture, their real-time AI markerless motion capture solution, no suits required, quick and easy 6–8 camera set-up compatible with off-the-shelf cameras, calibration all in a few clicks, capturing at 60FPS, live-stream directly into Unreal Engine and Unity. Coupled with Moverse Portal, a cloud-based asset management and proprietary AI based reprocessing system which produces clean and stable motion data and export as GLB and FBX file formats. It even runs from a gaming laptop!
Additionally, the company chose SIGGRAPH to launch Moverse Motifs, a generative AI powered 3D animation library of high quality ready-to-use motions for creators. Users can choose an IP cleared Motif, generate unique variations and export animations to accelerate projects of all kinds.
Getty Images unveiled Generative AI, the firm’s ideation and content creation tool powered by NVIDIA, which utilizes artificial intelligence to generate and curate high-quality imagery and video content through a users’ prompts and editing capabilities. Rest assured, it’s commercially safe as the system is trained exclusively on permissioned data from the company’s extensive library. New creations belong to the creator and not added to the creative library for public use. This tool is designed to meet the growing demand for unique, customized digital assets, unleash creativity, and streamline content creation for media professionals.
DI4D‘s CEO Colin Urquhart detailed the groundbreaking technology behind their latest projects, including the Call of Duty: Modern Warfare series, the PURE4D 2.0 pipeline, and the new CG short, DOUBLE, featuring Neil Newbon. PURE4D 2.0 enhances Neil Newbon’s digital double by integrating facial performance data from a head-mounted camera with high-resolution data from a 4D capture system, achieving unprecedented scale and quality in animation.
The PURE4D pipeline has already been instrumental in delivering hours of realistic facial animation for major franchises like Call of Duty: Modern Warfare 2 & 3 and F1® 21 & 23. DI4D recently announced their collaboration with Clear Angle Studios and TexturingXYZ to deliver their vision for a new standard of performance-driven digital human faces for SIGGRAPH, Denver.
Adobe Substance 3D and HP Z Captis is pioneering digital material capture and sampling. The integration of Adobe Substance 3D Sampler with HP’s Z Captis product and HP Capture Management SDK takes creative freedom to new heights. By effortlessly digitizing real-world textures, users can export data and seamlessly incorporate them into 3D workflows, enhancing iterative design and enabling real-time collaboration. This technology harnesses a polarized and photometric computer vision system, powered by an NVIDIA® Jetson AGX Xavier module, to capture materials in stunning 8K resolution. This synergy bridges the gap between concept and execution, allowing for more innovative and accurate designs.
The HTC VIVERSE XR platform captured significant attention with its interactive 3D experiences technology, Polygon Streaming, which promises to enhance the realism and fluidity of virtual environments. This innovation enables real-time streaming of complex 3D polygons, offering a more immersive and responsive VR experience.
At the NVIDIA Inception Innovation Zone, VIVERSE also featured its advanced avatars, powered by NVIDIA’s ACE (Avatar Cloud Engine) and Audio2Face for immersive real-time interactions in XR coupled with their XR Elite headset. These tools facilitate the creation of highly interactive and expressive avatars, capable of realistic lip-syncing and facial animations, thereby elevating user engagement in virtual spaces.
“Unlocking the potential for more dynamic interactions has been a key pursuit in XR,” said Seth Schneider, Director of Digital Human Product Management at NVIDIA. “The integration of the NVIDIA Audio2Face NIM with VIVERSE Avatar enables dynamic lip-syncing, enhancing your conversational experiences.”
UneeQ, digital humans and ‘The Face of Enterprise AI’ of Auckland, New Zealand with operations in Austin, Texas introduced its next-generation digital human technology Synanim™, with NVIDIA Audio2Face, an NVIDIA ACE NIM microservice to enable dynamic facial animation and lip sync. The technology leverages GenAI and LLM (Large Language Model) to create interactive avatars capable of meaningful humanistic interactions during real-time conversations with real humans. UneeQ’s solutions aim to redefine customer service and virtual communication by providing highly personalized and responsive digital personalities.
Looking Glass impressed with its 3D display technology, which delivers a true holographic experience without the need for special glasses. On show was Looking Glass 16″ and 32″ Spatial Display. Their tech offers a unique way to visualize and interact with three-dimensional content, opening up new possibilities for various fields, including entertainment and education. The company is leveraging NVIDIA RTX 6000 Ada Generation GPUs and NVIDIA Maxine technology to improve real-time audio, video, and augmented reality experiences.
Shout-out Tech
Magnifi AI-powered video solutions demonstrated its advanced content creation platform, which utilizes artificial intelligence to instantly generate key moments and highlights from live or recorded feeds for a streamlined approach in the production of high-quality visuals and animations. Magnifi AI’s technology simplifies the creative process, making it more accessible for creators to produce compelling video content for the enjoyment of viewers across platforms. Magnifi facilitates Sports, ESports, News Broadcasters and Entertainment customers.
Abstract Polyverse showcased its new suite of creative tools designed for the exploration and manipulation of 3D digital environments. Their technology allows artists to experiment with complex designs and visual effects, pushing the boundaries of digital artistry and creativity.
As SIGGRAPH continues to showcase these groundbreaking technologies, it is clear that the future of digital interaction, creativity, and AI is brimming with potential. The conference highlights how these innovations are poised to transform various industries and redefine our digital experiences.
Return to TrailblaXR Magazine
Discover more from Instinctively Real Media | Global Creative Agency
Subscribe to get the latest posts sent to your email.
