The Beauty of Gaussian Splats
“The beauty of Gaussian Splats.” - NVIDIA Co-Founder and CEO, Jensen Huang.
Hi Everyone!
Contained in this month’s update:
Exciting updates to platforms and general industry news.
What companies are hiring for Radiance Fields, right now!
Code releases for you to try out!
Let’s get into it!
Industry Updates
March came and went with several updates and exciting demos shown off.
NVIDIA’s GTC was the epicenter, with CEO Jensen Huang showing off several splats and even naming them twice during his keynote!
“The beauty of Gaussian Splats.” - NVIDIA Co-Founder and CEO, Jensen Huang.
The NVIDIA team also had several demos, including some mind-blowing dynamic gaussian splatting VR demos, using QUEEN. The biggest impact of the week was the open sourcing of both 3D Gaussian Ray Tracing (3DGRT), in addition to 3D Gaussian Unscented Transform (3DGUT). Both have an Apache 2.0 license.
Sony’s AlphaUniverse published an article about Radiance Fields. HTC Viverse Worlds was announced with 3DGS support for interactive 3D. VR platform Resonite has integrated 3DGS. Chaos V-Ray 7 now offers 3DGS support for Revit.
Babylon.js released V8.0, along with several improvements to their Gaussian Splatting implementation. 3DGS in Houdini has gotten another upgrade with GSOPs 2.5.1. SuperSplat now supports video renderings, in addition to more traditional social media features. Kiri Engine released both an API, in addition to V3 of their free 3DGS Blender Plugin.
Niantic placed a big bet on Scaniverse and Niantic Spatial, selling several of their most well know IP, but kept Scaniverse. I profiled Applied Intuition’s NeuralSim, powered by Gaussian Splatting. Autonomous vehicles have quietly been massively benefiting from Radiance Field representations.
I have been notified of multiple extremely high profile usages of Gaussian Splatting dropping within the next two weeks! I am so excited to see them released and wish I could say more, but they are coming. I will also be beginning to create video content. Please consider subscribing to the Radiance Field YouTube channel!
Newsletter Sponsor
Odyssey is pioneering world models, the next frontier of artificial intelligence. By learning from the real-world, Odyssey is training a new kind of generative model, capable of generating cinematic, interactive worlds in real-time. Odyssey’s mission is to reinvent film, gaming, and beyond.
If you would like to sponsor upcoming Newsletters, please reach out to me!
Research
With CVPR announcements releasing in March, there were so many papers that came out!
NeuralGS: Bridging Neural Fields and 3D Gaussian Splatting for Compact 3D Representation
StochasticSplats: Stochastic Rasterization for Sorting-Free 3D Gaussian Splatting
Morpheus: Text-Driven 3D Gaussian Splat Shape and Color Stylization
X2-Gaussian: 4D Radiative Gaussian Splatting for Continuous-time Tomographic Reconstruction
AH-GS: Augmented 3D Gaussian Splatting for High-Frequency Detail Representation
Bézier Splatting for Fast and Differentiable Vector Graphics.
GauRast: Enhancing GPU Triangle Rasterizers to Accelerate 3D Gaussian Splatting
4DGC: Rate-Aware 4D Gaussian Compression for Efficient Streamable Free-Viewpoint Video
Hardware-Rasterized Ray-Based Gaussian Splatting
HoGS: Unified Near and Far Object Reconstruction via Homogeneous Gaussian Splatting
M3: 3D-Spatial MultiModal Memory
1000+ FPS 4D Gaussian Splatting for Dynamic Scene Rendering
Who’s Hiring:
The Job Board on Radiancefields.com is live. If you have an opening, get in touch!
We now offer placement services, for totally free! Upload your resume to this page!
Huawei is looking for a Principal Engineer - Neural Visual Computing.
Waymo is looking for a Machine Learning TLM, Sensor Simulation.
Meta’s Reality Labs is looking for a Software Engineer, Computer Vision - Hyperscape Dense Reconstruction.
Booz Allen Hamilton is looking for a Machine Learning and Computer Vision Expert.
Apple is looking for a Computer Vision Research Engineer - Apple Maps 3D Vision Team.
Code releases:
Efficient Perspective-Correct 3D Gaussian Splatting Using Hybrid Transparency
HoGS: Unified Near and Far Object Reconstruction via Homogeneous Gaussian Splatting
Triplane-Based Compression of 3D Gaussian Splatting
M3: 3D-Spatial Multimodal Memory
REdiSplats: Ray Tracing for Editable Gaussian Splatting
Website Updates:
Radiancefields.com has continued to release more functionalities, including an interactive list of Industry Software support for Gaussian Splatting and a Buyer’s Guide. There’s a couple more pages that will be coming, including a redesign of the home page that I am hopeful will be valuable to you and your team.
If you found value in today’s newsletter, please consider upgrading to a paid subscription. There is currently no better way to support me and it tremendously helps to continue to provide content and information.
That’s it for this one. Please feel free to reach out for anything and see you next time!
Michael Rubloff