MTS (Product - Engineering - FDE) @SpAItial_AI

Joined November 2011
583 Photos and videos
If you're building with World models. Apply for our Creative/Startup program for a chance to get free credits, early access and direct team feedback.
Announcing the SpAItial Startup and Creative Partners Program for teams and creators building with world models. Accepted applicants get free credits, priority API access, early Echo model access, integration support, a direct feedback loop with the lab. We want real builders using Echo in real workflows so your feedback shapes what comes next. Application links in the comment 👇
3
341
RO2⚡️ reposted
High-quality 3D reconstruction is still hard. In particular, with 3DGS, getting full coverage without occlusions is often impractical: training views can look great, but you can barely move around. With Echo-2, we take a different path: reconstruction as conditional generation. By leveraging a strong generative prior, Echo-2 creates high-fidelity digital twins from sparse input views—constrained by what was captured, while completing appearance and geometry in a coherent 3D world. These are a few sample scenes, but the same approach scales to large environments from only a handful of images. API update incoming!
Sparse captures in, complete worlds out. Echo reconstructs scenes from a small set of views, using world modeling priors to fill what sparse 3DGS leaves behind. Coming soon to the SpAItial API.
5
27
247
21,627
RO2⚡️ reposted
Sparse captures in, complete worlds out. Echo reconstructs scenes from a small set of views, using world modeling priors to fill what sparse 3DGS leaves behind. Coming soon to the SpAItial API.
1
21
131
27,354
This is the easiest way to use the 3D world model from @SpAItial_AI. I asked Claude to recreate worlds from my childhood photos, and now I can explore them and walk around inside. The nostalgia is incredible 🤯 You can just ask for edits, generate collision meshes, and fully vibecode environment and games using Claude or any agent
New from SpAItial. You can now: - Create 3D world directly from the Claude desktop app using the new SpAItial AI plugin - Create worlds with your agents using the SpAItial MCP. Works for Claude Code, Codex, OpenCode, VS Code, Windsurf etc Create, edit, refine your worlds without leaving your chat! Links below 👇
2
16
1,463
RO2⚡️ reposted
Today, we enable AutoResearch in the physical world for the first time! Introducing ENPIRE: we give 8 Codex agents a fleet of robots, an allocation of GPUs, and generous token budget. We set them free with a simple goal: solve the task as quickly as possible, keep the robots busy but stay safe, don't waste precious compute. Make no mistake. Then humans step aside and our watch begins. The robot fleet starts to come alive: they learn to look for visual clues, reset the scene, practice novel skills, tinker with control stack, read papers online, debate, reflect, get stuck, and try again directly on the hardware. All we did is to give Codex an API to the world of atoms, and the rest is emergence. ENPIRE is able to solve high-precision tasks like tying zip-ties, organizing fine pins, and installing GPUs all by itself. We also discovered a new type of "physical scaling": 8 robots exploring in parallel improves significantly faster than fewer ones. A part of our NVIDIA GEAR lab now self-improves tirelessly over night. We just read the reports in the morning. /goal: we all take a holiday and Jensen wouldn't even notice ;) We will be open-sourcing everything, so you can host your self-running robot lab at home too! Deep dive in the thread:
187
570
3,845
653,079
Added some new scenes to show the bot using learned navigation skills. Navigation on Planet Mars Navigation on a skate park scene Works really well, and avoids new obstacles i throw at it. It also learned to jump! 🤯
A fun way to try the new Claude Fable. I asked it to train a bot using RL to navigate 3D worlds created with @SpAItial_AI. This is all running in the browser including RL training! Link to demo and code in comments What you can do: -> Train a bot from scratch, watch it learn in minutes, then drop it into a world it has never seen and it keeps navigating obstacles. -> The worlds are real scenes generated from a text prompt or a photo via the @SpAItial_AI API (you get a splat a collision mesh). -> Mesh is made into a 2D walkability height grid that the RL environment runs on. -> The trick to generalization: the policy only ever sees egocentric inputs. A 16-ray lidar, the goal's body frame, and its speed. No global coordinates, no map. So it learns navigation, not a memorized world.
4
20
2,390
A fun way to try the new Claude Fable. I asked it to train a bot using RL to navigate 3D worlds created with @SpAItial_AI. This is all running in the browser including RL training! Link to demo and code in comments What you can do: -> Train a bot from scratch, watch it learn in minutes, then drop it into a world it has never seen and it keeps navigating obstacles. -> The worlds are real scenes generated from a text prompt or a photo via the @SpAItial_AI API (you get a splat a collision mesh). -> Mesh is made into a 2D walkability height grid that the RL environment runs on. -> The trick to generalization: the policy only ever sees egocentric inputs. A 16-ray lidar, the goal's body frame, and its speed. No global coordinates, no map. So it learns navigation, not a memorized world.
3
24
101
12,450
Try it live in the browser (no setup): risenw.github.io/bot-in-worl… Repo link: github.com/risenW/bot-in-wor… Stack: World and collision mesh @SpAItial_AI PPO algorithm from: @puffer_ai Viewer: @playcanvas Physics: Rapier
6
346
RO2⚡️ reposted
Photoreal walls. Real geometry. Bots. WebRTC and all open source. Here's how built a fully multiplayer, browser-playable Quake III arena where every level is a 3D world created from a single Image using Echo-2 🧵👇
SplatArena: Multiplayer arena is LIVE 🚀🚀🚀 Quake3-style combat. Drop in, frag your friends, and play on a world generated by Echo-2. Play now, directly in your browser: arena.spaitial.io/
4
4
31
4,530
RO2⚡️ reposted
Having a few hours this afternoon after @CVPR? Consider visiting Red Rocks 20 minutes outside of Denver! For some inspiration, here's a world processed by @SpAItial_AI Echo-2 HQ model from a single phone image! Link to the world in🧵
2
6
109
11,340
RO2⚡️ reposted
❄️ New @playcanvas engine example: real-time Depth of Field on Gaussian Splats, powered by the engine's post-processing stack — with scene depth driven by a proxy mesh. Thanks to @SpAItial_AI for the Gaussian Splat mesh generation 🙏 Live link 👇
6
13
124
6,150
Fun weekend project: using @AIatMeta Sam3 to segment objects inside a @SpAItial_AI scene. Pipeline: -> Generate a world on @SpAItial_AI app and export as .ply -> @playcanvas viewer to render splat a uniform spatial grid over splat centers -> Capture frames camera pose, POST to a local SAM3 server -> Lift each 2D mask → 3D: frustum-cull splats via the grid, reproject with the pose -> Recolor / isolate the segmented Gaussians This is all running locally on my Mac. Static scene, segment once, reuse persisted mask. All open source (link in comment), you can clone and build on top of this 👇🏽
10
39
372
21,691
RO2⚡️ reposted
Excited for my workshop talks @CVPR in Denver! I'll cover recent works from our PhD students on generative AI and physically-grounded world models such as GenRecon, World Reconstructions, GaussianGPT, and many more. Bonus: some of our latest results from @SpAItial_AI :)
1
5
57
3,708
RO2⚡️ reposted
🚀 Major upgrades just landed in SuperSplat, the free and open source platform for 3D Gaussian splatting. Here is a 24-MILLION-Gaussian scan streaming live to a web browser. Near instant load time. Solid 60 fps. How? A new compute-based WebGPU renderer automatic LOD streaming. 🧵
22
115
766
49,228
RO2⚡️ reposted
I am in the back row of the CVPR AC workshop RIGHT NOW fragging noobs inside a radiance field, username is "Jon Barron", come at me, I dare you.
SplatArena: Multiplayer arena is LIVE 🚀🚀🚀 Quake3-style combat. Drop in, frag your friends, and play on a world generated by Echo-2. Play now, directly in your browser: arena.spaitial.io/
5
3
80
16,613
We turned 3D worlds created with Echo-2 into a multiplayer, Quake3, combat game. Imagine a world you generate from a single image becomes a full playable game map. 🔥 Play live now 👇🏽
SplatArena: Multiplayer arena is LIVE 🚀🚀🚀 Quake3-style combat. Drop in, frag your friends, and play on a world generated by Echo-2. Play now, directly in your browser: arena.spaitial.io/
6
508
RO2⚡️ reposted
Enter the Backrooms - in 15 minutes 🪄 Upload a movie still to @SpAItial_AI Echo-2 ⏬ Download a 3D Gaussian splat PLY file 🥽 Upload to @PlayCanvas SuperSplat and enter VR [1 / 3]
5
16
133
9,116
RO2⚡️ reposted
Releasing Echo-2 HQ, an improved model that delivers greater detail and sharper results. You can zoom in super close and discover remarkable appearance fidelity. Available via API and in the app. Try it out! Check out some of the scenes below👇
4
26
97
14,663