building autonomous robots | @spacex | prev @aws @amazon

Joined October 2022
88 Photos and videos
Pinned Post
what if we treated robot actions like audio waveforms? introducing neural action codec (NAC) a method for creating a compressed action vocabulary to train VLA policies
16
28
368
41,301
wild, elon liked the post
i joined @SpaceX ! we need self replicating autonomous robots to make us a multi-planetary civilization
9
64
6,721
i joined @SpaceX ! we need self replicating autonomous robots to make us a multi-planetary civilization
we will need robots building robots if we are going to have a space civilization. this is true even with agi or asi
80
41
1,472
117,469
introducing hierarchical implicit q-chunking (HIQC) long-horizon offline reinforcement learning is hard the more steps an agent takes, the more value estimation errors compound i reduce this by decomposing the horizon into smaller segments with subgoals and action chunks
3
11
95
6,696
this simple idea leads to an increase of nearly 10% average compared on 9 long horizon simulation task
2
1
8
1,038
1
4
868
i found by simply using a high level policy predicting latent subgoal and a low level policy prediciting action chunks you can reduce the number of bootstrapped value estimates to O((T/k)^(1/2))
2
1
8
929
2
551
ahad reposted
Check out Ahad's work on leveraging neural audio codec architectures for VLA action tokenization. An interesting direction that adapts ideas from audio compression to represent continuous robot actions.👇
what if we treated robot actions like audio waveforms? introducing neural action codec (NAC) a method for creating a compressed action vocabulary to train VLA policies
2
54
9,638
what if we treated robot actions like audio waveforms? introducing neural action codec (NAC) a method for creating a compressed action vocabulary to train VLA policies
16
28
368
41,301
here is a policy comparison to a few other methods
1
1
18
1,612
the first replication!
The speed from idea > physical thing has never been so fast. Two things Asher (uni student) has been helping us out on: > CAD modelling to 3D prints for mock setup of potential customers task e.g. this tea light wax candle mould built in the kitchen of our campsite. > Swappable heads prototype on our SO-101 arm. #robotics #physicalAI #robot #CAD
3
630
introducing lattice a low-cost robot arm with a modular, detachable gripper so the robot can swap its own tools the adapter is $14 if you already have an so101 arm, and about $140 to build the full system from scratch it’s now fully open source
40
43
528
39,901
also want to acknowledge @jeluna20 as a core contributor on this project, and the open source repos it’s built on: @lerobothf @uma_robots @vectorwang2
1
11
974