@PokeRobotics. Final year PhD @Tsinghua University, IIIS.

Joined July 2021
22 Photos and videos
Pinned Post
๐ŸŒถ๏ธ๐Ÿค–๐–๐ž ๐œ๐จ๐จ๐ค๐ž๐ ๐ญ๐ก๐ž ๐ซ๐จ๐›๐จ๐ญ๐ข๐œ๐ฌ ๐ฐ๐จ๐ซ๐ฅ๐โ€™๐ฌ ๐Ÿ๐ข๐ซ๐ฌ๐ญ ๐ฉ๐ฅ๐š๐ญ๐ž ๐จ๐Ÿ ๐Œ๐š๐ฉ๐จ ๐“๐จ๐Ÿ๐ฎ.๐Ÿค–๐ŸŒถ๏ธ This was not just a cooking demo. It was a 30-minute, long-horizon robotics challenge packed with delicate, continuous, high-dexterity actions. With only a small number of demonstrations, our model learned to perform complex manipulation over an extended sequence. At the same time, we pushed hard on motion control and system-level optimization, making the robot move smoothly while keeping the high success rate. For us, this plate of Mapo Tofu is more than a dish. It is a small but meaningful step toward home robots that can handle real everyday tasks with the dexterity, consistency, and reliability people expect.
15
25
135
23,727
Zhecheng Yuan reposted
We should stop optimizing robot policies against a single overall reward. Trajectories differ along many axes, such as speed, precision, and subtask completion, and one can be better on some while worse on others. If we collapse all of that into a single overall axis we lose this structure making the reward ambiguous and harder to optimize. Blog: freeform-pl.github.io/fpl.weโ€ฆ Paper: arxiv.org/abs/2606.32027
10
31
152
30,842
Zhecheng Yuan reposted
Interaction with the real world is the major bottleneck in robot learning. So what would robot RL look like if we didnโ€™t need to limit compute per interaction? Our latest work, Off-Policy Generative Policy Optimization (OGPO, accepted to ICML26) embarks on answering this question (spoiler alert: when done correctly, it helps massively!). ๐Ÿงต(1/N)
13
64
335
84,754
Zhecheng Yuan reposted
Impressive long-horizon robustness!
๐ŸŒถ๏ธ๐Ÿค–๐–๐ž ๐œ๐จ๐จ๐ค๐ž๐ ๐ญ๐ก๐ž ๐ซ๐จ๐›๐จ๐ญ๐ข๐œ๐ฌ ๐ฐ๐จ๐ซ๐ฅ๐โ€™๐ฌ ๐Ÿ๐ข๐ซ๐ฌ๐ญ ๐ฉ๐ฅ๐š๐ญ๐ž ๐จ๐Ÿ ๐Œ๐š๐ฉ๐จ ๐“๐จ๐Ÿ๐ฎ.๐Ÿค–๐ŸŒถ๏ธ This was not just a cooking demo. It was a 30-minute, long-horizon robotics challenge packed with delicate, continuous, high-dexterity actions. With only a small number of demonstrations, our model learned to perform complex manipulation over an extended sequence. At the same time, we pushed hard on motion control and system-level optimization, making the robot move smoothly while keeping the high success rate. For us, this plate of Mapo Tofu is more than a dish. It is a small but meaningful step toward home robots that can handle real everyday tasks with the dexterity, consistency, and reliability people expect.
1
1
352
Zhecheng Yuan reposted
This is incredible! This isn't a 24-hr stream doing essentially the same tasks over and over. This is a 30-min continuous sequence of various subtasks; any of them failing along the way we won't be getting no Mapo Tofu! Great stuff from @fancy_yzc & the PokeBot team.
๐ŸŒถ๏ธ๐Ÿค–๐–๐ž ๐œ๐จ๐จ๐ค๐ž๐ ๐ญ๐ก๐ž ๐ซ๐จ๐›๐จ๐ญ๐ข๐œ๐ฌ ๐ฐ๐จ๐ซ๐ฅ๐โ€™๐ฌ ๐Ÿ๐ข๐ซ๐ฌ๐ญ ๐ฉ๐ฅ๐š๐ญ๐ž ๐จ๐Ÿ ๐Œ๐š๐ฉ๐จ ๐“๐จ๐Ÿ๐ฎ.๐Ÿค–๐ŸŒถ๏ธ This was not just a cooking demo. It was a 30-minute, long-horizon robotics challenge packed with delicate, continuous, high-dexterity actions. With only a small number of demonstrations, our model learned to perform complex manipulation over an extended sequence. At the same time, we pushed hard on motion control and system-level optimization, making the robot move smoothly while keeping the high success rate. For us, this plate of Mapo Tofu is more than a dish. It is a small but meaningful step toward home robots that can handle real everyday tasks with the dexterity, consistency, and reliability people expect.
1
3
12
1,832
Zhecheng Yuan reposted
When will I be invited to see such a long-horizon demo? Itโ€™s awesome.๐Ÿ‘
๐ŸŒถ๏ธ๐Ÿค–๐–๐ž ๐œ๐จ๐จ๐ค๐ž๐ ๐ญ๐ก๐ž ๐ซ๐จ๐›๐จ๐ญ๐ข๐œ๐ฌ ๐ฐ๐จ๐ซ๐ฅ๐โ€™๐ฌ ๐Ÿ๐ข๐ซ๐ฌ๐ญ ๐ฉ๐ฅ๐š๐ญ๐ž ๐จ๐Ÿ ๐Œ๐š๐ฉ๐จ ๐“๐จ๐Ÿ๐ฎ.๐Ÿค–๐ŸŒถ๏ธ This was not just a cooking demo. It was a 30-minute, long-horizon robotics challenge packed with delicate, continuous, high-dexterity actions. With only a small number of demonstrations, our model learned to perform complex manipulation over an extended sequence. At the same time, we pushed hard on motion control and system-level optimization, making the robot move smoothly while keeping the high success rate. For us, this plate of Mapo Tofu is more than a dish. It is a small but meaningful step toward home robots that can handle real everyday tasks with the dexterity, consistency, and reliability people expect.
1
1
13
2,293
Zhecheng Yuan reposted
Doesnโ€™t seem that crazy anymore to have a robot chef. Impressive long horizon work!
๐ŸŒถ๏ธ๐Ÿค–๐–๐ž ๐œ๐จ๐จ๐ค๐ž๐ ๐ญ๐ก๐ž ๐ซ๐จ๐›๐จ๐ญ๐ข๐œ๐ฌ ๐ฐ๐จ๐ซ๐ฅ๐โ€™๐ฌ ๐Ÿ๐ข๐ซ๐ฌ๐ญ ๐ฉ๐ฅ๐š๐ญ๐ž ๐จ๐Ÿ ๐Œ๐š๐ฉ๐จ ๐“๐จ๐Ÿ๐ฎ.๐Ÿค–๐ŸŒถ๏ธ This was not just a cooking demo. It was a 30-minute, long-horizon robotics challenge packed with delicate, continuous, high-dexterity actions. With only a small number of demonstrations, our model learned to perform complex manipulation over an extended sequence. At the same time, we pushed hard on motion control and system-level optimization, making the robot move smoothly while keeping the high success rate. For us, this plate of Mapo Tofu is more than a dish. It is a small but meaningful step toward home robots that can handle real everyday tasks with the dexterity, consistency, and reliability people expect.
1
2
440
Zhecheng Yuan reposted
more long horizon task and more robust manipulation systems!!'
๐ŸŒถ๏ธ๐Ÿค–๐–๐ž ๐œ๐จ๐จ๐ค๐ž๐ ๐ญ๐ก๐ž ๐ซ๐จ๐›๐จ๐ญ๐ข๐œ๐ฌ ๐ฐ๐จ๐ซ๐ฅ๐โ€™๐ฌ ๐Ÿ๐ข๐ซ๐ฌ๐ญ ๐ฉ๐ฅ๐š๐ญ๐ž ๐จ๐Ÿ ๐Œ๐š๐ฉ๐จ ๐“๐จ๐Ÿ๐ฎ.๐Ÿค–๐ŸŒถ๏ธ This was not just a cooking demo. It was a 30-minute, long-horizon robotics challenge packed with delicate, continuous, high-dexterity actions. With only a small number of demonstrations, our model learned to perform complex manipulation over an extended sequence. At the same time, we pushed hard on motion control and system-level optimization, making the robot move smoothly while keeping the high success rate. For us, this plate of Mapo Tofu is more than a dish. It is a small but meaningful step toward home robots that can handle real everyday tasks with the dexterity, consistency, and reliability people expect.
1
2
20
2,907
Zhecheng Yuan reposted
Long horizon specialist models on the edge is what a lot of robots applications need
๐ŸŒถ๏ธ๐Ÿค–๐–๐ž ๐œ๐จ๐จ๐ค๐ž๐ ๐ญ๐ก๐ž ๐ซ๐จ๐›๐จ๐ญ๐ข๐œ๐ฌ ๐ฐ๐จ๐ซ๐ฅ๐โ€™๐ฌ ๐Ÿ๐ข๐ซ๐ฌ๐ญ ๐ฉ๐ฅ๐š๐ญ๐ž ๐จ๐Ÿ ๐Œ๐š๐ฉ๐จ ๐“๐จ๐Ÿ๐ฎ.๐Ÿค–๐ŸŒถ๏ธ This was not just a cooking demo. It was a 30-minute, long-horizon robotics challenge packed with delicate, continuous, high-dexterity actions. With only a small number of demonstrations, our model learned to perform complex manipulation over an extended sequence. At the same time, we pushed hard on motion control and system-level optimization, making the robot move smoothly while keeping the high success rate. For us, this plate of Mapo Tofu is more than a dish. It is a small but meaningful step toward home robots that can handle real everyday tasks with the dexterity, consistency, and reliability people expect.
1
316
Zhecheng Yuan reposted
Impressive workโ€”stable real-world long-horizon execution. Excited to see home robots moving forward! Congrats @fancy_yzc
๐ŸŒถ๏ธ๐Ÿค–๐–๐ž ๐œ๐จ๐จ๐ค๐ž๐ ๐ญ๐ก๐ž ๐ซ๐จ๐›๐จ๐ญ๐ข๐œ๐ฌ ๐ฐ๐จ๐ซ๐ฅ๐โ€™๐ฌ ๐Ÿ๐ข๐ซ๐ฌ๐ญ ๐ฉ๐ฅ๐š๐ญ๐ž ๐จ๐Ÿ ๐Œ๐š๐ฉ๐จ ๐“๐จ๐Ÿ๐ฎ.๐Ÿค–๐ŸŒถ๏ธ This was not just a cooking demo. It was a 30-minute, long-horizon robotics challenge packed with delicate, continuous, high-dexterity actions. With only a small number of demonstrations, our model learned to perform complex manipulation over an extended sequence. At the same time, we pushed hard on motion control and system-level optimization, making the robot move smoothly while keeping the high success rate. For us, this plate of Mapo Tofu is more than a dish. It is a small but meaningful step toward home robots that can handle real everyday tasks with the dexterity, consistency, and reliability people expect.
1
1
327
Zhecheng Yuan reposted
Long horizon multi step task: cooking mapo tofu. It definitely feels like affordable, capable home robots are on the way
๐ŸŒถ๏ธ๐Ÿค–๐–๐ž ๐œ๐จ๐จ๐ค๐ž๐ ๐ญ๐ก๐ž ๐ซ๐จ๐›๐จ๐ญ๐ข๐œ๐ฌ ๐ฐ๐จ๐ซ๐ฅ๐โ€™๐ฌ ๐Ÿ๐ข๐ซ๐ฌ๐ญ ๐ฉ๐ฅ๐š๐ญ๐ž ๐จ๐Ÿ ๐Œ๐š๐ฉ๐จ ๐“๐จ๐Ÿ๐ฎ.๐Ÿค–๐ŸŒถ๏ธ This was not just a cooking demo. It was a 30-minute, long-horizon robotics challenge packed with delicate, continuous, high-dexterity actions. With only a small number of demonstrations, our model learned to perform complex manipulation over an extended sequence. At the same time, we pushed hard on motion control and system-level optimization, making the robot move smoothly while keeping the high success rate. For us, this plate of Mapo Tofu is more than a dish. It is a small but meaningful step toward home robots that can handle real everyday tasks with the dexterity, consistency, and reliability people expect.
1
3
32
5,488
Zhecheng Yuan reposted
This is such a nice surprise. If robots can help me get mapo tofu, Iโ€™m officially sold ๐Ÿค–๐ŸŒถ๏ธ
๐ŸŒถ๏ธ๐Ÿค–๐–๐ž ๐œ๐จ๐จ๐ค๐ž๐ ๐ญ๐ก๐ž ๐ซ๐จ๐›๐จ๐ญ๐ข๐œ๐ฌ ๐ฐ๐จ๐ซ๐ฅ๐โ€™๐ฌ ๐Ÿ๐ข๐ซ๐ฌ๐ญ ๐ฉ๐ฅ๐š๐ญ๐ž ๐จ๐Ÿ ๐Œ๐š๐ฉ๐จ ๐“๐จ๐Ÿ๐ฎ.๐Ÿค–๐ŸŒถ๏ธ This was not just a cooking demo. It was a 30-minute, long-horizon robotics challenge packed with delicate, continuous, high-dexterity actions. With only a small number of demonstrations, our model learned to perform complex manipulation over an extended sequence. At the same time, we pushed hard on motion control and system-level optimization, making the robot move smoothly while keeping the high success rate. For us, this plate of Mapo Tofu is more than a dish. It is a small but meaningful step toward home robots that can handle real everyday tasks with the dexterity, consistency, and reliability people expect.
1
2
350
At the same time, we made many optimizations across motion control and the full robotic system, enabling smooth motion while maintaining a high success rate.
87
Zhecheng Yuan reposted
Video world model imaginations๐ŸŒŽ๐Ÿ’ญcan miss critical but plausible outcomes of robot actions. Introducing ๐™Ž๐™ฉ๐™ง๐™š๐™จ๐™จ๐˜ฟ๐™ง๐™š๐™–๐™ข: inference-time steering for video WMs, imagining plausibleโœ…, high-impactโš ๏ธ futures for ๐™ง๐™ค๐™—๐™ช๐™จ๐™ฉ๐Ÿ›ก๏ธ policy evaluation and improvement. (1/15)
3
32
186
31,042
Zhecheng Yuan reposted
If the end goal of robot hands is to perform human motion, then we should optimize the hardware design with human motion - and on a large scale! We can generate both a high-dof generalist hand, and also low-dof specialized hands from human demonstration.
8
39
230
32,844
Zhecheng Yuan reposted
this took so long for me to understand: the bottleneck to more innovation is not more high intelligence people, but more people having an interest in hard problems it's impossible to create new useful things if you don't get immense happiness from making that thing
111
234
3,112
404,376
Zhecheng Yuan reposted
Children learn from play. Can robots do the same? We propose ๐๐ฅ๐š๐ฒ๐Ÿ๐ฎ๐ฅ ๐€๐ ๐ž๐ง๐ญ๐ข๐œ ๐‘๐จ๐›๐จ๐ญ ๐‹๐ž๐š๐ซ๐ง๐ข๐ง๐ , a paradigm that gives embodied coding agents a play stage before downstream tasks arrive, and instantiate it with ๐‘๐€๐“๐ฌ (Robotics Agent Teams), where robots discover reusable skills through curious play. Co-led with @jiaxin_ge_
9
63
341
88,076
Zhecheng Yuan reposted
Keeping human at the center is what allows us to cut through the noise. Unlike many previous works, UME is designed for humans โ€” not the robot. Over the past few days, Iโ€™ve received a lot of great feedback on our hardware design. Truly appreciate all of it! I wanted to clarify a core philosophy behind our choices: Our hardware design is human-centered, the only goal is to maximize human comfort and recover the full range of motion of the human arm. Why? Because data quality and efficiency matters. When a user struggles to hold an awkward end-effector or faces joint limits, his time is wasted for nothing, and the data goes into trash. This is exactly the reason we committed to our hardware software combination of Coaxial Configuration and Universal Retargeting. Inspired by @StanfordHAI @Stanford
Introducing Universal Manipulation Exoskeleton (UME) A low-cost exoskeleton with real-time haptic torque feedback for learning autonomous policies that perform highly force-mediated, tightly space-constrained, visually occluded, whole-body, and long-horizon mobile manipulation tasks. Using UME, the teleoperator can unsheathe a heavy metal sword completely blindfolded. ume-exo.github.io/ ๐Ÿงต1/N
8
27
190
122,442
Zhecheng Yuan reposted
่ฝฌ่‡ชๅฐ็บขไนฆ๏ผš็”จ AI ่ฏป่ฎบๆ–‡ไธคๅนดๅŠ๏ผŒๆˆ‘่ฎคไธบๆœ€ๅฅฝ็”จ็š„ prompt xhslink.com/o/6XFS2HHAQVZ Github ไธญ่‹ฑๆ–‡ Skill & Instruction ็‰ˆ: github.com/FeijiangHan/Paperโ€ฆ TLDR๏ผšๆ€ป็ป“่ฎบๆ–‡ไธ่ƒฝ่ขซๅŠจๅธๆ”ถ๏ผŒ่ฆไธปๅŠจๆ€่€ƒไฝœ่€…ไปŽ 0 ่Žทๅพ— idea ็š„้€ป่พ‘๏ผŒไปฅๅŠๆ€่€ƒๅฆ‚ไฝ•โ€œๆ”ปๅ‡ปโ€่ฟ™็ฏ‡่ฎบๆ–‡ใ€‚ 1. ่ฎบๆ–‡ๆๅ‡บๅนถ่งฃๅ†ณ็š„็ ”็ฉถ้—ฎ้ข˜ๆ˜ฏไป€ไนˆ๏ผˆ่ฐƒ็ ”ๅ’Œ่กฅๅ……่ƒŒๆ™ฏ๏ผ‰๏ผŸไธบไป€ไนˆ่ฟ™ไธช้—ฎ้ข˜ๆ˜ฏ้‡่ฆ็š„๏ผŸ่งฃๅ†ณ่ฟ™ไธช้—ฎ้ข˜่ƒฝๅธฆๆฅๅ“ชไบ›ไปทๅ€ผ๏ผŸ 2. ่ฟ™ไธช้—ฎ้ข˜ไน‹ๅ‰่ขซ่งฃๅ†ณไบ†ๅ—๏ผŸไน‹ๅ‰็š„็ ”็ฉถไธบไป€ไนˆๅญ˜ๅœจไธ่ถณ๏ผŸ 3. ใ€้‡่ฆใ€‘ๅœจๆญฃๅผ่ฎฒๆ–นๆณ•ไน‹ๅ‰๏ผŒๅ…ˆ้‡ๅปบไฝœ่€…ๅฏ่ƒฝ็š„ๆ€่€ƒ่ทฏๅพ„ใ€‚ไธ่ฆไฝฟ็”จ่ฎบๆ–‡่‡ชๅทฑ็š„่ดก็Œฎไฝœไธบๅ‰ๆ๏ผŒๅชไฝฟ็”จไน‹ๅ‰ๅทฒๆœ‰็š„่ƒŒๆ™ฏใ€ๅคฑ่ดฅๆจกๅผใ€็ป้ชŒ่ง‚ๅฏŸๅ’Œ็›ธๅ…ณๅทฅไฝœใ€‚ๆ€่€ƒๅ’Œๆจกๆ‹Ÿไฝœ่€…ๆœฌไบบ็š„ๆ€่ทฏๅ’Œๅ—ๅˆฐ็š„ inspiration ไปฅๅŠ intuition๏ผŒๅผ•ๅฏผๆˆ‘็†่งฃไธบไป€ไนˆไฝœ่€…ๅฏไปฅๅŸบไบŽๅทฒๆœ‰็Ÿฅ่ฏ†ๆƒณๅˆฐ่ฟ™็ฏ‡่ฎบๆ–‡็š„ idea 4. ่ฟ™็ฏ‡่ฎบๆ–‡ๆๅ‡บๆ–นๆณ•็š„ Intuition ๆ˜ฏไป€ไนˆ๏ผŸๆ˜“ๆ‡‚ๆธ…ๆ™ฐ concise ็š„ๅ‘Š่ฏ‰ๆˆ‘่ฟ™็ฏ‡่ฎบๆ–‡ๆ ธๅฟƒ idea ็š„ๆœฌ่ดจ 5. ่ฟ™็ฏ‡่ฎบๆ–‡็š„ๅ…ทไฝ“ๆ–นๆณ•ๆ˜ฏไป€ไนˆ๏ผŸ็ป“ๅˆไธ€ไธช็œŸๅฎž็š„ไพ‹ๅญ่ฎฒ่งฃ๏ผš่พ“ๅ…ฅใ€ๅค„็†ใ€่พ“ๅ‡บๅฎŒๆ•ด็š„ pipeline 6. ่ฟ™็ฏ‡่ฎบๆ–‡็š„ๆ ธๅฟƒๆ•ฐๅญฆๆŽจๅฏผ่ฟ‡็จ‹ๆ˜ฏไป€ไนˆ๏ผˆ่ฎฉ 0 ๅŸบ็ก€็š„ๆˆ‘ไปŽ็†่ฎบ่ง†่ง’็†่งฃๆ–นๆณ•๏ผ‰๏ผŸๅฆ‚ๆžœๆœ‰๏ผŒ่ฏท็ป™ๆˆ‘่กฅๅ……็†่ฎบ่ƒŒๆ™ฏ๏ผˆๆˆ‘็š„ๆ•ฐๅญฆๆฏ”่พƒๅทฎ๏ผ‰๏ผŒๅ‘Š่ฏ‰ๆˆ‘็†่ฎบ็š„ๅŸบ็ก€ๅ’Œ intuition๏ผ›ๅฆ‚ๆžœๆฒกๆœ‰๏ผŒๅฏไปฅ่ฏดๆ˜Žๅนถ่ทณ่ฟ‡่ฟ™ไธ€็‚น 7. ่ฟ™็ฏ‡่ฎบๆ–‡ๆ˜ฏๅฆ‚ไฝ•่ฎพ่ฎกๅฎž้ชŒๆฅ้ชŒ่ฏๆๅ‡บ็š„ๆ–นๆณ•ๅ’Œ claim ็š„๏ผŸๆŒ‰็…งไธ‹้ขๆ ผๅผๆ€ป็ป“๏ผšๆๅ‡บไบ†ไป€ไนˆ้—ฎ้ข˜->่ฎพ่ฎกไบ†ไป€ไนˆๅฎž้ชŒ้ชŒ่ฏ่ฟ™ไธช้—ฎ้ข˜->้—ฎ้ข˜็š„็ญ”ๆกˆๆ˜ฏไป€ไนˆใ€‚ไธ้œ€่ฆๅพˆๅคšๆ•ฐๆฎ็ป†่Š‚๏ผŒๅช้œ€่ฆๆ ธๅฟƒๆ€่ทฏ 8. ๆ€ป็ป“่ฟ™็ฏ‡่ฎบๆ–‡็š„ take-aways 9. ใ€้‡่ฆใ€‘่ฟ™็ฏ‡่ฎบๆ–‡ๆœ€่„†ๅผฑ็š„ๅ‡่ฎพๆ˜ฏไป€ไนˆ๏ผŸ 10. ๅฆ‚ๆžœๆˆ‘ๆœ‰ 1 ๅ‘จๆ—ถ้—ด๏ผŒ่ƒฝๅšไธ€ไธชๆœ€ๅฐๅค็Žฐๅฎž้ชŒ้ชŒ่ฏๅฎƒ็š„ๅ“ชไธ€็‚น๏ผŸ 11. ใ€้‡่ฆใ€‘ๅฆ‚ๆžœๆˆ‘ๅๅฏนๅฎƒ๏ผŒๆˆ‘ไผšๆ€Žไนˆ่ฎพ่ฎกๅไพ‹๏ผŸ 12. ่ฐƒ็ ”ใ€ๆ€่€ƒใ€ๅŸบไบŽไฝ ็š„ไฟกๆฏๆๅ‡บไธ€ไธช follow up ็š„ idea๏ผŒ่ฆ novel๏ผŒไธๆ˜ฏๅขž้‡็ ”็ฉถ๏ผŒๆ˜ฏไปŽๆ–นๆณ•็ผบ้™ท Limitationๅ’Œ้œ€ๆฑ‚ๅ‡บๅ‘ๆ€่€ƒๅฏ่ƒฝ็š„ๆ–ฐ็š„ๆœ‰ไปทๅ€ผ็š„็ ”็ฉถ ๆˆ‘่ฎคไธบ 3 ๆ˜ฏๆœ€้‡่ฆ็š„๏ผŒไฝ†ๅˆ่ขซๅพˆๅคšไบบๅฟฝ็•ฅใ€‚ ๆˆ‘็”จ AI ๆ€ป็ป“่ฎบๆ–‡ๆ”ถ่Žทๆœ€ๅคง็š„ๅพ€ๅพ€ไธๆ˜ฏ่ฎบๆ–‡ๆ–นๆณ•ๆœฌ่บซ๏ผˆๆฏ•็ซŸๅคงๅคšๆ•ฐๆ–นๆณ•ๅ‡ ไธชๆœˆๅŽๅฏ่ƒฝๅฐฑ่ฟ‡ๆ—ถไบ†๏ผ‰๏ผŒ่€Œๆ˜ฏไฝœ่€…ๆ˜ฏๅฆ‚ไฝ•่ขซๅฏๅ‘็š„ใ€‚ ่ฏป่ฎบๆ–‡่ฆๅๅ‘ๆŽจ็†ไฝœ่€…็š„ๆ€่€ƒ่ฟ‡็จ‹๏ผŒๆ‰่ƒฝ้”ป็‚ผๅŸบไบŽ related work ๅ’Œ inspiration ๆๅ‡บ idea ็š„่ƒฝๅŠ›ใ€‚ ๆ‰€ไปฅ่ฆๆŒ‰็…งไธŠ้ข็š„้กบๅบๆ€ป็ป“๏ผŒๅ…ˆไบ†่งฃ่ƒŒๆ™ฏ๏ผŒ็„ถๅŽๅฐ่ฏ•่‡ชๅทฑๆ€่€ƒ๏ผŒๅฆ‚ๆžœไฝ ๆ˜ฏไฝœ่€…็š„่ฏ่ƒฝไธ่ƒฝๆƒณๅˆฐ่งฃๅ†ณๆ–นๆณ•๏ผŒๅ†็ป“ๅˆAI้€†ๅ‘่’ธ้ฆไฝœ่€…็š„ๆ€่€ƒ่ฟ‡็จ‹๏ผŒ็„ถๅŽไฟฎๆญฃไฝ ็š„ๆ€่€ƒใ€‚๏ผˆ่ฟ™็ฑปไผผไธ€็ง meta learning๏ผŒๅญฆไน ๅฆ‚ไฝ•ๅš research๏ผŒ่€Œ้ž่ขซ่ฎบๆ–‡็ป†่Š‚ๅนฒๆ‰ฐ๏ผ‰ 9-12 ไนŸๅพˆ้‡่ฆใ€‚ๆˆ‘ไปฌ่ฆ็œ‹่ฟ™็ฏ‡่ฎบๆ–‡ๆœ€ๅคง็š„้™ๅˆถ๏ผŒๅฆ‚ไฝ•ๆœ€ๅฐๅค็Žฐๆ ธๅฟƒ claims๏ผŒๅฆ‚ไฝ•ๅไพ‹่ฎพ่ฎกๆ”ปๅ‡ปๅฎƒ๏ผŒ็„ถๅŽๅฐ่ฏ•ๆๅ‡บๆ–ฐ็š„ ideas ่กฅๅ……่ฆๆฑ‚๏ผš * ้ฃŽๆ ผๅ‚่€ƒ Andrej Karpathy ๅ’Œ Kaiming He๏ผŒ่ฆๆฑ‚ๆœ‰็œŸไบบ็š„่ฏญๆ„Ÿ * ไฝฟ็”จ่ฏฆ็ป†็š„ใ€ๅ‡†็กฎ็š„ claim๏ผŒๆฏๅฅ่ฏ้ƒฝ่ฆๆœ‰ไฟกๆฏ้‡๏ผŒ้ฟๅ…ๅคง็ฉบ่ฏๅ’Œๆณ›ๆณ›่€Œ่ฐˆ * ไฝฟ็”จๆต็•…็š„ๆ–‡ๆœฌ๏ผŒ้ฟๅ…ๆปฅ็”จ็ ดๆŠ˜ๅทใ€ๅผ•ๅท๏ผŒไฟๆŒ่พ“ๅ‡บๅ†…ๅฎนๆธ…ๆดๆต็•…๏ผŒๆ˜“่ฏปๆ€ง้ซ˜ * ไฝฟ็”จ็œŸไบบ้€ป่พ‘๏ผŒ้ฟๅ…ไฝฟ็”จ[ไธๆ˜ฏ...่€Œๆ˜ฏ]่ฟ™็ง AI ็š„ไฝŽไฟกๆฏ้‡็ป“ๆž„ * ่ฏทไธฅๆ ผๅŒบๅˆ†ๅ››็ฑปไฟกๆฏ๏ผš่ฎบๆ–‡ๅŽŸๆ–‡ๆ˜Ž็กฎๅฃฐ็งฐ็š„ๅ†…ๅฎนใ€็›ธๅ…ณๆ–‡็Œฎไธญ็š„ๅทฒๆœ‰็ป“่ฎบใ€ๅŸบไบŽ่ฏๆฎ็š„ๅˆ็†ๆŽจๆ–ญใ€ไป็„ถไธ็กฎๅฎš็š„็Œœๆต‹ใ€‚ไธ่ฆๆŠŠๆŽจๆ–ญๅ†™ๆˆไบ‹ๅฎžใ€‚ ไธชไบบๅฎž่ทต็ป้ชŒ๏ผšLLMs ๆœ‰ไธŠไธ‹ๆ–‡้™ๅˆถ๏ผŒไธ€ๆฌกๅฎŒๆ•ดๆ€ป็ป“ 12 ไธช้—ฎ้ข˜ๅฏ่ƒฝไผšๅญ˜ๅœจไธ€ไบ›ๅฐ็ป†่Š‚็ผบๅคฑ๏ผˆไฝ†ๅฏนๆˆ‘ๆฅ่ฏดๅคŸ็”จไบ†๏ผŒๅๆญฃๅฏไปฅ็ปง็ปญๆ้—ฎ๏ผ‰๏ผ›ๅฆ‚ๆžœ่ฟฝๆฑ‚็ฒพๅบฆ๏ผŒๅฏไปฅๆฏไธช้—ฎ้ข˜ๅ•็‹ฌๆ้—ฎ๏ผŒๆˆ–่€…่ฐƒ็”จ subagent ๅ•็‹ฌๅค„็†๏ผŒๆœ€ๅŽๆ•ดๅˆใ€‚ ่ฟ™ไธช็‰ˆๆœฌ่ฟ˜ๅฏไปฅ็ปง็ปญๆ‰ฉๅ……ๅ’Œไผ˜ๅŒ–๏ผŒๅคงๅฎถๅ–้•ฟ่กฅ็Ÿญๅณๅฏใ€‚
39
87
512
34,799
Zhecheng Yuan reposted
Another crazy CVPR 2026 world model result. โ€œEnvisioning the Futureโ€ forecasts where points in a scene will move, step by step, from a single image. No dense video needed. - 3,000x faster than video models, 10x fewer parameters, and 5x more accurate under a fixed compute budget. - An autoregressive diffusion model rolls sparse point trajectories forward through short, predictable steps, modeling uncertainty as it grows. - Why it matters: Rollouts get cheap enough to simulate thousands of futures and plan over them, hitting 78% billiard planning accuracy vs 16% for the best dense video baseline.
33
232
11,926