We're graduate students, postdocs, faculty and scientists at the cutting edge of artificial intelligence research.

Joined July 2017
42 Photos and videos
Berkeley AI Research reposted
Did a model secretly train on another model's outputs? Providers can catch this from server-side logs โ€” Anthropic recently reported catching 29M such exchanges. But those methods need usage logs and infrastructure access; they don't work from the model itself. Our paper does: compare a model to an earlier checkpoint of itself, and ask which candidate teacher best explains the shift between them. The true teacher stands out. ๐Ÿงต
5
7
20
6,636
Berkeley AI Research reposted
If you want a robot to do something well, you need to know how to talk to it. If you don't, you can learn, with Semantic Action RL! In our paper, @JagdeepBhatia8, @ajwagenmaker, @verityw_ show how RL over VLA prompts enables new tasks and learns blazing fast in the real world!
3
24
263
27,369
Berkeley AI Research reposted
How can generalist policies adapt to new challenges at deployment using skills they already have? We optimize VLA *prompt inputs* with reinforcement learning, enabling efficient real-robot adaptation on complex tasks where existing methods struggle. ๐Ÿงต semantic-action-rl.github.io
2
18
75
14,900
Berkeley AI Research reposted
โœˆ๏ธI'll be at ACL in San Diego this week! I'll be at the NLP CSS workshop on Jul 3 (on the 12pm panel) and we have two main papers: - aclanthology.org/2026.acl-loโ€ฆ, Jul 5, 2-3:30pm poster (I'll be there) - aclanthology.org/2026.acl-loโ€ฆ, Jul 7, 9-10:30am poster (@stefkrsteski presenting)
1
3
46
7,773
Berkeley AI Research reposted
How can we scale perception-based humanoid learning without collecting massive humanoid teleoperation data? ๐Ÿš€ Excited to finally share VLK! What excites me most about VLK is that it reframes data collection as a data generation problem. Instead of relying on expensive humanoid teleoperation, we automatically generate synchronized vision, language, and whole-body kinematics from reconstructed real-world scenes. Making this vision a reality required bridging three fundamental challenges: ๐Ÿ‘€ Perception: Bridging the RGB sim โ†’ real gap through visual domain randomization and motion blur mitigation during both training and deployment. ๐Ÿค– Embodiment: Bridging the kinematics โ†’ dynamics gap with real-time VLA deployment, test-time RTC, and SceneBot, enabling seamless deployment on a real humanoid. ๐ŸŒ Environment: Bridging the real-world โ†’ synthetic gap to enable scalable Vision-Language-Kinematics data generation through scene reconstruction and interaction synthesis. It has been an amazing journey working with such an incredible team. For a complete walkthrough of the project, check out @jiaman01's thread below ๐Ÿ‘‡ ๐ŸŒ Project: vision-language-kinematics.gโ€ฆ ๐Ÿ“„ Paper: arxiv.org/abs/2606.30645 ๐ŸŽฆ Video: youtu.be/ZB6k_iMJP7M Huge thanks to my amazing collaborators @jiaman01 @eric_srchen @TakaraTruong @ Pei Xu, and to our advisors @pabbeel @rocky_duan @KoushilSreenath @akanazawa @carlo_sferrazza @GuanyaShi @ckarenliu.
๐Ÿค– How can we scale up humanoid robot learning? Introducing ๐ŸŒŸVLK๐ŸŒŸ: generating large-scale synthetic data with paired egocentric observations, text, and full-body G1 kinematics for learning humanoid loco-manipulation. No teleoperation needed! Website: vision-language-kinematics.gโ€ฆ
11
43
288
863,224
Berkeley AI Research reposted
๐Ÿšจ Learning from Situated and Embodied Workshop @ COLM 2026 deadline is today! Submit your work on agents, embodied AI, human-AI interaction! Non-archival; preprints and under-review work welcome. learning-situated-interactioโ€ฆ
3
5
4,836
Berkeley AI Research reposted
Introducing WARP-RM: A Warp-Augmented Relative Progress Reward Model for Data Curation ๐Ÿงต We gave our t-shirt folding robot more demonstrations and it got worse. Every extra demo ended in a successfully folded shirt. The data wasn't bad. It was noisy. The policy couldn't tell productive motion from dead time, and it imitated both equally. So which moments of a demo are actually worth copying? ๐ŸŒ Project Website: uynitsuj.github.io/warp-rm ๐Ÿ“„ Paper: arxiv.org/abs/2606.28320 ๐Ÿ’ป Code: github.com/uynitsuj/WARP-RM ๐Ÿ“จ XDOF blog post: xdof.ai/blog/warp-rm
6
22
141
26,788
Berkeley AI Research reposted
1/N Neuroscience and social science research on humans has shown: โ€“ Similar brain activity predicts friendship and cooperation โ€“ Diverse minds drive innovation We wondered whether AI-AI interaction would show the same pattern. It does. LLMs with similar internal representations cooperate more, but produce less novel output. ๐Ÿงต (ICML 2026)
3
17
45
7,278
Berkeley AI Research reposted
We can learn a model that provides shaped "process rewards" for robotic RL, that evolves automatically as the policy gets better. This improves performance on benchmarks, and works in the real world! Some fun new work with Raymond Tsao & @ajwagenmaker
4
40
368
35,870
BAIR (@berkeley_ai ) Faculty Michael I. Jordan gave the Commencement Speech at this year's @BerkeleyCDSS graduation where he spoke on the theme "Human Connection in the Era of Internet Technology". youtube.com/watch?v=omEtpo3oโ€ฆ
4
2
18
10,165
Berkeley AI Research reposted
We are excited to announce what we have been working on for more than six months: The OpenThoughts-Agent dataset and OpenThinker-agent models. More than 100 ablations on data curation for RL environments for coding agents. Our data recipe is SOTA over all open-data agents in their class. We post-train a Qwen-3-32B to get 26% on Terminal Bench and open all our training sets, data pipelines, experiments and models. Some lessons we learned for training agents vs reasoning: 1. The Diversity of tasks matters more, compared to reasoning (OpenThoughts-Agent vs OpenThoughts). You could teach reasoning from math and it transfered widely but RL environments seem to teach more specific capabilities, so each domain must be covered. 2. Filtering high quality and hard questions remains very important. (Was also true for OpenThoughts reasoning). We discuss several ways of filtering. 3. Synthetic re-writing and task augmentation didnโ€™t give significant benefits in our experiments. Sampling multiple teacher rollouts per task did work (was also true for reasoning). Even when keeping the dataset size fixed, multiple answers gave benefits. The Multiple answers mystery is still valid for agentic environments. 4. Stronger models are not necessarily better teachers (was also true for reasoning). The stronger teacher for Quen-3 was GLM-4.7-AWQ and the Terminus2 harness in Daytona. We are releasing 100k tasks and trajectories. 5.Benefits from GRPO remain limited and still on-going. I currently officially hate GRPO.
How can we train small agentic models that are highly capable of terminal use and coding? Announcing OpenThoughts-Agent OpenThinkerAgent-32B, the strongest Qwen-3 based open-data agentic model: 44.8% avg across 7 agentic benchmarks! (1/n)
17
35
219
392,800
Berkeley AI Research reposted
Why diffusion denoising-based generative methods do not suffer the curse of dimensionality even though the data may lie in extremely high-dim spaces? Our new work, accepted by the JMLR: arxiv.org/abs/2409.02426 reveals the not-so-surprising secret: as long as the intrinsic dimension of the distribution is very low, the generative process can be extremely efficient and effective! It seems that a mixture of low-rank Gaussians is a universal model for all informative real-world data. as we stipulated in a former textbook of mine: Generalized Principal Component Analysis: vision.jhu.edu/gpca/, published exactly ten years ago!
13
115
790
57,422
Berkeley AI Research reposted
Great work using offline agentic exploration to develop robot skills!
Children learn from play. Can robots do the same? We propose ๐๐ฅ๐š๐ฒ๐Ÿ๐ฎ๐ฅ ๐€๐ ๐ž๐ง๐ญ๐ข๐œ ๐‘๐จ๐›๐จ๐ญ ๐‹๐ž๐š๐ซ๐ง๐ข๐ง๐ , a paradigm that gives embodied coding agents a play stage before downstream tasks arrive, and instantiate it with ๐‘๐€๐“๐ฌ (Robotics Agent Teams), where robots discover reusable skills through curious play. Co-led with @jiaxin_ge_
1
10
70
22,781
Berkeley AI Research reposted
Excited to share T-Rex: Tactile-Reactive Dexterous Manipulation ๐Ÿฆ–๐Ÿค– Touch is fundamental to human dexterity, yet most Vision-Language-Action (VLA) models either ignore tactile feedback or lack the ability to react to high-frequency contact signals. In this work, we tackle both the data and architectural challenges of tactile-reactive dexterous manipulation. ๐Ÿฆ– A 100-hour tactile-synchronized dexterous manipulation dataset with 7,700 trajectories, 22 motor primitives, and 200 everyday objects. ๐Ÿฆ– A tactile-reactive MoT architecture with spatial-temporal tactile encoding and asynchronous high-frequency tactile refinement. ๐Ÿฆ– A scalable training recipe combining 22,889 hours of human egocentric pretraining with tactile-grounded robot mid-training. Across 12 real-world contact-rich manipulation tasks, T-Rex achieves over 30% higher average success rate than the strongest baseline. We are fully open-sourcing the dataset, models, teleoperation stack, training code, and inference pipeline. ๐ŸŒ Project: tactile-rex.github.io/ ๐Ÿ“„ Paper: arxiv.org/abs/2606.17055 ๐Ÿ’ป Code: github.com/ZhuoyangLiu2005/Tโ€ฆ ๐Ÿค— Dataset: huggingface.co/datasets/zekaโ€ฆ ๐Ÿงต Thread โ†“
21
65
240
72,159
Berkeley AI Research reposted
Check our new work: T-Rex: Tactile-Reactive Dexterous Manipulation ๐Ÿฆ–๐Ÿ”ฅ Touch is fundamental, yet most VLAs are too slow for high-frequency contact. We built a unified foundation model to change that, pushing the limits of the @DexmateAI robot and @SharpaRobotics hands. Whatโ€™s inside: ๐Ÿง  Architecture: tactile-reactive MoT for async high-frequency refinement. ๐Ÿ“ฆ Data: 100-hr tactile dataset: 7.7k trajectories, 200 objects. ๐Ÿ‹๏ธ Training: 22.8k hrs human pre-training --> tactile mid-training --> high-frequency control ๐Ÿ“ˆ Result: 30% success across 12 real-world contact-rich tasks. ๐Ÿ”“ Open-sourcing models, data, teleop stack, and code. tactile-rex.github.io
Excited to share T-Rex: Tactile-Reactive Dexterous Manipulation ๐Ÿฆ–๐Ÿค– Touch is fundamental to human dexterity, yet most Vision-Language-Action (VLA) models either ignore tactile feedback or lack the ability to react to high-frequency contact signals. In this work, we tackle both the data and architectural challenges of tactile-reactive dexterous manipulation. ๐Ÿฆ– A 100-hour tactile-synchronized dexterous manipulation dataset with 7,700 trajectories, 22 motor primitives, and 200 everyday objects. ๐Ÿฆ– A tactile-reactive MoT architecture with spatial-temporal tactile encoding and asynchronous high-frequency tactile refinement. ๐Ÿฆ– A scalable training recipe combining 22,889 hours of human egocentric pretraining with tactile-grounded robot mid-training. Across 12 real-world contact-rich manipulation tasks, T-Rex achieves over 30% higher average success rate than the strongest baseline. We are fully open-sourcing the dataset, models, teleoperation stack, training code, and inference pipeline. ๐ŸŒ Project: tactile-rex.github.io/ ๐Ÿ“„ Paper: arxiv.org/abs/2606.17055 ๐Ÿ’ป Code: github.com/ZhuoyangLiu2005/Tโ€ฆ ๐Ÿค— Dataset: huggingface.co/datasets/zekaโ€ฆ ๐Ÿงต Thread โ†“
4
17
9,088
Berkeley AI Research reposted
Children learn from play. Can robots do the same? We propose ๐๐ฅ๐š๐ฒ๐Ÿ๐ฎ๐ฅ ๐€๐ ๐ž๐ง๐ญ๐ข๐œ ๐‘๐จ๐›๐จ๐ญ ๐‹๐ž๐š๐ซ๐ง๐ข๐ง๐ , a paradigm that gives embodied coding agents a play stage before downstream tasks arrive, and instantiate it with ๐‘๐€๐“๐ฌ (Robotics Agent Teams), where robots discover reusable skills through curious play. Co-led with @jiaxin_ge_
9
63
341
88,068
Berkeley AI Research reposted
Remember the backlash against all AI voices being feminineโ€”Siri, Alexa, etc.? Now, companies use a wider range of AI voices with ambiguous names like โ€œalloyโ€ and โ€œshimmer.โ€ Bias solved foreverโ€”ha, no. What happens when people hear these supposedly neutral voices?๐Ÿ‘‡
6
10
62
19,158
Berkeley AI Research reposted
In computer vision, the field advanced significantly due to openly available datasets and models; hope this will be true in robotics as well.
Introducing ABC: open data, training, and infrastructure for robotics. We release the largest teleop dataset to date, and extensively investigate design decisions, pretraining, and post-training techniques. @arthurallshire @Cinnabar233 @adamrasb @redstone_hong @davidrmcall
4
23
228
31,691
Berkeley AI Research reposted
We can convert human videos to robot hand-object interaction trajectories in 4D. Enjoy! Paper: arxiv.org/abs/2606.19333 Website: do-as-i-do.com Code: github.com/malik-group/do-asโ€ฆ Authors:@bhawna_paliwal_,@HarithejaE,@willjhliang, @pabbeel , @notmahi , @JitendraMalikCV
13
86
812
71,587