Joined March 2019
67 Photos and videos
Alexandre Défossez reposted
Heading to ICML 2026 in Seoul next week with @romfbr31 to present Hibiki-Zero🇫🇷🇬🇧🇵🇹🇪🇸🇩🇪[kyutai.org/blog/2026-02-12-h…], Kyutai's latest real-time speech translation model. I'll be giving an oral presentation on July 8 at 10:30 AM KST. Feel free to join if you'd like to learn more!💬
4
23
1,999
Happening in 15 min at the Scaleway booth, 3rd floor. Come and chat with us !
I'll present our recent and on-going work at @kyutai_labs on multimodal generative AI and world-models tomorrow, Thurs. 18th of June at the Scaleway booth at Vivatech, Hall 7.3 | Booth 3F10, at 10:30am. Come and see us! Also come see @GradiumAI at the AWS booth.
2
568
I'll present our recent and on-going work at @kyutai_labs on multimodal generative AI and world-models tomorrow, Thurs. 18th of June at the Scaleway booth at Vivatech, Hall 7.3 | Booth 3F10, at 10:30am. Come and see us! Also come see @GradiumAI at the AWS booth.
1
3
25
4,755
Alexandre Défossez reposted
Hypnotizing to watch. Great work, co-authored by our very own @nico_dufour
What if you could turn any number of photos (3, 8, 15, or even 60) into one clean 3D surface (pts & mesh) with Flow Matching? Check out our new work, Surflo: Consistent 3D Surface Flow Model with Global State. 🧵 1/n 🔗anttwo.github.io/surflo/
3
42
7,116
Alexandre Défossez reposted
We upgraded Gradium TTS for the cases voice agents can't get wrong: phone numbers, codes, email addresses read back right the first time. Couple of examples: English: 97% on emails, top of the field. French: leads every competitor we benchmarked. Samples methodology → gradium.ai/blog/gradium-tts-…
2
14
49
8,523
Alexandre Défossez reposted
Making full-duplex speech dialog models more interactive, reactive, engaging -- and human-y 🤖🗣️ An incredible effort driven by @atsumoto_ohashi, in collaboration with @neilzegh, @honualx, and myself.
New paper: Multi-Faceted Interactivity Alignment in Full-Duplex Speech Models We use RL to post-train speech models (Moshi and PersonaPlex) to talk more like a human: to know when to respond, when to wait, and when to nod along with “yeah”s and “okay”s when listening.
6
14
1,881
Moshi is great but sometimes not fully exploiting its full-duplex abilities. @atsumoto_ohashi applied carefully crafted RL rewards on Moshi's output given some real inputs to improve interactivity on all axis. Works great on Moshi and the derived PersonaPlex by @nvidia.
New paper: Multi-Faceted Interactivity Alignment in Full-Duplex Speech Models We use RL to post-train speech models (Moshi and PersonaPlex) to talk more like a human: to know when to respond, when to wait, and when to nod along with “yeah”s and “okay”s when listening.
7
30
2,878
Pushing the performance of our on-device TTS model, which supports arbitrary voices.
Our on-device TTS model Phonon (100M params) now reaches 1.00% WER on the Seed-TTS English benchmark. Smaller than every model it already beats.
3
23
3,179
Alexandre Défossez reposted
Today @kyutai_labs and @ELLISInst_Tue launch @kesai_labs! Robot learning is bottlenecked by the cost of physical interaction. Our mission is to advance the efficiency frontier of robust & safe physical AI through fully open and reproducible research. kesai.eu/blog/2026-05-20-kes…
1
8
17
1,409
Research and innovation in AI must be at a European scale. @kyutai_labs and @ELLISInst_Tue are partnering to launch @kesai_labs, a new lab for physical AI and autonomous driving. The founding team are rockstars, ready to push scientific excellence, openness and real-world impact.
KE:SAI is moving in! Today, we are announcing the launch of @kesai_labs (Kyutai ELLIS Scalable Autonomous Intelligence), a new open-science research lab dedicated to the next frontier of AI: systems that can understand and act in the real world, starting with autonomous driving.
1
2
17
1,305
🙏
Impact of Kyutai is undeniable. Huge thanks again to @neilzegh, @lmazare, @honualx, and @tom_labiausse for being true trailblazers in the speech AI space. Hibiki and Moshi have sparked a new wave of innovation and pushed the boundaries of what’s possible in speech AI.
5
839
Alexandre Défossez reposted
This is cool but @kyutai_labs demonstrated this like a year 1/2 ago ago. On an iPhone.
People talk, listen, watch, think, and collaborate at the same time, in real time. We've designed an AI that works with people the same way. We share our approach, early results, and a quick look at our model in action. thinkingmachines.ai/blog/int…
13
7
99
16,183
TM’ model seems quite exciting. Glad to see @kyutai_labs works Moshi (from 2024) and MoshiRAG cited as inspirations, ideas and research do flow westward over the Atlantic, and we’ll keep pushing new ones. To be tested!
Today we're sharing our work on interaction models. A new class of model trained from scratch to handle real-time interaction natively, instead of gluing it onto a turn-based one. youtu.be/A12AVongNN4
1
9
60
4,457
Alexandre Défossez reposted
Three of our papers got accepted at ICML and one at CVPR this year 🎉 We will have researchers on-site for both conferences, so come talk to us if you want to learn more about Kyutai! 👁️ MoshiVis (CVPR’26) → Vision Speech Models: A data- and training- efficient pipeline for omni models built on top of Moshi 🧠 MoshiRAG (ICML’26) → Making speech-to-speech models smarter with the power of RAG and minimal latency 🗣️Hibiki-Zero (ICML’26) → Streaming speech-to-speech translation without aligned data leveraging GRPO ⌛ Kairos (ICML’26) → Recency bias is real, even for LLMs. More details in a future post! #ICML2026 #CVPR2026
3
13
151
9,666
Digging the story behind Chernobyl with MoshiRAG. 2026 is the 40th anniversary of the reactor meltdown, a tragic event, unavoidable given the systemic issues in the USSR nuclear program. I have a thought for the firefighters and liquidators that risked or gave their life there.
1
8
990
Hybrid speech-to-speech models with access to external search or text LLMs are the best way to combine low latency full-duplex with the highest capabilities. In Moshi-RAG, Moshi can decide when to "call a friend" and receives a compressed document to guide it.
Speech-native models like Moshi sound great and answer fast, but aren’t as smart as text LLMs. In our new paper, MoshiRAG, we show how Moshi can ask for advice from a text LLM or a knowledge base. The tricky part is how to do this in real time without adding latency. 🧵
1
2
35
4,093
Step 1: nailing our accuracy on the standard multilingual TTS eval set (from MiniMax) ✅ Step 2: realizing this benchmark does not capture real world use cases, so we're building a harder one⏱️
We benchmarked pronunciation accuracy across 5 languages. Gradium has the lowest average WER. Still, at these rates, many errors are ASR artifacts or normalizer gaps, not actual TTS mistakes. We're now working on better benchmarks (numbers, named entities, code-switching). Full blog post below:
1
34
2,354
We are looking for talent able to help us shape @GradiumAI data acquisition, annotation and QA process, with immediate impact on our line of products and future research. Help us bring speech interaction to the next level. 👉 gradium.homerun.co
3
3
27
3,168
If you are doing a PhD on generative AI, model alignment, or speech, and want to get at the forefront of speech modeling research, we are opening PhD level internship at @GradiumAI. Come and join the team behind Mimi, Moshi, Hibiki, and PocketTTS. 👉 gradium.homerun.co/
6
32
3,563