33
45
534
614,739
284 Photos and videos
Modal reposted
Join Applied Compute and @modal for an evening in Seoul! We’re hosting an ICML rooftop happy hour for top researchers, PhDs, AI lab scientists, and the people building the future of ML infrastructure and custom models. Come unwind and enjoy one of Korea’s hidden gems with us - RSVP in comments.
#ICML2026
3
10
84
14,987
Modal reposted
Jun 30
Claude Science has a @modal integration built-in.
Great to see the advantages of Modal as a compute substrate shine through here — fan out, shared storage, reproducible environments, GPU flexibility. Try it out!
The most demanding problems in life sciences need more than a capable model, they need infrastructure that scales.
Today we're announcing our integration with Claude Science, bringing Modal's elastic compute to researchers when they need it.
We're committing up to $100K in compute to support academic life sciences research. Apply by July 15.
6
12
69
10,219
The most demanding problems in life sciences need more than a capable model, they need infrastructure that scales.
Today we're announcing our integration with Claude Science, bringing Modal's elastic compute to researchers when they need it.
We're committing up to $100K in compute to support academic life sciences research. Apply by July 15.
Introducing Claude Science, a new app designed with every stage of research in mind.
Artifacts traced to their code, environments managed on demand, and 60 optional scientific databases that you can connect.
Available now in beta.
5
16
132
30,928
Our new Auto Endpoints feature is powered by a new Modal primitive: Modal Servers.
In this blogpost, we walk through design principles and detailed architecture: @EnvoyProxy, @googlecloud Spanner config store, and a @Cloudflare Pingora-based custom proxy.
4
11
85
41,967
Still don't think people fully appreciate how big dflash can be for inference latency/throughput. Genuine game changer for latency-sensitive workloads.
Modal Auto Endpoints provide state-of-the-art open source inference perf with a click.
Learn how we developed our low latency inference playbook with @DecagonAI, delivering responses 60ms faster than the best proprietary provider.
modal.com/blog/achieve-sota-…
3
8
36
5,738
Modal reposted
The no-longer-secret ingredient is DFlash by @zhijianliu_ and @jianchen1799.
If you train a custom DFlash speculator on your data, you can get to lower latencies than any generic inference API can achieve.
That's the benefit of owning your inference!
Modal Auto Endpoints provide state-of-the-art open source inference perf with a click.
Learn how we developed our low latency inference playbook with @DecagonAI, delivering responses 60ms faster than the best proprietary provider.
modal.com/blog/achieve-sota-…
6
13
103
10,491
Modal Auto Endpoints provide state-of-the-art open source inference perf with a click.
Learn how we developed our low latency inference playbook with @DecagonAI, delivering responses 60ms faster than the best proprietary provider.
modal.com/blog/achieve-sota-…
1
13
79
28,924
Modal reposted
Jun 23
You no longer have to pick between the performance of a black box API and the flexibility and control of @modal. Auto Endpoints give you both.
We're unlocking frontier performance for everyone without having to talk to sales or an FDE. More cooking here, stay tuned.
It is not too late to _actually_ own your inference.
Introducing: Modal Auto Endpoints.
5
10
94
9,801
Modal reposted
Jun 23
Managed private LLM endpoints, now available for everyone in @modal. Deploy in a few clicks with the UI or a few keystrokes with our CLI.
The coolest thing is that these are not black boxes – customers have full access to the code underneath.
It is not too late to _actually_ own your inference.
Introducing: Modal Auto Endpoints.
21
20
170
27,452
Read here: modal.com/blog/unpacking-san…
1
9
1,571
We're hosting an art show with @GrayAreaorg in San Francisco! 💚
Submissions are open till July 15: modal.art
Jun 18
📢 We're partnering with @modal to offer a new development and exhibition opportunity for artists with sustained engagements in artificial intelligence and the arts.
This global open call seeks proposals for creative projects that demonstrate the intentional use of AI to further artistic expression.
Generative media, enabled by models trained at network-scale and proliferated by agentic systems, has opened an expansive toolkit for artists. As aesthetic practices evolve, how can artists help us interpret the new realities unlocked through scaling computation?
Against a prevailing narrative where inference equates to automation, homogenization, and slop, we think there’s another story. One where artists harness the inherent creativity of inference to expand perspectives, create novel forms, and suggest alternative ways of sensing the world.
Selected artists will receive:
📌 $2,000 honorarium
📌 Up to $5,000 in materials and production stipends
📌 Up to $20,000 value in Modal credits to use for custom model training and cloud GPU compute.
𝗗𝗘𝗔𝗗𝗟𝗜𝗡𝗘: 𝗝𝘂𝗹𝘆 𝟭𝟱
Full details at modal.art/
2
3
37
7,215
Sandbox startup latency and scaling can make or break your RL training run.
Great post breaking this down, shown using Modal Sandboxes.
Jun 16
RL Systems Mind the Gap:
Matching Trainer and Generator Throughput
RL Training Infrastructure, GRPO,
PipelineRL, Async RL, Policy Staleness,
RL Sandbox Infra, CPU Requirements,
TCO Analysis, Thinking Machines Tinker
newsletter.semianalysis.com/…
5
59
9,904
Modal reposted
Jun 16
Our sandbox team has been on a crusade against every millisecond of latency and it's paying off.
More cool results coming very soon!
10
7
207
17,934