Building @usemagnitude. Coding agents, dev tools, open source. YC S25

Joined November 2023
47 Photos and videos
Pinned Post
Introducing Magnitude. It's a coding agent that runs entirely on open models. It costs 60% less than Claude Code with no drop in performance. Try it now: npm i -g @magnitudedev/cli Here's how it works 👇
62
50
557
164,158
Magnitude scores 75.5% on Terminal-Bench 2.1, making it the top coding agent for GLM 5.2. npm i -g @magnitudedev/cli See how we did it (and kept it fair) below ⬇️
19
14
170
19,994
How we fix overthinking: When a single reasoning trace reaches 1k tokens, we force the model to generate a string acknowledging its overthinking and that it should act now. We then start its next tool call block. This prevents endless "But.. Wait.. Actually.." chains that GLM can sometimes produce that burn output tokens and time with no productive upside. This fired over 2000 (!!) times during the TB run. My guess is that overthinking in open models is an artifact of optimizing for single shot benchmarks. In a multi-turn benchmark like TB (which more closely resembles real agent behavior), its more optimal to interleave thinking with tools.
1
1
13
1,497
We went out of our way to make this a fair fight. All runs are done with the exact same conditions: - All on Fireworks serverless GLM-5.2 - Same time of day, same load - Standard Terminal-Bench timeouts Magnitude Claude Code run in goal mode. OpenCode has no goal mode. We tried a plugin for it but it destroyed their prefix cache, so we scrapped it. We even patched GLM-5.2's image crashes across agents to eliminate that variable Open call for more benchmarks that test agents instead of just models. Most benchmarks are model-centric and you have to go out of your way to control for other variables and create a fair test environment
1
12
1,360
All these GLM 5.2 providers advertise 200 tok/s. Yet you try them and get 50 tok/s The top speeds are super impressive. And I love how much activity there is in the ecosystem. But it makes it really hard to get a true read of provider inference speeds under normal conditions My guess is they allocate a ton of compute to their serverless model APIs right around launch, then slowly pull it back once their score has been established. It's benchmaxxing but for providers You can see it in the Artificial Analysis chart of speeds over time. They peak right on launch day, then gradually or sometimes rapidly decline over the next few days I'm very excited for when one of these reported 200 tok/s scores holds for 7 days
You may have heard that GLM-5.2 at 328 token/s is cool, How about 392? Databricks is now #1 in inference speed for GLM-5.2 on Artificial Analysis. It's a great model, and we did a lot of optimizations.
29
13
220
35,438
It’s interesting that GLM 5.2 is in the same cost ballpark as GPT 5.5 despite costing ~5x less per token You could say it’s because GPT 5.5 is more efficient with its tokens, but I think it’s largely because GLM 5.2 is inefficient It thinks for far too long, and sometimes will spend an entire benchmark task just thinking and not taking any tool calls. This hurts performance and costs a lot There’s ways to patch this at the provider layer and when you do, GLM 5.2 token efficiency increases dramatically with no drop in performance (in fact it gets better!)
New open source releases have moved the Pareto frontier on Ramp SWE-Bench. Kimi K2.7 Code and GLM 5.2 perform stronger than their predecessors at a higher cost, within reach of closed source models.
18
4
182
34,871
turns out firmware engineering is an awesome use case for open models talked to a founder this week doing 1B tokens a day with them. just points his agent at his execution trace and has it patch things live runs it pretty much all day. most of the work is pattern matching and does not need a frontier model. and it would hit cc rate limits anyway interesting
1
9
1,711
I don’t think you can actually run GLM 5.2 locally to do meaningful work (yet). The 2 bit quant benchmarks at 82% top-1 accuracy. That sounds great in theory until you realize that means you’re getting the “wrong” tokens ~20% of the time. Think about how quickly that compounds
Truly unbelievable GLM 5.2 just released and it's an open weights model you can run locally The insane part is, it's just as good as Opus 4.8 Unlimited, free super intelligence running on your desk In this video I cover how it works, and how to set up your first local model:
4
11
999
Tom Greenwald reposted
clever!
Introducing Magnitude. It's a coding agent that runs entirely on open models. It costs 60% less than Claude Code with no drop in performance. Try it now: npm i -g @magnitudedev/cli Here's how it works 👇
2
2
36
13,283
Tom Greenwald reposted
it turns out if you do a lot of really good context engineering, you can get frontier intelligence for like half the price, and in some cases even better than a single frontier model
Introducing Magnitude. It's a coding agent that runs entirely on open models. It costs 60% less than Claude Code with no drop in performance. Try it now: npm i -g @magnitudedev/cli Here's how it works 👇
18
33
514
89,220
Tom Greenwald reposted
These guys (@tomgreenwald & @anderslie) build with incredible taste Highly recommend checking this out if you're building with OSS models
Introducing Magnitude. It's a coding agent that runs entirely on open models. It costs 60% less than Claude Code with no drop in performance. Try it now: npm i -g @magnitudedev/cli Here's how it works 👇
5
3
23
5,960
Tom Greenwald reposted
Excited for @wafer_ai to partner with @usemagnitude to power their coding agent with powerful open source models! Open source models are the closest to frontier LLMs they've ever been, so it's now feasible to reduce costs by 60% while maintaining quality across the board.
Introducing Magnitude. It's a coding agent that runs entirely on open models. It costs 60% less than Claude Code with no drop in performance. Try it now: npm i -g @magnitudedev/cli Here's how it works 👇
2
3
22
2,068
Tom Greenwald reposted
My friends @tomgreenwald & @anderslie made a harness designed for open source models. If you’re working with OSS models, don’t use anything but magnitude. They squeezed every last drop of performance out of their harness.
Introducing Magnitude. It's a coding agent that runs entirely on open models. It costs 60% less than Claude Code with no drop in performance. Try it now: npm i -g @magnitudedev/cli Here's how it works 👇
3
5
44
7,243
Introducing Magnitude. It's a coding agent that runs entirely on open models. It costs 60% less than Claude Code with no drop in performance. Try it now: npm i -g @magnitudedev/cli Here's how it works 👇
62
50
557
164,158
Our internal benchmark measures the cost efficiency of coding agents. It's built around two projects: Rain, a bespoke DSL written in Zig, and pgx, a real Postgres driver written in Go. The benchmark includes 20 tasks meant to reflect a diversity of real world engineering work, rather than intentionally tricky puzzles. Tasks cover features, bug fixes, and refactors in the project. We run each task 5 times for a total of 100 trials. We measure the score for each task and compare it to the total cost by token usage, in order to determine the performance per dollar of each agent.
1
22
6,012
Magnitude runs on our own provider layer, built to fix common open model failures like malformed tool calls, runaway thinking, and doom loops. We build custom chat templates and parsers for each model for reliable performance. Inference comes from @FireworksAI_HQ and @wafer_ai, both fast and zero data retention, so none of your code trains models. The TUI is built on @EffectTS_. The API and console run on @vercel.
2
26
5,199
Tom Greenwald reposted
At HumanLayer, we’re on a mission to solve the AI slop code problem. In 2025 we open-sourced our Research, Plan, Implement framework, now deployed inside fortune 500s like Block and Uber - places where shipping slop is just not an option And that was just the beginning. Today, we’re opening access to HumanLayer - an Agentic IDE, collaboration platform, and building blocks for your software factory. HumanLayer enables engineers solving hard problems in complex codebases to: > move 2-3x faster across the entire SDLC (not just coding) > maintain rigorous standards for system architecture and program design Hundreds of engineers at companies of all sizes are already using HumanLayer to ship fast without sacrificing quality. I'm excited to invite you to try humanlayer today at humanlayer.com, and I'm even more excited to see what you build. @0xblacklight and I are deeply grateful to our team, our customers who give us so much incredible energy and feedback, our investors who have always been in our corner, and our friends and family who have supported us along this crazy journey if you're a staff or principal engineer trying to make AI coding work at scale for your team, we'd love to hear from you as @swyx likes to say - let's make this the year of no more slop
217
143
1,361
339,581
81% on Terminal Bench 2.1 😱
Introducing GLM-5.2: Frontier Intelligence, Open Weights - Significant improvements in coding and agentic tasks - Strong long-horizon capabilities with a 1M context window - Two levels of reasoning effort: GLM-5.2 (max) pushes the limits, while GLM-5.2 (high) strikes a strong balance between performance and token efficiency - MIT-licensed open weights - Same API pricing as GLM-5.1 Tech Blog: z.ai/blog/glm-5.2 Weights: huggingface.co/zai-org/GLM-5… API: docs.z.ai/guides/llm/glm-5.2 Coding Plan: z.ai/subscribe Chat: chat.z.ai
1
152