I took a small step back from agent loops. My decisions are still better than LLM decisions.
It makes you feel extremely productive but I would say it's an illusion of overconfidence. The quality of that software is not as high as manually iterating plan, perfectly understanding and judging those decisions, and making sure the LLM perfectly executes it.
The one exception is software with "reward -> iterate" style optimization where constraints are very clear. You can just define the constraints and let the LLM cook. For example "build firecracker infra where browsers spin up in 400ms" -> the final state is very clear.
In the last few weeks coding felt more like ML which feels magical when it works, sadly very rare though. I hope next models change this β maybe when Fable is back (I hope).