Note from OP: I posted this because I find a topic of "agent swarms" super interesting as seen as an engineering challenge. It's just a novel kind of problem yet to be solved. And this article describes what worked well and what not, what gains did they get making certain changes.
But being honest I see some gaps in their reasoning. SQLite is an open source project which most probably means its code already is part of a training set of frontier LLMs. This calls into question whether language models actually invented or just recalled. Also, as noted in the article, they instructed models to build something based on the docs. That means that the goal was to recreate, not to invent. One of the hardest things in software engineering is to figure what to build and this agent swarm has already been given that information, what made the job much easier.
1 Comments
vermaterc@lemmy.ml · 0 pts · 13d
Note from OP: I posted this because I find a topic of "agent swarms" super interesting as seen as an engineering challenge. It's just a novel kind of problem yet to be solved. And this article describes what worked well and what not, what gains did they get making certain changes.
But being honest I see some gaps in their reasoning. SQLite is an open source project which most probably means its code already is part of a training set of frontier LLMs. This calls into question whether language models actually invented or just recalled. Also, as noted in the article, they instructed models to build something based on the docs. That means that the goal was to recreate, not to invent. One of the hardest things in software engineering is to figure what to build and this agent swarm has already been given that information, what made the job much easier.