pyr0ball

u/pyr0ball@reddthat.com
3 posts · 74 comments

Recent posts

Recent comments

Fair point, I'll own it. Dropping a project link in a thread about slopcode is going to read as a pitch, and I needed to promote or nothing will ever happen.

That said, I figured showing a concrete example was more useful than just adding another opinion to the pile. If you want to pull the repo (https://git.opensourcesolarpunk.com/Circuit-Forge/peregrine), the structure is there to review. There's a deterministic pipeline underneath the LLM layer (eligibility checks, form validation, deadline tracking all run without LLM involvement), CI with test coverage, and a fine-tuned model approach that keeps inference on local hardware where possible.

The hard part wasn't the LLM layer, it was the plumbing around it that keeps the LLM in an advisory role instead of a decision-making one. That design constraint is what I wanted to show, not just "look, I made a thing."

The pre-LLM-effort-was-a-filter argument holds up, but I think what effort was really filtering for was why someone built the thing. High effort filtered out "this seemed fun for a weekend" projects. LLMs just surfaced that those were always the majority.

The better filter is: does this project serve a specific audience that genuinely needs it, or is it a demo of what you can do with Claude?

What I look for now:

  • Specific problem for a specific group of people (not "general-purpose LLM wrapper")

  • Open core (MIT or something that lets the community carry it if the author walks)

  • Revenue model or institutional backing (someone has to keep the lights on)

  • Evidence the author understands what they shipped, not just LLM output committed wholesale

We build CircuitForge, self-hosted tools for navigating opaque systems (job markets, government benefits, insurance). The architecture is deterministic-first: eligibility checks, validation, and data pipelines are rule-based and grounded in structured data, so the LLM is drafting from a clean, repeatable foundation rather than hallucinating into a void. That also means we can run smaller, specifically fine-tuned models instead of throwing a frontier model at everything and hoping for the best. Smaller models run on consumer hardware, which cuts hosting cost and shrinks the privacy risk surface significantly. Humans approve before anything acts. Pipeline layer is MIT and lives on Forgejo. There's a full devops stack, a real business model, and I use these tools every day. We're also actively collaborating with other devs and always looking for contributors.

The people using these tools actually need them. That's the commitment signal that doesn't evaporate when the novelty wears off.

on 🤔 Interesting · c/programmer_humor · 2 pts · 45d

You clearly didn't read very far, but I guess I need to be more upfront about the details. The only thing I charge for is using my hardware, and I'm only doing that for people who can't do it for themselves. All of the software is open source. All of the software is self-hostable, and the three I built first don't even need an LLM to be useful. I'm building it with low-spec (8gb vram or less) as the priority deployment option so anyone who is capable can use these for free

I'm one engineer trying to democratize and federate AI

You're depleted and need time to recover before you try helping again. This is a perfect case of "secure your own mask before assisting others".

Go be with friends. Touch some grass. Do some art. Go visit a garden or plant something.

If you feel up to it, look into volunteering we local food banks or animal shelters.

On a larger scale, build a digital lifeboat and de-google/apple/fb. Form privacy cooperatives with your family and friends (whoever is the techiest runs a server for the cooperative and you all share a private cloud). This can act as a filter and a support group if managed well.

Try a local garden center, assuming it's not a big box store. Most of the people there will be happy to chatter about their favorite plants if you're into that, but just going and looking around always lifts my spirits

Also happy to help you get a job if you want to beta test: https://circuitforge.tech/software/peregrine

edit: I'm the main dev on this and can get you freebies