Right? A year ago 70B felt massive and now it's basically mid-tier. The pace of this is genuinely hard to keep up with even when you're paying close attention to it.
Fair point and you're right I should have said largest commonly deployed in consumer companion apps rather than largest period. Behemoth at 123B exists but none of the platforms I tested are actually running that in production. Sloppy phrasing on my part, appreciate the correction.
No public analytics that I've seen platforms keep that close to the chest. From actually using these things though the ones that hold up seem to be doing selective memory extraction rather than dumping the full conversation history into every context window. Key facts, emotional markers, relationship milestones — that kind of thing. Which makes sense because a raw running log would be insane compute costs for a $15/month product. Still way more expensive than session-only chat which is probably why free tiers get quietly capped so fast.
Right? A year ago 70B felt massive and now it's basically mid-tier. The pace of this is genuinely hard to keep up with even when you're paying close attention to it.
Fair point and you're right I should have said largest commonly deployed in consumer companion apps rather than largest period. Behemoth at 123B exists but none of the platforms I tested are actually running that in production. Sloppy phrasing on my part, appreciate the correction.
No public analytics that I've seen platforms keep that close to the chest. From actually using these things though the ones that hold up seem to be doing selective memory extraction rather than dumping the full conversation history into every context window. Key facts, emotional markers, relationship milestones — that kind of thing. Which makes sense because a raw running log would be insane compute costs for a $15/month product. Still way more expensive than session-only chat which is probably why free tiers get quietly capped so fast.