Vetting a Fresh Open Weights Coding Model Before It Touches Your Codebase
What to check in a new open weights coding model's license, GPU sizing, agent sandbox, and eval results before it reaches production code.
writing · 23 posts
Guides, deep dives and opinion pieces on LLM systems, Postgres, queues and deploy pipelines.
What to check in a new open weights coding model's license, GPU sizing, agent sandbox, and eval results before it reaches production code.
A tiered method for weighing GPT-6.5 rumors, a dated look at one reversed leak, and an alert setup that waits for API evidence.
How to read recent model release news, track regressions against a baseline, and run a small offline eval before migrating.
How to compare LLMs by cost per completed task, and route work between Haiku and Sol with validated escalation.
How to separate verified GPT-7 and Bel claims from rumor, and prepare model migrations with evals, pinning, and staged rollouts.
How we weighed a polling transactional outbox against Debezium CDC for order events, with the tradeoffs and production numbers.
What Claude Haiku 5.5 costs, what its reported benchmarks show, and how to call it from Python for cheap, high-volume classification.
Handle out-of-order and lost events in distributed systems without strict ordering. Practical patterns for gap detection, recovery, and avoiding zombie states.
Practical instrumentation strategies for measuring and allocating LLM costs in production across tenants, A/B tests, and feature flags without sacrificing latency.
Practical patterns for handling LLM failures at scale: cached responses, tiered model fallbacks, request reshaping, and honest trade-offs when your primary strategy breaks.