Topic
9 articles tagged with “ai”.
Full architecture breakdown of a personal GPU inference lab on RTX 3090 — vLLM, SGLang, llama.cpp benchmarks, a Go model gateway with OpenTelemetry, Qwen Scope SAE activations in Grafana, and the FlashInfer investigation that inverted my benchmark results.
I built an auto-research pipeline in Pi to iterate personality forms across models. The delta table it returned was uncomfortable: the heaviest form lifted one model by 29 points and dragged another down by 15. Trimming the prompt fixed it. Adding to it had broken it.
From 6 billion tokens a month to 865,000 for a complete CLI tool. How architectural discipline around token economics produced 20x efficiency gains.
QRAG combines structural Arabic indices with multi-model AI pipelines to transform keyword search into deep linguistic analysis.
Why I separated the reasoning engine from the chat interface, and what years of incident response taught me about building AI-augmented workflows.
Anthropic blocked 650,000 developers at 2 AM without warning. Here's the economics, the enforcement pattern, and what it means for your AI stack.
18 specific AI engineering predictions for 2026, each with confidence levels and falsifiable criteria. Public scorecard dropping January 2027.
Workflow prompts deliver consistency. Single-file scripts deliver power. Directory watchers deliver scale. Together, they multiply: 1 + 1 + 1 = 10, not 3.
Progressive disclosure, file-based persistence, sub-agent delegation, and Skills vs MCP - reduce tokens by 94%, cut costs 36x.