Standard Operating Procedures
Fresh Updated January 2026This section contains detailed SOPs for understanding and working with LLM technical phenomena.
SOP Index
By Category
Infrastructure Phenomena
| SOP | Topic | Key Metric |
|---|---|---|
| 001 | KV Cache Non-Determinism | 11.67 unique outputs/30 runs |
| 004 | MoE Routing Variance | 30 unique completions at temp=0 |
| 007 | Rate Limiting Effects | TPM throttling variance |
Context Phenomena
| SOP | Topic | Key Metric |
|---|---|---|
| 002 | Context Rot & Hidden State Drift | 20-60% degradation |
| 005 | Lost in the Middle | 30% worse middle retrieval |
Behavioral Phenomena
| SOP | Topic | Key Metric |
|---|---|---|
| 003 | RLHF Alignment Tax | 5-15% performance drop |
| 006 | Prompt Injection Security | No architectural separation |
| 008 | Interpretability Gaps | 100+ papers, no consensus |
Document Control
All SOPs follow consistent formatting:
- Version: 1.0
- Status: Active
- Last Review: January 2026
- Source: Thinking Machines Lab, Chroma Research, ACL 2024-2025