Skip to content

Standard Operating Procedures

Fresh Updated January 2026

This section contains detailed SOPs for understanding and working with LLM technical phenomena.

SOP Index

By Category

Infrastructure Phenomena

SOPTopicKey Metric
001KV Cache Non-Determinism11.67 unique outputs/30 runs
004MoE Routing Variance30 unique completions at temp=0
007Rate Limiting EffectsTPM throttling variance

Context Phenomena

SOPTopicKey Metric
002Context Rot & Hidden State Drift20-60% degradation
005Lost in the Middle30% worse middle retrieval

Behavioral Phenomena

SOPTopicKey Metric
003RLHF Alignment Tax5-15% performance drop
006Prompt Injection SecurityNo architectural separation
008Interpretability Gaps100+ papers, no consensus

Document Control

All SOPs follow consistent formatting:

  • Version: 1.0
  • Status: Active
  • Last Review: January 2026
  • Source: Thinking Machines Lab, Chroma Research, ACL 2024-2025

Based on research from Thinking Machines Lab, Chroma Research, and ACL 2024-2025