LLM Infra Notes

Practical notes on running LLMs on rented GPUs: VRAM sizing, batching, vector stores, and what actually breaks in production.

共 3 篇 · 按主题整理 · 更新于 2026-11-05


Architecture1

Sizing1

Throughput1