LLMs-from-scratchvsvllm
LLMs-from-scratch vs vllm
LLMs-from-scratch and vllm ; side by side.
Identity
rasbt
LLMs-from-scratchImplement a ChatGPT-like LLM in PyTorch from scratch, step by step
vllm-project
vllmA high-throughput and memory-efficient inference and serving engine for LLMs
Numbers
LLMs-from-scratch
vllm
- GitHub stars
- 96,429
- 81,518
- PH votes
- not available
- not available
- npm / week
- not available
- not available
Filed under
vllm alone: Inference Providers.
On the ground
No operator notes yet.
Operator notes for this pairing land here when we’ve shipped real work with both. The bar is “a real thing we built, including what didn’t work.”