Janas: Run LLMs larger than RAM by streaming experts from SSD

Summary

Janas streams large language model experts from SSDs to run models exceeding available RAM, achieving 37 tokens per second on a 32 GB laptop.

Carried by: Hacker News. First seen: 2026-10-13T00:00:05Z.