Open Source
Colibrì runs DeepSeek V4.1 Flash from disk, but I/O is still the real limit
Colibrì 1.11.0 adds native DeepSeek V4.1 Flash support, showing how disk-tiered inference trades memory capacity for I/O and latency.
Local AI inference
-
New Products
NVIDIA PAIR scales local agent inference by routing requests, not pooling VRAM
NVIDIA PAIR can widen local agent throughput across PCs and Macs, but it routes independent requests rather than pooling VRAM or sharding models.
-
Open Source
FreeToken runs frontier-scale MoE models on consumer GPUs
FreeToken uses bandwidth-adaptive CPU-GPU execution and semantic caching to serve 35B to 753B MoE models on consumer and workstation hardware.
