↑
logo

FreeToken: Datacenter-class intelligence on the hardware you own

Posted by lioeters |4 hours ago |2 comments

lioeters 3 hours ago

Source: https://github.com/FlashML-org/FreeToken

> FreeToken is an edge-native Mixture-of-Experts (MoE) serving engine designed for running frontier-scale open-weight models on personal and consumer hardware. It treats heterogeneous edge resources—GPUs, CPUs, host memory, and interconnects—as a unified, elastic inference platform.

andsoitis 4 hours ago

Sounds almost too good to be true. Has anyone tried it?