3 pointsby lioeters4 hours ago2 comments
  • lioeters3 hours ago
    Source: https://github.com/FlashML-org/FreeToken

    > FreeToken is an edge-native Mixture-of-Experts (MoE) serving engine designed for running frontier-scale open-weight models on personal and consumer hardware. It treats heterogeneous edge resources—GPUs, CPUs, host memory, and interconnects—as a unified, elastic inference platform.

  • andsoitis4 hours ago
    Sounds almost too good to be true. Has anyone tried it?