FreeToken Unlocks Frontier MoE Inference on Consumer Hardware via Dynamic Co-Execution

Researchers from UC Berkeley and MIT have developed FreeToken, an open-source inference engine that enhances the utility of Mixture-of-Experts models on consumer hardware. By implementing a...