Tether announces the release of a cross-platform BitNet LoRA framework that supports large model training and inference on consumer-grade GPUs and smartphones.

robot
Abstract generation in progress

Deep Tide TechFlow News, on March 17, according to Tether CEO Paolo Ardoino, the Tether AI team released the new version of QVAC Fabric, integrated with the cross-platform BitNet LoRA framework, enabling training and inference of billion-parameter large models on consumer-grade GPUs and smartphones.

The new QVAC Fabric LLM achieves cross-platform running of BitNet LoRA fine-tuning and inference on AMD, Intel, Apple Metal, and mobile GPUs for the first time. On flagship devices, GPU inference speeds are 2 to 11 times faster than CPUs, with memory usage reduced by up to 90% compared to full-precision models. The Tether team has completed fine-tuning of models with up to 3.8 billion parameters on flagship phones like Pixel 9, S25, and iPhone 16, and achieved fine-tuning of models with up to 13 billion parameters on the iPhone 16. The related code has been open-sourced on GitHub.

View Original
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
Add a comment
Add a comment
No comments
  • Pin