onde
1.1.4indexedRun LLMs locally with model downloading, GGUF export, SDKs and a CLI for testing; optimized on-device inference enabling private, serverless chat and model management.
20
Stars
—
Used by
dependents
69
Health
/ 100
Onde Inference
Run LLMs on-device with Onde Inference, with first-class support for Apple silicon.
Swift SDK · Kotlin Multiplatform SDK · Flutter SDK · React Native SDK · Website
In production
Onde is already shipping in real App Store apps. Chat runs fully on-device, so there is no server round trip and no user data leaving the device. For SDK docs, platform notes, and setup details, see https://ondeinference.com/sdk. If you want to test downloads, model selection, or GGUF export before wiring the engine into app code, use Onde CLI.
License
Onde is dual-licensed under MIT and Apache 2.0. You may use it under either license at your option.
Dependency attribution
| Dependency | License |
|---|
Model licenses
Models downloaded by Onde have their own licenses independent of this crate. By using Onde, you are also subject to the license of the model you load:
¹ Qwen Community License conditions: no training of competing models, attribution required, no misrepresentation of origin. Organisations with more than 100 million monthly active users must obtain a separate commercial licence from Alibaba Cloud.
² DeepSeek License v1.0 conditions: use-based restrictions apply (see Attachment A of the license). Prohibits military use, generation of disinformation, and certain other uses. Governing law is PRC law.
Onde's own license (MIT OR Apache-2.0) is independent of these model licenses. If you build an application on top of Onde, you are responsible for complying with the license of whichever model your users load.
Copyright
© 2026 Onde Inference (Splitfire AB).