xybrid-ai

xybrid

Cross-platform on-device AI toolkit: run LLMs, ASR and TTS natively from Flutter, Unity, Kotlin, Swift or Rust on a llama.cpp and ONNX Runtime core. Private, offline, no cloud.

425 45 Rust Apache-2.0updated yesterday

local voice

View on GitHubDispute this mapping →

Curator's take

The pick when the model has to ship inside the app — a mobile feature, a desktop tool, or AI NPCs in a Unity game — rather than behind your API. One Rust runtime, real SDKs per platform, and text plus speech in and out, so a voice assistant doesn't mean three vendors. The Unity binding with a playable 3D tavern demo is the differentiator; nothing else in the local stack targets game engines seriously. Check maturity per binding before committing: Flutter, Kotlin, Unity and the CLI are available, Swift is 'coming soon', and the browser SDK is a preview LiteRT.js adapter with raw typed-tensor I/O only. At 425 stars this is early, and on-device means you own model sizing, thermals and battery.

Mapped by ShipWithAI editors · links verified

README.md

English · 简体中文 · 日本語

Xybrid

Run LLMs, ASR, and TTS natively in apps and games.
Flutter · Swift · Kotlin · Unity · Rust
Private, offline, no cloud required.

Continue your stack

What teams reach for next — and why each earns a place beside xybrid. Ranked by curator confidence.

Pairs well with

pocket-tts

Kyutai's 100M-parameter CPU-only TTS — streaming audio in ~200ms, ~6× real-time on two laptop cores, voice cloning, six languages. pip install and it talks.

Why it fitsXybrid provides the on-device speech plumbing; pocket-tts is the kind of model that makes it viable — 100M parameters, CPU-only, streaming in ~200ms — when your TTS budget is a phone core rather than a GPU.

Alternative to See all + compare →

coreai-models

Apple's official Core AI toolkit: recipes exporting Hugging Face models to .aimodel, PyTorch primitives for authoring, Swift runtime for macOS/iOS apps — plus skills for coding agents.

Why it fitsBoth put open models inside apps rather than behind an API. Apple's toolkit is deeper on one platform — .aimodel export and a Swift runtime tuned for Apple silicon; Xybrid trades that depth for reach across Flutter, Kotlin, Unity, Rust and the web.

speech-to-speech

Modular local voice-agent pipeline — VAD→STT→LLM→TTS behind an OpenAI Realtime-compatible WebSocket; every stage swappable, the LLM slot takes any OpenAI-compatible server. Powers Reachy Mini robots.

Why it fitsTwo routes to a local voice agent. speech-to-speech runs a swappable VAD-STT-LLM-TTS pipeline behind an OpenAI-Realtime-compatible socket on a machine you control; Xybrid puts the same stages on the device itself, inside your app binary.