Kana & Mari's SoundRepos (English)
NobodyWho is a Rust-based, on-device inference engine for running GGUF-format large language models locally and offline. It provides streaming chat, conversation and context management, grammar-based tool calling, embeddings, reranking, multimodal input, text-to-speech and speech-to-text, with bindings for Kotlin, Swift, Python, Flutter, React Native and Godot. Inference is powered by llama.cpp with Vulkan and Metal GPU acceleration.
45 jaksot
Kommentit
0Ole ensimmäinen kommentoija
Rekisteröidy nyt ja liity Kana & Mari's SoundRepos (English)-yhteisöön!