Kana & Mari's SoundRepos (English)
NobodyWho is a Rust-based, on-device inference engine for running GGUF-format large language models locally and offline. It provides streaming chat, conversation and context management, grammar-based tool calling, embeddings, reranking, multimodal input, text-to-speech and speech-to-text, with bindings for Kotlin, Swift, Python, Flutter, React Native and Godot. Inference is powered by llama.cpp with Vulkan and Metal GPU acceleration.
45 Folgen
Kommentare
0Sei die erste Person, die kommentiert
Melde dich jetzt an und werde Teil der Kana & Mari's SoundRepos (English)-Community!