Kana & Mari's SoundRepos (English)
NobodyWho is a Rust-based, on-device inference engine for running GGUF-format large language models locally and offline. It provides streaming chat, conversation and context management, grammar-based tool calling, embeddings, reranking, multimodal input, text-to-speech and speech-to-text, with bindings for Kotlin, Swift, Python, Flutter, React Native and Godot. Inference is powered by llama.cpp with Vulkan and Metal GPU acceleration.
45 episoder
Kommentarer
0Vær den første til at kommentere
Tilmeld dig nu og bliv en del af Kana & Mari's SoundRepos (English)-fællesskabet!