Kana & Mari's SoundRepos (English)
NobodyWho is a Rust-based, on-device inference engine for running GGUF-format large language models locally and offline. It provides streaming chat, conversation and context management, grammar-based tool calling, embeddings, reranking, multimodal input, text-to-speech and speech-to-text, with bindings for Kotlin, Swift, Python, Flutter, React Native and Godot. Inference is powered by llama.cpp with Vulkan and Metal GPU acceleration.
45 Episoder
Kommentarer
0Vær den første til å kommentere
Registrer deg nå og bli medlem av Kana & Mari's SoundRepos (English) sitt community!