Kana & Mari's SoundRepos (English)
NobodyWho is a Rust-based, on-device inference engine for running GGUF-format large language models locally and offline. It provides streaming chat, conversation and context management, grammar-based tool calling, embeddings, reranking, multimodal input, text-to-speech and speech-to-text, with bindings for Kotlin, Swift, Python, Flutter, React Native and Godot. Inference is powered by llama.cpp with Vulkan and Metal GPU acceleration.
45 afleveringen
Reacties
0Wees de eerste die een reactie plaatst
Meld je nu aan en word lid van de Kana & Mari's SoundRepos (English) community!