Kana & Mari's SoundRepos (English)

nobodywho-ooo/nobodywho

2 min · 3. aug. 2026
Billede af episoden nobodywho-ooo/nobodywho

Description

NobodyWho is a Rust-based, on-device inference engine for running GGUF-format large language models locally and offline. It provides streaming chat, conversation and context management, grammar-based tool calling, embeddings, reranking, multimodal input, text-to-speech and speech-to-text, with bindings for Kotlin, Swift, Python, Flutter, React Native and Godot. Inference is powered by llama.cpp with Vulkan and Metal GPU acceleration.

Comments

0

Be the first to comment

Sign up now and become a member of the Kana & Mari's SoundRepos (English) community!

Start for free

Start 14 days free trial

99 kr. / month after trial. · Cancel anytime

  • Podcasts kun på Podimo
  • 20 lydbogstimer pr. måned
  • Gratis podcasts

All episodes

45 episodes