Llama-server which is part of llamacpp does this for a few months now | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

ekianjo 5 months ago | parent | context | favorite | on: The local LLM ecosystem doesn’t need Ollama

Llama-server which is part of llamacpp does this for a few months now

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact