Run LLMs Locally with Docker: A Quickstart Guide to Model Runner | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Run LLMs Locally with Docker: A Quickstart Guide to Model Runner (docker.com)
		3 points by homarp 5 months ago \| hide \| past \| favorite \| 3 comments

kristianp 5 months ago | [–]

This is part of docker desktop on MacOS.

> Now available in Beta with Docker Desktop 4.40 for macOS on Apple silicon

Also provides an api endpoint.

homarp 5 months ago | | [–]

discussion here https://news.ycombinator.com/item?id=43643944

homarp 5 months ago | [–]

it uses llama.cpp

Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact