Pool spare GPU capacity to run LLMs at larger scale | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Pool spare GPU capacity to run LLMs at larger scale (github.com/michaelneale)
		10 points by i386 4 hours ago \| hide \| past \| favorite \| 2 comments

		help

iwinux 3 hours ago | [–]

You lost me on "spare GPU". I don't have any capable GPUs, let alone spare ones :)

vagrantJin 1 hour ago | [–]

This is very promising, definitely looks more user friendly than exo. Can't wait to try it out.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact