> I'd also like a private rubygem instance

that was always possible https://guides.rubygems.org/run-your-own-gem-server/

(there's also "gem server")