I've been slowly working on https://github.com/CanineHQ/canine for about 2 years now. Basically a self hosted, FOSS that turns a Kubernetes cluster into something as easy to use as Heroku.
It was a pain point from a start up I cofounded before where we needed Kubernetes flexibility but developers hated using it. I figured there was no reason why it had to be hard to use and thus Canine was born.
I've been interested in seamless LLM routing for faster and more stable inference. I just launched https://www.tesseract.click with that goal. It's a simple lightweight SaaS to help manage your third-party LLM providers and balance speed, stability, and cost.