nvidia has already seen where this is going and why the bought hugging face and created consumer spark chips. its all local and open source.

for those of you who might not know, hugging face makes money by renting compute. so you have a local free model and when you need more compute to run on their machines you pay. its a very straight forward budiness model. pay for what you use.