Comment on Is anyone self-hosting their own AI?

<- View Parent
panda_abyss@lemmy.ca ⁨5⁩ ⁨days⁩ ago

I pointed lemonade at my llama.cpp model folder but it uses json files to configure them. I think it was fine for importing them or you could have an agent write them for you. After that you can manage models inside the app

Overall it wasn’t a huge deal, it’s easier than managing llama.cpp directly with rocm updates.

source
Sort:hotnewtop