Comment on Is anyone self-hosting their own AI?
panda_abyss@lemmy.ca 5 days agoI pointed lemonade at my llama.cpp model folder but it uses json files to configure them. I think it was fine for importing them or you could have an agent write them for you. After that you can manage models inside the app
Overall it wasn’t a huge deal, it’s easier than managing llama.cpp directly with rocm updates.