Executives and researchers leading Meta’s AI efforts obsessed over beating OpenAI’s GPT-4 model while developing Llama 3, according to internal messages unsealed by a court on Tuesday in one of the company’s ongoing AI copyright cases, Kadrey v. Meta.
I feel like the contents of his soul are starting to show on his face. Interesting.
pupbiru@aussie.zone 5 days ago
Next Monday: Meta announces Llama 3 beats GPT-4! Next Tuesday: OpenAI releases GPT-5
don’t get me wrong, i hope the open-ish model beats the closed BS model, but this is what happened last time… Llama pretty consistently equals or beats last generation OpenAI
possiblylinux127@lemmy.zip 4 days ago
Honestly I think Meta is focusing on the wrong thing. We don’t necessarily need a crazy power model. What we really need is efficiency. They should focus on models that are small to medium in size and highly efficient.
ChatGPT is old news and they are getting way less media attention. Being the “top dog” in AI doesn’t mean much.
theneverfox@pawb.social 4 days ago
That’s basically what’s down stream from an open source model. Llama derivatives are what I use on my mid range gaming computer, and honestly they’re comparable. They can handle fewer details at a time, but they’re faster and way more efficient… Once you add in rag and tool use, they’re better than models 200x their size
pupbiru@aussie.zone 3 days ago
there are efficient, self hostable models. i believe phi can run on mobile devices without too much trouble?