No wonder that people like Sam Altman are looking for ways to make the models better without having to use more data. What will happen if we feed that data back into their LLMs? 😷Data contamination: We have this huge amount of ‘new’ - and sometimes hallucinated - data that is being generated by generative AI chatbots. 🌎Geopolitics: it’s increasingly difficult for data to cross country borders. Personal vaults or cryptocurrency wallets, making it harder for LLMs to access the data they crave. 🕸️Web3's impact: If Web3 fulfills its promise, users could store data in Contrary to most artists, Grimes is allowing anyone to use her voice for AI-generated songs … for a 50% profit share. 💸Data monetization: Twitter, Reddit, Stack Overflow & others want AIĬompanies to pay up for training on their data.

Samsung even warned employees not to use AI tools like ChatGPT for security reasons. Germany, France, Ireland, Canada, and Spain remain suspicious. 🔐Privacy matters & regulation: Italy banned ChatGPT over privacyĬoncerns (now back after changes). Universal Music asked Spotify & Apple Music to stop AI companies from accessing their songs for training. 🎨Copyright conundrums: Getty Images, individual artists like SarahĪndersen, Kelly McKernan & Karloa Otiz are suing AI companies over Why is it becoming harder and more expensive to access data? So if you have a model that keeps needing more data to become better, that's a problem. What is he NOT saying? That access to data is becoming damned hard & expensive. ➡️COST: ChatGPT cost over over 100 million dollars to develop. ➡️PHYSICAL LIMITS: there's a limit to how many & how quickly data centers can be built. ➡️RETURNS: scaling up model size comes with diminishing returns. That kind of parameter growth is no longer tenable, feels Altman. ➡️GPT-4: (2023): amount undisclosed – but likely trillions of parameters So why is that revolutionary? Well, this is how OpenAI's LLMs (the models that 'feed' chatbots like ChatGPT & Google Bard) grew exponentially over the years: He believes that future progress in AI needs new ideas, not just bigger models. Sam Altman, CEO of OpenAI, dropped a 💣 at a recent MIT event, declaring that the era of gigantic AI models like GPT-4 is coming to an end.

The apology by plato audio