Machine learning models have grown tremendously in recent years, with some having hundreds of billions of data points, and we wonder how big they can get. How do we deploy even bigger models, whether it’s in the cloud or using captive infrastructure? Models are getting bigger and bigger, then are distilled and annealed, and then grow bigger still. In this episode, Dennis Abts of Groq discusses the scalability of ML models with Stephen Foskett and Chris Grundemann. HPC architecture and concepts are coming to the enterprise, enabling us to work with unthinkable amounts of data. But we are also reducing precision and complexity of models to reduce their size. The result is that businesses will be able to work with ever-larger data sets in the future.
Three Questions
- How long will it take for a conversational AI to pass the Turing test and fool an average person?
- Will we ever see a Hollywood-style “artificial mind” like Mr. Data or other characters?
- How small can ML get? Will we have ML-powered household appliances? Toys? Disposable devices?
Guests and Hosts
Dennis Abts, Chief Architect at Groq . Connect with Dennis on LinkedIn or on Twitter @DennisAbts
Chris Grundemann is the Managing Director at Grundemann Technology Solutions. You can connect with Chris on LinkedIn and on X/Twitter or visit his website to learn more.
Stephen Foskett, Organizer of the Tech Field Day Event Series, part of The Futurum Group. Find Stephen’s writing at GestaltIT.com, on Twitter at @SFoskett, or on Mastodon at @[email protected].