AI is all about data, so it is no surprise that enterprises are deploying their own private AI inside the firewall. This episode of Utilizing Tech brings Chris Wolf, Global Head of AI and Advanced Services at VMware by Broadcom, to discuss private AI with Frederic Van Haren and Stephen Foskett. Companies looking to deploy AI are finding that it doesn’t require nearly as much hardware as expected, software is widely available, and are reluctant to trust sensitive data to a service provider. VMware by Broadcom is deploying their own private AI code assist, keeping proprietary software and standards inside the firewall. But the solution also helps the AI team be more agile and responsive to the needs of the business and customers. One of the first use cases they found for private AI was customer support, and this is tightly integrated with internal documentation and sources to ensure valid responses. The biggest challenge is to integrate unstructured data, which can be spread across many locations, and this is actively being investigated by companies like Broadcom as well as projects like LlamaIndex. VMware has contributed back to the open source community, notably with the Ray workload scheduler, open source models, and related projects. It’s important to build community and long-term engagement and support for open source as well, and this is in keeping with the overall trends in the AI community. Organizations looking to get started with private AI should consider the VMware by Broadcom reference architecture, which incorporates best practices at a smaller scale and pick a use case that provides immediate value.
Podcast Information
Stephen Foskett, Organizer of the Tech Field Day Event Series, part of The Futurum Group. Find Stephen’s writing at GestaltIT.com, on Twitter at @SFoskett, or on Mastodon at @[email protected].
Frederic Van Haren is the CTO and Founder at HighFens Inc., Consultancy & Services. Connect with Frederic on LinkedIn or on X/Twitter and check out the HighFens website.
Chris Wolf is the Global Head of AI and Advanced Services at VMware by Broadcom. You can connect with Chris on LinkedIn and learn more about VMware’s AI efforts by visiting their website.
Thank you for listening to Utilizing AI, part of the Utilizing Tech podcast series. If you enjoyed this discussion, please subscribe in your favorite podcast application and consider leaving us a rating and a nice review on Apple Podcasts or Spotify. This podcast was brought to you by Gestalt IT, now part of The Futurum Group. For show notes and more episodes, head to our dedicated Utilizing Tech Website or find us on X/Twitter and Mastodon at Utilizing Tech.