The technological revolution sparked by generative AI threatens to create the deepest digital divide we've ever seen. In this illuminating talk, Danilo Pau from STMicroelectronics reveals how only a handful of companies worldwide possess the resources to fully harness large-scale generative AI, while the rest of humanity risks being left behind.

Pau takes us through the sobering reality of today's AI landscape: hyperparameterized models requiring nuclear power plants for training, hundreds of millions in costs, and worrying environmental impacts. But rather than accept this centralized future, he presents a compelling alternative path – bringing generative AI to edge devices.

Through a comprehensive survey of recent research, Pau demonstrates that generative AI is already running on edge devices ranging from smartphones to microcontrollers. His team's work with STMicroelectronics processors showcases practical implementations including style transfer, language models, and perhaps most impressively, an intelligent thermostat capable of natural language interaction with reasoning capabilities.

What emerges is a vision for AI not as another backend classifier but as a transformative interface between humans and machines. "GenAI is not for another detector," Pau explains. "We need to offer new added value" through natural interactions that understand context and can reason about the world.

For researchers and developers, this talk provides concrete pathways to explore: from audio processing as a "low-hanging fruit" to visual question answering systems that run on minimal hardware. The future of AI isn't just in massive data centers – it's in the devices all around us, waiting to be unleashed through energy-efficient processing and innovative approaches to model optimization.

Ready to join the movement bringing AI capabilities to everyone? Explore how edge-based generative AI could transform your products and help bridge the growing digital divide.

Send us a text

Support the show

Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org