EP49

Local AI, Invisible Intelligence: Who Really Controls the Model

With Lee Crossley, Consultant CTO, Overshow

Show notes

In this episode we sit down with Lee Crossley - Consultant CTO | Overshow Co-Founder (https://www.linkedin.com/in/leecrossley/). Lee shares insights on the future of local AI models, their applications, and the evolving landscape of AI technology, emphasizing the importance of local models for privacy, security, and efficiency.

Key topics
* The evolution of local AI models and their applications
* The importance of model routing and hybrid AI strategies
* The role of hardware and device capabilities in AI deployment
* Industry trends and the impact of major players like Apple, Google, and Microsoft
* Security, privacy, and compliance considerations in local AI

Links & resources mentioned
Ollama – run local LLMs on your machine – https://ollama.com
Google Gemma – open-weight models for local use – https://ai.google.dev/gemma
Perplexity – hybrid/local model routing with PII handling – https://www.perplexity.ai/hub/products/portable-computer
Anthropic Claude & Claude Code – https://www.anthropic.com
Azure IoT Edge & on‑prem AI options – https://learn.microsoft.com/azure/iot-edge
Apple Intelligence – on-device AI strategy – https://www.apple.com/apple-intelligence/