Challenges and Solutions of Moving Vision LLMs to the Edge

OEMs, brands and cloud providers want to move LLMs to the edge, especially for vision applications. What are the benefits and challenges of doing so? In this talk, we explore how edge AI is evolving to encompass massively increasing LLM model sizes, the use cases of local LLMs and the performance, power and chip area considerations that system architects should consider when utilizing vision-based LLMs.