Embedded vision applications, with their demand for ever more processing power, are driving up the size and complexity of edge SoCs. Heterogeneous architectures that bring together CPUs, GPUs and specialized NPUs have become the standard approach to achieving high-performance density […]
Artificial Intelligence is rapidly integrating into every aspect of technology. While the neural processing unit (NPU) often receives the majority of the spotlight as the ultimate AI problem solver, it is essential to recognize that not all AI workloads can […]
Multimodal LLMs promise to bring exciting new abilities to devices! As we see foundational models become more capable, we see compute requirements grow as well. It is not uncommon to see LLMs grow to tens of billions of parameters, at […]
Many computer vision projects reach proof of concept but stall before production due to high costs, deployment challenges and infrastructure complexity. This session explores the path from prototype to production, focusing on how to reduce the cost of vision workloads […]
Large language models (LLMs) often demand hand-coded conversion scripts for deployment on each distinct processor-specific software stack—a process that’s time-consuming and prone to error. In this session, we introduce a model-agnostic approach designed to streamline LLM deployment, especially for the […]
The adoption of large language models (LLMs) and vision-language models (VLMs) in edge AI applications has been limited by on-device computation and memory resources, and also by the cost of training and developing large models suitable for edge applications. The […]
Quadric’s Chimera general-purpose neural processor executes complete AI/ML graphs—all layers, including pre- and post-processing functions traditionally run on separate DSP processors. To enable this, the Chimera Graph Compiler processes and optimizes a combination of NN graphs, Python code and C++ […]
As humans, when we look at a scene our first impressions are sometimes wrong; we need to take a second look, to squint and reassess. Squinting enables us to focus our attention on the subject we are investigating and often […]
In this talk we’ll present Moonshine, a speech-to-text model that outperforms OpenAI’s Whisper by a factor of five in terms of speed. Leveraging this efficiency, we’ll show how to build a voice interface on a low-cost, resource-constrained Cortex-A SoC using […]
As large language models (LLMs) and vision-language models (VLMs) have quickly become important for edge applications from smartphones to automobiles, chipmakers and IP providers have struggled with how to adapt processor software stacks. In this talk, Expedera’s Ram Tadishetti examines […]
Want to contact us?
Use the small blue chat widget in the lower right-hand corner of your screen, or the form linked below.
STAY CONNECTED
Follow us on Twitter and LinkedIn.
