In this talk, the Caper team will explore deploying an embedded computer vision model on Android devices for real-time product classification with the goal of increased customer satisfaction during shopping. We will dive into the details of achieving real-time inference on a low-resource system via a state machine approach based on a machine learning pipeline. We’ll touch on the challenges of seamlessly integrating with existing Android ecosystems and running real-time machine learning without hindering other device functions. We’ll also highlight preliminary results, emphasizing minimizing system resource usage. Join us to learn how we are leveraging AI in retail, aligning with Instacart’s goal of driving innovation in the retail sector to enhance the retail experience.