Multi-modal Re-identification: IOT + Computer Vision for Residential Community Tracking

In this talk we will introduce how Seedland builds safer and healthier residential communities in China using cross-modal IOT-plus-vision person tracking and intelligence. The recent COVID-19 outbreak necessitated monitoring in communities such as tracking of quarantined residents and tracking of close-contact interactions with sick individuals. High-density communities also have many non-resident visitors (delivery, repair, social) and tracking allows safeguarding of sensitive areas like playgrounds. Vision techniques for face recognition and person tracking are severely challenged in real residential communities; for example, poor accuracy for children and the elderly due to sparse training data and suboptimal positioning of cameras. Also, attributes such as whether somebody is sick, or is a visitor, cannot be observed by a camera. We will describe our solution, which propagates intelligence from smart community devices and services across camera-based person-tracking to build a rich annotated graph of behavior and attributes. We will detail technical solutions to real-world challenges in person identification, annotation and multi-day tracking.