EdgeSight Digital Twin
Monash VISTA is building the perception system behind a living digital twin (DT). We are working with RGB cameras, LiDAR and radar running on edge computing hardware, and combining them with modern computer vision. Cameras give the scene meaning: we are working towards training and deploying AI models that segment spaces and detect objects and people. LiDAR gives it precise geometry, with millions of 3D points that map every surface to the centimetre, even in the dark. Radar adds motion: it measures how fast things move and keeps working through rain, fog and smoke, without capturing anyone’s image.
Our current challenge is bringing these streams together on a single platform so the DT understands what is in a space, exactly where it is, and how it is moving.
Later we plan on adding live IoT data such as temperature or water levels. Stacked together, these layers turn a static 3D model into one that reflects the real world as it happens. This project gives our members hands-on experience across the full stack, from embedded hardware and software to edge AI and 3D visualisation, using open-source tools and building custom software of your own.
If you want to learn computer vision, robotics-grade sensing and digital twins by building something real, join the Monash VISTA team in the Smart Infrastructure Lab at Monash Innovation Labs.
