- ICNS Home
- Projects
- Open PhD Projects
- Defining Performance Metrics for Closed Loop Event Based Imaging Systems
Defining Performance Metrics for Closed Loop Event Based Imaging Systems
Supervisors
Dr Nimrod Kruger & A/Prof Gregory Cohen
Description
The current focus on event-based sensing in academia and industry revolves around creating advanced sensors, characterizing them, and developing data analysis pipelines. There are a plethora of exciting demonstrations highlighting this technology’s capabilities, but benchmarks and comparative performance metrics against traditional imaging modalities are scarce. Simple questions, such as “At what distance can an event camera detect a drone?” cannot be answered without an extensive design, prototyping, and data collection cycle. A design process for a conventional camera includes performance metrics and criterions assessed before any hardware is purchased or lines of code are written. Without the equivalent for event-based sensing, their adoption for high-end tasks is delayed.
This project aims to define the metrics and criterions for event-based imaging systems performance. Through several design-to-prototype cycles of unique designs, we will establish what constitutes a “good” event sensor and event-based imaging system, setting new standards for manufacturers of sensors, cameras, and systems.
Outcomes
- Survey current state-of-the-art in vision performance metrics for both conventional and neuromorphic sensors.
- Define specialized metrics for event-based signals fitting closed loop processing (line of sight motion) and dynamic scenes.
- Evaluate these metrics, through various analytical tools and literature, to assess performance – and establishing design criterions.
- Construct a performance model: a designer tool used for evaluating performance of imaging system at the drawing board stage.
- Initiate a full design process for a unique, high-end, event-based imaging systems through several prototype stages.
About ICNS
Partnership
Research
Projects
-
- Task-Driven Model Evaluation in Large-Scale Spiking Neural Networks
- A Neuromorphic Ferroelectric field-effect Ultra-Scaled Chip for Spiking Neural Networks
- Event Based Wavefront Sensing Modalities
- Physics-Based Encoding for Spiking Neural Networks
- Neuromorphic Computational Imaging
- Defining Performance Metrics for Closed Loop Event Based Imaging Systems
- A Neuromorphic Framework for Event-Based DNNs using Minifloats
- A RISC-V instruction set architecture (ISA) extensions for neuromorphic computing using minifloats
- Astrometry with Event-based Vision Sensors
- Automatic Evaluation of Bushfire Risk via Acoustic Scene Analysis
- Bio-inspired Sensors for Space Situational Awareness
- Building a Neuromorphic Auditory Pathway for Sensing the Surrounding Environment
- Cold Start Astrometry for High-Precision Airspace and Space Objects Tracking with Neuromorphic Cameras
- Control Systems Inspired by Insect Central Pattern Generators that can Adapt to Dynamic Environments.
- Design of Neuromorphic Spiking Neural Networks for Real-Time Processing
- Enhanced Maritime Situational Awareness with Neuromorphic Cameras
- Environmental Situational Awareness using Neuromorphic Vision Sensors and IMU-based SLAM
- Fault Tolerant Distributed Swarm Intelligence using Neuromorphic Computing and Local Learning Principles
- Honey Bee Waggle Dance Detection via Neuromorphic Engineering
- Integrated Circuit Design for Event-based Vision Sensors
- Low-Power Acoustic Ecological Monitoring in Remote Areas using Machine Learning and Neuromorphic Engineering
- Neuromorphic Computing in Extreme Environments
- Neuromorphic Cyber Security at the Edge
- Neuromorphic Engineering for Acoustic Aerial Drone Detection in Visually Obscured Environments
- Machine Learning-Based Tool for Therapists to Monitor Speech Progress in Late Talkers
- Machine Learning for Automated Child Reading Assessment and Intervention
- Underwater Acoustic Drone Detection via Neuromorphic Models of Marine Mammal Audition
Resources
Master's Program
Opportunities
Events
News
Contact