- ICNS Home
- Projects
- Open PhD Projects
- Cold Start Astrometry for High-Precision Airspace and Space Objects Tracking with Neuromorphic Cameras
Cold Start Astrometry for High-Precision Airspace and Space Objects Tracking with Neuromorphic Cameras
Supervisors:
Primary supervisor A/Prof. Gregory Cohen
Description:
Objects in the sky – birds, drones, planes, meteorites, and satellites – are typically tracked with radars or motorized telescopes. These heavy instruments are extremely expensive and must be anchored in concrete slabs. It takes years to deploy a new observatory in remote places such as the Australian outback, and the observatory cannot be moved after its construction.
Neuromorphic cameras are silicon sensors whose pixels’ circuits are inspired by biological retinas. They do not generate frames but report changes in luminance in the form of asynchronous events. This sensing strategy breaks the fundamental relationship between frame rate and data rate. As a result, Neuromorphic cameras have an extremely high temporal resolution but generate little data. Their output can be processed in real time with low latency and little power.
Neuromorphic cameras open the door to a new type of sky monitoring device. One that fits in the boot of a car, can be rapidly deployed in remote places, uses little power, is inexpensive, and tracks unknown objects with incredibly high temporal resolution. Such a device – or better yet, a network of such devices – would have a wide range of applications including wildlife monitoring, airspace control, and space debris monitoring.
Outcomes:
During this thesis, the candidate will design novel Neuromorphic computer vision algorithms to tackle the open problems that must be solved to make the device possible. These problems include:
- Use stars to automatically calibrate a motorized Neuromorphic camera deployed in an unknown position (a problem that we dubbed Cold start astrometry).
- Follow an extremely fast object using cues from a Neuromorphic camera, also known as close loop tracking.
- Fuse data from multiple Neuromorphic sensors to reconstruct 3D trajectories.
About ICNS
Partnership
Research
Projects
-
- Task-Driven Model Evaluation in Large-Scale Spiking Neural Networks
- A Neuromorphic Ferroelectric field-effect Ultra-Scaled Chip for Spiking Neural Networks
- Event Based Wavefront Sensing Modalities
- Physics-Based Encoding for Spiking Neural Networks
- Neuromorphic Computational Imaging
- Defining Performance Metrics for Closed Loop Event Based Imaging Systems
- A Neuromorphic Framework for Event-Based DNNs using Minifloats
- A RISC-V instruction set architecture (ISA) extensions for neuromorphic computing using minifloats
- Astrometry with Event-based Vision Sensors
- Automatic Evaluation of Bushfire Risk via Acoustic Scene Analysis
- Bio-inspired Sensors for Space Situational Awareness
- Building a Neuromorphic Auditory Pathway for Sensing the Surrounding Environment
- Cold Start Astrometry for High-Precision Airspace and Space Objects Tracking with Neuromorphic Cameras
- Control Systems Inspired by Insect Central Pattern Generators that can Adapt to Dynamic Environments.
- Design of Neuromorphic Spiking Neural Networks for Real-Time Processing
- Enhanced Maritime Situational Awareness with Neuromorphic Cameras
- Environmental Situational Awareness using Neuromorphic Vision Sensors and IMU-based SLAM
- Fault Tolerant Distributed Swarm Intelligence using Neuromorphic Computing and Local Learning Principles
- Honey Bee Waggle Dance Detection via Neuromorphic Engineering
- Integrated Circuit Design for Event-based Vision Sensors
- Low-Power Acoustic Ecological Monitoring in Remote Areas using Machine Learning and Neuromorphic Engineering
- Neuromorphic Computing in Extreme Environments
- Neuromorphic Cyber Security at the Edge
- Neuromorphic Engineering for Acoustic Aerial Drone Detection in Visually Obscured Environments
- Machine Learning-Based Tool for Therapists to Monitor Speech Progress in Late Talkers
- Machine Learning for Automated Child Reading Assessment and Intervention
- Underwater Acoustic Drone Detection via Neuromorphic Models of Marine Mammal Audition
Resources
Master's Program
Opportunities
Events
News
Contact