Table of Contents
Fetching ...

ODD-SEC: Onboard Drone Detection with a Spinning Event Camera

Kuan Dai, Hongxin Zhang, Sheng Zhong, Yi Zhou

TL;DR

Outdoor experimental results validate reliable detection with a mean angular error below 2{\deg} under challenging conditions, underscoring its suitability for real-world surveillance applications.

Abstract

The rapid proliferation of drones requires balancing innovation with regulation. To address security and privacy concerns, techniques for drone detection have attracted significant attention.Passive solutions, such as frame camera-based systems, offer versatility and energy efficiency under typical conditions but are fundamentally constrained by their operational principles in scenarios involving fast-moving targets or adverse illumination.Inspired by biological vision, event cameras asynchronously detect per-pixel brightness changes, offering high dynamic range and microsecond-level responsiveness that make them uniquely suited for drone detection in conditions beyond the reach of conventional frame-based cameras.However, the design of most existing event-based solutions assumes a static camera, greatly limiting their applicability to moving carriers--such as quadrupedal robots or unmanned ground vehicles--during field operations.In this paper, we introduce a real-time drone detection system designed for deployment on moving carriers. The system utilizes a spinning event-based camera, providing a 360° horizontal field of view and enabling bearing estimation of detected drones. A key contribution is a novel image-like event representation that operates without motion compensation, coupled with a lightweight neural network architecture for efficient spatiotemporal learning. Implemented on an onboard Jetson Orin NX, the system can operate in real time. Outdoor experimental results validate reliable detection with a mean angular error below 2° under challenging conditions, underscoring its suitability for real-world surveillance applications. We will open-source our complete pipeline to support future research.

ODD-SEC: Onboard Drone Detection with a Spinning Event Camera

TL;DR

Outdoor experimental results validate reliable detection with a mean angular error below 2{\deg} under challenging conditions, underscoring its suitability for real-world surveillance applications.

Abstract

The rapid proliferation of drones requires balancing innovation with regulation. To address security and privacy concerns, techniques for drone detection have attracted significant attention.Passive solutions, such as frame camera-based systems, offer versatility and energy efficiency under typical conditions but are fundamentally constrained by their operational principles in scenarios involving fast-moving targets or adverse illumination.Inspired by biological vision, event cameras asynchronously detect per-pixel brightness changes, offering high dynamic range and microsecond-level responsiveness that make them uniquely suited for drone detection in conditions beyond the reach of conventional frame-based cameras.However, the design of most existing event-based solutions assumes a static camera, greatly limiting their applicability to moving carriers--such as quadrupedal robots or unmanned ground vehicles--during field operations.In this paper, we introduce a real-time drone detection system designed for deployment on moving carriers. The system utilizes a spinning event-based camera, providing a 360° horizontal field of view and enabling bearing estimation of detected drones. A key contribution is a novel image-like event representation that operates without motion compensation, coupled with a lightweight neural network architecture for efficient spatiotemporal learning. Implemented on an onboard Jetson Orin NX, the system can operate in real time. Outdoor experimental results validate reliable detection with a mean angular error below 2° under challenging conditions, underscoring its suitability for real-world surveillance applications. We will open-source our complete pipeline to support future research.
Paper Structure (24 sections, 7 equations, 7 figures, 5 tables)

This paper contains 24 sections, 7 equations, 7 figures, 5 tables.

Figures (7)

  • Figure 1: Illustration of our system operating in an outdoor scenario. Top: The scene with the trajectories of the drone (in red) and our device (in blue), with an inset at the bottom-left showing the rear view of the same scene. Bottom: The detection results from our system. Specific measurement locations are marked with circled letters.
  • Figure 2: CAD model of the system. Red and green boxes represent the actuation module and the perception-computing module, respectively.
  • Figure 3: Flowchart of the proposed algorithm. The two modules are executed independently. The Pre-processing part receives data from the event camera and converts it into image slices. The Detection part receives and processes the image stream, performs network inference, and calculates the relative bearing to the system based on the detection results.
  • Figure 4: Overview of the proposed detection network. Our novel Temporal Fusion Module (highlighted in a green dashed border) enhances detection by analyzing a sequence of frames that capture motion relationships. It employs Feature Channel Gating (FCG) to adaptively weight features, aggregates Temporal Context Vector (TCV) across the segment, and fuses it with features from the detection backbone to improve the network’s target recognition accuracy.
  • Figure 5: Coordinate systems and bearing estimation. (a) Image plane: Detection result with a red bounding box marking the drone and a dot indicating its centroid. (b) Spinning platform system: The detected centroid is projected into the 3D coordinate system (origin: camera optical center; y-axis: rotation axis; z-axis: zero-direction). This projection enables bearing calculation.
  • ...and 2 more figures