pipette
ESEspañol

SDPAD: A Fully Spike-Driven Pipeline for End-to-End Autonomous Driving

Chengjun Zhang, Yuhao Zhang, Jie Yang, Mohamad Sawan

PreprintClaims a big stepReal-world use

In the authors' words

End-to-end autonomous driving demands trajectory planners that are both highly accurate and cheap enough for edge deployment. State-of-the-art artificial neural network (ANN) planners meet the accuracy requirement at the cost of heavy dense computation, while spiking neural networks (SNNs)---though promising orders-of-magnitude energy savings through sparse, event-driven arithmetic---still lag far behind in planning accuracy. We present SDPAD, a fully spike-driven end-to-end planning pipeline that closes this gap. SDPAD converts a pre-trained ANN perception stack into integer-spike form via quantized ANN2SNN conversion, lifts multi-view images into the bird's-eye-view (BEV) space with a spike-driven-max (SDM) depth distribution (Spike-3D-Lift), and plans through the Spike-QFormer, a spiking query transformer in which ego, agent, and map queries distilled from the BEV scene are fused by learnable waypoint queries via cross-attention, followed by deformable spike-cross-attention refinement. Every operation is gated by integer spikes and inference is a single feed-forward pass without temporal simulation loops. On the nuScenes open-loop benchmark, SDPAD achieves an average error of 0.40 m and a collision rate of 0.12%, on par with strong ANN planners while consuming 69.9 mJ---less than 2% of recent ANN baselines. In closed-loop evaluation on the NAVSIM navtest split, SDPAD reaches 86.3 PDMS, surpassing the previous SNN planner SAD by 4.3 points and matching mainstream ANN planners at a fraction of their energy. To our knowledge, SDPAD is the first fully spike-driven planner evaluated in end-to-end autonomous driving, demonstrating that SNNs can rival dense ANNs in complex driving tasks.

Main resultThe abstract does not state a limitation.

In plain words AI summary

The authors created SDPAD, a fully spike-driven system for end-to-end autonomous driving. SDPAD converts a pre-trained artificial neural network perception stack into integer-spike form. On the nuScenes benchmark, SDPAD achieves 0.40 meter average error and 0.12% collision rate. SDPAD uses 69.9 millijoules, less than 2% of recent artificial neural network baselines. On NAVSIM, SDPAD reaches 86.3 PDMS, surpassing the previous spiking neural network planner by 4.3 points.

Written by Kimi K2.5 using only the abstract above. Jev checked that every sentence is supported by the abstract sentences it cites, and removed any that were not. Point at a sentence to highlight its source.

Appeared: Friday, October 9. arXiv. Preprint, not yet peer-reviewed.