SDPAD: A Fully Spike-Driven Pipeline for End-to-End Autonomous Driving
En palabras de los autores
End-to-end autonomous driving demands trajectory planners that are both highly accurate and cheap enough for edge deployment. State-of-the-art artificial neural network (ANN) planners meet the accuracy requirement at the cost of heavy dense computation, while spiking neural networks (SNNs)---though promising orders-of-magnitude energy savings through sparse, event-driven arithmetic---still lag far behind in planning accuracy. We present SDPAD, a fully spike-driven end-to-end planning pipeline that closes this gap. SDPAD converts a pre-trained ANN perception stack into integer-spike form via quantized ANN2SNN conversion, lifts multi-view images into the bird's-eye-view (BEV) space with a spike-driven-max (SDM) depth distribution (Spike-3D-Lift), and plans through the Spike-QFormer, a spiking query transformer in which ego, agent, and map queries distilled from the BEV scene are fused by learnable waypoint queries via cross-attention, followed by deformable spike-cross-attention refinement. Every operation is gated by integer spikes and inference is a single feed-forward pass without temporal simulation loops. On the nuScenes open-loop benchmark, SDPAD achieves an average error of 0.40 m and a collision rate of 0.12%, on par with strong ANN planners while consuming 69.9 mJ---less than 2% of recent ANN baselines. In closed-loop evaluation on the NAVSIM navtest split, SDPAD reaches 86.3 PDMS, surpassing the previous SNN planner SAD by 4.3 points and matching mainstream ANN planners at a fraction of their energy. To our knowledge, SDPAD is the first fully spike-driven planner evaluated in end-to-end autonomous driving, demonstrating that SNNs can rival dense ANNs in complex driving tasks.
En palabras simples Resumen con IA
Los autores crearon SDPAD, un sistema completamente impulsado por picos para conducción autónoma de extremo a extremo. SDPAD convierte una pila de percepción de red neuronal artificial preentrenada en forma de picos enteros. En la evaluación nuScenes, SDPAD logra un error promedio de 0.40 metros y una tasa de colisión del 0.12%. SDPAD usa 69.9 milijulios, menos del 2% de las líneas base recientes de redes neuronales artificiales. En NAVSIM, SDPAD alcanza 86.3 PDMS, superando al planificador de red neuronal de picos anterior por 4.3 puntos.
Escrito por Kimi K2.5 usando solo el abstract de arriba. Jev verificó que cada oración esté respaldada por las oraciones del abstract que cita y eliminó las que no. Pasá el cursor por una oración para ver de dónde sale.
Apareció: viernes, 9 de octubre. arXiv. Preprint, todavía sin revisión por pares.