Spiking Neural Network Predicting Sequence of the External Worlds States in Model-Based Reinforcement Learning

Mikhail Kiselev

IA y aprendizaje automáticoAprendizaje por refuerzo

Spiking Neural Network Predicting Sequence of the External Worlds States in Model-Based Reinforcement Learning

Mikhail Kiselev

Preprint

En palabras de los autores

This paper presents a spiking neural network (SNN) designed to predict the sequence of the external world states starting from the current world state. This SNN does not create the world dynamics model - instead it incorporates the SNN trained to predict the next world state and provides all mechanisms necessary to make the chain of predicted world states. These mechanisms are entirely spiking - they are implemented as spiking neuron ensembles. The present article describes this neuronal structure and tests its operation on a classic RL benchmark - ATARI ping-pong.

Resultado principalEl resumen no menciona limitaciones.

Leer el paper PDF

Apareció: jueves, 24 de septiembre. arXiv. Preprint, todavía sin revisión por pares.

IA y aprendizaje automático Aprendizaje por refuerzo 24 de sept de 2026
PCQC: Privileged Counterfactual Question Credit for Multi-Turn Medical Dialogue
To address this gap, we introduce PCQC (Privileged Counterfactual Question Credit), which uses privileged patient information during training to learn from questions never asked.
Chenxuan Li, Jiayi Wan, Xinrong Chen y 3 más — arXiv
PreprintUso en el mundo real
IA y aprendizaje automático Aprendizaje por refuerzo 24 de sept de 2026
Context-Continuous Preference Learning for Exoskeleton Personalization
We propose Context-Continuous Preference Learning (CCPL), a Gaussian-process preference model that shares observations across nearby contexts while retaining context-specific utility estimates.
Sunin Baek, Sungwoo Park, Daekyum Kim — arXiv
PreprintUso en el mundo real
IA y aprendizaje automático Aprendizaje por refuerzo 24 de sept de 2026
EBRL: Asynchronous Embodied RL by Multi-Grained Resource Management
Experiments show that EBRL achieves 1.30-3.47 times the end-to-end rollout throughput and 2.5 times of training convergency compared to the SOTA embodied RL systems.
Liang Mi, Weijun Wang, Bowen Gao y 12 más — arXiv
Preprint
IA y aprendizaje automático Aprendizaje por refuerzo 24 de sept de 2026
DCRL: Decoupling and Coupling Reinforcement Learning via Policy-Reward Manifold Alignment
To address the aforementioned misalignment, we propose Decoupling and Coupling Reinforcement Learning (DCRL) framework, which incorporates two key components: (1) a syllogistic logic-based prompt evolution mechanism that dynamically refines reward rubrics to enhance the expressiveness of the reward manifold; and (2) a policy-reward re-coupling mechanism that jointly updates the reward and policy models, ensuring consistent evaluation and mitigating manifold mismatch during training.
Henan Sun, Zehua Li, Haitao Hu y 4 más — arXiv
PreprintAfirmaciones fuertes, leer con cuidado
IA y aprendizaje automático Aprendizaje por refuerzo 24 de sept de 2026
On Preference Coverage Collapse from Hindsight Relabeling in Multi-Objective Reinforcement Learning
We show that this extension is frequently harmful: across four preference-conditioned off-policy algorithms spanning two critic backbones and two preference-sampling schemes on the continuous-control MO-Gymnasium suite, it degrades 19 of 36 algorithm-environment settings by as much as four standard deviations, improves only one, and leaves the rest unaffected.
Baptiste Bonin, Caro Strickland, Audrey Durand — arXiv
Preprint

Todos los papers nuevos de Aprendizaje por refuerzo

Spiking Neural Network Predicting Sequence of the External Worlds States in Model-Based Reinforcement Learning

En palabras de los autores

Más de Aprendizaje por refuerzo ese día

PCQC: Privileged Counterfactual Question Credit for Multi-Turn Medical Dialogue

Context-Continuous Preference Learning for Exoskeleton Personalization

EBRL: Asynchronous Embodied RL by Multi-Grained Resource Management

DCRL: Decoupling and Coupling Reinforcement Learning via Policy-Reward Manifold Alignment

On Preference Coverage Collapse from Hindsight Relabeling in Multi-Objective Reinforcement Learning