Flowing Through States: ODE Regularization for Reinforcement Learning
Mohamed Ghanem, Bernd Finkbeiner
ICLR 20262026
Abstract
Proposes FlowReg, a neural ODE-based regularization method for reinforcement learning that aligns an agent's latent representation with the underlying environment dynamics by modeling MDP trajectories as ODE flows. Integrated into Actor-Critic algorithms, it improves performance across Atari environments.
Less Effort, Shorter Proofs: Reinforcement Learning for Security Protocol Analysis in Tamarin
Matthias Cosler, Cas Cremers, Bernd Finkbeiner, Mohamed Ghanem, Niklas Medinger
ACM CCS 20262026
Abstract
Presents a reinforcement learning framework for proof search in the Tamarin security protocol verifier, inspired by AlphaZero and AlphaProof. A stateless Tamarin API exposes proof search as a classical RL environment, in which Monte Carlo Tree Search is guided by a neural heuristic that learns from completed subproofs. Across 16 case studies, it finds more proofs automatically than Tamarin's standard search and produces shorter proofs than both the standard and human-engineered heuristics.
Natural Synthesis: Outperforming Reactive Synthesis Tools with Large Reasoning Models
Frederik Schmitt, Matthias Cosler, Niklas Metzger, Julian Siber, Vladimir Krsmanović, Mohamed Ghanem, Bernd Finkbeiner
NeurIPS 20262026
Abstract
Tackles both sides of reactive synthesis. Algorithmically, it couples large reasoning models with model checkers to iteratively repair a synthesized Verilog implementation through sound symbolic feedback, solving more benchmarks than the best dedicated tools in the annual synthesis competition and extending to parameterized systems. On the specification side, an autoformalization step shifts the task from temporal logic to natural language, evaluated on a hand-authored dataset of natural-language specifications.