Talks

Research Talks

Surprise and novelty in human reinforcement learning Curiosity, Information Seeking, and Exploration (CISE) Conference · October 2025 A taxonomy of surprise definitions Active Inference Institute · January 2023 Novelty drives exploration, whereas surprise modulates learning Bernstein Conference · September 2021 Novelty is not Surprise EPFL Neuro Symposium · February 2021

Lecture Series: Curiosity-driven Exploration

Recorded for the "Artificial Neural Networks and Reinforcement Learning" course at EPFL.

Part 1: Exploration Bonus in Tabular Reinforcement Learning Part 2: Curiosity-driven and Intrinsically Motivated Reinforcement Learning Part 3: Noisy-TV Problem and Drawbacks of Curiosity-driven Reinforcement Learning