AirPods turning down volume during workout

A strange phenomenon that seems to be restricted to workouts: When a “free run” block starts (I don’t do cycling workouts) my AirPods often (not always) slowly turn down the volume. They are connected to an iPhone that only serves as my music player. Has anyone else experienced this?