Sorry to hear it, @undercover_Rider_Wil. (I’m also not a fan of climbing for no reward!)
Sounds like you might have unwittingly uncovered a new ATV Remote bug, like someone else who has posted this morning. Check out: U-turn bug with ATV remote
Since Zwift seem to have released a number of ‘under the hood’ updates with the latest game version, perhaps the code for the ATV remote has been altered without being announced.