There’s a bug with the Apple Tv remote inside Zwift, you can upvote it here @John_Molloy
Zwift is looking into this problem
