In case anyone sees similar problems in future, in the end this was due to the Zwift play controllers losing calibration and effectively braking all the time.
This wasn’t an issue in ERG mode because braking is disabled.
Recalibration fixed one controller but borked the other. Am waiting on an answer from support about how to recover the faulty one…