Only altitude accumulated while actively in the challenge counts.
Go to the Menu and click where I circled.
