Setup your alert with your threshold.
Then on the Trigger Condition Tab, set "Do not trigger this action until condition exists for more than" xx Seconds/Minutes/Hours
This will hold the alert in a preparing to alert state until the trigger conditions have existed for your set amount of time.