Here we go ...
At the moment I have to use "Create a special reset condition for this alert" to achieve this, what makes it more difficult to manage, as any change in trigger rule has to be reflected in reset as well. Would be much easier to have above option, especially when first one is already doing this, but just need an extra option to delay reset a little bit.
Thanks,
Alex