NTA will take lot of resources so it would be good to re-check on your existing specs and get it increased if possible.
Also observe the pattern when is it exactly remaining high. During DB maintenance is one instance.
How many pollers do you have? How many routers are forwarding traffic to each one? I don't have a rule of thumb, but I'd try utilizing multiple Additional Polling Engine(APE) servers to spread the processing load out.