So as I am combing through the logs I find a few errors like this:
[EmailPoller-1] WARN c.s.oncall.email.EmailPollerImpl - Unsupported content-type: text/html; charset=us-ascii
I have anyone that is not sending replies in plain text format change the reply to plain text and they are now validating the emails.
I have found that AC is very picky in terms of the replies it will process. Not only needing to be plain text but also case sensitive where it has to be validate and not Validate or ack and not Ack.