Since upgrading to 2023.1.1, powershell monitors are randomly flipping between up and unknown statuses

We just recently upgraded from 2020.2.6 to 2023.1.1 and I noticed that after the upgrade, our powershell monitors are flickering between up and unknown statuses, almost every hour. When I test the component/script on the application details page, it always works. I haven't seen any recent posts about this, but I'm pretty sure this is having to do with the upgrade and not an issue with timeouts. Any advice?