Some of the agent not showing "Update available" under the agent status, how we can upgrade those agents from console.
I would go and try to add those agents again. Many times when we had an issue with agent we did re-added them. Most of the time it worked.