When closing this tool from the system tray it doesn't really kill the program. IPSLAMonitor.exe continues to run. If you close it from the actual program window the process actually ends.
I cannot reproduce this (just tested on 2 systems). I did see one time where it did not go away immediately, but within a few seconds the process did terminate. Can you check again?