If you have a program that will let you edit notifications, you should be able to go in, track down which one it is that's driving you insane, and delete it. You can try using
MemMaid (commercial),
SK Tools,
FdcSoft Task Manager (free), and there are probably others out there that can do the job just as well, too.