Mark as solution notifications are getting spammy

Yes, pretty much every day :slightly_smiling_face: