The metal might just be starting to oxidize, try using a stain-removing brass cleaner. In my opinion, the very best product in this category is Twinkle.
It works for polishing your stem as well. You can also try soaking the windcover in a mixture of salt and vinegar for a little while. Careful, it's very abrasive.