Personally I've stopped caring. There are a few cases here. First, they've somehow been told the wrong thing, in that case you start having to pull out uniform inspection sheets and then you seem like the badge police. We have a local case where leaders gave permission to swap out the WSO with an alternate. I could provide plenty of documentation that the original source was wrong but I'll just make enemies. Second, the scout or scouter made an honest mistake and they will discover it themselves eventually. Third, they know it's wrong and they put it there anyway. Typically this happens with Fireman or Totin' or adults wearing patrol emblems. Fourth, they just don't care enough to do it right or fix it.
If someone asks me about patches I have uniform inspection sheets on me, but beyond that I'm keeping my mouth shut. Perhaps if I was an SPL or Committee Chair I might behave differently.