When bluetooth ear pieces were the thing some years back it looked less odd. I know someone that had a noise cancelling one and it just looked like someone that wore it to take an occasional call or whatever. If someone is walking around with air pods or the like in their ears you’d assume they are listening to music/podcast and it would be odd socially for someone to wear them out to a dinner party.
Why can't smartphones be louder for those people? put it behind a "enable full audio range" setting to prevent accidental activation if you like.