Is that common experience for everyone?
Generally speaking, noise cancelling headphones work by utilising a small builtin microphone that 'listens' to the ambient sound immediately around you and then uses that signal to lower those sounds in your headphones.