Is it a career risk being a Compiler Engineer?

I am a recent grad who wants to work in the Compiler Engineering field. My friends tell me that I will be too specialized hence being risky for me career-wise. Is this true?