IMO, the biggest risk in switching jobs is the possibility that your new boss (or perhaps one of your close colleagues) will be a jackass/psycopath/etc. This can easily ruin a few years of your life and leave a good hole in your career.
I could double or triple my salary right now, but after having been burned a couple of times, I'm very nervous about risking it again.