I could go the traditional route and work through standard Physics books, e.g. something like the Feynman lectures. But if I want to arrive at modern Physics, is it even a good idea to spend many months working through "Newtonian" stuff that may not be relevant? How much of the standard Physics curriculum (Mechanics, Electricity and Magnetism, etc) is a prerequisite for understanding modern Physics? You can see I'm quite clueless.
How do I best go about this? Do you have any resource you would recommend?
EDIT: I took a look at SICM [0] because it has a CS angle which I thought may help, but it's above my level. I don't understand what many of the Physics terms means and I don't have the intuition to follow the explanations.
[0] https://groups.csail.mit.edu/mac/users/gjs/6946/sicm-html/book.html
So... yeah, you've got to start at the beginning. Or at least, know what you're passing by.
I would suggest to pick up a used copy of Modern Physics by Serway Moses and Moyer. You should be able to find an old edition for about $20. Read through it once first, don't try to work the problems, just absorb the concepts. This will give you a basic map of the idea space, so you know what you'll need to learn. Then find a part which you find fascinating and try some of the problems. You'll likely find you'll be missing some tools and then you'll need to go back and learn some things, but at least you will know what you need it for, and your interest will fuel your ability to work through the problems.
It's only a slight exaggeration to say that the simple harmonic oscillator is the most important model in physics. You learn it in freshman mechanics, and you still need it to understand quantum field theory.
The hard part is that to really understand physics, you need to work through problems. Reading or lectures alone won't do it. You'll need to learn to apply the concepts from what you're learning. If you are following textbooks, definitely work through the problems.
(my credentials for this advice are that I have a PhD in physics)