I want to have a deeper understanding of CPUs, GPUs, how it all connects.
I want to learn by building chip emulators in Go
What’s a good resource/s to get started?
If you enjoy what you're doing, but want to learn about more modern CPUs and modern GPUs, you can progress towards more recent systems. The sixth generation systems (Dreamcast, PS2, Gamecube, Xbox) are comparable to modern architectures, but with a lot less horsepower.
The NESdev Wiki is a good source of information [1] to get started.
Learning how to program FPGAs (in verilog, etc.) is also a nice way for software people to start getting into hardware.