Learning to Build Video Codecs
What are some good resources to learn about implementing a video encoder/decoder from scratch?
The creator of lz4 is blogging constantly on compression algorithms, maybe you could start with this as it is a lot easier to understand.
How much math are you comfortable with? Codecs are about packing the most information into the smallest energy, which is a bit of a task.