Then of course there is "The Art of Computer Programming" (https://de.wikipedia.org/wiki/The_Art_of_Computer_Programmin...) which has one book dedicated to numerical algorithms as well.
If you want to actually implement, then I would say "don't". The libraries should be accurate and exposed to mass scrutiny with their use throughout the industry.