Setting aside the obvious of keeping them away from tablets and smartphones and most of the internet, would a linux box work? Would I be able to find adequate educational kids games that worked with Linux?
Avoid the version with Windows and delete Youtube links like the plague of course. People think about safety in general, but tend to forget about the surveillance aspect—why it's important to keep big corps out.