If you can manage people working remotely part of the time, why not all of the time? You get access to a much larger, possibly global, pool of candidates.
Nothing to do with startups, really. I suppose a startup might benefit more from in-person collaboration, but that seems more a function of the team members and communication than physical presence.
You might find that more senior people and those with specialized skills, who don't struggle to find a job, will strongly prefer remote only. I have only worked remotely for about 15 years and I know quite a few other senior people who only work remotely.