Why isn't my ISP providing AI as a service?

> Maybe I am missing something really fundamental/silly ??

Your ISP doesn't own rackspace?

Perhaps as your ISP rather than HN?

Can we ban questions like this? Though I recognize this person is a perfect YC candidate by asking why you can't connect a home connection to a rack of GPUs.

I’m not sure what problem this would solve. The data sent to, and revived from, the LLM is small. Why would saving a couple theoretical hops on the network matter? That’s not the bottleneck.

First, the ISP would need fat stacks of not-mismanaged cash and decide to invest those in huge amounts of hardware that will atrophy in value from before the moment the check clears.

Next, the ISP would need the technical chops to set up that hosting themselves (or be able to afford outsourcing the setup and maintenance).

All the while, the ISP would need to withstand moving outside their area of expertise and primary business focus and core competence, that being delivering network connectivity (at the lowest possible cost and, most often, at the highest possible price).

And finally, if the ISP can do all that, they would need to decide it would be a solid business decision; hat the investment would pay off, that the customers not only exist but with sufficient quantity and spending capacity to make it worth while.

And then, they need to think of this idea, convince management, executive, board, shareholder, and lobbyist levels that it's a good idea and not too risky.

*And then* they need to successfully execute the project to bring it to market.

All in all, an outfit provisioning AI as a service needs fat stacks of (potentially funny) money, the knowledge and guts to pull it off, and, to have thought of the idea in the first place. And convinced the money guys that it should be done.

I have always believed that for the insane customer soaking that ISP's do, a little of that Fort Knox could go to quality content creators. Devil's in the details, of course.

The idea is to let customers choose which content creators they want to reward, and not have to set up 100 potentially hackable accounts with small creators without payment processing.

User gets to choose, from a vast array of creators, not just inane "bundles" and from excess ISP profits.

Unlike the internet for decades, quality gets a chance versus quantity.

Mom and Pop thank you.