HACKER Q&A
📣 behnamoh

How to create llama.cpp LAN server on a Mac Studio?


I know how to use llama.cpp and run local servers in terminal, but I want to be able to send API requests from other machines on the network (or even out of network if it's possible). This Mac Studio is located in my company office and I should use the company VPN to connect to it (I can SSH or do Screen Sharing).


  👤 sequoiar68 Accepted Answer ✓
try to setup peer-proxy to expose local web service https://github.com/InstantWebP2P/peer-proxy