Storing LLM models on external SSD: Is the SSD speed important?

Question

For example:Samsung T7 w/ USB 3.2 (read: 1050MB/s) vs. Fantom w/ Thunderbolt 3/4 (read: 2800MB/s)

speedgoose · Accepted Answer

Yes that will improve the loading speed. But the additional cost is perhaps not worth the time saved, unless you switch models all the time and don&rsquo;t have a lot of free ram to use as cache.

Storing LLM models on external SSD: Is the SSD speed important?

For example:
Samsung T7 w/ USB 3.2 (read: 1050MB/s) vs. Fantom w/ Thunderbolt 3/4 (read: 2800MB/s)

Yes that will improve the loading speed. But the additional cost is perhaps not worth the time saved, unless you switch models all the time and don’t have a lot of free ram to use as cache.