Has Apple Silicon's unified memory benefited your workload?

Question

One distinct advantage of Apple Silicon is that you can get up to 96GB of of high bandwidth (400GB/s) for an M2 Max and up to 192GB (800GB/s) for an M2 Ultra.Has anyone's workload greatly benefited from this architecture?I'm thinking AI inference for models where memory size matters more than compute?

Zetobal · Accepted Answer

With 2 8GB M1s with failing ssds I can tell you that no matter the speed boost it wears out your ssds. swap swap swap.

zeristor · Answer

Would it be 200Gb/s for a MacBook Air M2? Asking for a friend.