Compress to Smallest Possible Size

Question

Hey HN,I am on a mission to try and compress a 50 GB file into the smallest possible size.My best idea so far is to use zstd with --ultra -22 flag.Do you have any better suggestion?Update, creating my own dictionary might improve the compression rate.

IcePic · Accepted Answer

Might be worth looking at a few of the better ones from this list:http://mattmahoney.net/dc/text.htmlSome 200 programs tested against a large set of wikipedia data.

powturbo · Answer

Try a bwt compressor like BwtSatan : https://github.com/powturbo/Turbo-Range-Coder/releases/tag/2...bwtsatan -20 inputfile outputfile

PaulHoule · Answer

what kind of file?

Compress to Smallest Possible Size

Hey HN,
I am on a mission to try and compress a 50 GB file into the smallest possible size.
My best idea so far is to use zstd with --ultra -22 flag.
Do you have any better suggestion?
Update, creating my own dictionary might improve the compression rate.

Might be worth looking at a few of the better ones from this list:
http://mattmahoney.net/dc/text.html
Some 200 programs tested against a large set of wikipedia data.

Try a bwt compressor like BwtSatan : https://github.com/powturbo/Turbo-Range-Coder/releases/tag/2...
bwtsatan -20 inputfile outputfile

what kind of file?