Jump to content
Clément

Zip Compression library

Recommended Posts

I'd still go with compressionmode 1 and 25sec instead of 18% better compression and almost twice the time.

HDD is cheap, time isn't.

Edited by Attila Kovacs

Share this post


Link to post
10 minutes ago, Clément said:

I downloaded the personal version an yet... the same results...

What happens if you set the CompressionMode to 5?

 

If it's still the same size, can you test with the file from http://mattmahoney.net/dc/textdata.html

In that case we are talking about the same file.

It could be that your file is extra compressible by the way Windows does it.

 

And if it still does not compare, you might want to post some code.

 

Share this post


Link to post

I did some more digging....

Results.thumb.jpg.d962da1901091ae2a0fdd2500d78aca2.jpg

 

I built this test using a single file, then combining files 3&4 and then 3&4&5. I'm using zipForge clNormal compression, that's why the size from 3&4&5 from this test is bigger than the previous one (using clMax).

As you can see, zipForge beats windows in every challenge. zipforge huge 3 has 182MB against windows 187MB . The same goes for the other 2.

If we add zip forges 3 single files add up to 320MB...

if we add Windows zip 3 single files, they also add up to 320MB ...

 

My best guess is that windows zip uses all 3 files combined to achieve a better compression result.
 

Share this post


Link to post
3 minutes ago, Clément said:

My best guess is that windows zip uses all 3 files combined to achieve a better compression result.

Yes, That's what I expected.

I'm not sure if you can tinker with the buffer settings of TZipForge to achieve the same result.

(maybe the bigger the buffer, the faster it sees there is some repetition.)

 

Did you also test CompressionMode 5? (CompressionMode <> CompressionLevel).

 

BTW. Just a stupid question... but did you unzip your Windows-zip to see if the result is correct :classic_happy:

Share this post


Link to post
14 minutes ago, rvk said:

Did you also test CompressionMode 5? (CompressionMode <> CompressionLevel).

Results_mode5.thumb.jpg.2789f2b2b74868369f7bfdaa082784b7.jpg

 

Huge 5_mode 5 is faster 15s.
Huge 5 (normal) zipped in 19s.

 

Windows10zip files uncompresses fine using windows in anyway ( explorer and extracting one file, or using menu ).
I can decompress Windows10 zip with WinRAR 6.11 and Peazip 8.1.0.

 

So windows is using some archiving method other applications can uncompress, including zipForge. I just uncompressed windows10zip file using zipforge and it worked as expected. There's must a be way to combine the files to compress even more.

 

Anyway, it's good know windows is going this far! Hopefully there are some tweaking we can do to achieve the same results

 

Edited by Clément

Share this post


Link to post
23 minutes ago, Clément said:

My best guess is that windows zip uses all 3 files combined to achieve a better compression result.

Wouldn't it be simpler just to use ShellAPI and Windows to zip?

Share this post


Link to post
2 minutes ago, FredS said:

Wouldn't it be simpler just to use ShellAPI and Windows to zip?

My ending product will be a Window Service available in both 32 and 64 bits. My next step is looking for some library or a way to use windows zip in my application. And of course, combine files carefully to achieve best compression. But I'm still digging... :classic_cheerleader:

Share this post


Link to post
5 hours ago, Angus Robertson said:

but then we are into DLL hell

That's trivial to deal with these days by putting all dependent DLLs into an assembly that sits alongside your executable.

Share this post


Link to post
39 minutes ago, FredS said:

Wouldn't it be simpler just to use ShellAPI and Windows to zip?

Very likely this would give a bad UX

Share this post


Link to post
36 minutes ago, Clément said:

My ending product will be a Window Service available in both 32 and 64 bits.

Is 32 bit OS still a thing these days? We are about to drop support for it and probably should have done so some time ago.

Share this post


Link to post

The PPMd compression method does well with text files and is available in newer versions of Winzip and other archivers like 7zip. 

Share this post


Link to post
2 hours ago, Alexander Sviridenkov said:

You can register own ZCompression stream implementation based on libdeflate, it will be much faster than default implementation.

Would you please elaborate?

Share this post


Link to post

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×