Jump to content



Photo

Google Releases New Compression Algorithm


  • Please log in to reply
6 replies to this topic

#1 tiagosilva29

tiagosilva29

    Looking for a job in Lisbon

  • 12,231 posts
  • Joined: 08-May 04

Posted 02 March 2013 - 12:38

The Zopfli Compression Algorithm is a new open sourced general purpose data compression library that got its name from a Swiss bread recipe. It is an implementation of the Deflate compression algorithm that creates a smaller output size compared to previous techniques. The smaller compressed size allows for better space utilization, faster data transmission, and lower web page load latencies. Furthermore, the smaller compressed size has additional benefits in mobile use, such as lower data transfer fees and reduced battery use. The higher data density is achieved by using more exhaustive compression techniques, which make the compression a lot slower, but do not affect the decompression speed. The exhaustive method is based on iterating entropy modeling and a shortest path search algorithm to find a low bit cost path through the graph of all possible deflate representations.

The output generated by Zopfli is typically 3–8% smaller (PDF warning) compared to zlib at maximum compression, and we believe that Zopfli represents the state of the art in Deflate-compatible compression. Zopfli is written in C for portability. It is a compression-only library; existing software can decompress the data. Zopfli is bit-stream compatible with compression used in gzip, Zip, PNG, HTTP requests, and others.

Due to the amount of CPU time required --- 2 to 3 orders of magnitude more than zlib at maximum quality — Zopfli is best suited for applications where data is compressed once and sent over a network many times, for example, static content for the web. By open sourcing Zopfli, thus allowing webmasters to better optimize the size of frequently accessed static content, we hope to make the Internet a bit faster for all of us.

Source: http://googledevelop...ith-zopfli.html


#2 UXGaurav

UXGaurav

    Tried Classic Shell? It has 15 million+ downloads & growing

  • 3,972 posts
  • Joined: 18-October 05
  • Location: Windows
  • OS: Windows

Posted 02 March 2013 - 12:51

Interesting. Wonder how it does against LZMA and LZMA2 considering both reasonable speed and compression ratio.

#3 Torolol

Torolol

  • 3,097 posts
  • Joined: 24-November 12

Posted 02 March 2013 - 13:06

Zopfli is bit-stream compatible with compression used in gzip, Zip, PNG, HTTP requests, and others.

i wonder how it goes against stuff like KZIP & PNGOUT ?
http://advsys.net/ken/utils.htm

#4 OP tiagosilva29

tiagosilva29

    Looking for a job in Lisbon

  • 12,231 posts
  • Joined: 08-May 04

Posted 02 March 2013 - 13:12

Wonder how it does against LZMA and LZMA2 considering both reasonable speed and compression ratio.

This is about DEFLATE-compatible compressions, so LZMA/LZMA2 don't enter into the picture.

Spoiler


#5 +Majesticmerc

Majesticmerc

    Resident Idealist

  • 6,198 posts
  • Joined: 24-August 05
  • Location: United Kingdom
  • OS: Arch Linux / Win 7
  • Phone: HTC One X

Posted 02 March 2013 - 13:27

I read the PDF. It's decent, but has a very specific use case. That is: One-time compression and multiple decompressions for static data (they do acknowledge this). Compressing files using this algo is epic slow compared to gzip for the same file (talking 5 seconds for gzip compared to 7 minutes for the same file using Zopfli). It'll be very good for conserving bandwidth on, say, file distribution sites though where CPU time is inconsequential compared to bandwidth requirements.

#6 Growled

Growled

    Neowinian Senior

  • 41,508 posts
  • Joined: 17-December 08
  • Location: USA

Posted 03 March 2013 - 03:15

Some good stuff coming out of Google labs these days.

#7 Hum

Hum

    totally wAcKed

  • 63,247 posts
  • Joined: 05-October 03
  • Location: Odder Space
  • OS: Windows XP, 7

Posted 03 March 2013 - 15:55

^ Maybe Microsoft can steal it. :p