Google Releases New Compression Algorithm


Recommended Posts

  Quote
The Zopfli Compression Algorithm is a new open sourced general purpose data compression library that got its name from a Swiss bread recipe. It is an implementation of the Deflate compression algorithm that creates a smaller output size compared to previous techniques. The smaller compressed size allows for better space utilization, faster data transmission, and lower web page load latencies. Furthermore, the smaller compressed size has additional benefits in mobile use, such as lower data transfer fees and reduced battery use. The higher data density is achieved by using more exhaustive compression techniques, which make the compression a lot slower, but do not affect the decompression speed. The exhaustive method is based on iterating entropy modeling and a shortest path search algorithm to find a low bit cost path through the graph of all possible deflate representations.

The output generated by Zopfli is typically 3?8% smaller (PDF warning) compared to zlib at maximum compression, and we believe that Zopfli represents the state of the art in Deflate-compatible compression. Zopfli is written in C for portability. It is a compression-only library; existing software can decompress the data. Zopfli is bit-stream compatible with compression used in gzip, Zip, PNG, HTTP requests, and others.

Due to the amount of CPU time required --- 2 to 3 orders of magnitude more than zlib at maximum quality ? Zopfli is best suited for applications where data is compressed once and sent over a network many times, for example, static content for the web. By open sourcing Zopfli, thus allowing webmasters to better optimize the size of frequently accessed static content, we hope to make the Internet a bit faster for all of us.

Source: http://googledevelopers.blogspot.com/2013/02/compress-data-more-densely-with-zopfli.html
  UXGaurav said:
Wonder how it does against LZMA and LZMA2 considering both reasonable speed and compression ratio.
This is about DEFLATE-compatible compressions, so LZMA/LZMA2 don't enter into the picture.

But yes, LZMA/LZMA2 traditionally has superior compression ratio. Too bad that still not used in HTTP transfer-encoding.

I read the PDF. It's decent, but has a very specific use case. That is: One-time compression and multiple decompressions for static data (they do acknowledge this). Compressing files using this algo is epic slow compared to gzip for the same file (talking 5 seconds for gzip compared to 7 minutes for the same file using Zopfli). It'll be very good for conserving bandwidth on, say, file distribution sites though where CPU time is inconsequential compared to bandwidth requirements.

This topic is now closed to further replies.
  • Recently Browsing   0 members

    • No registered users viewing this page.
  • Posts

    • Microsoft lets you have extra year of Windows 10 updates for free by Taras Buria The end of Windows 10 support is quickly approaching, which means users are facing a tough choice: leave Windows 10 behind and update to Windows 11 or stay and either accept the risk of using unsupported software or enroll in the extended security update program. If you plan to go with the latter option, Microsoft has some important details and good news for you. Microsoft finally announced program enrollment details for Windows 10 users. Starting today, Windows 10 Insiders can access a new enrollment wizard through the Settings app and push notifications to set up their systems for the Extended Security Update program (ESU). More importantly, Microsoft is introducing free enrollment options, allowing Windows 10 users to remain supported for one more year without paying Microsoft a single dollar. Now, you can get 12 more months of security updates using one of the following three options: Use the Windows Backup app to sync your settings to the cloud Pay 1,000 Microsoft Rewards points Pay $30 (local prices may vary) This is the first time that Microsoft has made the Extended Security Update program available for consumers. Previously, this program was reserved for commercial customers only. However, four years after the release of Windows 11, Windows 10 remains the dominant desktop operating system. At this scope, Microsoft cannot just drop hundreds of millions of users behind. Microsoft's initial plan was to give customers 12 months of extra updates for $30, but now, the company is seemingly giving up on that. While the $30 option is still available, the program is pretty much free for every consumer, which addresses some of the concerns I expressed earlier. 1,000 Microsoft Reward points is a pretty small price to pay, and the Windows Backup option is entirely free. With these two new options, Microsoft makes security updates more accessible to users (governments are already warning users about the end of Windows 10 support), giving them more time to plan their migration to Windows 11 without sending their computers to the landfill and generating thousands of tons of e-waste. The enrollment wizard is now available to Windows 10 Insiders. Next month, it will be available outside the Insider program as part of the July non-security updates. Broad availability is expected by mid-August. Commercial organizations can also enroll their devices today using the Microsoft Volume Licensing Program. The price is $61 per device for one year. For Windows 365, these Cloud PCs are eligible for extended security updates at no extra cost. It is worth noting that the program only grants one year of security updates, from October 15, 2025, to October 13, 2026. However, those who need more support can opt for third-party solutions like 0patch, which promises five more years of security updates. The end of mainstream Windows 10 support means that the company will stop providing technical support and feature/security updates outside the ESU program. As such, many developers will start dropping Windows 10 support in their products, reduce available functionality, and more. However, Windows 10 PCs will not stop working overnight. Moreover, some of Microsoft-made services will continue receiving support. Those include Microsoft 365 and Microsoft Defender updates. Microsoft 365 apps will be getting new features until August 2026 and security updates until October 10, 2028. For many users, the biggest problem with Windows 11 is not its controversial taskbar or Start menu (which is getting a big redesign, mind you). Steeper hardware requirements prevent many users from updating their still-capable computers to a supported release. To mitigate this, Microsoft is willing to offer free security updates for one year instead of lowering Windows 11's hardware requirements. Several months ago, Microsoft doubled down on those and stressed that Windows 11's minimum hardware requirements would not be lowered.
    • When the rich steal, it's business, when the poor steal, it's a crime. Typical systematic injustice in the US. From broad daylight corruption being legal (a.k.a. lobbying), to deporting "illegal immigrants" from a land that was stolen to begin with. Alas, can't ever expect true justice from a land built from the ground up with injustice...
    • A little older than that really since it was originally Keyhole from 2001.
    • A lifetime subscription to AI MagicX (Rune Plan) drops to lowest price by Steven Parker Today's highlighted deal comes via our Apps + Software section of the Neowin Deals store, where for only a limited time, you can save 93% on a lifetime subscription to AI MagicX (Rune Plan). Transform Your Vision with AI-Driven Creativity AI MagicX is your ultimate creative companion, offering a suite of AI-powered tools designed to elevate your content creation process. From generating unique logos to crafting stunning art, AI MagicX empowers you to bring your ideas to life effortlessly. Enhance user engagement with our smart AI Chatbots, generate compelling articles with our AI Article Generator, and create captivating stories with our AI Story Generator. Streamline your document editing with the AI MagicX Editor. Perfect for entrepreneurs and small business owners, AI MagicX provides customizable solutions that leverage cutting-edge AI technology to make your creative process seamless and efficient. Special AI-powered features for your services AI Logo Designer Craft unique brand identities effortlessly Generate personalized logos instantly, avoiding generic stock logos MagicX Art Generator Turn simple descriptions into breathtaking visuals No artistic skills needed to create stunning art AI Chatbots Boost user interaction and engagement Experience the power of our smart chatbots for free AI Article Generator Create high-quality articles in minutes Generate well-researched and engaging content effortlessly AI Story Generator Develop captivating stories with ease Transform your ideas into compelling narratives quickly Document Editor Enhance your document editing process Increase productivity, creativity, and efficiency with the AI Magicx Editor What is AI MagicX? AI Magicx is a comprehensive platform offering advanced AI tools for content creation. Whether you need a unique logo, captivating art, engaging articles, or interactive chatbots, AI Magicx has you covered. How AI MagicX works Start using AI MagicX to automatically enhance your creative process. Our tools are designed to be intuitive and user-friendly, making content creation simple. AI Magicx leverages advanced AI technology to deliver high-quality results quickly and efficiently. What's included in the Rune Plan per month? Unlimited MagicX words 250 MagicX Images 250 MagicX Logos Private Generations Commercial license 100 Premium Chatbots Messages Good to know Length of access: lifetime Redemption deadline: redeem your code within 30 days of purchase Access options: desktop or mobile Max number of device(s): 999 Version: 3+ Updates included A lifetime subscription to AI MagicX (Rune Plan) normally costs $972, but you can pick it up for just $59.97 for a limited time - that represents a saving of $912. For a full description, specs, and license info, click the link below. There are two other discounted plans available. Get this lifetime deal for just $59.97, or learn more Although priced in U.S. dollars, this deal is available for digital purchase worldwide. We post these because we earn commission on each sale so as not to rely solely on advertising, which many of our readers block. It all helps toward paying staff reporters, servers and hosting costs. Other ways to support Neowin Whitelist Neowin by not blocking our ads Create a free member account to see fewer ads Make a donation to support our day to day running costs Subscribe to Neowin - for $14 a year, or $28 a year for an ad-free experience Disclosure: Neowin benefits from revenue of each sale made through our branded deals site powered by StackCommerce.
    • AI can read everything it wants. It cannot comprehend like a human. Everyone is being sold a steaming pile of lies.
  • Recent Achievements

    • Week One Done
      DrRonSr earned a badge
      Week One Done
    • Week One Done
      Sharon dixon earned a badge
      Week One Done
    • Dedicated
      Parallax Abstraction earned a badge
      Dedicated
    • First Post
      956400 earned a badge
      First Post
    • Week One Done
      davidfegan earned a badge
      Week One Done
  • Popular Contributors

    1. 1
      +primortal
      604
    2. 2
      ATLien_0
      226
    3. 3
      Michael Scrip
      169
    4. 4
      +FloatingFatMan
      154
    5. 5
      Som
      136
  • Tell a friend

    Love Neowin? Tell a friend!