166 pointsby kekqqq21 hours ago13 comments
  • arjie19 hours ago
    The fact that ZIP files include the catalog/directory at the end is such nostalgia fever. Back in the day it meant that if you naïvely downloaded the file, a partial download would be totally useless. Fortunately, in the early 2000s, we got HTTP's Range and a bunch of zip-aware downloaders that would fetch the catalog first so that you could preview a zip you were downloading and even extract part of a file! Good times. Well, not as good as now, but amusing to think of today.
    • st_goliath17 hours ago
      > ... a partial download would be totally useless ...

      no, not totally. The directory at the end of the archive points backwards to local headers, which in turn include all the necessary information, e.g. the compressed size inside the archive, compression method, the filename and even a checksum.

      If the archive isn't some recursive/polyglot nonsense as in the article, it's essentially just a tightly packed list of compressed blobs, each with a neat, local header in front (that even includes a magic number!), the directory at the end is really just for quick access.

      If your extraction program supports it (or you are sufficiently motivated to cobble together a small C program with zlib....), you can salvage what you have by linearly scanning and extracting the archive, somewhat like a fancy tarball.

      • nwallin16 hours ago
        At work, our daily build (actually 4x per day) is a handful of zip files totaling some 7GB. The script to get the build would copy the archives over the network, then decompress then into your install directory.

        This works great on campus, but when everyone went remote during COVID it wasn't anymore. It went from three minutes to like twenty minutes.

        However. Most files change only rarely. I don't need all the files, just the ones which are different. So I wrote a scanner thing which compares the zip file's filesize and checksum to the checksum of the local file. If they're the same, we skip it, otherwise, we decompress out of the zip file. This cut the time to get the daily build from 20 minutes to 4 minutes.

        Obviously this isn't resilient to an attacker, crc32 is not secure, but as an internal tool it's awesome.

        • btilly15 hours ago
          How would this have compared to using rsync?
          • necovek12 hours ago
            Not as much geek cred for using an off the shelf solution? ;)
      • tonyedgecombe12 hours ago
        XPS (Microsoft's alternative to PDF) supported this. XPS files were ZIP files under the hood and were handled directly by some printers. The problem was the printer never had enough memory to hold a large file so you had to structure the document in a way it could be read a page at a time from the start.
      • brabel9 hours ago
        > the directory at the end is really just for quick access.

        No, its purpose was to allow multi floppy disks archives. You would insert the last disk, then the other ones, one by one…

        • st_goliath7 hours ago
          That literally is quick access, it does the same thing in both cases, trying to get rid of the linear scan and having to plow through data unnecessarily.

          If the archive is on a hard disk, the program reads the directory at the end and then seeks to the local header, rather than doing a linear scan. Or the floppy motor, if it is a small archive on a single floppy.

          If you have multiple floppies, you insert the last one, the program reads the header and then tells you what floppy to insert, rather than having to go through them one by one, which you know, would be slower.

          In one case, a hard disk arm, or the floppy motor, does the seeking, in the other case, your hands do the seeking. But it's still the same algorithm, doing the same thing, for the same reason.

    • Karliss17 hours ago
      Partial zip shouldn't be totally useless and a good unzip tool should be able to repair such partial downloads. In addition to catalog at end zip also have local headers before each file entry. So unless you are dealing with maliciously crafted zip file or zip file combined with something else, parsing it from start should produce identical result. Some zip parsers even default to sequential parsing behavior.

      This redundant information has lead to multiple vulnerabilities over the years. As having redundant information means that a maliciously crafted zip file with conflicting headers can have 2 different interpretations when processed by 2 different parsers.

    • EvanAnderson16 hours ago
      Partial downloads weren't useless, though, as other commenters have said.

      The PKZIP tools came with PKZIPFIX.EXE, which would scan the file from the beginning and rebuild a missing central archive. You could extract any files up to the truncated file where your download stopped.

    • halapro15 hours ago
      I hate that the most common video container on the web does this too. Most non-"stream-ready" mp4 files lack even the basic information such as height/width until the file has completed loading.[1]

        [1]: https://forum.videohelp.com/threads/393096-Fixing-Partially-Download-MP4-Files
    • cat_plus_plus17 hours ago
      Well what do you want it to do, it doesn't know full directory with offsets until it's done compressing and dispersed directory would have lousy access pattern for quick listing. And you know, if you are compressing you probably want the smallest file so duplicate directories are not idea.
  • danudey20 hours ago
    Debian's `unzip` utility, which is based off of Info-ZIP but with a number of patches, errors out on overlapping files, though not before making a 21 MB file named `0` - presumably the only non-overlapping file.

        unzip zbsm.zip
        Archive:  zbsm.zip
          inflating: 0
        error: invalid zip file with overlapped components (possible zip bomb)
    
    This seems to have been done in a patch to address https://nvd.nist.gov/vuln/detail/cve-2019-13232

    https://sources.debian.org/patches/unzip/6.0-29/23-cve-2019-...

    • layer818 hours ago
      Yep, these kinds of format shenanigans are increasingly rejected for security reasons. Not zip bombs specifically, but to prevent parser mismatch vulnerabilities (i.e. two parser implementations decompressing the same zip file to different contents, without reporting an error).
    • Retr0id13 hours ago
      I think these mitigations are misguided and I've had false-positives at least once. Rather than caring about structural details (overlapping files etc.), decompressors should just limit the overall decompression ratio by default (bytes in vs bytes out). It shouldn't matter how the ratio is achieved.
  • RGamma4 hours ago
    From the bottom of the page

    > A final plea

    It's time to put an end to Facebook. Working there is not ethically neutral: every day that you go into work, you are doing something wrong. If you have a Facebook account, delete it. If you work at Facebook, quit.

    And let us not forget that the National Security Agency must be destroyed.

  • Twirrim19 hours ago
    Previously discussed in 2019, https://news.ycombinator.com/item?id=20352439

    Someone shared a link to that site in a conversation earlier this year on HN. For a long time now, I've had a gzip bomb sitting on my server that I provide to people that make a certain categories of malicious calls, such as attempts to log in to wordpress, on a site not using wordpress. That post got me thinking about alternative types of bombs, particularly as newer compression standards have become ubiquitous, and supported in browsers and http clients.

    I spent some time experimenting with brotli as a compression bomb to serve to malicious actors: https://paulgraydon.co.uk/posts/2025-07-28-compression-bomb/

    Unfortunately, as best as I can see, malicious actors are all using clients that only accept gzip, rather than brotli'd contents, and I'm the only one to have ever triggered the bomb when I was doing the initial setup!

  • est18 hours ago
    I wonder if there's any reverse zip-bombs? e.g. A realy big .zip file, takes long time to unzip, but get only few bytes of content.

    Like bomb the CPU time instead of memory.

    • nwallin16 hours ago
      Trivially. Zip file headers specify where the data is. All other bytes are ignored.

      That's how self extraction archives and installers work and are also valid zip files. The extractor part is just a regular executable that is a zip decompresser that decompresses itself.

      This is specific to zip files, not the deflate algorithm.

      • Retr0id13 hours ago
        There are also deflate-specific tricks you can use - just spam empty non-final blocks ad infinitum.

            import zlib
            zlib.decompress(b"\x00\x00\x00\xff\xff" * 1000 + b"\x03\x00", wbits=-15)
        
        If you want to spin more CPU, you'd probably want to define random huffman trees and then never use them.
        • Retr0id11 hours ago
          I had claude implement the random-huffman-trees strategy and it works alright (~20MB/s decompression speed), but a minimal huffman tree that only encodes the end symbol works out even slower (~10MB/s), presumably because each tree is more compact.

          The minimal version boils down to:

              bytes.fromhex("04c001090000008020ffaf96") * 1000000 + b"\x03\x00"
      • ks204816 hours ago
        That would be a big zip file, but would not take a long time to unzip.
    • zipping154917 hours ago
      Isn't that mathematically impossible?
      • hayley-patton10 hours ago
        I'm pretty sure it's mathematically guaranteed that you have to be bad at compressing something. You can't compress data to less than its entropy, so compressing totally random bytes (where entropy = size) would have a high probability of not compressing at all, if no identifiable patterns appear in the data by sheer coincidence. Establishing then that you have incompressible data, the least bad option would be to signal to the decompressor to reproduce the data verbatim, without any compression. The compressor would increase the size of the data by including that signal somehow. Therefore there is always some input for a compressor that causes it to produce a larger output, even by some miniscule amount.
      • hdjrudni17 hours ago
        Why's that? I'm not really sure how DEFLATE works but I can imagine a crappy compression that's like "5 0" means "00000". So if you try to compress "0" you get "1 0" which is longer than the input. In fact, I bet this is true for any well-compressed format. Like zipping a JpegXL image will probably yield something larger. Much larger.. I don't know how you do that.
  • kleiba20 hours ago
    In one of my previous jobs, I got laid off in the most condescending way, only to be asked days later by my former boss to send her some documents. If only I knew about this then...
    • Computer020 hours ago
      You have bigger enemies more worthy of that personal risk. This comment bewilders me a bit.
    • colechristensen20 hours ago
      Don't commit felonies because you're unhappy with your former employer.
      • lossyalgo19 hours ago
        Is it a felony to crash someone's computer?
        • dpifke18 hours ago
          If it causes more than $5k in damage. Otherwise, it's a misdemeanor.

          But you probably don't want to be investigated for either.

          • colechristensen14 hours ago
            A deliberate act of revenge against a former employer... wouldn't be given much benefit of the doubt by the courts.
        • jclarkcom12 hours ago
          Would it even crash a computer? They would fill up their hard drive but that would just yield warnings to the user in most operating systems. Chances are they would kill it manually because it would take a long time
        • fragmede19 hours ago
          Violations of the Computer Fraud and Abuse Act (CFAA) can be either misdemeanors or felonies. It's definitely broad enough that doing so could get you in serious trouble if pursued.
        • colechristensen19 hours ago
          Possibly, yes.
        • drob51819 hours ago
          If done deliberately…
      • tjpnz12 hours ago
        Nothing wrong with getting some satisfaction. Just don't do it in a way that can be traced back to you.
  • 54245820 hours ago
    Okay, so I know back in the day you could choke scanning software (ie email attachment scanners) by throwing a zip bomb into them. I believe the software has gotten smarter these days so it won’t simply crash when that happens - but how is this done; How does one detect a zip bomb?
    • danudey20 hours ago
      I don't understand the code itself, but here's Debian's patch to detect overlapping zip bombs in `unzip`:

      https://sources.debian.org/patches/unzip/6.0-29/23-cve-2019-...

          The detection maintains a list of covered spans of the zip files
          so far, where the central directory to the end of the file and any
          bytes preceding the first entry at zip file offset zero are
          considered covered initially. Then as each entry is decompressed
          or tested, it is considered covered. When a new entry is about to
          be processed, its initial offset is checked to see if it is
          contained by a covered span. If so, the zip file is rejected as
          invalid.
      
      So effectively it seems as though it just keeps track of which parts of the zip file have already been 'used', and if a new entry in the zip file starts in a 'used' section then it fails.
      • necovek12 hours ago
        I wonder if this has actually been used for backing up in real use cases (think how LVM or ZFS do snapshotting)?

        I.e. an advanced compressor could abuse the zip file format to share base data for files which only incrementally change (get appended to, for instance).

        And then this patch would disallow such practice.

    • 10000truths19 hours ago
      For any compression algorithm in general, you keep track of A = {uncompressed bytes processed} and B = {compressed bytes processed} while decompressing, and bail out when either of the following occur:

      1. A exceeds some unreasonable threshold

      2. A/B exceeds some unreasonable threshold

      • integralid9 hours ago
        In practice one of the things that happens very often is that you compress a file filled with null bytes. Such files compress extremely well, and would trigger your A/B threshold.

        On the other hand, zip bomb described in this blog post relies on decompressing the same data multiple times - so it wouldn't trigger your A/B heuristics necessarily.

        Finally, A just means "you can't compress more than X bytes with my file format", right? Not a desirable property to have. If deflate authors had this idea when they designed the algorithm, I bet files larger than "unreasonable" 16MB would be forbidden.

        • 10000truths7 hours ago
          > In practice one of the things that happens very often is that you compress a file filled with null bytes. Such files compress extremely well, and would trigger your A/B threshold.

          Sure, if you expect to decompress files with high compression ratios, then you'll want to adjust your knobs accordingly.

          > On the other hand, zip bomb described in this blog post relies on decompressing the same data multiple times - so it wouldn't trigger your A/B heuristics necessarily.

          If you decompress the same data multiple times, then you increment A multiple times. The accounting still works regardless of whether the data is same or different. Perhaps a better description of A and B in my post would be {number of decompressed bytes written} and {number of compressed bytes read}, respectively.

          > Finally, A just means "you can't compress more than X bytes with my file format", right? Not a desirable property to have. If deflate authors had this idea when they designed the algorithm, I bet files larger than "unreasonable" 16MB would be forbidden.

          The limitation is imposed by the application, not by the codec itself. The application doing the decompression is supposed to process the input incrementally (in the case of DEFLATE, reading one block at a time and inflating it), updating A and B on each iteration, and aborting if a threshold is violated.

      • nrhrjrjrjtntbt18 hours ago
        Embarrsingly simple for a scanner too as you just mark as suspicious when this happens. You can be wrong sometimes and this is expected
  • dang14 hours ago
    Related. Others?

    A better zip bomb [WOOT '19 Paper] [pdf] - https://news.ycombinator.com/item?id=20685588 - Aug 2019 (2 comments)

    A better zip bomb - https://news.ycombinator.com/item?id=20352439 - July 2019 (131 comments)

  • measurablefunc19 hours ago
    Decompression is equivalent to executing code for a specialized virtual machine. It should be possible to automate this process of finding "small" programs that generate "large" outputs. Could even be an interesting AI benchmark.
    • shakna11 hours ago
      Many of them already do this. [0]

      It is a much easier problem to solve than you would expect. No need to drag in a data centre when heuristics can get you close enough.

      [0] https://sources.debian.org/patches/unzip/6.0-29/23-cve-2019-...

    • bikeshaving19 hours ago
      My guess is this is a subset of the halting problem (does this program accept data with non-halting decompression), and is therefore beautifully undecidable. You are free to leave zip/tgz/whatever fork bombs as little mines for live-off-the-land advanced persistent threats in your filesystems.
      • machinationu19 hours ago
        it's not. decompression always ends since it progresses through the stream always moving forward. but it might take a while
  • cuechan20 hours ago
    Is it possible to implement something similar but with a protocol that supports compression? Can we have a zip bomb but with a compressed http response that gets decompressed on the client? There are many protocols that support compression in some way.
  • KingLancelotan hour ago
    [dead]
  • chupasaurus20 hours ago
    (2019) with last update in 2023.
    • dang14 hours ago
      Added. Thanks!
  • gazabbqparty4 hours ago
    [flagged]