Largest file you have ever seen (in size)?


Recommended Posts

Hey

Whats the largest file (size) you have ever encountered?

As a reminder, the following are the max sizes a file can be on some common (and not so common) file systems:

Tape for the Elektronika BK: 64 kB

FAT32: 4 GB

ext3: 2 TB

ext4: 16 TB

exFAT: 127 PB

HFS Plus: 8 EB

NTFS: 16 EB

GPFS: 512 YB

Could just generate a txt file with the same characters over and over in it to fill the largest size and then claim to be the victor of this question. Funny part is it would compress down to like 100k zipped since it's a repeating character and header info.

  On 19/10/2012 at 14:04, xendrome said:

Could just generate a txt file with the same characters over and over in it to fill the largest size and then claim to be the victor of this question. Funny part is it would compress down to like 100k zipped since it's a repeating character and header info.

  On 19/10/2012 at 14:06, Buttus said:

or make a gigantic virtualbox system file...

If you want to go ahead and waste your time to just post on this thread, go ahead.

Thing is, I doubt you have enough space, drives and/or need for 512 YB.....

I've dealt with some text files that are several hundred GB in size. They're mostly collections used for research.

I'm currently working with a 800GB text file containing nothing but Tweets. My biggest probably is actually just finding somewhere to store all the data. I doubt many people have dealt with files > 3TB simply because the storage is difficult (unless you're using tapes etc.).

  On 19/10/2012 at 14:12, Pong said:

I've dealt with some text files that are several hundred GB in size. They're mostly collections used for research.

I'm currently working with a 800GB text file containing nothing but Tweets. My biggest probably is actually just finding somewhere to store all the data. I doubt many people have dealt with files > 3TB simply because the storage is difficult (unless you're using tapes etc.).

Are these just tweets for tweets with information (Person who sent it, ID of tweet, time, etc)?

Just curious :)

  On 19/10/2012 at 14:04, xendrome said:

Could just generate a txt file with the same characters over and over in it to fill the largest size and then claim to be the victor of this question. Funny part is it would compress down to like 100k zipped since it's a repeating character and header info.

  On 19/10/2012 at 14:06, Buttus said:

or make a gigantic virtualbox system file...

Why do you guys have to make things so difficult?

"cat /dev/urandom > blob"

At least I would call it blob...

  On 19/10/2012 at 14:42, pes2013 said:

Are these just tweets for tweets with information (Person who sent it, ID of tweet, time, etc)?

Just curious :)

Basically, yes. I have access to the Twitter gardenhose, which spits out roughly 10% of all Tweets as they are posted.

This page lists all the details which are included with the ~34M Tweets I get to analyse every day:

https://dev.twitter.com/docs/platform-objects/tweets

  On 21/10/2012 at 12:49, pes2013 said:

I did not understand a word you said....

He's probably talking about the 42 kb zip file. I have it on my machine actually, as I'd like to test it out one day. Details:

One example of a Zip bomb is the file 42.zip which is a zip file consisting of 42 kilobytes of compressed data, containing five layers of nested zip files in sets of 16, each bottom layer archive containing a 4.3 gigabyte (4 294 967 295 bytes; ~ 3.99 GiB) file for a total of 4.5 petabytes (4 503 599 626 321 920 bytes; ~ 3.99 PiB) of uncompressed data.

Can read more about it here: http://en.wikipedia.org/wiki/Zip_bomb

  • Eric locked this topic
This topic is now closed to further replies.
  • Recently Browsing   0 members

    • No registered users viewing this page.
  • Posts

    • It funny how in a few short years Intel has become the budget brand. I just had to do an unexpected platform swap on my main system due to memory stability issues that suddenly developed. I went with a 9800X3D, but seeing these prices making me regret not at least considering this direction. I really don't need top-tier performance, and between a cheaper CPU and cheaper board, the Intel option looks like it would have been $300-400 cheaper. I already have a 360 AIO, so the extra heat wouldn't have been a big deal. Oh well, live and learn. I normally am the kind of person that will consider something like this for weeks, but I needed to move quickly and my decision point was "9800X3D is a fantastic chip, and Ultra-200 is basically a joke" which is true, but what I didn't consider is a CPU like this 265K is still worlds head of my 5800X, and I really don't need more than that. Its just the enthusiast mindset :-)
    • The only compelling reason for 99% of people will be Windows 10's end-of-support on October, nothing more.
    • This thread has run its course. The complaint has been noted and we'll handle things on our side.  Again, for future reference please report a post that you have an issue with and we will investigate.  <Thread closed>
    • AMD Ryzen 9000, 8000, 7000 CPUs have a vulnerable TPM-Pluton, major firmware fix released by Sayan Sen Last week, the Trusted Computing Group (TCG), which is the developer of the Trusted Platform Module (TPM) security standard, alerted the press and AMD about a new TPM vulnerability on Ryzen processors. Tracked under ID "CVE-2025-2884" (AMD is tracking it as "AMD-SB-4011"), the vulnerability allows an attacker to exploit the vulnerability by sending malicious commands to read data stored in the TPM via an information disclosure flaw or potentially impact TPM availability on systems through a denial of service attack. This is a type of out-of-bound read security flaw. The TCG notes that the flaw occurs in the CryptHmacSign function due to improper validation of a message digest or hash via the hash-based message authentication code (HMAC) signature scheme, leading to an out-of-bounds situation. TCG explains in its VRT0009 advisory: The Common Vulnerability Scoring System (CVSS) score of the flaw is 6.6 indicating a medium level of severity. This is typically the case for most local-level attacks as in order to exploit such a flaw, the threat actor must have physical access to a device. Regardless, AMD has issued firmware to patch the vulnerability on Ryzen 7000, 8000 (Zen 4) and Ryzen 9000 (Zen 5) parts. AMD has confirmed that AGESA (AMD Generic Encapsulated Software Architecture) firmware Combo PI (Platform Initialization) 1.2.0.3e mitigates the flaw. The company notes that the said firmware fixes "ASP fTPM + Pluton TPM" issue. If you are wondering, ASP refers to AMD Secure Processor which is "a dedicated hardware component embedded in every system-on-a-chip." AMD's motherboard vendor partners like Asus and MSI have already begun rolling out the firmware update. MSI has a blog post about the 1.2.0.3e Combo PI as it mentions several new upcoming features including support for new CPUs, better memory compatibility, and more. MSI writes: Interestingly, Asus notes that this firmware update is irreversible as it is a major release. Thus one would hope that it is a very stable release and given that this is the "e" stepping of the firmware, there are pretty good chances of that. Other vendors like Gigabyte and ASRock are yet to release their updates.
    • Really?? Having a sense of humor is a sign of intelligence...what does that say about someone who totally misses the joke and can only respond by parroting a political talking point they heard others make?
  • Recent Achievements

    • Apprentice
      Wireless wookie went up a rank
      Apprentice
    • Week One Done
      bukro earned a badge
      Week One Done
    • One Year In
      Wulle earned a badge
      One Year In
    • One Month Later
      Wulle earned a badge
      One Month Later
    • One Month Later
      Simmo3D earned a badge
      One Month Later
  • Popular Contributors

    1. 1
      +primortal
      604
    2. 2
      ATLien_0
      281
    3. 3
      +FloatingFatMan
      179
    4. 4
      Michael Scrip
      151
    5. 5
      Steven P.
      111
  • Tell a friend

    Love Neowin? Tell a friend!