Needless to say, Fujifilm is citing generative AI and other AI-related services as major drivers behind the growing demand for magnetic tape
LTO-10 tapes were released earlier this year, providing a native capacity of 40 terabytes.
Needless to say, Fujifilm is citing generative AI and other AI-related services as major drivers behind the growing demand for magnetic tape
LTO-10 tapes were released earlier this year, providing a native capacity of 40 terabytes.
Archival of everything being scraped before its pushed off the internet and replaced with AI produced garbage.
The ship has sailed on the front. But even if its for the corpus of training data, surely that can’t be stored on tape, the access time would be way too slow.
It’s purpose is archival, not access. Tape density, cost, and reliability is much better than other mediums for that purpose.
Thats exactly my point, why bother archiving when you need it accessible for training? Surely they would be putting the training data on a faster medium.
when doing a training run, the speed bottleneck is computing power, not storage I/O speed.
Because you need a backup.
True in general, but I am not convinced its true for OpenAI or anthropic.
Their training data is probably already replicated across multiple datacenters, so tape archiving is less critical. And if tape archiving is critical, then surely they already have sufficient backups already right? And its not like the organic content of the internet is growing anymore, so there isn’t going to be an explosion of new organic data they need to store.
So I don’t buy that they need this. I think this is fujifilm trying to get in on the bubble, and nothing more.