100

Is Big Data Getting Too Big?


[MUSIC] “This episode is brought to you by Lynda.com” [MUSiC] We all use technology but do we understand
how it works? Consider a grain of rice. It’s not much of
a bite, but imagine if it was a byte. Our computers deal in a language of 1s and
0s to store their information and compute their instructions.
Eight of these 1 and 0 bits make a byte, and a thousand of those make a kilobyte, and a
thousand of those make a megabyte. But today we commonly deal in a currency even
larger, like gigabytes and terabytes. Although we don’t even understand how astronomically
huge they really are. But consider this: a terabyte of seconds is
32,000 years! We’re quickly moving far beyond these scales
to even larger ones, like petabytes, just one of which could cover the entire island
of Manhattan. Did you know that all the videos on YouTube are about 500 petabytes? Whereas companies like Google store up to 10 exabytes of data.
We are saving so much, in fact, that it’s becoming a serious challenge to even deal
with. [MUSIC] It’s estimated as many books were printed
in the first 50 years after the Gutenberg printing press as scribes had written in all
the previous 1,200. Today, on the other hand, we double our store of information every 2
or 3 years. Consider that in 2007, all the data we had
ever saved–and I mean everything– was estimated at 300 exabytes.
By 2013 that number had grown to 1,200 exabytes. The total amount of data on Earth, since the
dawn of civilization, quadrupled in just six years. This acceleration, will no doubt continue
to accelerate. The radio telescopes that make up the Square
Kilometer Array will generate an exabyte of astronomical data every four days. In several years we’ll probably live in
a world that deals in zettabytes, one of which, on our rice scale, would fill the Pacific
Ocean. This isn’t about Moore’s Law, the exponential
growth of computing hardware power, it’s about data: BIG data. While much of it will be useless, or at least
hard to organize, this quantity of data will lead to changes in the quality of how we live
and understand our world, probably in ways that we can’t imagine. Consider this cave painting. Its creation
was pretty slow and it contains a limited amount of information.
But consider this photograph. It was faster to make and contains much more
detail. But once we could capture that horse’s motion,
our observations became even more meaningful, but they also consisted of more data.
At first, only 12 or 24 images. But as we increase our resolution, dividing
that experience into smaller amounts of time and detail, extracting more information, suddenly
we create a ton of data to deal with. But maybe big data is in our DNA. Literally.
Sequencing the first human genome, reading just about every letter, cost roughly $3 billion
dollars in 2001. Today, the same sequencing only costs about $1000, cheap enough that
it might soon be cheaper to sequence a genome than to store one on a hard drive, tape drive,
or magnetic storage device. Beyond the challenges of processing and analyzing
all this data, which are huge, we have a more practical problem. Where are we gonna keep
it all? 100 years from now, it’s estimated we’ll
be storing 42 yottabytes of data every year. Using technology that companies like the Google
use today, we’d need enough data centers to cover the surface area of 12 Jupiters. But DNA itself might hold the answer. Harvard
researchers have been able to write entire books to DNA, and the molecule has the potential
to hold petabytes of data in just a few grams of genetic material. That doesn’t explain how we’ll read it,
write it, or even store it, but to deal with the coming data deluge, we will need
something new. It might give a whole new definition to… “saving
the world.” Stay curious.

Glenn Chapman

100 Comments

  1. To recover it quickly:

    1Bit * 8
    =1Byte * 1024
    =1KiloByte * 1024
    =1MegaByte * 1024
    =1GigaByte * 1024
    =1TerraByte * 1024
    =1PetaByte * 1024
    =1ExaByte * 1024
    =1ZetaByte * 1024
    =1YotaByte * 1024

    and that's where the official side of it stops and different people call it different things.

  2. I think the current spike in data growth stems from a human need for a close to perfect user interface.
    The shorter we can keep operation cycles, the quicker we can continue learning, working or relaxing.
    That said, the rate of which my data is coming in and loading up is close to optimal right now. I'm wondering if I even need faster, crisper or smarter Data access terminals.
    Oh, who am I kidding I'm a Human. I'm greedy. I can never have enough. 😉

  3. This episode contains fantastic acting! You'll brain will be like: "How could he know that back in hte early 80s!?"

  4. this video was prob inspired by farcry blood dragon ,the graphics are literally identical

  5. 0:34 Wrong! 1024 of those. Since binary is a base-2 numbers system, a.k.a 0 and 1, computers use powers of 2. So, 2^10 = 1024 – and not 1000.

  6. Great video but I had tracking off so I couldnt really see it properly

  7. ok, ok… you had me till comic sans at the end… totally broke the immersion! 😛

  8. I thought the video technology during 2013 was better and had a higher resolution (1:47)

  9. Still less than mole XD

    BTW – mole is 6,022 x 10^23 or 12g of pure carbon. We know caesium atoms had 9,192,631,770 cycles of the radiation that gets an atom of caesium-133 to vibrate between two energy states. In second!
    (i think carbon can even faster due to being lighter)

  10. Is it just me or it seems like AC game with data can be stored by DNA. I know Ubisolf got the idea from a book just saying

  11. watching this right after Zuckerberg had to answer why he's storing and selling peoples personal information

  12. arrg seriously?!
    you couldnt have just actually made it a square video so i could watch it full screen?? it has to be like a tine box in the middle of my screen??

  13. did you say 1 terabyte of seconds? shouldn't be 1 terasecond? or at least one tera of seconds? because you just said 1 teramiles of seconds. two diferent measuring units.

  14. Clicked on this link: https://cen.acs.org/articles/93/i35/Sc and got a 404 Not Found message. :o( . If you have time, you might want to provide a different link to a good source of info on DNA Storage. Thanks for this interesting info.

  15. Cool video… if sequencing DNA and reading it doesn't progress fast enough, we may have to figure what data to forget!..

    …no matter how much Google wants to know everything!.. about every-who!.. who's ever been alive since 1998!

  16. Hey,that's not true.In this case,bigger unit is equal as 1024 times the smaller unit.

  17. 1:10 If they would quit saving and delete all of the people's personal data and stop trying to collect information on their users then they could clear up some space, then it wouldn't be such a problem. wink 😉

  18. Everyone: try 360p instead. 240p adds too much modern MPEG-style square pixelization which wouldn't have existed on 80s NTSC VHS (which is roughly 360p…. -ish). As Technology Connections says, "THESE ARE NOT PIXELS". It really does look amazing in 360p though.

  19. .ioktbs firing shots at tmz for being useless and reddit for being disorganized. I love this channel xD

  20. Interesting video…but please do do pj, the last one, saving the world was too mucn

  21. The unplugged keyboard <3 That is such a cool gimmick. I love this 80's style.

  22. okay, so, we can't just delete all the useless or unneeded data to make room for the new information because ..?

  23. i’m reminded horribly of that “how to use internet” video. but this was well done xD

  24. We might create life forms from scratch to evolve on a different planet, and they will wonder where they came from.

  25. You should invite a special guest… like umm Dr.Steve Brule, that guy is a grenius

  26. it would be a miracle flustering with triumph to see with my very own eyes, that can not even begin to detect most of the Electro-Magnetic spectrum, something such that is similar to this video production. oh, just the sight of this magical 80s themed majestically awkward video presentation was truly divine and whimsical. just the thought of a similar presentation would bring me great joy as it could possibly, yet not easily be of far greater remark

  27. This video was so rad! The theme, the information, the presentation, all off it! So cool!

Leave a Reply

Your email address will not be published. Required fields are marked *