Jump to content

Zettabyte Era

From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by Monkbot (talk | contribs) at 03:07, 11 January 2021 (Task 18 (cosmetic): eval 47 templates: hyphenate params (43×);). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

The Zettabyte Era or Zettabyte Zone[1] is a period of human and computer science history that started in the mid-2010s. The precise starting date depends on whether it is defined as when the global IP traffic first exceeded that of one zettabyte, which happened in 2016, or when the amount of digital data in the world first exceeded a zettabyte, which happened in 2012. A zettabyte is a multiple of the unit byte that measures digital storage, and it is equivalent to 1,000,000,000,000,000,000,000 [1021] bytes.[2]

According to Cisco Systems, an American multinational technology conglomerate, the global IP traffic achieved an estimated 1.2 zettabytes (or an average of 96 exabytes (EB) per month) in 2016. Global IP traffic refers to all digital data that passes over an IP network which includes, but is not limited to, the public Internet. The largest contributing factor to the growth of IP traffic comes from video traffic (including online streaming services like Netflix and YouTube).[3][4]

The Zettabyte Era can also be understood as an age of growth of all forms of digital data that exist in the world which includes the public Internet, but also all other forms of digital data such as stored data from security cameras or voice data from cell-phone calls.[5] Taking into account this second definition of the Zettabyte Era, it was estimated that in 2012 upwards of 1 zettabyte of data existed in the world and that by 2020 there would be more than 40 zettabytes of data in the world at large.[6]

The Zettabyte Era translates to difficulties for data centers to keep up with the explosion of data consumption, creation and replication.[7] In 2015, 2% of total global power was taken up by the Internet and all its components, so energy efficiency with regards to data centers has become a central problem in the Zettabyte Era.[8]

The zettabyte

Multiple-byte units
Decimal
Value Metric
1000 kB kilobyte
10002 MB megabyte
10003 GB gigabyte
10004 TB terabyte
10005 PB petabyte
10006 EB exabyte
10007 ZB zettabyte
10008 YB yottabyte
10009 RB ronnabyte
100010 QB quettabyte
Binary
Value IEC Memory
1024 KiB kibibyte KB kilobyte
10242 MiB mebibyte MB megabyte
10243 GiB gibibyte GB gigabyte
10244 TiB tebibyte TB terabyte
10245 PiB pebibyte —
10246 EiB exbibyte —
10247 ZiB zebibyte —
10248 YiB yobibyte —
—
—
Orders of magnitude of data

A zettabyte is a digital unit of measurement. One zettabyte is equal to one sextillion bytes or 1021 (1,000,000,000,000,000,000,000) bytes or, one zettabyte is equal to a trillion gigabytes.[4][2] To put this into perspective, consider that "if each terabyte in a zettabyte were a kilometre, it would be equivalent to 1,300 round trips to the moon and back (768,800 kilometers)".[4] Or, as former Google CEO Eric Schmidt puts it, from the very beginning of humanity to the year 2003, an estimated 5 exabytes of information was created,[9] which corresponds to 0.5% of a zettabyte. In 2013 that amount of information (5 exabytes) took only two days to create and that pace is continuously growing.[9]

Definitions

The concept of the Zettabyte Era can be separated into two distinct categories:

  1. In terms of IP traffic: This first definition refers to the total amount of data to traverse global IP networks such as the public Internet. In Canada for example, there has been an average growth of 50.4% of data downloaded by residential Internet subscribers from 2011 to 2016.[10] According to this definition, the Zettabyte Era began in 2016 when global IP traffic surpassed one zettabyte, estimated to have reached roughly 1.2 zettabytes.[3]
  2. In terms of all forms of digital data: In this second definition, the Zettabyte Era refers to the total amount of all the digital data that exists in any form, from digital films to transponders that record highway usage to SMS text messages.[5] According to this definition, the Zettabyte Era began in 2012, when the amount of digital data in the world surpassed that of one zettabyte.[6]

In 2016, Cisco Systems stated that the Zettabyte Era was now reality when global IP traffic reached an estimated 1.2 zettabytes. Cisco also provided future predictions of global IP traffic in their report The Zettabyte Era: Trends and Analysis. This report uses current and past global IP traffic statistics to forecast future trends. The report predicts trends between 2016 and 2021. Here are some of the predictions for 2021 found in the report:[3]

  • Global IP traffic will triple and is estimated to reach 3.3 ZB on a yearly basis
  • In 2016 video traffic (e.g. Netflix and YouTube) accounted for 73% of total traffic. In 2021 this will increase to 82%
  • The number of devices connected to IP networks will be more than three times the global population
  • The amount of time it would take for one person to watch the entirety of video that will traverse global IP networks in one month is 5 million years
  • PC traffic will be exceeded by smartphone traffic. PC traffic will account for 25% of total IP traffic while smartphone traffic will be 33%
  • There will be a twofold increase in broadband speeds[3]

Factors that led to the Zettabyte Era

There are many factors that brought about the rise of the Zettabyte Era. Increases in video streaming, mobile phone usage, broadband speeds and data center storage are all contributing factors that led to the rise (and continuation) of data consumption, creation and replication.[3][11][12]

Increased video streaming

There is a large, and ever-growing consumption of multimedia, including video streaming, on the Internet that has contributed to the rise of the Zettabyte Era.[13] In 2011 it was estimated that roughly 25–40% of IP traffic was taken up by video streaming services.[14] Since then, video IP traffic has nearly doubled to an estimated 73% of total IP traffic. Furthermore, Cisco has predicted that this trend will continue into the future, estimating that by 2021, 82% of total IP traffic will come from video traffic.[3]

The amount of data used by video streaming services depends on the quality of the video. Thus, Android Central breaks down how much data is used (on a smartphone) with regards to different video resolutions. According to their findings, per hour video between 240p and 320p resolution uses roughly 0.3GB. Standard video, which is clocked in at a resolution of 480p, uses approximately 0.7GB per hour. High-definition video which varies between 720p and 2k resolution uses about 0.9GB (720p), 1.5GB (1080p) and 3GB (2k) per hour. Finally, 4K video, known as ultra-high-definition video, uses about 7.2GB per hour.[15][dubious – discuss]

Netflix and YouTube are at the top of the list in terms of the most globally streamed video services online. In 2016, Netflix represented 32.72% of all video streaming IP traffic, while YouTube represented 17.31%. The third spot is taken up by Amazon Prime Video where global data usage comes in at 4.14%.[16]

Netflix

Currently, Netflix is the largest video streaming service in the world, accessible in over 200 countries and with more than 80 million subscribers.[17] Streaming high definition video content through Netflix uses roughly 3 GB of data per hour, while standard definition takes up around 1 GB of data per hour.[18] In North America, during peak bandwidth consumption hours (around 8 PM) Netflix uses about 40% of total network bandwidth.[19] The vast amount of data marks an unparalleled period in time and is one of the major contributing factors that has led the world into the Zettabyte Era.[3]

YouTube

YouTube is another large video streaming (and video uploading) service,[20] whose data consumption rate across both fixed and mobile networks remains quite large.[21] In 2016, the service was responsible for using up about 20% of total Internet traffic and 40% of mobile traffic. In 2016, 100 hours of video content on YouTube was uploaded every 60 seconds.[22] YouTube not only offers content for download (through streaming) but also a portion of their total Internet usage is attributed to uploading video content as well.[dubious – discuss] As of 2018, 300 hours of YouTube video content is uploaded every minute.[23]

Increased wireless and mobile traffic

The usage of mobile technologies to access IP networks has resulted in an increase in overall IP traffic in the Zettabyte Era. In 2016, the majority of devices that moved IP traffic and other data streams were hard-wired devices. Since then, wireless and mobile traffic have increased and are predicted to continue to increase rapidly. Cisco predicts that by the year 2021, wired devices will account for 37% of total traffic while the remaining 63% will be accounted for through wireless and mobile devices. Furthermore, smartphone traffic is expected to surpass PC traffic by 2021; PCs are predicted to account for 25% of total traffic, down from 46% in 2016, whereas smartphone traffic is expected to increase from 13% to 33%.[3]

According to the Organisation for Economic Co-operation and Development (OECD), mobile broadband penetration rates are ever-growing. Between June 2016 and December 2016 there was an average mobile broadband penetration rate increase of 4.43% of all OECD countries. Poland had the largest increase coming in at 21.55% while Latvia had the lowest penetration rate having declined 5.71%. The OECD calculated that there were 1.27 billion total mobile broadband subscriptions in 2016, 1.14 billion of these subscriptions had both voice and data included in the plan.[11]

Increased broadband speeds

Broadband is what connects Internet users to the Internet, thus the speed of the broadband connection is directly correlated to IP traffic – the greater the broadband speed, the greater the possibility of more traffic that can traverse IP networks. Cisco estimates that broadband speeds are expected to double by 2021. In 2016, global average fixed broadband reached speeds as high as 27.5 Mbit/s but are expected to reach 53 Mbit/s by 2021.[3] Between the fourth quarter of 2016 and the first quarter of 2017, average fixed broadband speeds globally equated to 7.2 Mbit/s.[clarification needed] South Korea was at the top of the list in terms of broadband speeds. In that period broadband speeds increased 9.3%.[24]

High-bandwidth applications need significantly higher broadband-speeds. Certain broadband technologies including Fiber-to-the-home (FTTH), high-speed digital subscriber line (DSL) and cable broadband are paving the way for increased broadband speeds.[3] FTTH can offer broadband-speeds that are ten times (or even a hundred times) faster than DSL or cable.[25]

Internet service providers in the Zettabyte Era

The Zettabyte Era has affected Internet service providers (ISPs) with the growth of data flowing from all directions. Congestion occurs when there is too much data flowing in and the quality of service (QoS) weakens.[26] In both China and the U.S. some ISPs store and handle exabytes of data.[6] The response by certain ISPs is to implement so-called network management practices in an attempt to accommodate the never-ending data-surge of Internet subscribers on their networks. Furthermore, the technologies being implemented by ISPs across their networks are evolving to address the increase in data flow.[27]

Network management practices have brought about debates relating to net neutrality in terms of fair access to all content on the Internet.[27] According to The European Consumer Organisation, network neutrality can be understood as an aim that "all Internet should be treated equally, without discrimination or interference. When this is the case, users enjoy the freedom to access the content, services, and applications of their choice, using any device they choose".[28]

According to the Canadian Radio-television and Telecommunications Commission (CRTC) Telecom Regulatory Policy 2009-657 there are two forms of Internet network management practices in Canada. The first are economic practices such as data caps, the second are technical practices like bandwidth throttling and blocking. According to the CRTC, the technical practices are put in place by ISPs to address and solve congestion issues in their network, however the CRTC states that ISPs are not to employ ITMPs for preferential or unjustly discriminatory reasons.[29][clarification needed]

In the United States, however, during the Obama-era administration, under the Federal Communications Commission's (FCC) 15–24 policy, there were three bright-line rules in place to protect net neutrality: no blocking, no throttling, no paid prioritization.[30] On 14 December 2017, the FCC voted 3–2 to remove these rules, allowing ISPs to block, throttle and give fast-lane access to content on their network.[31]

In an attempt to aid ISP's in dealing with large data-flow in the Zettabyte Era, in 2008 Cisco unveiled a new router, the Aggregation Services Router (ASR) 9000, which at the time was supposed to be able to offer six times the speed of comparable routers. In one second the ASR 9000 router would, in theory, be able to process and distribute 1.2 million hours of DVD traffic.[32] In 2011, with the coming of the Zettabyte Era, Cisco had continued work on the ASR 9000 in that it would now be able to handle 96 terabytes a second, up significantly from 6.4 terabytes a second the ASR 9000 could handle in 2008.[33][relevant?]

Data centers

Energy consumption

Data centers attempt to accommodate the ever-growing rate at which data is produced, distributed, and stored. Data centers are large facilities used by enterprises to store immense datasets on servers.[34] In 2014 it was estimated that in the U.S. alone there were roughly 3 million data centers,[35] ranging from small centers located in office buildings to large complexes of their own.[36] Increasingly, data centers are storing more data than end-user devices. By 2020 it is predicted that 61% of total data will be stored via cloud applications (data centers) in contrast to 2010 when 62% of data storage was on end-user devices. An increase in data centers for data storage coincides with an increase in energy consumption by data centers.[37]

In 2014, data centers in the U.S. accounted for roughly 1.8% of total electricity consumption which equates to 70 billion kWh. Between 2010–2014 an increase of 4% was attributed to electricity consumption by data centers, this upward trend of 4% is predicted to continue through 2014–2020.[38] In 2011, energy consumption from all data centers equated to roughly 1.1 to 1.5% of total global energy consumption.[39] Information and communication technologies, including data centers, are responsible for creating large quantities of CO2 emissions. It is estimated that by 2020 they will account for 12% of total global emissions.[39]

Google’s green initiatives

The energy used by data centers is not only to power their servers. In fact, most data centers use about half of their energy costs on non-computing energy such as cooling and power conversion. Google's data centers have been able to reduce non-computing costs to 12%.[40] Furthermore, as of 2016, Google uses its artificial intelligence unit, DeepMind, to manage the amount of electricity used for cooling their data centers, which results in a cost reduction of roughly 40% after the implementation of DeepMind.[41] Google claims that its data centers use 50% less energy than ordinary data centers.[42][better source needed]

According to Google's Senior Vice President of Technical Infrastructure, Urs Hölzle, Google's data centers (as well as their offices) will have reached 100% renewable energy for their global operations by the end of 2017. Google plans to accomplish this milestone by buying enough wind and solar electricity to account for all the electricity their operations consume globally. The reason for these green-initiatives is to address climate change and Google's carbon footprint. Furthermore, these green-initiatives have become cheaper, with the cost of wind energy lowering by 60% and solar energy coming down 80%.[42]

In order to improve a data center's energy efficiency, reduce costs and lower the impact on the environment, Google provides 5 of the best practices for data centers to implement:[43]

  1. Measure the Power Usage Effectiveness (PUE),[clarification needed] a ratio used by the industry to measure the energy used for non-computing functions, to track a data center's energy use.
  2. Using well-designed containment methods, try to stop cold and hot air from mixing. Also, use backing plates for empty spots on the rack and eliminate hot spots.
  3. Keep the aisle temperatures cold for energy savings.
  4. Use free cooling methods to cool data centers, including a large thermal reservoir or evaporating water.
  5. Eliminate as many power conversion steps as possible to lower power distribution losses.

The Open Compute Project

In 2010, Facebook launched a new data center designed in such a way that allowed it to be 38% more efficient and 24% less expensive to build and run than the average data center. This development led to the formation of the Open Compute Project (OCP) in 2011.[44][45] The OCP members collaborate in order to build new technological hardware that is more efficient, economical and sustainable in an age where data is ever-growing.[45] The OCP is currently working on several projects, including one specifically focusing on data centers. This project aims to guide the way in which new data centers are built, but also to aid already existing data centers in improving thermal and electrical energy as well as to maximize mechanical performance. The OCP's data center project focuses on five areas: facility power, facility operations, layout and design, facility cooling and facility monitoring and control.[46]

References

  1. ^ "Zipping Past the Zettabyte Era: What's Next for the Internet?". Now. Powered by Northrop Grumman. Retrieved 5 July 2020.
  2. ^ a b TechTerms. "Zettabyte". Retrieved 12 January 2018.
  3. ^ a b c d e f g h i j Cisco Systems. "The Zettabyte Era: Trends and Analysis". Retrieved 12 October 2017.
  4. ^ a b c Barnett, Jr., Thomas. "The Zettabyte Era Officially Begins (How Much is That?)". Cisco Blogs. Retrieved 4 December 2017.
  5. ^ a b Gantz, John; Reinsel, David (December 2012). "THE DIGITAL UNIVERSE IN 2020: Big Data, Bigger Digital Shadow s, and Biggest Grow th in the Far East" (PDF): 1. Retrieved 4 December 2017. {{cite journal}}: Cite journal requires |journal= (help)
  6. ^ a b c Xu, Zhi-Wei (March 2014). "Cloud-Sea Computing Systems: Towards Thousand-Fold Improvement in Performance per Watt for the Coming Zettabyte Era" (PDF). Journal of Computer Science and Technology. 29 (2): 177–181. doi:10.1007/s11390-014-1420-2. S2CID 14818321. Retrieved 13 October 2017.
  7. ^ Arista. "The zettabyte era is here. Is your datacenter ready?" (PDF). Retrieved 12 January 2018.
  8. ^ Newman, Kim (2014). "ChipScaleReview". Retrieved 4 December 2017.
  9. ^ a b Vance, Jeff. "Big Data Analytics Overview". Datamation. Retrieved 22 October 2017.
  10. ^ CRTC. "Communications Monitoring Report 2016: Telecommunications sector overview". Canadian Radio-television and Telecommunications Commission. Retrieved 22 October 2017.
  11. ^ a b OECD. "OECD Broadband Portal". Organisation for Economic Co-operation and Development. Retrieved 4 December 2017.
  12. ^ Chéramy, Séverine; Clermidy, Fabien; Simon, Gilles; Leduc, Patrick. "The "active-interposer" concept for high-performance chip-to-chip connections". p. 35.
  13. ^ Althoff, Tim; Borth, Damian; Hees, Jörn; Dengel, Andreas (2014). "Analysis and Forecasting of Trending Topics in Online Media Streams". arXiv:1405.7452 [cs.SI].
  14. ^ Rao, Ashwin; Legout, Arnaud; Lim, Yeon-sup; Towsley, Don; et al. (2011). Written at Tokyo, Japan. Network characteristics of video streaming traffic (PDF). CONEXT 2011. New York, New York, USA: ACM Press. doi:10.1145/2079296.2079321. ISBN 978-1-4503-1041-3.
  15. ^ Hildenbrand, Jerry. "How much mobile data does streaming media use?". Android Central. Retrieved 4 December 2017.
  16. ^ Nickelsburg, Monica. "Study: Amazon Video is now the third-largest streaming service, behind Netflix and YouTube". Geek Wire. Retrieved 4 December 2017.
  17. ^ Ingram, Mathew. "Netflix Is Winning the Streaming Race—But for How Long?". Fortune. Retrieved 4 December 2017.
  18. ^ Netflix. "How can I control how much data Netflix uses?". Retrieved 4 December 2017.
  19. ^ Pariag, David; Brecht, Tim (2017). "Application Bandwidth and Flow Rates from 3 Trillion Flows Across 45 Carrier Networks" (PDF): 4–5. Retrieved 4 December 2017. {{cite journal}}: Cite journal requires |journal= (help)
  20. ^ Orsolic, Irena; Pevec, Dario; Suznjevic, Mirko; Skorin-Kapov, Lea (2016). "YouTube QoE Estimation Based on the Analysis of Encrypted Network Traffic Using Machine Learning" (PDF). Retrieved 4 December 2017. {{cite journal}}: Cite journal requires |journal= (help)
  21. ^ Summers, Jim; Brecht, Tim; Eager, Derek; Gutarin, Alex (2016). "Characterizing the Workload of a Netflix Streaming Video Server" (PDF). Retrieved 4 December 2017. {{cite journal}}: Cite journal requires |journal= (help)
  22. ^ Wamser, Florian; Casas, Pedro; Seufert, Michael; Moldovan, Christian; Tran-Gia, Phuoc; Hossfeld, Tobias (30 March 2016). "Modeling the YouTube stack: From packets to quality of experience" (PDF). Retrieved 4 December 2017. {{cite journal}}: Cite journal requires |journal= (help)
  23. ^ Chen, Steve; Hurley, Chad; Karim, Jawed. "37 Mind Blowing YouTube Facts, Figures and Statistics – 2018". FortuneLords. Retrieved 20 March 2018.
  24. ^ Akamai. "akamai's [state of the internet] – Q1 2017 report" (PDF). Akamai. Retrieved 7 December 2017.
  25. ^ FCC. "Types of Broadband Connections". Federal Communications Commission. Retrieved 7 December 2017.
  26. ^ Al-Bahadili, Hussein (2012). Simulation in Computer Network Design and Modeling: Use and Analysis. Information Science Reference. p. 282. ISBN 9781466601925. Retrieved 5 December 2017.
  27. ^ a b Dutta, Soumitra; Bilbao-Osorio, Beñat. "The Global Information Technology Report 2012" (PDF). Insead. S2CID 154025136. Retrieved 5 December 2017.
  28. ^ The European Consumer Organization. "Factsheet: The EU's Net Neutrality Rules" (PDF). Retrieved 5 December 2017.
  29. ^ CRTC. "Telecom Regulatory Policy CRTC 2009-657". Retrieved 5 December 2017.
  30. ^ FCC. "REPORT AND ORDER ON REMAND, DECLARATORY RULING, AND ORDER" (PDF). Retrieved 5 December 2017.
  31. ^ Castro, Alex. "The FCC just killed net neutrality". The Verge. Retrieved 31 January 2018.
  32. ^ Hamblen, Matt. "Cisco unveils a router for the 'Zettabyte Era'". Computer World. Retrieved 5 December 2017.
  33. ^ Zawacki, Neil. "Cisco Introduces a Simpler Way to Build Internet for Zettabyte Era". Compare Business Products. Retrieved 5 December 2017.
  34. ^ Stroud, Forrest. "Data Center". Webopedia. Retrieved 5 December 2017.
  35. ^ Tikoff Vargas, Maria. "10 Facts to Know About Data Centers". Office of Energy Efficiency & Renewable Energy. Retrieved 6 December 2017.
  36. ^ Freedman, Andrew. "There Are Now 3 Million Data Centers in the U.S., and Climbing". Mashable. Retrieved 20 March 2018.
  37. ^ Hormann, Peter; Campbell, Leith (2014). "Data Storage Energy Efficiency in the Zettabyte Era" (PDF). Australian Journal of Telecommunications and the Digital Economy: 51.1–52.2. Retrieved 5 December 2017.
  38. ^ Koomey, Jonathan; Masanet, Eric; Horner, Nathaniel; Azevedo, Inês; Lintner, William. "United States Data Center Energy Usage Report". Berkeley National Laboratory. Retrieved 5 December 2017.
  39. ^ a b Rong, Huigui; Zhang, Haomin; Xiao, Sheng; Li, Canbing; Hu, Chunhua (2016). "Optimizing energy consumption for data centers" (PDF). Renewable and Sustainable Energy Reviews. 58: 674–691. doi:10.1016/j.rser.2015.12.283. Retrieved 5 December 2017.
  40. ^ Google: Data Centers. "Efficiency: How we do it". Google. Retrieved 6 December 2017. {{cite web}}: |last1= has generic name (help)
  41. ^ Vincent, James. "Google uses DeepMind AI to cut data center energy bills". The Verge. Retrieved 20 March 2018.
  42. ^ a b Hölzle, Urs. "100% renewable is just the beginning". Google. Retrieved 6 December 2017.
  43. ^ Google: Data Centers. "Efficiency: How others can do it". Google. Retrieved 6 December 2017. {{cite web}}: |last1= has generic name (help)
  44. ^ Facebook: Sustainability. "Building the most efficient data centers on Earth". Facebook. Retrieved 6 December 2017. {{cite web}}: |last1= has generic name (help)
  45. ^ a b Open Compute Project: About. "About OCP". Open Compute Project. Retrieved 6 December 2017.
  46. ^ Open Compute Project. "Datacenter". Open Compute Project. Retrieved 8 December 2017.

Further reading

Retrieved from "https://en.wikipedia.org/w/index.php?title=Zettabyte_Era&oldid=999620941"