||This article's tone or style may not reflect the encyclopedic tone used on Wikipedia. (February 2014)|
|Part of a series on Statistics|
Data Science is the extraction of knowledge from large volumes of data that are structured or unstructured, which is a continuation of the field data mining and predictive analytics, also known as knowledge discovery and data mining (KDD). "Unstructured data" can include emails, videos, photos, social media, and other user-generated content. Data science often requires sorting through a great amount of information and writing algorithms to extract insights from this data.
Data science employs techniques and theories drawn from many fields within the broad areas of mathematics, statistics, chemometrics, information theory, and computer science, including signal processing, probability models, machine learning, statistical learning, data mining, database, data engineering, pattern recognition and learning, visualization, predictive analytics, uncertainty modeling, data warehousing, data compression, computer programming, and high performance computing. Methods that scale to Big Data are of particular interest in data science, although the discipline is not generally considered to be restricted to such data. The development of machine learning, a branch of artificial intelligence used to uncover patterns in data from which predictive models can be developed, has enhanced the growth and importance of data science.
The field of data science utilizes data preparation, statistics, and machine learning to investigate problems in various domains such as agriculture, marketing optimization, fraud detection, setting public policy, etc.
Data scientists use the ability to find and interpret rich data sources; manage large amounts of data despite hardware, software, and bandwidth constraints; merge data sources; ensure consistency of datasets; create visualizations to aid in understanding data; build mathematical models using the data; and present and communicate the data insights/findings.
Data science techniques affect research in many domains, including agriculture, the biological sciences, medical informatics, health care, social sciences and the humanities. It heavily influences economics, business and finance. From the business perspective, data science is an integral part of competitive intelligence, a newly emerging field that encompasses a number of activities, such as data mining and data analysis.
The term "data science" (originally used interchangeably with "datalogy") has existed for over thirty years and was used initially as a substitute for computer science by Peter Naur in 1960. In 1974, Naur published Concise Survey of Computer Methods, which freely used the term data science in its survey of the contemporary data processing methods that are used in a wide range of applications. In 1996, members of the International Federation of Classification Societies (IFCS) met in Kobe for their biennial conference. Here, for the first time, the term data science is included in the title of the conference ("Data Science, classification, and related methods").
In November 1997, C.F. Jeff Wu gave the inaugural lecture entitled "Statistics = Data Science?" for his appointment to the H. C. Carver Professorship at the University of Michigan. In this lecture, he characterized statistical work as a trilogy of data collection, data modeling and analysis, and decision making. In his conclusion, he initiated the modern, non-computer science, usage of the term "data science" and advocated that statistics be renamed data science and statisticians data scientists. Later, he presented his lecture entitled "Statistics = Data Science?" as the first of his 1998 P.C. Mahalanobis Memorial Lectures. These lectures honor Prasanta Chandra Mahalanobis, an Indian scientist and statistician and founder of the Indian Statistical Institute.
In 2001, William S. Cleveland introduced data science as an independent discipline, extending the field of statistics to incorporate "advances in computing with data" in his article "Data Science: An Action Plan for Expanding the Technical Areas of the Field of Statistics," which was published in Volume 69, No. 1, of the April 2001 edition of the International Statistical Review / Revue Internationale de Statistique. In his report, Cleveland establishes six technical areas which he believed to encompass the field of data science: multidisciplinary investigations, models and methods for data, computing with data, pedagogy, tool evaluation, and theory.
In April 2002, the International Council for Science: Committee on Data for Science and Technology (CODATA) started the Data Science Journal, a publication focused on issues such as the description of data systems, their publication on the internet, applications and legal issues. Shortly thereafter, in January 2003, Columbia University began publishing The Journal of Data Science, which provided a platform for all data workers to present their views and exchange ideas. The journal was largely devoted to the application of statistical methods and quantitative research. In 2005, The National Science Board published "Long-lived Digital Data Collections: Enabling Research and Education in the 21st Century" defining data scientists as "the information and computer scientists, database and software and programmers, disciplinary experts, curators and expert annotators, librarians, archivists, and others, who are crucial to the successful management of a digital data collection" whose primary activity is to "conduct creative inquiry and analysis."
Domain specific interests
Data science is the practice of deriving valuable insights from data. Data science is emerging to meet the challenges of processing very large data sets i.e. "Big Data" consisting of structured, unstructured or semi-structured data that large enterprises produce. At center stage of data science is the explosion of new data generated from smart devices, web, mobile and social media. Many practicing data scientists commonly specialize in specific domains such as the fields of marketing, medical, security, fraud and finance. However, data scientists rely heavily upon elements of statistics, machine learning, optimization, signal processing, text retrieval and natural language processing to analyze data and interpret results.
Although use of the term "data science" has exploded in business environments, many academics and journalists see no distinction between data science and statistics. Writing in Forbes, Gil Press argues that data science is a buzzword without a clear definition and has simply replaced “business analytics” in contexts such as graduate degree programs. In the question-and-answer section of his keynote address at the Joint Statistical Meetings of American Statistical Association, noted applied statistician Nate Silver said, “I think data-scientist is a sexed up term for a statistician....Statistics is a branch of science. Data scientist is slightly redundant in some way and people shouldn’t berate the term statistician.”
As an interdisciplinary subject, data science draws scientific inquiry from a broad range of academic subject areas. Some areas of research are:
- Data mining and Knowledge discovery (KDD)
- Cloud computing
- Databases and information integration
- Signal processing
- Learning, natural language processing and information extraction
- Computer vision
- Information retrieval and web information access
- Knowledge discovery in social and information networks
- Information Visualization
Security Data Science
Data science has a long and rich history in security and fraud monitoring reference needed. Security data science is focused on advancing information security through practical applications of exploratory data analysis, statistics, machine learning and data visualization. Although the tools and techniques are no different from those used in data science in any data domain, this group has a micro-focus on reducing risk, identifying fraud or malicious insiders using data science. The information security and fraud prevention industry have been evolving security data science in order to tackle the challenges of managing and gaining insights from huge streams of log data, discover insider threats and prevent fraud.
Clinical data science
Data science has always been prominent in the field of clinical trials. Timely insight into clinical data provides answers to medical questions documenting the safety and efficacy of novel and existing therapeutic compounds. With large and complex data, clinical data scientists have been producing statistical analyses of clinical trials for marketing applications since clinical development has been required. In the early 2000s, the clinical data scientist evolved from a role of a consultant to statisticians to a strategic one. Now the clinical data scientist assists in the planning, collection, transformation, analysis and reporting of clinical trial data and communication of their results. These scientists are crucial to the determination of safety and efficacy of novel therapeutic compounds.
Genomic data science
Application of Data Science does not only stop at clinical trials, it was also applied to learning the proteins and DNA sequences in Genomics. This field, because of the tools of the data scientist, the work for analyzing, and studying DNA structures, viruses and other biological pathogens. Handling of data is around before but using data science will make it easier for handling vast amount of data in Genomics and make the procedures repeatable. Data Science could be used to help sort genomic data in order to process gene types.
With the increasing adoption of GPS, imagery, and sensor technologies as standard data collection instruments on agricultural equipment, farmers gain access to vast amounts of data. The data provides information about crops, weather, soil characteristics and other factors impacting crop growth and yield. Data scientists working in agriculture help growers and agronomists by identifying patterns in the data and developing predictive models that allow farmers to reduce inputs and increase yields.
Data science is utilized by many companies to pinpoint what customers want, how they buy, and what they might be interested in buying at a future point. Currently, Amazon and Netflix utilize sophisticated data science algorithms to create "smart product recommendations" for their customers. Every purchase that is made, product that is bought, or movie that is watched collects data about an individuals interests and buying habits. The use of data science allows companies to utilize that information to recommend further purchases that might interest the individual.
- Calvin Andrus (2012). "Data science: An Introduction". Wikibooks.org. Retrieved 8 August 2012.
- Drew Conway, John Myles White. "Machine Learning for Hackers". O’Reilly Media, Inc.
- Jun (Luke) Huan,"Theoretic Foundation of Data Science, EECS 940". 20 May 2012. Retrieved 1 January 2012., University of Kansas
- Matthew A. Russell. "Mining the Social Web, 2nd Edition". O'Reily Media, Inc.
|Wikimedia Commons has media related to Data science.|
|Wikibooks has more on the topic of: Data science|
- Dhar, V. (2013). "Data science and prediction". Communications of the ACM 56 (12): 64. doi:10.1145/2500499.
- Jeff Leek (2013-12-12). "The key word in "Data Science" is not Data, it is Science". Simply Statistics.
- LaPonsie, Maryalene. "Data scientists: The Hottest Job You Haven't Heard Of". Retrieved 7 October 2012.
- Forbes-Gil Press-A Very Short History of Data Science-May 2013
- Wu, C. F. J. (1997). "Statistics = Data Science?" (PDF). Retrieved 9 October 2014.
- "Identity of statistics in science examined". The University Records, 9 November 1997, The University of Michigan. Retrieved 12 August 2013.
- "P.C. Mahalanobis Memorial Lectures, 7th series". P.C. Mahalanobis Memorial Lectures, Indian Statistical Institute. Retrieved 18 August 2013.
- Cleveland, W. S. (2001). Data science: an action plan for expanding the technical areas of the field of statistics. International Statistical Review / Revue Internationale de Statistique, 21-26
- International Council for Science : Committee on Data for Science and Technology. (2012, April). CODATA, The Committee on Data for Science and Technology. Retrieved from International Council for Science : Committee on Data for Science and Technology: http://www.codata.org/
- Data Science Journal. (2012, April). Available Volumes. Retrieved from Japan Science and Technology Information Aggregator, Electronic: http://www.jstage.jst.go.jp/browse/dsj/_vols
- Data Science Journal. (2002, April). Contents of Volume 1, Issue 1, April 2002. Retrieved from Japan Science and Technology Information Aggregator, Electronic: http://www.jstage.jst.go.jp/browse/dsj/1/0/_contents
- The Journal of Data Science. (2003, January). Contents of Volume 1, Issue 1, January 2003. Retrieved from http://www.jds-online.com/v1-1
- National Science Board. "Long-Lived Digital Data Collections Enabling Research and Education in the 21st Century". National Science Foundation. Retrieved 30 June 2013.
- "Tim O’Reilly: The World’s 7 Most Powerful Data Scientists". http://www.forbes.com/pictures/lmm45emkh/2-jeff-hammerbacher-chief-scientist-cloudera-and-dj-patil-entrepreneur-in-residence-greylock-ventures/.
- "Data Science: What's The Half-Life Of A Buzzword?". Forbes. 2013-08-19.
- "Nate Silver: What I need from statisticians". Statistics Views. 23 Aug 2013.
- "Q&A with the UW Data Science Faculty". University of Wisconsin. Retrieved 11 August 2015.
- Anderson, Janna. "The Future of The Internet" (PDF). Pew Research Center. Retrieved 7 October 2012.
- West, Darrell. "Big Data For Education: Data Mining, Data Analytics, and Web Dashboards" (PDF). The Brookings Institution. Retrieved 7 October 2012.
- Davenport, Thomas. "The Human Side of Big Data and High-Performance Analytics" (PDF). International Institute for Analytics. Retrieved 7 October 2012.
- Hellerstein, Joseph. "The MADlib Analytics Library or MAD Skills, the SQL" (PDF). University of California at Berkeley. Retrieved 7 October 2012.
- Stodder, David. "Customer Analytics In the Age of Social Media" (PDF). TDWI Research. Retrieved 7 October 2012.
- Yangyong, Zhu; Yun Xiong (June 2011). "Dataology and Data science：Up to Now".
- Loukides, Mike. "Mining the Social Web, Again". Retrieved 21 Mar 2014., O'Reilly Radar