Data Science: The Numbers of Our Lives
HARVARD BUSINESS REVIEW calls data science âthe sexiest job in the 21st century,â and by most accounts this hot new field promises to revolutionize industries from business to government, health care to academia.
GraphicThe field has been spawned by the enormous amounts of data that modern technologies create â" be it the online behavior of Facebook users, tissue samples of cancer patients, purchasing habits of grocery shoppers or crime statistics of cities. Data scientists are the magicians of the Big Data era. They crunch the data, use mathematical models to analyze it and create narratives or visualizations to explain it, then suggest how to use the information to make decisions.
In the last few years, dozens of programs under a variety of names have sprung up in response to the excitement about Big Data, not to mention the six-figure salaries for some recent graduates.
In the fall, Columbia will offer new masterâs and certificate programs heavy on data. The University of San Francisco will soon graduate its charter class of students with a masterâs in analytics. Other institutions teaching data science include New York University, Stanford, Northwestern, George Mason, Syracuse, University of California at Irvine and Indiana University.
Rachel Schutt, a senior research scientist at Johnson Research Labs, taught âIntroduction to Data Scienceâ last semester at Columbia (its first course with âdata scienceâ in the title). She described the data scientist this way: âa hybrid computer scientist software engineer statistician.â And added: âThe best tend to be really curious people, thinkers who ask good questions and are O.K. dealing with unstructured situations and trying to find structure in them.â
Eurry Kim, a 30-year-old âwannabe data scientist,â is studying at Columbia for a masterâs in quantitative methods in the social sciences and plans to use her degree for government service. She discovered the possibilities while working as a corporate tax analyst at the Internal Revenue Service. She might, for example, analyze tax return data to develop algorithms that flag fraudulent filings, or cull national security databases to spot suspicious activity.
Some of her classmates are hoping to apply their skills to e-commerce, where data about usersâ browsing history is gold.
âThis is a generation of kids that grew up with data science around them â" Netflix telling them what movies they should watch, Amazon telling them what books they should read â" so this is an academic interest with real-world applications,â said Chris Wiggins, a professor of applied mathematics at Columbia who is involved in its new Institute for Data Sciences and Engineering. âAnd,â he added, âthey know it will make them employable.â
Universities can hardly turn out data scientists fast enough. To meet demand from employers, the United States will need to increase the number of graduates with skills handling large amounts of data by as much as 60 percent, according to a report by McKinsey Global Institute. There will be almost half a million jobs in five years, and a shortage of up to 190,000 qualified data scientists, plus a need for 1.5 million executives and support staff who have an understanding of data.
North Carolina State University introduced a masterâs in analytics in 2007. All 84 of last yearâs graduates in the field had job offers, according to Michael Rappa, who conceived and directs the universityâs Institute for Advanced Analytics. The average salary was $89,100, and more than $100,000 for those with prior work experience.
âThis has become relevant to every company,â said Michael Chui, a principal at McKinsey who has studied the field. âThereâs a war for this type of talent.â
Because data science is so new, universities are scrambling to define it and develop curriculums. As an academic field, it cuts across disciplines, with courses in statistics, analytics, computer science and math, coupled with the specialty a student wants to analyze, from patterns in marine life to historical texts.
Claire Cain Miller is a technology reporter for The Times.
A version of this article appeared in print on April 14, 2013, on page ED18 of Education Life with the headline: The Numbers of Our Lives.