You are here

97 Percent of Data Scientists Say 'Big Data' Technology Solutions Need Improvement

Survey of Statisticians Also Shows Open Source 'R' Adoption Expected to Continue to Grow

Revolution Analytics, the leading commercial provider of R software, services and support, today released survey findings on the state of "Big Data" analytics. The company polled attendees this week at the Joint Statistical Meeting, the largest gathering of statisticians and data scientists in North America. The survey revealed nearly 97 percent of data scientists believe big data technology solutions need improvement and the top three obstacles data scientists foresee when running analytics on Big Data are: complexity of big data solutions; difficulty of applying valid statistical models to the data; and having limited insight into the meaning of the data.

Other survey findings included:

  • When asked whether they expected their use of various analytics platforms (SPSS, SAS, R, S+, MATLAB) to decrease, stay the same, or increase over the next 24 months - only open source R registered a majority of 'increased use' responses with 47 percent.
  • Over 86 percent of statisticians polled consider themselves 'data scientists'.
  • As an industry, there is no general agreement on how 'Big Data' should be defined. Survey results show factions of data scientists view the threshold of big data at a terabyte, a petabyte, or just above what can be reasonably managed for any given job.

"The next generation of R-based technology from Revolution Analytics is being designed to give data scientists more computing power, speed and agility when handling big data sets," said Jeff Erhardt, COO of Revolution Analytics. "Big data is changing the way we analyze and interpret data -- we're now in the age of Big Analytics. These survey results underscore our commitment to enabling companies to affordably solve data management and computation challenges through innovations in statistical analytics. They also reflect the growing demand for R-enabled analytics, which give companies the right algorithms and data visualization tools to process larger data sets."

Revolution Analytics' survey was conducted at the Joint Statistical Meeting and approximately 200 data scientists from a wide range of industry verticals participated. The Joint Statistical Meeting was held jointly with the American Statistical Association, the International Biometric Society (ENAR and WNAR), the Institute of Mathematical Statistics, the Statistical Society of Canada, the International Chinese Statistical Association, and the International Indian Statistical Association from July 30 to .

Additional Online Resources

About Revolution Analytics

Revolution Analytics is the leading commercial provider of software and services based on the open source R project for statistical computing. Led by predictive analytics pioneer Norman Nie, the company brings high performance, productivity and enterprise readiness to R, the most powerful statistics language in the world. The company's flagship Revolution R product is designed to meet the production needs of large organizations in industries such as finance, life sciences, retail, manufacturing and media. Used by over 2 million analysts in academia and at cutting-edge companies such as Google, Bank of America and Acxiom, R has emerged as the standard of innovation in statistical analysis. Revolution Analytics is committed to fostering the continued growth of the R community through sponsorship of the community site, funding worldwide R user groups and offers free licenses of Revolution R Enterprise to everyone in academia.

Media Contact

Jasmine Teer
LEWIS Pulse PR for Revolution Analytics
+ 1 (415) 321-2348