Finding a decent data scientist for less than the price of a deposit on a Sydney harbour side home is almost impossible these days. But that could change quickly and dramatically due to automation, according to research analysts at Gartner.
More than 40 per cent of data science tasks will be automated by 2020, resulting in increased productivity and broader usage of data and analytics by citizen data scientists, say the researchers.
Gartner defines a citizen data scientist as a person who creates or generates models that use advanced diagnostic analytics or predictive and prescriptive capabilities, but whose primary job function is outside the field of statistics and analytics.
According to researchers, citizen data scientists can bridge the gap between mainstream self-service analytics by business users and the advanced analytics techniques of data scientists.
Indeed Gartner believes that by 2019, citizen data scientists will surpass data scientists in the amount of advanced analysis produced.
Automation will allow them to perform sophisticated analysis that would previously have required more expertise, enabling them to deliver advanced analytics without having the skills that characterise data scientists.
The study argues that vendors are now focused on making simplification a top goal through the automation of various tasks, such as data integration and model building.
According to Alexander Linden, research vice president at Gartner, “Making data science products easier for citizen data scientists to use will increase vendors’ reach across the enterprise as well as help overcome the skills gap. The key to simplicity is the automation of tasks that are repetitive, manual intensive and don’t require deep data science expertise.”
Data scientists inside companies will also benefit from automation of course as it will also lead to significant productivity improvements for data scientists.
There will however be fewer data scientists needed to do the same amount of work, but every advanced data science project will still require at least one or two data scientists.
A vast amount of analysis produced by citizen data scientists will feed and impact the business, creating a more pervasive analytics-driven environment, while at the same time supporting the data scientists who can shift their focus onto more complex analysis.
“Most organisations don’t have enough data scientists consistently available throughout the business, but they do have plenty of skilled information analysts that could become citizen data scientists,” said Joao Tapadinhas, research director at Gartner. “Equipped with the proper tools, they can perform intricate diagnostic analysis and create models that leverage predictive or prescriptive analytics. This enables them to go beyond the analytics reach of regular business users into analytics processes with greater depth and breadth.”
According to Gartner, the result will be access to more data sources, including more complex data types; a broader and more sophisticated range of analytics capabilities; and the empowering of a large audience of analysts throughout the organisation, with a simplified form of data science.
“Access to data science is currently uneven, due to lack of resources and complexity — not all organisations will be able leverage it,” said Tapadinhas. “For some organisations, citizen data science will therefore be a simpler and quicker solution — their best path to advanced analytics.”