Automation strikes again: Data Science jobs at risk, is there opportunity for channel?

​Data scientists could be out of job in the next few years, with Gartner predicting more than 40% of data science tasks will be automated by 2020.

The analyst firm says this will result in increased productivity and broader usuage of data and analytics by citizen data scientists.

Gartner defines a citizen data scientist as a person who creates or generates models that use advanced diagnostic analytics or predictive and prescriptive capabilities, but whose primary job function is outside the field of statistics and analytics.

According to Gartner, citizen data scientists can bridge the gap between mainstream self-service analytics by business users and the advanced analytics techniques of data scientists.

"They are now able to perform sophisticated analysis that would previously have required more expertise, enabling them to deliver advanced analytics without having the skills that characterise data scientists," the company explains.

With data science continuing to emerge as a powerful differentiator across industries, Gartner says almost every data and analytics software platform vendor is now focused on making simplification a top goal through the automation of various tasks, such as data integration and model building.

"Making data science products easier for citizen data scientists to use will increase vendors' reach across the enterprise as well as help overcome the skills gap," explains Alexander Lindin, research vice president at Gartner.

"The key to simplicity is the automation of tasks that are repetitive, manual intensive and don't require deep data science expertise," he says.

Linden says the increase in automation will also lead to significant productivity improvements for data scientists.

"Fewer data scientists will be needed to do the same amount of work, but every advanced data science project will still require at least one or two data scientists," he states.

Joao Tapadinhas, research director at Gartner, says the analyst firm also predicts that citizen data scientists will surpass data scientists in the amount of advanced analysis produced by 2019.

"A vast amount of analysis produced by citizen data scientists will feed and impact the business, creating a more pervasive analytics-driven environment, while at the same time supporting the data scientists who can shift their focus onto more complex analysis," says Tapadinhas.

"Most organisations don't have enough data scientists consistently available throughout the business, but they do have plenty of skilled information analysts that could become citizen data scientists," he says.

"Equipped with the proper tools, they can perform intricate diagnostic analysis and create models that leverage predictive or prescriptive analytics.

"This enables them to go beyond the analytics reach of regular business users into analytics processes with greater depth and breadth," explains Tapadinhas.

According to Gartner, the result will be access to more data sources, including more complex data types; a broader and more sophisticated range of analytics capabilities; and the empowering of a large audience of analysts throughout the organisation, with a simplified form of data science.

"Access to data science is currently uneven, due to lack of resources and complexity not all organizations will be able leverage it," says Tapadinhas.

"For some organizations, citizen data science will therefore be a simpler and quicker solution their best path to advanced analytics," he says.