PRESS RELEASE – WÜRZBURG, June 2nd, 2022
BARC (Business Application Research Center) releases the results of its new topical survey “Driving Innovation with AI. Getting Ahead with DataOps and MLOps”. This global survey gives insights into the perception of DataOps and MLOps and related issues. The study is available for download free of charge thanks to sponsorship by ONE LOGIC, Domino Data Lab and DataRobot.
- – Key Finding #1: DataOps and MLOps are widely perceived as relevant concepts for addressing common ML challenges and issues, but only 50 percent of companies already using ML have begun implementing them.
- – Key Finding #2: The concepts live up to their reputation and can provide successful solutions to numerous challenges, help to cope with complexity and enable faster deployments. 97 percent of those who have implemented data/MLOps say they have made significant improvements as a result.
- – Key Finding #3: While open source is dominating the scene, the complexity-reducing and accelerating effect of commercial tools and platforms in the provision of ML results can play an important role for the implementation of Data/MLOps.
- – Key Finding #4: The adoption of DataOps and MLOps is also having a positive impact on the success of other measures such as hiring experts and using new tools, platforms and infrastructure. However, there are still unresolved challenges, most notably access to data and overall acceptance of ML solutions in the broader enterprise context.
What benefits can you expect from Data/MLOps?
According to the results of BARC’s new survey, most companies have only just started their ML journey so have not yet deployed an ML model. Nevertheless, most respondents have already familiarized themselves with the concepts of DataOps and MLOps and are evaluating their implementation. The proportion of those who have already at least partly adopted DataOps and MLOps is surprisingly low at 26 percent. Of the ML practitioners surveyed who have deployed at least one ML model, half have already adopted DataOps and MLOps to some degree and 97 percent of those said they have achieved significant improvements by doing so (see Figure 1).
Figure 1: Which significant improvements has your company achieved with the introduction of MLOps/DataOps? (n=61)
“This is no surprise as DataOps focuses on the realization of a manageable, maintainable and automated flow of quality-assured data to data products whose success depends on being up to date,” said Alexander Rode, Data & Analytics Analyst at BARC and co-author of the study. “MLOps addresses the additional special requirements of the development, deployment and maintenance of ML models which are also data products. The goal of both concepts in this context is to achieve transparency regarding all interdependencies across involved systems along an end-to-end data pipeline and to foster collaboration between experts by making the process of developing, updating and maintaining ML models more agile and efficient.”
The survey also uncovered several other positive effects and comparative advantages that can be attributed to the adoption of DataOps and MLOps.
Software selection also matters
In general, DataOps and MLOps as process-oriented concepts can be implemented with open source and commercial tool stacks alike. Nevertheless, the study results show that users of commercial tools are less likely to experience overwhelming complexity as soon as ML models are deployed. The type of tool used makes little difference in the phase before the first deployment (see Figure 2).
Figure 2: Tool stacks compared by actual complexity vs. expected complexity, by level of advancement (ML beginners: n=99; ML practitioners: n=100)
“In our opinion, this time should be used to experiment with different tools and to evaluate present and future requirements,” said Rode. “We recommend getting familiar with the concepts of DataOps and MLOps as they address most of the challenges and problems of applied AI. The survey results indicate that this is not a bad idea anyway. Just occupying yourself with these concepts seems to have a positive effect on the perception and handling of ML-related work. The adoption of DataOps and MLOps also promotes the faster deployment of ML models.”
About the survey
Driving Innovation with AI. Getting Ahead with DataOps and MLOps is a BARC market research study that examines the perception and impact of DataOps and MLOps in companies who want to make use of machine learning. It is based on a worldwide survey of 248 companies of various sizes and industries. The authors of the study are BARC Analysts Alexander Rode and Timm Grosser.
BARC (Business Application Research Center) is one of Europe’s leading analyst firms for business software, focusing on the areas of data, business intelligence (BI) and analytics, enterprise content management (ECM) and customer relationship management (CRM). The company was founded in 1999 as a spin-off of the Chair of Business Administration and Information Systems at the Julius-Maximilians-University in Würzburg. Today, BARC combines empirical and theoretical research, technical expertise and practical experience, including a constant exchange with all market participants.
For all enquiries and further information, please contact:
Tel: +49 (0) 931 880651-47
Mobile: + 49 (0) 1520 431 82 39