Human or Machine? Two Paths for Deploying Analytics
By Bill Franks, Mar 14, 2019
As data science and analytics teams continue to feel pressure to deliver more value from analytics, many organizations still struggle with the processes and technology required to deploy models into production and more rapidly make data-driven decisions. When evaluating how to best undertake these activities, organizations should consider an important distinction to determine the best path forward.
HUMAN OR MACHINE?
The pervasive level of analytics required to reach Level 4 or 5 on IIA’s Analytics Maturity Model requires that a significant number of analytics products are integrated into business operations. These products can be used to help humans make a better decision in the context of their workflow. For example, a call center rep might see cross-sell offers prioritized based on the context of an interaction. Or, a supply chain manager might receive an alert that the forecasted price of a key ingredient has significantly changed so that they can take action.
Analytics products can also be integrated into business processes to guide the decision making of a machine. Examples include automatically underwriting a life insurance application or managing the dynamic pricing of airline seats.
The roles, processes, and technology needed to inform a human decision maker are very different than those needed to inform a machine decision maker. Exactly who, or what, will be making a decision should be established early on to ensure the final product is designed for the correct end user.
Many data science and analytics groups develop models while focusing primarily on the data, analytic techniques, and business problem. In a pilot phase, this is sufficient. However, there are significant differences between automating a decision for a machine versus informing a decision for a human. These differences need to be accounted for throughout the analytical development and deployment process.
While the algorithmic approach may be consistent whether informing a human or a machine to make a decision, the supporting architecture, data provisioning, and process monitoring needs to be very different.
For example, when call center employees are delivering offers from a script, they are able to identify if something has gone haywire and what they are seeing makes no sense. They may or may not deal with the situation optimally, but they will notice quickly, report the issue, and attempt to adjust.
An automated machine-based decisioning process, however, will only be able to assess problems within the exact context and parameters that are programmed into it. The process may not even realize that something has gone haywire, let alone report it or try to adjust. Care must be taken to build in more validation logic and / or to have a human monitoring a process as it runs, much like how humans monitor manufacturing processes.
There is an inherent advantage to having many people observing the actions of an analytic process on an ongoing basis. Enabling human-based decisions provides ample opportunity for the organization to find issues. A machine-based process, on the other hand, will simply continue stamping out decisions regardless of an obvious-to-a-human problem arising. A much higher level of monitoring and results tracking is required when deploying analytics to facilitate a machine-based decision.
Another major difference between human- and machine-based decisions is the speed and scale of the decisions being made. While the number of cross-sell offers made in a call center in a day may be impressive, it would pale in comparison to the number of decisions being made by machines optimizing output within a complex assembly line. Machine-based decisions often occur at a rate that is orders of magnitude higher than human decisions. This necessitates a more scalable, sophisticated, and performant pipeline from raw data to recommended decision.
FROM MANY TO MILLIONS
As the practice of analytics matures within a company, opportunities that drive significant value by informing human back office or strategic decisions are typically found early. The current frontier for most companies is not assisting a few decisions that create millions in value but assisting millions of decisions that each create a small amount of value. These small individual values can add up to a massive number in total and the pursuit of this frontier is the foundation of The Analytics Revolution currently underway.
While organizations must aggressively pursue analytics that inform both human- and machine-based decisions, the differences in the requirements for each must also be understood and accounted for from the beginning. The failure to recognize the distinction has led many organizations to struggle more than needed.
About the author
Bill Franks is IIA’s Chief Analytics Officer, where he provides perspective on trends in the analytics and big data space and helps clients understand how IIA can support their efforts and improve analytics performance. His focus is on translating complex analytics into terms that business users can understand and working with organizations to implement their analytics effectively. His work has spanned many industries for companies ranging from Fortune 100 companies to small non-profits.
Franks is the author of the book Taming The Big Data Tidal Wave (John Wiley & Sons, Inc., April, 2012). In the book, he applies his two decades of experience working with clients on large-scale analytics initiatives to outline what it takes to succeed in today’s world of big data and analytics. Franks’ second book The Analytics Revolution (John Wiley & Sons, Inc., September, 2014) lays out how to move beyond using analytics to find important insights in data (both big and small) and into operationalizing those insights at scale to truly impact a business. He is an active speaker who has presented at dozens of events in recent years. His blog, Analytics Matters, addresses the transformation required to make analytics a core component of business decisions.
Franks earned a Bachelor’s degree in Applied Statistics from Virginia Tech and a Master’s degree in Applied Statistics from North Carolina State University. More information is available at www.bill-franks.com.