Skip to main content

Quantum Epistemology for Business

To truly understand data, we need to rethink what we mean by "measurement"

This article was published in Scientific American’s former blog network and reflects the views of the author, not necessarily those of Scientific American


“One should be especially careful in using the words ‘reality,’ ‘actually,' etc., since these words very often lead to statements [without any empirical content].” — Werner Heisenberg

As recently as a decade ago, most business decisions were based on very limited data. More recently, an explosion of data, a dramatic decline in the cost of processing power and advances in machine learning have created the expectation we will be able to capitalize on a data windfall to revolutionize most aspects of business. The data (from the Latin datum—a thing which is given) on which machine learning and analytics are built, are taken as given and incontrovertible. But what managers, data scientists and social scientists think of as data is in fact not given. It is the outcome of a process of measurement—an interaction between an observer, a technique or apparatus and a context.

As every seasoned executive knows, asking for data to inform an important decision can set in motion a process in which facts and figures are colored, filtered, obscured, deleted, shaded, clipped and even fabricated. In practice, the result depends on whom you ask for it (observer dependence), how you ask for it (frame dependence) and when and under what conditions you ask for it (context dependence). Equally, the process by which we ask people to report preferences, emotions and perceptions can interfere with the underlying state, to the point where inquiries can create rather than report the states they refer to. “Are you happy?” triggers a complex set of considerations about self and others which make it overly simplistic to interpret “yes” as “s/he is happy.” Research suggests that individual dispositions and propensities are second-person specific (“happy towards whom?”; “signaling happiness in the presence of whom?”).


On supporting science journalism

If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


These limitations of data and measurement are precisely the grist of quantum mechanics, one of the most successful predictive theories humans have developed to describe the world. Quantum mechanics has also produced a model of measurement that uses concepts like indeterminacy, superposition, entanglement and observer-dependence very precisely. This model can be used in other contexts, with phenomena that do not occur on the space-time scales of quantum mechanics.

Indeterminacy refers to the impossibility of jointly measuring certain pairs of variables, such as the momentum and position of a particle, with high accuracy. When we survey social and organizational interactions that create measurements we call data, we find many examples of such Heisenberg-complementary variable pairs.

Say you are trying to simultaneously measure the motivational force of an emotional state of a person and her awareness of that state. If a person’s awareness of being in a state (“excited”) impacts the motivational force of the state (because, for instance, the process of answering a question or filling out an instrument changes the intensity of the state), or vice versa, then we cannot measure both variables with the same accuracy. And, if both variables are relevant to the person’s propensity to act in a certain way in a given situation, then we are faced with a Hobsonian choice.

Superposition, non-locality and entanglement. Quantum mechanics describes physical systems as being in superpositions of states (both spin-up and spin-down), rather than discrete states (spin-up or spin-down). Moreover, when we do measure the state of one entity (an electron), the result (spin-up or spin-down?) can impact the measured state of other entities (other electrons), even if the second measurement is performed so far away as to preclude the two entities from communicating to one another at velocities lower than the speed of light. That’s what physicists mean by “entanglement.”

Data-generating processes (producing “measurements”) in organizations can exhibit similar patterns.

Superposition: Humans frequently experience radical ambivalence with respect to internal states and dispositions to act. Research suggests that ambivalence is in fact not “uncertainty about how you really feel”—which could be resolved by clever observation and inquiry—but a superposition of dispositional, motivational or emotional states. Measurements will collapse this superposition into a single state corresponding, say, to one motivation or another. Whatever we end up declaring to be data—the stuff we feed to predictive algorithms and take as axiomatic—depends on the process we used to “collapse the superposition.”

Non-locality: When we try to create composite estimates of the variables that matter to the success of an organization (like “heed” or “openness”) by measuring individual level variables (like “attention span” and “reward sensitivity”), the responses we get likely reflect non-local interactions, even if information flow is strictly classical in nature. Managers behave and respond in ways that depend on underlying “epistemic networks,” which reflect what they think others in their network think, what they think others think they think, and so forth. They often give answers and produce behaviors that shape and adapt to the perceived social context.

Observer-dependence and frame-dependence. As every CEO knows, initiating a “transformation process” is not just hard work but treacherous work: the information you need to do the right thing will be highly dependent on the perceptions, incentives and behaviors of those on whom you rely to provide that information. The choice of dimensions and rubrics on questionnaires and interview and focus group scoring sheets will generate different response patterns based on choice of words, sequence of questions, grammatical complexity, perceived intent and purpose—as well as the perceived emotional temperature (active/passive, positive/negative, dominant/submissive) of the instrument we use to inquire.

We are laboring under the illusion of “classical information” and “classical measurement” when we deal with human and organizational phenomena. Insights from quantum epistemology raise indelible doubts about the given-ness of data. But businesspeople need more than reasonable doubt: they need insights and action prompts. How can we leverage “quantum effects” in human organizations? The “quantum epistemology of social phenomena” is in its infancy, but already can provide a battery of new questions for those who want to understand and shape the process of measurement.

Contextualizing the “given”: The examples demonstrate how important it is to grasp the process by which data is generated, and, in particular:

What is the purpose of the measurement?

What is the measurement “apparatus”?

Gauging the importance of quantum effects: These effects will be more critical in some contexts than others, leading us to ask:

Do the people whose behavior we are measuring interact with each other?

Does it involve possibly complementary variables like perceptions and emotions?

Separating the separable: The examples also show how important it is to consider the pairwise interactions among different measurements, which suggests that we should also ask:

What are the organizational variables whose measurements are likely to interfere with one another?

By what mechanism does this interference happen?

How do we mitigate it?

Making Heisenbergian uncertainty part of the “interrogator’s toolkit”: Something is real if it is real in its conseqences, argued sociologist David Émile Durkheim in the early 20th century. Every strategist has a little Durkheim floating around in her mind: she knows that even talking about measuring a variable that impacts a decision with economic consequences will itself have economic consequences. These considerations are rarely applied to measurement processes—leading us to ask:

How does the decision to measure shape perceptions and motivations?

How does the specific way in which we measure shape them?

How does the announcement of the results shape subsequent attempts to measure—and the outcomes?

Taking superpositions seriously. Just as quantum computation harnesses phenomena of superposition to generate useful work, taking the radical indeterminacy of affective states seriously can generate useful strategies for intervening in organizations, by asking:

What is the likely set of states the system we are trying to measure is “simultaneously” in?

What are the ways in which a measurement can “make real” a possible world we want to bring about—or one we desperately wish to avoid?