Photo by Tolga Ulkan on Unsplash

Exploring the Multiverse of “What If”: The Power of Counterfactual Reasoning in AI”

Harsh Agrawal

--

Counterfactual Reasoning is a term that I heard in a doc and made me deep dive into to find what it’s all about. I know it sounds like a big, fancy term but trust me, it’s not as complicated as it sounds. Imagine you’re faced with a decision, as adults often are in our daily lives — maybe it’s choosing between two job offers, deciding whether to invest in stocks or bonds or even something as simple as selecting a restaurant for dinner. You make a choice and move forward, but have you ever stopped to wonder what might have happened if you had chosen differently?

That’s where counterfactual reasoning comes into play. It involves mentally simulating alternative outcomes that could have occurred if different choices were made. It’s like exploring the “what ifs” of life.

For example, let’s say you accepted one job offer over another. With counterfactual reasoning, you might ponder what your career path would look like if you had chosen differently. Would you have different growth opportunities? Would your work-life balance be better or worse?

It’s not just about regret or second-guessing decisions; it’s a valuable cognitive tool for understanding causality and learning from our experiences.

By considering different “what If” scenarios, we can gain insights into how our decisions shape outcomes so we can take profound decisions in the future.

Let’s Discuss some Technicality

Photo by Pablo García Saldaña on Unsplash

From a cognitive perspective, counterfactual reasoning relies on mental simulations and inferences that enable users to construct and evaluate multiverse scenarios.

These mechanisms involve skimmed data gain from memory, manipulating variables and assessing the plausibility and consequences of different hypothetical situations.

Challenges:

It has never been an easy task as limitations are always there:

Data Availability: let’s think of data availability like ingredients for our favorite dish. When we are cooking we need the right set of ingredients to make a delicious meal. Similarly in decision making, we need the right information or data to make conclusions.

If you don’t have enough data, it’s like cooking without all the ingredients. The availability of relevant data is crucial because, without it, we may overlook important factors or inaccurately assess the potential outcomes of different choices.

Causality: Causality is like understanding the cause-and-effect relationships in life. It’s the idea that one thing causes another to happen. For example, if you eat too much candy, you might get a stomach ache. Here, eating candy is the cause, and the stomach ache is the effect. Understanding causality helps us figure out why things happen the way they do and predict what might happen next.

Cognitive Biases: Imagine you have a pair of glasses that sometimes distorts how you see things. Cognitive biases are like those glasses — they’re mental shortcuts or patterns in thinking that can sometimes lead us to make decisions or judgments in a way that might not be entirely accurate or fair.

In counterfactual reasoning, being aware of these biases is crucial because they can affect our ability to accurately evaluate alternative scenarios and make informed decisions.

Advantages Of Counterfactual Reasoning

Counterfactual Reasoning provides us transparency towards the decision-making process of the AI system and also makes it easier to understand and interpret its choices according to our needs.

It allows us to have a more accurate and precise assessment of AI predictions and their biases.

It helps in the improvement of different inputs which can lead to more reliable AI solutions.

Most importantly it helps us to build trust in AI systems.

How Spotify use it 🎵

Photo by sgcdesignco on Unsplash

Spotify is using counterfactual reasoning to finds the impacts of its content recommendations on every user engagements. They find the loop holes which causes stop in user engagement from their recommendation system by considering what might have happened if different song choices provided.

They have developed a machine learning model to capture the counterfactual analysis which helps them to improve recommendations.

Some other major companies using these methods are Netflix, Uber, Amazon, Facebook, and Google to leverage the impact of decision-making with optimized outcomes.

Well this is my first ever medium blog soon will be coming up with more detailed topics about the Metaverse Of AI and how to control it.

--

--

Harsh Agrawal

DataScience @TigerAnalytics | Product Developer | Google Solution challenge global finalist | Exploring Metaverse of AI