← Kairos MBA MasterclassAll programsHomeSearch
Kairos MBA Masterclass·20:14

Important Terminologies: Correlation vs Causation, Input vs Output Metrics, Pareto, False Positives, and A/B Tests

Anand Menon Analytics trainer - heads strategy, special projects and international business at Wakefit; ex Flipkart (kids fashion P&L) and Sephora India; IIM Kozhikode

The short version

  1. Correlation is not causation: ice cream and sunburn share hot weather; rising makeup prices and rising sales share rising demand - so if you are ahead of plan, relax discounts and bank margin (0:02-0:05).
  2. You cannot move an output (revenue, NPS, a marathon time) directly; move inputs (meetings, traffic, add-to-cart, resolution speed). Leading indicators predict, lagging ones report; optimise leading ones in weeks, not quarters. Pareto: 80% of outcomes from 20% of causes - SKUs, customers, keywords (0:05-0:14).
  3. False positives vs false negatives: decide which error you can live with (medicine, courts, factory QC). A/B test: control 1%, marketing variant 1.1%, product variant 1.15% - and you may still pick 1.1% if it fits the brand goal, because it beats today. Measure incrementality over control (0:14-0:20).

At a glance, three clicks deep

Skim here first: the closed row is the glance, open is the study card with the key points and timestamps, and the ↓ link drops to that concept's full write-up below.

01Correlation vs causationLook for the hidden third variable.›

Look for the hidden third variable.

Three examples (0:02-0:05)

↓ Full write-up of this concept

02Input vs output metrics; leading vs lagging indicatorsMove inputs;›

Move inputs; watch leading indicators.

Inputs (0:05-0:09)

Lead vs lag (0:09-0:11)

↓ Full write-up of this concept

03Pareto, false positives vs negatives, and A/B testing80/20;›

80/20; choose your error; test against a control.

Pareto (0:11-0:14)

Errors (0:14-0:16)

A/B (0:16-0:20)

↓ Full write-up of this concept

The concepts in full

01

Correlation vs causation

Price went up and sales went up. Before you raise prices everywhere, find the third thing.

Two metrics moving together need not be cause and effect. Ice cream and sunburn share hot weather; big houses and long lives share the ability to afford healthcare; makeup prices and sales both rising from October to December share festive demand. Discounts normally move inversely to sales, so rising price with rising sales signals demand strength - if you are already ahead of the annual plan, relax discounts and bank margin.

Why it matters

The single most common analytical error, with a business consequence attached.

02

Input vs output metrics; leading vs lagging indicators

Nobody finishes a marathon by staring at the finish time. Work the calories and the mileage.

Outputs (revenue, NPS, finish time) cannot be moved directly; inputs can. B2B: meetings, qualified leads, trade shows. Ecommerce: traffic, product-page views, add-to-cart, then conversion. Support: response and resolution speed drive satisfaction. Leading indicators predict future success (on-time delivery -> NPS; daily calories -> weight; new launches -> repeat rate); lagging indicators measure past performance. Optimise leading indicators within a week or two instead of waiting a quarter.

Why it matters

Decides which numbers belong on the weekly review.

03

Pareto, false positives vs negatives, and A/B testing

A factory should tolerate false negatives - better to re-check a good unit than ship a bad one. Decide which error you can afford.

Pareto: 80% of outcomes from 20% of causes - sales from SKUs, revenue from customers, search visits from keywords (prioritise the 500 by volume), industry profit from companies; focus on the 20%, delegate or drop the rest (reused later: 23 of 553 SKUs; 3 of 12 pricing factors). False positive = a positive result that should be negative; false negative the reverse; design for the acceptable error: medicine prefers false positives (retest), courts false negatives (innocent until proven), QC false negatives. A/B test: control sees the default; variants differ; marketing wants the campaign category on top (1.1%), product wants cheapest first (1.15%), control 1% - either beats today, so the brand goal may still pick 1.1%. Report incrementality over control.

Why it matters

Three tools that recur through the Excel case and the pricing model.

Tools referenced

ToolCoverageMomentContext
Microsoft ExcelexplainedSubject of the lesson; nothing else demonstrated

Action items

    Resources mentioned

    Resources
    • docLesson page on the platform

    Extraction notes

    This page was built from an auto-generated transcript, which garbles product and people's names. Those were corrected silently in everything above and logged here for transparency. The warnings flag claims that were true on the recording day but change fast.

    Transcript corrections applied

    The transcript saysThe trainer actually means
    test case / SQ / SQLSKU
    GMBGMV
    average selling pointaverage selling price (ASP)
    1 0 1 / 2 0 1101 / 201

    True on recording day — verify before relying