Economic Evaluation in Health  ·  Faculty workshop  ·  Session 7

Modelling in half an hour

Why a model exists, what a decision tree and a Markov model do, what a cycle is, and what to distrust. For reading models, not building them.

Drummond et al., 4th ed., Chapter 9

By the end of this session

  1. Say why most economic evaluations are models, not trials
  2. Read a decision tree and roll it back
  3. Say what a Markov model and a cycle are
  4. Name what the Markov assumption forgets
  5. Ask seven questions of any published model

Why a model at all?

A trial gives youA decision needs
two or three armsevery relevant option, including current practice
one to three years of follow-upa lifetime, if survival differs
clinical outcomesQALYs, costs, Indian prices
a selected population, often abroadIndian patients in Indian facilities

A model is a framework for combining evidence from many sources to answer a question no single study answered.

Two shapes you will meet

Decision tree

Branches for choices and chance events, ending in outcomes. Events happen once, over a short period.

A test, a course of treatment, an acute episode.

Markov model

A few health states; people move between them in repeated cycles. Events recur over a long period.

Chronic disease, cancer recurrence, a lifetime horizon.

Many papers use both: a tree for the first event, a Markov model for what follows.

A decision tree

Drug A ₹10,000 Drug B ₹4,000 cure 0.8fail 0.2 cure 0.6fail 0.4 cured second-line + ₹20,000 cured second-line + ₹20,000 decisionchancechance

Constructed example. Square: a choice. Circle: chance. Triangle: where a path ends.

Rolling it back

Multiply along each path, then add the paths.

Expected costFirst-line cures
Drug A10,000 + 0.2 × 20,000 = ₹14,0000.8
Drug B4,000 + 0.4 × 20,000 = ₹12,0000.6
A versus B+₹2,000+0.2
ICER = 2,000 ÷ 0.2 = ₹10,000 per additional cure

Drug A costs six thousand rupees more at the counter but only two thousand more overall, because it avoids second-line treatment.

Constructed example.

When a tree breaks

  • Events recur: relapse, re-admission, a second stroke
  • Risk changes with time: age, years since surgery
  • The horizon is long, so the tree would need thousands of branches

Then you stop drawing every path and instead track how many people are in each state, year by year.

A Markov model

Well Sick Dead 0.100.020.20 0.880.801.00

States are exhaustive and exclusive: everyone is in exactly one.

Arrows carry the probability of moving in one cycle. Each state's arrows add to 1.

Dead is absorbing: nobody leaves.

Each state carries a cost and a utility per cycle.

Constructed example.

What a cycle is

Start 1,000 people in Well. Apply the arrows once per cycle, here one year.

CycleWellSickDeadQALYs this cycle
01,00000n/a
188010020852
277416858798

QALYs = people × utility (Well 0.9, Sick 0.6). Do the same with costs. Run until nearly everyone is dead, discount, add up. Then do it again for the other option.

Constructed example. Cycle 2: Well 880 × 0.88; Sick 100 × 0.80 + 880 × 0.10; Dead the rest.

What the model forgets

The Markov assumption: where you go next depends only on the state you are in now, not on how you got there or how long you have been there.

The problem

Recurrence after cancer surgery is highest in the first two years. A single "disease-free" state gives everyone the same risk in year 1 and year 10.

The usual fixes

Split the state by time since event ("tunnel" states), let probabilities change with age, or simulate individuals instead of a cohort.

If history matters clinically, check that the model remembers it.

How long is a cycle?

  • Short enough that two events rarely happen in one cycle
  • Matched to the disease: months for cancer on treatment, a year for slow chronic disease
  • People move at the end of a cycle but really move halfway through on average, so careful models apply a half-cycle correction

You need not compute any of this. You need to find the cycle length in the paper, and notice if it is missing.

Where the numbers come from

InputUsual sourceWhat to ask
Transition probabilitiestrials, cohorts, registriesFrom India? Over what follow-up?
Beyond follow-upextrapolationHow was it extended, and was it tested?
UtilitiesEQ-5D surveysIndian value set?
Costs per statecosting studies, package ratesThe five costing errors

A model built entirely on borrowed numbers can be internally perfect and still answer someone else's question.

Seven questions for any published model

  1. Is there a diagram of the structure? Could you redraw it?
  2. Do the states include every event that differs between the options?
  3. Is the cycle length stated and sensible?
  4. Where do the probabilities come from, and from which country?
  5. How far does it extrapolate beyond the evidence?
  6. Was it validated: does it reproduce known survival or incidence?
  7. Were structural alternatives tested, or only parameters?

And your paper

  1. Is it a model? A tree, a Markov model, both, or neither?
  2. Name the health states and the cycle length
  3. Which of the seven questions can the paper not answer?

Two sentences on its structure, ready for the report-back.

Sources

  1. Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the Economic Evaluation of Health Care Programmes. 4th ed. Oxford University Press; 2015. Chapter 9, Economic evaluation using decision analytic modelling.
  2. Briggs A, Sculpher M. An introduction to Markov modelling for economic evaluation. PharmacoEconomics 1998;13(4):397–409. PMID 10178664
  3. Caro JJ, Briggs AH, Siebert U, Kuntz KM. Modeling good research practices: overview. A report of the ISPOR-SMDM Modeling Good Research Practices Task Force-1. Value Health 2012;15(6):796–803. PMID 22990082