Skip to content
Methodology

Methodology · Model changes

Every change to the model

Numbered hexes are model versions, releases that changed the model's arithmetic, with what shipped alongside beneath them. Whenever the model changes, every past day is recomputed, so a history chart always shows one model.

ImprovementFixOthernModel version
  1. Polls for a race's lone independent are corrected, not dropped

    Oct 26

    A poll whose sponsor the feed tags independent now counts as that side's sponsored poll, lean removed, when the race has exactly one independent and the forecast places them on a side. Nebraska's Senate race gains two such polls.

    Fix · Polling average · All offices

  2. Alaska governor polls match the general ballot

    Oct 26

    Alaska's governor field now follows the Division of Elections' general ballot, which replaced a withdrawn finalist with the fifth-place ticket, and polls naming each ticket's lead candidate match it. The race gets a polling average.

    Fix · Polling average · Governor

  3. Governor averages add The New York Times's polls

    Oct 25

    Governor polls now come from The New York Times as well as VoteHub, adding polls in 30 of 36 races and the first polls in Arkansas, Idaho and Oklahoma. A poll both carry counts once.

    Improvement · Polling average · Governor

  4. Swapped field dates are repaired when the survey confirms them

    Oct 25

    A poll whose start and end dates arrive reversed is corrected when every other record of the same survey has the swapped dates. Otherwise it stays out of the averages.

    Fix · Polling average · All offices

  5. Governor polls match joint tickets

    Oct 22

    A poll naming only the top of a joint ticket now matches that ticket, which brings Ohio's governor polls into its average.

    Fix · Polling average · Governor

  6. A single feed label can be excluded

    Oct 20

    Besides firms the ratings ban, Bellwether can leave one exact pollster label out of every average, for a firm with no rating of its own.

    Improvement · Pollster ratings · All offices

  7. Model v15Oct 20

    1. House district polls stay in longer

      A district poll now counts for up to 240 days, discounted by age, instead of fading out by day 75. Many districts are polled only once or twice.

      TestedBetter log loss on 2022 and 2024 House races.

      Improvement · Polling average · House

    2. A candidate-scandal term for House races

      A nominee with a publicly known scandal loses about four points of margin from the day it became public.

      TestedFitted on 51 contested races, 2014–2024.

      Improvement · New input · House

  8. Model v14Oct 19

    1. Redrawn incumbents keep their overperformance

      In states redrawn for 2026, a returning incumbent keeps their 2024 overperformance, tapered by how much their district changed.

      TestedHeld in the 2022 redistricting.

      Improvement · New input · House

    2. House fundamentals refit on 2014–2024

      Fitted on six cycles instead of two. Seat-level uncertainty rises from 5.0 to 6.0 points.

      TestedTruer 80% intervals across six cycles.

      Improvement · Refit · House

  9. Model v13Oct 17

    1. Appointed incumbents treated as open seats

      An incumbent who did not win the seat's last election gets no incumbency credit, as in the historical fit.

      Fix · New input · Senate · Governor

    2. Senate uncertainty sized on recent cycles

      Senate fundamentals uncertainty now comes from the five latest cycles: 9.8 points, down from 13.8 since 1992.

      TestedBetter held-out log loss, 1992–2024.

      Improvement · Refit · Senate

    3. Polling error floors refit on size of miss

      The floor on a polling average's error is fitted on how far averages missed, not only who won: 5.1 points for the House, 5.55 for the Senate.

      TestedBrier 0.078 → 0.075 on 2022–2024 polling.

      Improvement · Refit · House · Senate

  10. Model v12Oct 14

    1. State lean measured against the nation

      A state's lean is now its margin relative to the national margin in the same election, so the fit and the forecast read it on one scale.

      TestedSenate even in backtests; governor slightly better.

      Fix · Structure · Senate · Governor

  11. Model v11Oct 14

    1. Ranked-choice polls read one candidate per side

      Where a party has two candidates on a first-choice ballot, its leading one is read. A poll's final two-way round is preferred.

      Fix · Polling average · House · Senate

  12. Model v10Oct 13

    1. One-party fields are certain party outcomes

      When certified ballot rules leave only one party eligible, as in some California top-two races, that party's win is certain.

      Fix · Structure · All offices

  13. Each survey counts once per matchup

    Oct 13

    A survey's population cuts and ballot versions count as one poll: final round first, then likely voters, registered voters, adults.

    Fix · Polling average · All offices

  14. Polling error floors refit for the fade

    Oct 7

    Refit with the 45-to-75-day fade in place. The live effect was small.

    Improvement · Refit · All offices

  15. Polls fade out instead of expiring

    Oct 6

    A poll counts in full for 45 days, then fades to zero by day 75, rather than dropping out all at once.

    TestedSteadier averages, as accurate or better.

    Improvement · Polling average · All offices

  16. Public launchOct 5

    Earlier changes were made while the site was in private preview.

  17. Only the independent model is published

    Oct 3

    Public pages show the model that never sees market prices. The market blend is kept for internal comparison.

    Other · Publishing · All offices

  18. Model v9Sep 27

    1. Generic-ballot polls matched across feeds

      The two poll feeds label generic-ballot answers differently; both now read as the same matchup.

      Fix · Polling average · All offices

  19. Independents' internal polls counted

    Sep 18

    A poll from an independent's campaign counts with its fitted lean removed, as party internals already did.

    Improvement · Polling average · Senate

  20. Independents rated apart from their caucus

    Sep 17

    Who an independent runs against is stored apart from the caucus they would join, so a seat can count as unaligned.

    Fix · Structure · Senate

  21. Partnerships count as their own pollsters

    Sep 16

    A partnership such as University of Houston/YouGov is its own pollster, and renamed firms are folded together.

    Improvement · Pollster ratings · All offices

  22. Incumbency and money follow the nominee

    Sep 15

    Incumbency and fundraising credit go to the settled nominee, not to the seat's party or every filer.

    Fix · New input · House · Senate

  23. Model v8Sep 4

    1. Missouri moves to its restored 2022 districts

      Missouri's House forecast uses the restored 2022 lines. Polls from before the ruling wait for boundary review.

      Other · Geography · House

  24. Model v6Aug 28

    1. House fundamentals read fundraising

      Each side's share of two-party FEC receipts is an input, which matters most in districts without polls.

      TestedHeld-out uncertainty 5.3 → 5.0 points.

      Improvement · New input · House

  25. One polling average per matchup

    Aug 28

    Each polled pairing gets its own average. Before a primary settles, pairings are weighted by how likely each is.

    Improvement · Polling average · All offices

  26. Decided seats are counted, not simulated

    Aug 23

    A seat already won, such as one with no opponent filed, counts for its winner in every run.

    Fix · Structure · All offices

  27. Sponsored polls counted, lean removed

    Aug 23

    Campaign and partisan polls count after their fitted lean toward the sponsor is removed: 6.4 points in the House, 5.6 for Senate and governor.

    TestedMore districts averaged; 2024 House Brier 0.114 → 0.103.

    Improvement · Polling average · All offices

  28. Averages follow a changed matchup

    Aug 22

    The guard against sudden jumps in an average lets one through when the race's matchup changes.

    Fix · Polling average · All offices

  29. Silver Bulletin's 2026 pollster ratings adopted

    Aug 22

    Ratings enter through each firm's historical lean and its ban status. The quality score fitted at zero weight.

    Improvement · Pollster ratings · All offices

  30. Model v5Aug 17

    1. Polling averages keep their uncertainty

      Each day of a polling average's history stores its uncertainty, so race pages can draw a band around the line.

      Other · Publishing · All offices

  31. Model v4Aug 17

    1. Polls matched across feeds by candidates

      A poll carried by both feeds is matched on the candidates it offered, so it counts once.

      Fix · Polling average · All offices

  32. Model v3Aug 16

    1. Chamber dots sampled by percentile

      The hundred runs drawn on a chamber page are one per percentile of the simulation, so their split matches the published probability.

      Other · Publishing · All offices

  33. Model v2Aug 16

    1. Senate history records its ballot reading

      Each recomputed day of the Senate forecast stores the generic-ballot reading it used, falling back to the House average as the live forecast does.

      Other · Publishing · Senate

  34. Model v1Aug 16

    1. House national anchor refit

      The House anchor is fitted on the same presidential lean it is applied to.

      Tested2024 Brier 0.027 → 0.021.

      Fix · Refit · House

  35. House effects shrink toward each firm's history

    Aug 12

    A pollster's lean this cycle is shrunk toward its historical lean, not toward zero.

    TestedBetter 2024 House and Senate Brier.

    Improvement · Pollster ratings · All offices

  36. Governor forecasts added

    Aug 11

    Every 2026 governor race is forecast, with fundamentals and a polling floor fitted on past governor races.

    Tested140 held-out races: Brier 0.159 → 0.108.

    Improvement · Structure · Governor

  37. Poll weights fitted on 2,533 past polls

    Aug 9

    Sample size, age, house effects and an error floor are fitted on FiveThirtyEight's House and Senate archive.

    Tested2022–2024 Brier 0.107 → 0.081.

    Improvement · Polling average · House · Senate

  38. Senate fundamentals fitted on 2016–2024

    Aug 9

    Fitted values replace hand-set ones. The window was chosen by testing on races back to 1992.

    Tested536 held-out races: Brier 0.114 → 0.100.

    Improvement · Refit · Senate

  39. Environment uncertainty grows with time left

    Aug 9

    The generic ballot is read as a forecast of November, with uncertainty that grows with the days remaining.

    Improvement · Structure · House

  40. House fundamentals fitted on past results

    Aug 8

    Lean, incumbency and overperformance are fitted on 788 contested 2022 and 2024 races, each year's national environment estimated apart.

    TestedFit on 2022, scored on 2024: error 3.8 → 3.3 points.

    Improvement · Refit · House

  41. An independent model, apart from markets

    Aug 8

    Each race gets a forecast that never sees market prices. No blend is more confident than its most confident input.

    Improvement · Structure · All offices

  42. Correlated errors in the simulation

    Aug 8

    Each run draws a national, a state and a race error, so seats in one state move together.

    Improvement · Structure · All offices

  43. Estimates combined as margins

    Aug 8

    Inputs are combined as margins weighted by precision, and disagreement widens the result.

    Improvement · Structure · All offices

  44. Duplicate polls counted once

    Aug 8

    A poll carried by both feeds counts once, and a firm spelled two ways counts as one.

    Fix · Polling average · All offices