Now they’ve had a day to do some basic analysis of the Scottish exam results the newspapers have had a chance to put their spin on the story – and the narrative runs something like this:
First narrative – ‘Scottish pupils have had their teacher predicted grades lowered by the qualifications authority’.
Second narrative: – Poor Scottish pupils have had their teacher predicted grades lowered more than rich pupils.
Links to both the above are at the end of this article
This makes for a great story, but I think they might be misleading. As far as I can see, this year’s National Five Scottish students have done better than they would, on average, had they sat the exams.
If you compare the previous years’ results with the teacher predicted grades you get to see how exaggerated those predictions were…..
A comparison of previous year’s results with teacher predicted grades and the actual downward-adjusted grades
All of the data above is from the articles linked below – NB the blue column for the least and most deprived clusters is only 2019 data, A-C pass rate, and the exam results I’m looking are the National 5s, equivalent to the English GCSE.
What’s really going on?
- Teachers in Scotland grossly inflated the predicted grades of their pupils, by 10% compared to previous years on average.
- They exaggerated the results of the poorest students more than for rich students (bloody left-wing teachers that is!)
- The exam authorities modified the results downards, but the results received are still much better than the previous years, showing an improvement.
- The poorest students have improved dramatically.
It’s highly unlikely that this bunch of students is hyper-successful compared to previous years, so thus unlikely we would have seen an increase in 10% points in the pass rate.
I think the real thing to keep in mind here is what really goes on in exams – pupils sit them, they are marked, and then stats magic is done on them so we end up with a similar amount of passes and grades distribution to the previous years – so it’s hard-wired into exams that little is going to change year on year.
That’s what we’re seeing here – the exam board adjusting to fit the results in with business as usual, but they’ve had to compromise with those optimistic teachers trying to game the system, and as a result, excuse the pun, this year’s Scottish students have done very well, especiallly the poor.
The students who should be angry are last year’s – they’ve lost out relative to this years, next year’s probably too, and those poor mugs actually had to sit their exams, and didn’t get four months off school!
This probably won’t be the way it’s spun in the media – it’s easy enough to find a few students a parents with individual axes to grind, against the overall trend of the 2020 cohort doing very nicely, thank you teachers!