Data without information… Now with data

Last week, NHS Scotland’s statistics service (Information Services Division Scotland LINK) released the latest figures for cancellations of elective operations, i.e non-emergency surgery.  The figures showed a seemingly high level of cancellations due to a lack of hospital capacity and a noticeable increase from last year.  As you’d expect, the opposition parties and various newspaper outlets picked up on this news and published stories reporting the figures.

As is the way in Scotland these days, the radical anti-establishment movement of Scottish independence then went into motion – seeking a way to defend the decade long governing party.  Not unusually, it was Wings Over Scotland who produced a rebuttal titled Data Without Information [LINK].

The Wings piece attempts to undermine the negative NHS Scotland figures by first comparing them to 2010 figures reported in this “Deadline News” piece [LINK].  It would seem that in 2010 NHS Scotland was cancelling 30 operations a day due to lack of capacity, whereas the latest figures show 20 cancelled operations a day… so everything is fine.  Things have improved under our glorious government.  It’s not news.  SNP good, etc.

Well… no.

The crux of Wings’ argument is thus:

A June 2010 report by Deadline News revealed that of over 600 cancelled operations in Scotland a week, a quarter – roughly 150 – were cancelled by hospitals for reasons of capacity. (In 2010 non-emergency operations were only conducted on weekdays, so that’s effectively 30 a day.)

He then favourably compares this to the ISD Scotland figures, reported in The Times, which show cancellations now at 20 per day.

What Stuart Campbell, the author, has either failed to tell you or failed to notice is that he is not comparing like-with-like.   Whereas the 2016 statistics only include “cancellation based on capacity or non-clinical reason by hospital”, the 2010 figures reported by Deadline News include cancellations “because the patient is unfit for surgery”.

deadline

Under the current ISD Scotland reporting system, operations which are cancelled due to the patient’s ill-health are covered by a second category: cancellation based on clinical reason by hospital.  During the time-series available in ISD Scotland (May ’15 to Nov ’16), this second category tends to be between 50% and 100% higher than those cancelled “based on capacity or non-clinical reason by hospital”.

If you were to include both of these statistics, you would reach an average of 53 cancelled operations per day.  Which doesn’t compare very favourably with 2010’s 30 a day…

It should be noted that “cancelled for clinical reasons” also includes a second category where the patient has not been “prepared for procedure correctly”.  It’s not clear if this is also included in the 2010 stats, so it’s not possible to say with absolute certainty that we’re comparing apples with apples.

reasons-for-cancellation

What is very clear is that Wings’ claim that cancellations have “gone down by a third” is based on at best a misunderstanding, at worst sheer deception.  Either way, it’s wrong.

Not to worry, though, because Stuart is content that non-clinical cancellations have only gone up by  “a whopping 0.4%… a very small sample and is a micro-fluctuation only”.

Whilst Stuart is right that the percentage of non-clinical hospital cancellations has “only” increased from 1.7% of total elective operations to 2.1%, this is a significant relative increase based on 19 months of data and over 570,000 operations.

In an attempt to allow for seasonal variations, I’ve plotted the changes year-to-year for months where this is data from both 2015 and 2016, then calculated the relative change from 2015 to 2016.

relative-change

Every month is showing a marked increase in cancellations from the corresponding period in the previous year, with an average relative increase of 17%.  Micro-fluctuation indeed.

But it’s fine.  Even that is irrelevant because NHS England is worse, isn’t it?  It doesn’t matter how bad something is in Scotland so long as it’s worse in England, right?  To such an end, Stuart attempts to claim “cancellations are still around 10% lower in Scotland”.  He even provides a handy link to this NHS England site for statistics [LINK].

Small problem.  The statistics show nothing of the sort.

Here are the NHS England stats for “the number of last-minute cancelled elective operations for non-clinical reasons” (see note 1).

nhs-eng-cancellation

The average percentage of cancellations in NHS England for the last 18 months is 1.0% of planned elective operations.  In Scotland, it’s 2.0%.  Or double.

So Wings’ three basic attempts to undermine these figures just don’t stack up.  There is no evidence that cancellations have reduced since 2010, there has in fact been a 17% relative increase since last year and the numbers aren’t better than NHS England.

It’s obvious that there are huge problems in NHS England.  It’s equally obvious that there are huge problems in NHS Scotland.  No doubt one performs worse than the other across the vast array of NHS services available but surely we should at least look to recognise problems if and when they do exist.  This sort of government apologism in a desperate effort to protect a desired constitutional outcome surely does no-one any favours.

Contrary to what Wings would have you believe, the press reports raise perfectly legitimate questions about the level of canceled operations*.

Data without information, eh?  Might have been nice to start with just the data.

 

 

Note 1 – both the NHS England and ISD Scotland statistics have the same definition for the timeframe of cancellations included in the stats.

For ISD Scotland [LINK]:

isd-definition

For NHS England [LINK]:

nhs-eng-definition

However, the ISD Scotland metadata document states that the stats are not comparable due to “definitional differences”

comparability

It’s not clear whether these “definitional differences” relate to other areas of the statistics, given NHS England only appears to provide data for cancellations for non-clinical reasons.  The definition of these also appears to be the same as ISD Scotland:

isd-scotland-definition
ISD Scotland
nhs-england-definition
NHS England

To my reading, this appears to make these specific statistics comparable, at least indicatively.  If you wish to discount them, then fine.

Note 2 – throughout this piece I have tended to use the short-hand “cancellations”.  To be clear, when referring to the latest ISD Scotland statistics this is intended to mean “cancellation based on capacity or non-clinical reason by hospital”.  It should be obvious why and where this short-hand is used but thought it worth mentioning.

 *This previously read “… were accurate and raised…”. Stuart Campbell (Wings) quite rightly pointed out that he didn’t claim they were inaccurate, ‘only presented without context’.  Hence I have edited this sentence.

Advertisements

11 thoughts on “Data without information… Now with data

  1. Great read and information that will be invaluable in the coming months.  Pauline Winchester 

    Sent from Samsung Mobile on O2

    Like

  2. I’m glad you’ve now removed the false claim that I’d said anything in the reports was “inaccurate”. But this:

    “Contrary to what Wings would have you believe, the press reports raise perfectly legitimate questions about the level of canceled operations*.”

    …isn’t really a lot better. I at no point disputed the press’s right to raise legitimate questions. My article expressly pointed out that there HAD been a rise in cancellations. All I said was that the figures were presented without any context, and as such represented bad journalism. They were, and the fact that you and I had to go and do for ourselves what they’re paid to do proves that point pretty conclusively.

    Liked by 1 person

    1. “…the Scottish media is still desperately trying to whip up scare stories about a health service in Scotland that’s coping considerably better with the vast pressures of the modern era than its beleaguered counterpart to the south.”

      Your article is clearly an attempt to de-legitimise the concerns that have been raised by the reporting of the figures.

      And you do so by providing your own context which is based on inaccurate information so let’s not get on your high-horse with pejorative “false claim” comments. You’ll notice that I have edited my article (with the edit recorded) to correct my innocent mistake, whilst your unedited article remains up on your site despite the inaccuracies I have noted here, which you don’t appear to dispute. To borrow a phrase, I won’t be taking any lessons on false claims from you sir.

      Liked by 1 person

      1. “…the Scottish media is still desperately trying to whip up scare stories about a health service in Scotland that’s coping considerably better with the vast pressures of the modern era than its beleaguered counterpart to the south.”

        …is a perfectly true statement. It’s not the Scottish NHS that’s closing the doors of A&E departments, it’s not the Scottish NHS that the Red Cross is issuing urgent panic alerts about.

        “Your article is clearly an attempt to de-legitimise the concerns that have been raised by the reporting of the figures.”

        Is it? News to me, but I guess you’d know my mind better than I do. I thought I was making a point about the presentation of data without context, because that was what I wrote about and linked to other examples of, and because I freely acknowledged that the number of cancelled ops had increased, but I guess I must have been mistaken. I feel such a fool now.

        Liked by 1 person

  3. Oh irony of Wings complaining about figures being presented out of context. His whole modus operandi is to cherry pick information and present it outwith context – just look at his misrepresentations (I’m being generous here) over pensions. He’s not interested in the truth. All he’s interested in is finding an angle that supports the SNP, bashes the UK or trashes Labour/LibDems/Tories – even if this means omitting the information that allows a full picture to be formed. Lie detector my erchie. He’s an absolute joke.

    Liked by 1 person

    1. And in doing this he is pretty much the same as the Telegraph, The Sun, Daily Mail, some times the Guardian, just from a different angle. I don’t like it but that’s the game they all play. The reason why he isn’t a joke and has support is because he’s also used his time to rebut Unionist misrepresentations.

      Like

      1. No disagreement from me that many news outlets put their own spin on things, but if you think he’s “pretty much the same” I very much beg to differ. He’s an order of magnitude worse.

        And I’m sorry, outwith his cabal of followers he is indeed a joke. Just not a very funny one.

        Liked by 1 person

      2. To be fair, I don’t think the Telegraph, The Sun, etc have ever claimed to have “factual errors identified by opponents – 0”. They may hide their mistakes away but at least they don’t claim infallibility in the face of such obvious and widespread evidence to the contrary.

        Like

  4. Thank you for your detailed and timely analysis. I am never quite sure if Wings is a) deliberately falsifying or b) doesn’t actually understand the data he claims to interpret. Actually, quite often I think it is the latter. But that doesn’t detract from the odiousness of his propaganda, which the faithful of the cult are all too willing to believe.

    Liked by 1 person

  5. Always good to see you holding to a standard of conscientious research, openness & integrity, Fraser.

    Always willing to correct any flaws of detail in that spirit, as the unblinkered reader can see again here.

    Where others of lesser scruple cut corners to their endpoint and bottom line – grab a mile (and trumpet their own crashing papal infallibility) if you give them an inch … while themselves continually selling a narrative that emerges as dodgy at every key turn investigated.

    “Quelle différence, ça! Vive la différence, là!”

    We’re living through troubled times. Some see that as an opportunity to muddy more waters. Pity.

    Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s