Environment Magazine

Dangers of Forcing Regressions Through the Origin

Posted on the 17 October 2017 by Bradshaw @conservbytes

Dangers of forcing regressions through the originI had an interesting ‘discussion’ on Twitter yesterday that convinced me the topic would make a useful post. The specific example has nothing whatsoever to do with conservation, but it serves as a valuable statistical lesson for all concerned about demonstrating adequate evidence before jumping to conclusions.

The data in question were used in a correlation between national gun ownership (guns per capita) and gun-related deaths and injuries (total deaths and injuries from guns per 100,000 people) (the third figure in the article). As you might intuitively expect, the author concluded that there was a positive correlation between gun-related deaths and injuries, and gun ownership:

Dangers of forcing regressions through the origin


Now, if you’re an empirical skeptic like me, there was something fishy about that fitted trend line. So, I replotted the data (available here) using Plot Digitizer (if you haven’t yet discovered this wonderful tool for lifting data out of figures, you would be wise to get it now), and ran a little analysis of my own in R:

Dangers of forcing regressions through the origin

Just doing a little 2-parameter linear model (y ~ α + βx) in R on these log-log data (which means, it’s assumed to be a power relationship), shows that there’s no relationship at all — the intercept is 1.3565 (± 0.3814) in log space (i.e., 101.3565 = 22.72), and there’s no evidence for a non-zero slope (in fact, the estimated slope is negative at -0.1411, but it has no support). See R code here.

Now, the author pointed out what appears to be a rather intuitive requirement for this analysis — you should not have a positive number of gun-related deaths/injuries if there are no guns in the population; in other words, the relationship should be forced to go through the origin (xy = 0, 0). You can easily do this in R by using the lm function and setting the relationship to y ~ 0 + x; see code here).

Sounds reasonable, and if you take it on face value, it justifies the purported positive relationship shown in the original article. Suddenly, the slope is now positive (1.0308 ± 0.1236) and supported statistically.

Dangers of forcing regressions through the origin

But slow-down there, matey! There’s a problem here, and it means everything for the interpretation of the relationship. Just because it’s intuitive and you can force the relationship to go through the origin, it doesn’t mean that the data support this approach.

If you look closely, you’ll see that the origin is far away from the nearest real data — in other words, we’re taking a huge leap by assuming the relationship continues from the lowest values in the dataset back to the origin. You’ll also notice that the outlier (the USA: point farthest to the right of the plot) seems to be driving much of this relationship.

What we need to do is examine the relative support for the 2-parameter (intercept + slope) model versus the origin model. We can do this easily by comparing the sample size-corrected Akaike’s information criterion (AICc) for each model, and then dividing the AICc for the full model by the AICc of the origin model; this is called the information-theoretic evidence ratio.

As you can see from the code, the evidence ratio is 56.8, which means that the 2-parameter model is 56 times more likely than the origin model after accounting for different the number of parameters in each.

As such, there is no statistical justification whatsoever to support the forced-origin model, even though it seems to make intuitive sense (see another useful discussion here). This is because we have overstepped the bounds of our inference capacity based on the small sample of data available.

Now, in this particular case, I admit that even I wanted this relationship to be real, for I am a firm supporter of extensive gun control (the many other data supporting why this makes sense are overwhelming). I am, in fact, a gun owner myself (for scientific and farming purposes), and I am in absolute favour of the tightest gun-control legislation possible.

But just because I want it to be true, doesn’t make it so. We have to stick to the evidence.

CJA Bradshaw

You Might Also Like :

Back to Featured Articles on Logo Paperblog

These articles might interest you :

  • One Week


    It's been just over a week since we landed in Tashkent. The trip was uneventful, other than William acting like a typical 17-month old baby and keeping... Read more

    The 15 July 2018 by   Sherwoods
  • Not Quite Eschatology

    Quite Eschatology

    Realized eschatology, if you’ll pardon my French, is a term that describes the “already/not yet” aspect of the “end of the world. Read more

    The 15 July 2018 by   Steveawiggins
  • 8 Lessons From The Field On Building A Premier Brand

    Lessons From Field Building Premier Brand

    Every new business dreams of becoming the premier brand in their space, like Starbucks is to coffee, and Apple is to consumer electronics, but they have no... Read more

    The 15 July 2018 by   Martin Zwilling
  • Superhero Doll Hopes to Help Young Black Girls Beat Low Self Esteem

    Superhero Doll Hopes Help Young Black Girls Beat Self Esteem

    FirstLadyB | B Inspired By Entertainment News Young black girls battling lo... Read more

    The 15 July 2018 by   Firstladyb
  • 5 of the Best Places in Glasgow for Ice Cream

    Best Places Glasgow Cream

    62 total views, 62 views today 5 of the Best Places in Glasgow for Ice Cream Whether it sunny or dull a “pokey hat” will always bring a smile to a face.  Here... Read more

    The 15 July 2018 by   Emma
  • GoGoHares!


    Following the flight of camp dragons, the parade of vivid jumbos and the troupe of panto gorillas in our midst comes an assortment of big-eared, bright-eyed... Read more

    The 15 July 2018 by   Jackscott
  • Brew the Perfect Iced Tea by TE-A-ME

    Brew Perfect Iced TE-A-ME

    Be it any season, staying hydrated is important and what better way to do so than by enjoying a nice cold glass of tea. Yes, make your water interesting by... Read more

    The 15 July 2018 by   Dr.jenifer Sayyed