Advertising and Linear Regression

I wanted to share an article that’s been making the rounds of my online circles. It’s Jesse Frederik and Maruits Martijn’s The new dot com bubble is here: it’s called online advertising. The point of the article is exploring whether online advertising even works, and how we know whether it does.

The article goes into several wys that one can test whether a thing has an effect. These naturally get mathematical. Among the tests developed is one that someone who didn’t know mathematics might independently invent. This is called linear regression, or linear correlation. The idea is to run experiments. If you think something causes an effect, try doing a little of that something. Measure how big the effect is. Then try doing more of that something. How big is the effect now? Try a lot. How big is the effect? Do none of it. How big is the effect?

Through calculations that are tedious but not actually hard, you can find a line that “best fits” the data. And it will tell you whether, on average, increasing the something will increase the effect. Or decrease it. There are subsidiary tests that will tell you how strong the fit is. That is, whether the something and the effect match their variations very well, or whether there’s just a loose correspondence. It can easily be that random factors, or factors you aren’t looking at, are more important than the something you’re trying to vary, after all.

In principle, online advertising should be excellent at matching advertising to people. It’s quite easy to test different combinations of sales pitches and measure how much of whatever it is gets bought. In practice?

You have surely heard the aphorism that correlation does not prove causation, usually from someone trying to explain that we can’t really prove that some large industry is doing something murderous and awful. But there are also people who will say this in honest good faith. Showing that, say, placing advertisements in one source correlates with a healthy number of sales does not prove that the advertisements helped any. One needs to design experiments thoughtfully to tease that out. Part of Frederik and Martijn’s essay is about the search for those thoughtful experiments, and what they indicate. There is an old saw that in science what one does not measure one does not understand. But it is also true that measuring a thing does not mean one understands it.

(Linear regression is far from the only tool available, or discussed in the article. It’s one that’s easy to imagine and explain, both in goal and in calculation, however.)

Author: Joseph Nebus

I was born 198 years to the day after Johnny Appleseed. The differences between us do not end there. He/him.

2 thoughts on “Advertising and Linear Regression”

  1. Can I just say, for the record, that I think Amazon is pulling a fast on with the data. I often go in, buy something, and for the next several hours or even days, I get ads for the precise item I purchased. I mean, not even a different brand! I think they’re using that to demonstrate high correlation between the ads I see and what I buy. I can’t think of any other reason to consider showing me ads after I’ve already purchased what is most clearly a one-time purchase.


    1. Oh, absolutely. We’ve all seen that phenomenon too. It makes some sense for consumable goods, at least if you can expect the thing to be consumed in the time it’d take to place a new order. But otherwise? Either Amazon thinks there are a lot of people out there collecting the kits to install half-flushes on toilets or else data-mining advertisements are at heart a fraud.

      By the way, if you go to Dover Publishing’s web site and browser around the books of glitter sticker dragons and stuff? You can get ads for that populating the corners of every web page you visit for surprisingly long a while. Definitely better getting those than the “Your Mac Has A MALWARE!” ads.


Please Write Something Good

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.