Volume Has Been Tested. The Results Are In

January 31, 2018      Kevin Schulman, Founder, DonorVoice and DVCanvass

Yesterday, I vented my spleen about the argument that volume leads to retention and that the volume of contact should be viewed as the lever to do so.

Now, I’d like to put my case studies where my mouth is.

Most of these are specific to mail.  Why?  Because that’s where the testing has been heretofore.  This is in large part because organizations face a greater tangible, incremental cost to mailing. It costs money to send an extra person an extra postal mail piece.  It costs no money to send an extra person an extra email.  So it’s natural to get logorrhea online and set a default of sending more to more.

But it turns out this does have a cost: $24,522.  That’s the amount that the average nonprofit lost to spam last year according to the excellent 2017 EveryAction Nonprofit Email Deliverability Study.

In fact, the study says that for every one percent of your email going to spam, you lose $1309.  And the more emails you send, the more likely you are to have undelivered emails.  More than a third of Giving Tuesday emails were routed as spam, losing the average nonprofit $6,184.

I haven’t seen the 2018 report yet, but holding the envelope up to my head like Carnac The Magnificent, I’m going to say they’ll be worse.

And you thought I was going to say that the costs of email are the time and effort you put into writing, designing, and sending them whether internal or external.  That too.

Additionally, the irritation factor is similar for online and offline, as is the drop off in marginal returns.

But if that bothers you, let’s start with one organization that cut both mail and email volume.

Catholic Relief Services.  CRS took a pilot group of 40,000 donors (against a control group of 40,000 donors of similar make-up) and tested decreased volume of both mail and emails by about 25-30%.  Long story short, that reduced volume cadence is their control this year because of its success.

In fact, with a 30% drop in email volume, their drop in online revenue was less than 2% – within the margin of error.

That last 30% of their email communication volume was giving them almost no additional value.  Imagine what you could do with the extra time you could save doing 30% fewer emails.  My guess is it’s better than “increase digital revenues by two percent.”  (And that’s with 30% less offline support that, if volume theory is correct, would also raise boats on the digital side.)

Union of Concerned Scientists.  UCS took a pilot group of 25,000 donors (against a similar control) and tested four mail appeals (plus four impact statements) per year versus 12-15 in the control condition.

Gasp! Zounds! Yes!  Four appeals per year!

Here, thanks to Blackbaud, is the video from Laurie Marden of UCS.  It’s great viewing:

But for those who don’t have the 18 minutes for the video, the test group:

  • Had $8000 more in net income
  • Came within five percent on gross revenues
  • Had $2.60 higher average gift
  • Saved $32,000 in costs
  • Halved cost per dollar raised
  • Had $9.69 higher net income per donor

Clean, clear crush.  UCS’s control is now four appeals per year and they are happy with the results.

Organization A. This international relief organization randomized their new donors to one of three conditions:

  • No additional no-ask cultivation touches
  • Six additional no-ask cultivation touches
  • 12 additional no-ask cultivation touches

Results?  No one wanted 12 additional cultivation touches – retention went down in all cases.  And there was no aggregate difference between no additional touches and six additional touches for retention rate – a nail in the coffin for the volume = retention maxim.

But wait!  When donors were broken down by commitment level, we found that highly committed donors – the ones we all really want to retain – had their retention drop by nine points when they got six additional touches.  They were already convinced and didn’t need to be sold.

BUT…Those less committed needed the extra touches – the six additional communications meant a 12-percent increase in retention.  This study in more detail here.

Clearly, this example is “cheating”, because we are breaking down donors by their commitment level.

So why don’t you “cheat”?

The central lie of the volume myth is that it is a strategy that can be applied across all donor categories. (When in fact it’s a strategy that results in hitting diminishing returns).

What this all means is that if you really want to maximize retention you’ll collect commitment information up front, and then by  customizing on it, you can decrease volume for your best donors and increase their retention.  Win-win.

Organization B. A human services organization was challenged to mail 15% less and hit the same revenue numbers.  The organization separated their donors into three tiers: one who could bear the most communications, one the least, and the remaining Goldilocks in between.  From there, they were able to send their more marginal pieces only to their best donors and only their best pieces to their most marginal donors.

Results: The organization didn’t just stay where they were; they increased net revenue by 14% and decreased their cost to raise a dollar by 17%.  Here’s the case study from our friends at DonorTrends.

Clearly, this example is “cheating”, because you are breaking down donors by their value to the organization.

So why don’t you “cheat”?

Here’s another example where “more is better thinking” ignores important subgroups who would benefit from less communication.  This type of modeling won’t help you figure out if your top-end of donors are getting too much mail, but it’s a way to start down the path of decreasing volume and increasing value.  And it will get you buy-in for more radical solutions.

National Committee to Preserve Social Security and MedicareAs reported here, The Committee coded people who requested less mail and sent them half as many appeals as those who stated no preference.  Those donors who requested – and received – half as many contacts gave more than the group that didn’t express a preference.

Clearly, this example is cheating.  You are comparing a group who, when asked, expressed a preference to those who didn’t.  Apples and oranges.

So why don’t you “cheat”?

If donor value increases when you get preferences and then and follow through on them, why isn’t that activity a central goal of your direct marketing?

This may be because better donors expressed a preference, rather than the act of adhering to the donor’s preference caused higher response and retention,  but honestly how much do you usually spend to find out who your best donors are?

So here they are – five case studies where organizations used different tactics to get off the volume hamster wheel.  All of them control for all the variables that they can.  The CRS and UCS examples, in particular, are scientific control-versus-test pilot programs.

The reality we all must face is this:   Volume testing alone only helps cleans up the mess we made.  We need to go past the issue of “volume” alone to focus on the actual needs of our donors.

We’ll talk about that later in the week, but next, in tomorrow’s post, we want to explain why volume hurts our donors.

Nick

5 responses to “Volume Has Been Tested. The Results Are In”

  1. Important to remember your current volume before saying that volume hurts the donors… if you send two appeals a year and two emails a year, this post may be less relevant as your donors haven’t had a chance really to get engaged to begin with.
    so many organizations don’t have the engaged donors yet and are not sending much volume at all, so there’s a build up phase and then an evaluation phase, consider which group you’re in as a nonprofit first!

  2. Neil Gallaiford says:

    I’m curious: if the test group of the Union of Concerned Scientists donors produced $8,000 more in net revenue in total, how could each of the 25,000 donors produce $9.69 higher net income per donor?

  3. What Erica said! Your examples come mainly from national organizations. I think your picture would change dramatically if you focused on community-based organizations.

  4. Nick Ellinger says:

    Erica and Dennis: agree – this was in reaction to a case study where there were 6x more email asks than the national large organization average. And as you can see with Union of Concerned Scientists, they cut their mailings to four per year. CRS is still a frequent emailer and mailer, albeit less than before. Both organizations had complaints from donors about their communication frequency previously.

    This last is, I think, the most important point: listen to your donors, both in the individual and the aggregate. My guess is that donors to an organization that mails twice per year will probably have people saying they don’t hear from the organization enough, rather than the “stop flooding me with letters.”

    Part of this was in reaction to something I’d heard from multiple consultants: a variation on “in my X years in nonprofit marketing, I have *never* seen fewer communications outperform more communications.” It happens sometimes. Not all times or cases, but sometimes. My goal is not to get everyone to cut pieces, but to realize that there are more than just up escalators.

    That said, as we’ll talk about on Friday, and we’ve hinted at previously, neither more or less volume is a strategy, because neither scale. I’m hoping to move the conversation to deeper, not wider.

    Neil, apologies – I’m mixing two time periods in order to get the full scope of the test in there. In the 2015 head-to-head test, there was $8000 more net revenue in the test group (about minute 12 in the video). They then rolled this out as their control cadence and compared before and after (2014 and 2016). When they rolled out, they made $9.69 more net per donor (about minute 15 in the video).

    My guess as to the difference is that the test audience didn’t include people who gave multiple times per year. As Laurie said, this group had the greatest risk for revenue loss and thus it wasn’t who they wanted to test with at first (understandably!). Thus, there was a greater net revenue gain per donor from 2014 to 2016.

  5. Pamela Grow says:

    🙂 What Erica and Dennis said.

    I’m looking forward to Friday’s post and moving the conversation “deeper, not wider.”