All Segmented Up and Nowhere to Go

March 15, 2023      Kevin Schulman, Founder, DonorVoice and DVCanvass

Why create segments?  The only reason is you believe Different Strokes was something other than an early 80s sitcom.

But what makes people different isn’t the question.  Some people like red hats, others blue; knowing that won’t help you raise more money.

What are the different reasons people support your charity is closer to the mark.

Consider this very expensive segmentation by a well-known agency for a well-known charity brand.

Forget the math and science of it for the moment.  The first thing that jumps off the page to me is 10 segments with names that tell me exactly zero about who they are and their different reasons for supporting the organization.

At bare minimum this segmentation fails on the simple labeling task alone – namely wanting those segment names to be descriptive of who they are and their reason for support.  It’s like naming fruits by color (not counting Oranges).

Now let’s dig in a bit more.  The rich, detailed descriptors for each segment, as illustrated for one of the segments, are deceptively interesting.  Heck, there is a section called “Motivators”.  What the fuller report shows is that these lovely charts show 10 groups that are more similar than different on these supposed insights, thus violating segmentation 101.

The death knell for this segmentation having any value is what I obscured in the first row but show now. Notice anything about the average age and it’s relationship to the segments?

It’s perfectly linear.  This really expensive segmentation with statistical clustering and enough PowerPoint slides to wallpaper a room is the equivalent of an age append.  Age, as one of the variables in the segmentation stew, is driving the entire outcome.

There are technical and logical reasons for this but suffice to say if you think age helps explain why people give (it doesn’t) then you could have done this segmentation scheme for pennies on the dollar.

The hidden pony in this pile of manure is buried in one of the 6,231 PowerPoint slides.

This shows the top 3 reasons people cited for their reason for giving to this charity.  The first two showcase the problem with asking an open-ended survey question asking people to introspect and come up with their innate, detailed reason they give.

Most people aren’t willing or able to do that mental work and take a shortcut with generic answers.  As evidence, 8 out of 10 gave the generic “to make a difference” response and on the right, you see this answer cut across all 10 segments pretty evenly with the Index score hovering around 100 for all but 1 group.

I don’t doubt the people who gave answer one or two, it’s just too superficial to do anything with it and as important, whatever I would do with it, I’d be doing for everybody since all the segments said the same thing.

Answer three is the pony.  This is getting closer to an innate, Identity answer.  And one that I can operationalize and one that is very different across these (useless) age cohorts.

Tailoring an appeal to religious reasons for giving and only sending it to groups 7,8 and 10 makes some sense.  This is one-hand behind my back, being forced to use these silly age buckets.

The better alternative is Identity based research to unearth these different motivators.  And not relying on open-ended survey data but more structured survey questions that people can reliably answer and that give us the ‘why’ insight we need.

Then I can use 3rd party data (demos, lifestyle) as proxy to score up the file with Identity based segments.  Religious people, Parents (it’s a kid charity), etc.

Turn the thing on its head.  Start with their different reasons for supporting as your strategic foundational insights.  Then use otherwise useless, messy, noisy demos and lifestyle data to reverse engineer and score the file to achieve scale.

Kevin

 

3 responses to “All Segmented Up and Nowhere to Go”

  1. Tom Ahern says:

    “The hidden pony in this pile of manure is buried in one of the 6,231 PowerPoint slides.” Bless your shoveling, Kevin!

  2. Chris Noble says:

    Thanks for this one, Kevin. So true – our industry often seems more in love with useless data (and charts) than with actual, purposeful answers. Thanks for reminding us it’s about the pony!

  3. Dale says:

    regarding ” The better alternative is Identity based research to unearth these different motivators. And not relying on open-ended survey data but more structured survey questions that people can reliably answer and that give us the ‘why’ insight we need.”
    Please share some good survey questions with us.