Author: David Baird

Breaking Bad Habits: Don’t Litter In Walter White’s Territory

There have been many famous anti-litter campaigns over the years: Woodsy the Owl’s “Give a Hoot! Don’t pollute,” “Keep America Beautiful” with Iron Eyes Cody, the Indigenous person who cried at the sight of litter being tossed out of cars, and the “Don’t Mess With Texas” campaign initiated by the Texas DOT. Now the state of New Mexico has developed a new campaign for the 21st century with a built-in fan base who I’m sure will share the video PSAs all over social media.

The “Breaking Bad Habits” anti-litter campaign features the state’s most famous modern anti-hero, Walter White from the AMC series Breaking Bad. Actor Bryan Cranston reprises his character as the high school chemistry teacher forced, by a cancer diagnosis, into the meth production trade in an attempt to create a nest egg for his family after he passes. You must agree, this is an unlikely character to feature in a state government PSA, but here is why it works so well.

Breaking Bad is synonymous with New Mexico. Breaking Bad Luigi’s Tours in Albuquerque operates RV tours of film locations from the show. Restaurant chain Twisters Burgers and Burritos has opened a Los Pollos Hermanos branded location that plays off the fictional restaurant chain central to the show. The New Mexico state government has joined the cultural phenomenon and partnered with the series’ creators to produce a new take on communicating the anti-litter message. It’s a great example of why partnering with an established brand is sometimes better than trying to create your own.

In the mid-80s, Texas launched its “Don’t Mess With Texas” anti-litter campaign. It began with a series of bumper stickers and eventually incorporated TV advertising that featured all kinds of famous Texans like musician Stevie Ray Vaughan, boxer George Foreman, and actor Matthew McConaughey. While the campaign was successful, the slogan “Don’t Mess With Texas” was quickly adopted by other companies and organizations. This created a nightmare of work for DOT attorneys chasing down unauthorized uses of the trademark phrase. These issues watered down the message to the point that a market research study conducted by the Texas DOT in the late 2000s discovered that only 61% of Texans knew that the slogan was for an anti-litter campaign. The Texas DOT did an incredible job of reintroducing the message with this ad featuring Texas music icon, George Strait.

Since the state of New Mexico doesn’t own the rights to Breaking Bad and the character Walter White, they can avoid all those legal nightmares and focus on communicating the message, don’t litter. After only three weeks, the video has received more than 200,000 views on YouTube and has been shared who knows how many times on social media. I only hope that a line of Breaking Bad Habits merchandise is in the works. TAKE MY MONEY, PLEASE!

Your Radio Station No Longer Needs To Follow The Herd For Music Decisions

More than 20 years ago, I was the Program Director of a Hot AC station in Missoula, MT. KMSO-FM was, and still is an independently owned broadcaster. When you’re in a position like that, you don’t have a lot of time to think about much of anything. You’re being pulled in a million different directions—morning show air shift, production, imaging, promotions, music scheduling, and so on. Every Monday, I would receive a list of songs from my consultant that I should consider playing. And, once or twice a year I would receive an updated list of recommended gold titles. I didn’t have access to Mediabase. It would not have been much help as none of my competitors were monitored. My market was too small for Jon Coleman and the team to conduct a FACT Strategic Music Test, and the budget would have been challenging. And callout? Forget it. All I had was a list of songs, my gut, and the opinions of everyone in the building, most of whom were not in the demo. I would have given anything to have access to some kind of music testing data to help me make my decisions and to tell the sales staff, “No, you’re wrong, this song tests.”

Programming a music radio station is truly a unique blend of art and science, yet the “science” was not accessible to many for too long. While local research using your own listeners is optimal, we knew there had to be a middle ground when that option isn’t available.

Over the past several months, Coleman Insights rolled out FACT USA, a series of reasonably priced music tests available for Mainstream AC, Hot AC, Country, Alternative, Classic Hits, Classic Rock, and R&B. The sample for each study includes 300 respondents, recruited nationally, with quotas set for age, gender, ethnicity, and region.

Logo for FACT USA National Music Test

For contemporary music-focused formats, CHR, Hot AC, Country, and Alternative, we offer Integr8 USA, a nationally recruited “callout” service, and like FACT USA, it has all the data quality reviews and procedures that Coleman Insights has developed in 10+ years of online music testing.

Integr8 USA Transparent Logo

What does this mean for you? No more guessing. No more following the herd.

Photo credit: Meiqiu.Photography / Shutterstock.com

Mediabase is a great tool for programmers. It can give you an overall sense of what is happening in your format. But have you ever thought about all the “behind the scenes” factors that influence those spin counts? How many of the stations in the panel that you’re reviewing have conducted a recent music test or have access to callout data? Do they have the same competitive situation as you? Does their strategy match yours? Is a song receiving extraordinary spins because the artist is coming to town or the record label is pushing it? You may be looking at streaming data, but some songs get a big jump in streaming that isn’t sustained and may not be great choices for the radio.

If you have the budget to conduct a market-level music test and/or callout research with your listeners, do it! There is nothing better than making decisions based on the opinions of your listeners. But, if you don’t have the resources to do that, we believe FACT USA and Integr8 USA are outstanding options to consider. You can best interpret and filter the results as it pertains to your station’s strategy.

Don’t be like me 20 years ago, following the herd with all art and “hopeful” science, hoping that other stations have it right. It’s time to select the songs you play with confidence.

Radio Needs Some Northern Exposure

I’ve been rewatching Northern Exposure lately, the comedy-drama that aired on CBS for six seasons starting in 1990, and I am reminded of what great radio sounds like. In the series, John Corbett plays the character Chris Stevens, who is a modern artist, an extremely well-read philosopher, has eclectic music tastes, spent time “in the joint,” and just so happens to be the morning DJ on the local radio station 570 KBHR-AM in the tiny town of Cicely, Alaska.

Northern Exposure took place in the fictional town of Cicely, Alaska. (Credit: Shutterstock/Birdiegal)

The station owner, Maurice Minnifield, played by actor Barry Corbin, is the stereotypical small-town businessman and owner of KBHR. Maurice is frequently perplexed by Chris but is smart enough to know that he is a true reflection of the community and needs to be given the freedom to get crazy and try new things. Maurice’s only requirement is that Chris shows up for work.

Chris has a unique gift for entertaining, educating, and challenging the norms of the community. Whether he is reading Nietzsche, recounting a story from his time in prison, or simply describing his view of town outside the studio window, his passionate delivery style and content are engaging and compelling. Now, I know that Cicely is a fictional town filled with unique characters. Heck, the average local blue collar worker can discuss the pros and cons of federalism vs. republicanism. But, following up on Sam Milkman’s previous blog, “What Is the Purpose of Your Radio Station?”, KBHR and its morning show has a purpose.

A few weeks ago, my wife and I traveled to the small town of Chama, New Mexico (population 915). After lunch we browsed the stores that lined the main street, and I noted that every single shop was listening to 96.1 The Eagle (KXJR). While nowhere near as avant-garde as 570 KBHR-AM, The Eagle understands its purpose.

KXJR-FM is a community-focused station in Chama, New Mexico. (Credit: Shutterstock/Silvio Ligutti)

It plays music for the tourists, critical to the local economy. But it mixes that with truly local, authentic programming that brings together this small community living in a media desert. It generally plays a mix of Classic Hits that serves as a soundtrack for the tourists who visit the town to shop, dine, and enjoy the Cumbres & Toltec Scenic Railroad. However, the station also mixes in programming specifically for the locals like “Beautiful Chama Valley Travel Show”, “Seeds of Liberation!” (…explores the many ways we can improve our lives by liberating ourselves from oppressive constructs…), “Chama’s EDML (Eleanor Daggett Memorial Library) Book Teasers”, “The Farm & Ranch Show”, and more. There’s even a local high school kid, Keith Trujillo, who DJs his own show that “kicks it with a blend of Funk, Hip Hop, Rap, and Country that’s vintage & new, chill & upbeat.” Instead of a station voice, you hear members of the community, even kids, announcing the Legal ID. Is it polished, professional radio? No. But, the community is listening and isn’t that the point?

What is your station’s purpose? It has to be more than playing 12 songs in a row, the most New Country, the best mix of the 90s to Now, etc. What is your station’s purpose in the community? What are the unique things you can offer that your listeners can’t get anywhere else?

As Sam Milkman wrote in his blog, ”You have the ideas. Let’s get crazy and try some of them. Let’s find our purpose again.”

So, I leave you with this, “True insanity is knowing the result yet continuing to do the same thing anyway.” It is time to try something revolutionary!

All Things Kum & Go (But Maybe They Shouldn’t)

But they love you enough to wear your logo on a t-shirt…

A few years ago, my son and I made a trip through the Midwest to meet with college football coaches who had invited him to join their program. Interstate driving is monotonous at best and besides your car radio, the only source of entertainment are the billboards and signs you see along the way. Driving through the corn fields of Iowa, one business caught my son’s eye. “Kum & Go? What the…? Dad, we gotta stop!”

In 1959, William A. Krause and Tony S. Gentle founded the Hampton Oil Company in Hampton, IA. By the early 60s, they began to open a chain of convenience stores, which by 1975 were united under a single brand name, Kum & Go. The name was a play on the phrase “come and go” using the initials of Krause & Gentle.

Kum & Go

A Kum & Go in Kremmling, Colorado (Photo credit: melissamn/Shutterstock)

Now, the euphemism that has probably entered your mind, dates back to at least 1650 with the bawdy song “Walking In A Meadow Greene” by Bishop Percy. Did Krause & Gentle consider the double entendre when selecting the name? The internet is silent on this subject, but there is no doubt it is a memorable brand name.

There’s an old saying, “If you try to please everyone, no one will like it.” This is especially true when building a brand. If the goal for your brand is to get the entire population to purchase your product or service, bad news, that simply isn’t possible. No brand has ever accomplished that. Not Apple, Coca-Cola, Nike… none of them. A successful brand has a contingent of extremely loyal followers. These are the people willing to wear your brand name and/or logo on a t-shirt, hat, flip-flops (yes, there are Kum & Go flip-flops), or whatever. These loyalists are what makes a local business brand, like a radio station, or a regional brand like Kum & Go successful in the long term.

These brand fans are incredibly difficult to obtain, but extremely valuable once you have them. They are willing to drive past seven convenience stores to buy gas and snacks from you. They will ignore all the other sources of entertainment available to them and choose to listen to your audio brand.

In Malcolm Gladwell’s book, The Tipping Point: How Little Things Can Make a Big Difference, he describes a phenomenon he calls the tipping point which is “that magic moment when an idea, trend, or social behavior crosses a threshold, tips, and spreads like wildfire.” In the case of Kum & Go, this occurred when Johnny Knoxville wore a Kum & Go shirt in the 2006 movie Jackass Number Two. It was at that moment that a legion of young adults across America became aware of Kum & Go for the first time, and quickly became fans.

Johnny Knoxville Kum & Go Jackass Number Two

Johnny Knoxville at the premiere for Jackass Number Two, a film during which he sports a Kum & Go t-shirt (Photo credit: Shutterstock/Featureflash Photo Agency)

In April 2023, Kum & Go’s 400+ stores were purchased by Utah-based Maverik, and it was recently announced that Maverik would retire the Kum & Go brand altogether and rename all of those stores Maverik. The reason? Concerns over the name and that it was “probably easier to focus on one brand for efficiencies and brand/consumer awareness.” This decision has created quite a stir among Kum & Go’s fans on social media and even led to a mention on The Late Show with Stephen Cobert. The bit was a perfect reflection of the fun, cheeky brand position that the chain has enjoyed for years.

Back to my travels with my son, of course he wanted to buy Kum & Go t-shirts for all his high school friends. But, we quickly learned that the Kum & Go merchandise is delivered to each store on Friday morning and there are slim pickings by that afternoon. With this intel, we were able to secure some souvenirs. And now that he is in college, I see Kum & Go merchandise every time I visit him on campus. I doubt that the Maverik brand will be able to capture this kind of loyalty anytime soon.

How Chevrolet Made Me Cry By Not Promoting a Sales Event

I cried while watching football. No, it’s not because my Browns lost another late-season game. I expect that this time of year, but for some reason I still watch anyway.

I cried watching Chevrolet’s 2023 holiday ad, “A Holiday To Remember.” If you are overly sentimental, I’ll summarize the commercial for you. Otherwise, please watch and have a box of tissues ready.

The ad opens with a rambunctious large family holiday gathering, and then focuses on the matriarch who is staring off into the distance. Several members of the family try to communicate with her, but she does not respond. It quickly becomes evident that she is suffering from Alzheimer’s or Dementia. Suddenly, her 20-something granddaughter, Tracy, has an epiphany. She walks her grandmother out to the garage, and the pair climb into a 1972 Chevrolet Suburban. As the two drive around town, listening to “Sunshine on My Shoulders” by John Denver, Tracy begins pointing out things around town hoping to spark a conversation.

Slowly the grandmother begins to realize that she is in her hometown, Saginaw, MI. We begin to see the memories of a life well lived come flooding back to her. A stop at her high school, at the drive-in movie theatre, a couple’s first kiss; all the unforgettable moments that happen in your car. Suddenly she remembers her husband Bill, and the pair drive straight back to the house. Gramps climbs into the front seat of the Suburban, she recognizes him, the two kiss, then go inside the house to celebrate what is likely Grams’ final Christmas.

We talk a lot at Coleman Insights about the importance of brand building. We use The Image Pyramid to help audio entertainment brands prioritize their marketing efforts. The first step to establishing a strong and resilient brand is to solidify its base image. What is the brand? Why does it exist? In Chevy’s case, they manufacture and sell cars and trucks. Everyone knows that. Since this base attribute of the brand is firmly established, Chevy has the luxury of focusing on other brand elements higher up the Image Pyramid.

For a decade, Chevy has positioned itself with the slogan “Find New Roads,” a uniquely American positioning statement. It encourages the consumer to associate the brand with commonly held consumer perceptions of what it means to be an American: Innovation, Exploration, Leadership, etc.

The “A Holiday To Remember” commercial is part of Chevy’s campaign for its new slogan “Together Let’s Drive.” In an interview with Automotive News, Chevy CMO Steve Majoros says that the “Together Let’s Drive” campaign was the result of nearly a year of market research that uncovered a shift in consumer values following the pandemic, a return to “a sense of respect and admiration for trusted institutions and a focus on friends, family, and community.” “A Holiday To Remember” brilliantly continues this effort by subtly connecting the Chevrolet brand with the importance of family, friends, and community.

In contrast, nearly every other commercial I saw during the Browns game was screaming about 40% off, BOGO, Black Friday, or something. Nothing that made me want to connect with the brand, and consequently since I can’t recall any of the messages, I will be shopping on Amazon again this year.

Radio should take note of the “Together Let’s Drive” campaign. Like the car, music has always been a central part of our lives. It’s there when we fall in love, celebrate with friends, and enjoy the best of what life has to offer. Assuming that your base music position is firmly established in the minds of your listeners, perhaps you can incorporate the power of memories in your programming this holiday season. Where were you when you first heard this song? What song was playing when you first fell in love? What memory does “White Christmas” evoke? Etc.

For me, my love of music comes from my mother who was a music teacher for nearly 50 years. She lost her battle with Dementia in 2017, but she is frequently in my thoughts, especially this time of year. While watching this Chevrolet ad, I recalled that she used to sing “Sunshine on My Shoulders” when I was a child to cheer me up if I had had a bad day. Thanks for the memories, Chevy.

Three Best Practices of Questionnaire Development

As you would probably expect, the thing everyone wants to know with every research study is, what are the results and what do they mean? But there’s a saying in the data business that should be considered in the development of any questionnaire:

“Garbage in, garbage out.”

In short, the quality of the output is determined by the quality of the input. And that starts with questionnaire development. A great deal of time at Coleman Insights is spent behind the scenes thinking about things such as how respondents will see or hear questions, which order they should go in, and so on. Whether we’re writing a complex survey for a media brand or you’re creating a simple survey in SurveyMonkey to send to your database, there are a fundamental set of procedures to consider. Here are three we keep in mind:

#3:     Ask the most important questions in the beginning.

The beginning of a survey is when the respondent is most engaged. Focus on the most important issues facing your brand as close to the beginning of the survey as possible. If you’re a podcaster, you may want to ask listeners how familiar with and interested they are in the guests you plan to talk to in upcoming episodes. While that’s informative, it’s not as important as learning, and tracking, how many podcast listeners are familiar with your brand, and of those, how many listen regularly. The appeal of your guests is irrelevant if few people are even aware that your podcast exists.

#2:     Don’t ask qualitative questions in a quantitative project.

Over the past few years, we’ve become more intentional about discouraging verbatims in perceptual studies. While there are a few exceptions, it’s like trying to paint a house with a hammer; you’re using the wrong tool for the job. In a qualitative study, like a Campfire Online Discussion Group or 20/20 Focus Group, an experienced moderator can probe participants for more details. A question like “Why are you listening to (radio station) less than you did a year or so ago” can be insightful in this type of research.  However, an answer like “Because I listen to streaming more” may be interesting, but it isn’t actionable. With qualitative research, we have the opportunity to dig deeper to find the reasons why the consumer is listening to streaming more. Did your station do something to cause them to listen less? Was there something about a particular streaming service that attracted them? Or, did they get a new smartphone and haven’t downloaded your app yet? Or perhaps they didn’t know they can ask their new smart speaker to play your radio station?

That same listening momentum question can still be effective in a quantitative study, like a Plan Developer. Instead of an open-ended verbatim answer to the question, it is more effective to specifically test theories you have as to why they are listening less and give the respondent some choices. For example:

  • The quality of the music has declined
  • The station plays the same songs over and over
  • The personalities on WAAA talk too much
  • Big Bob left the WAAA Morning Show
  • WAAA is playing too many commercials
  • You are listening to (X) more
  • Other (SPECIFY)

The result is likely to be much more actionable, which brings us to:

#1:     Ask questions that will provide actionable information.

Other than satisfying intellectual curiosity, there is no value in learning information that you can’t do anything with. For example, you may be curious what percentage of your listeners listen to your station on a radio vs. your app. However, what are you going to do with this information when you have it? If your goal is to get more people to use your app, you should consider a Campfire study to find out what people like and don’t like about it. Once you have the results, market what users like about the app and be sure to fix the issues that bother them.

The Benefits of a Trendable Study

In every Plan Developer℠ perceptual study we conduct at Coleman Insights, there are a multitude of ways to get at some of the answers every audio brand wants to know. Why do listeners choose my brand? Why don’t they choose it? How can I use that information to grow? While there is no doubt that one Plan Developer can be immensely valuable to craft and implement a strategic plan, the benefits of trended data, collected annually for our clients can be priceless.

For starters, listeners don’t always recognize changes in their behavior or perceptions. Sometimes these shifts are subtle and gradual, unconscious, or simply forgotten. Thus, asking what brand a consumer is using more or less doesn’t always give us obvious clarity. Trends allow us to uncover these patterns. We can see, over time, which brands have grown, and which have shrunk.

With trended data we can track which aspects of a brand have improved or declined. If a brand’s perception has slipped overall, we can investigate what’s driving that by examining the changes in images and brand attribute evaluation over the past several studies. For example, a radio station’s music image may remain strong, but its morning show image has eroded. In the following example, Station B and Station D were leading the variety image in the market in 2019 and 2020. But trending data show how a new competitor, Station A, gradually grew its variety image and took the lead in 2021.

Trends help us identify changes in content interest, which is applicable to both music and spoken word stations. Music tastes are not static and understanding their evolution in the market and among each station’s listeners can lead to one of the most actionable findings in a study. Tracking changing music appetites can help explain a decline in a brand’s performance, and a Plan Developer helps correct this negative trajectory by optimizing the station’s music blend. Over the past couple of years, monitoring these trends have allowed our clients to stay on top of pandemic-influenced behavior, such as heightened interest in news.

Consistently conducted research helps track the appeal of personalities as they become more familiar to the audience. Trends demonstrate if listeners are associating a station with a regular benchmark contest or feature. They tell us how fast consumption habits are changing and which platforms present the biggest threat.

A Plan Developer for your audio brand delivers “The Plan,” your strategic road map, but it’s the regular check-ups, the trendable studies, that keep your brand healthy and ahead of the competition.

Protecting Your Brand Identity

One could argue that nothing is more important to a company or a product than its brand identity. From logo to tag line, from what colors to use, to what “voice” to portray in messaging, brand identity is the gateway to how consumers perceive your brand­—the primary driver that separates successful companies from failures.

When a federal judge in Virginia ruled a few weeks ago that Gruyere cheese sold in America doesn’t have to come from the Gruyere region of Europe, it was not only a blow to the Swiss and French cheesemakers that filed the lawsuit; it was a lesson about protecting your brand identity at all costs. It’s a lesson the Gruyere producers should have learned from their counterparts in the Champagne province in the northeast of France.

While you personally may refer to a bottle of sparkling wine produced outside of France as “Champagne,” vineyards may not (although there’s an odd California loophole). As far back as 1843, a group of Champagne producers in France’s Champagne wine region banded together to successfully sue producers of sparkling wines outside the region for referring to their products as Champagne. But the effort to protect Champagne’s brand identity hardly stopped there. The Comité Interprofessionnel du Vin de Champagne (CIVC) was founded in 1941 with the specific goal of “preventing misuse of the name Champagne to describe sparkling wines, whether fakes being passed off as Champagne, or sparkling wines from other regions that use the name Champagne as a generic term (eg, American Champagne).” The CIVC has a Champagne Bureau in Washington, DC to protect the word “Champagne” from being misused in America. In 1990, new legislation extended Champagne brand protection beyond wines and spirits, resulting in successful lawsuits that prevented the selling of “Champagne cigarettes,” and a perfume called “Champagne” created by Yves Saint Laurent. Not sparkling wine from Champagne, France? No soup for you.

Which brings us back to our cheesy friends from Gruyere. They wanted similar trademark protection to what Champagne gets, arguing that Gruyere cheese can only come from the Gruyere region in Europe. The U.S. Dairy Export Council said Americans understand the gruyere name to be generic, applying only to the style regardless of origin. The honorable T.S. Ellis III agreed, and the words in his decision are important:

“It is clear from the record that the term GRUYERE may have in the past referred exclusively to cheese from Switzerland and France,” Ellis wrote. “However, decades of importation, production, and sale of cheese labeled GRUYERE produced outside the Gruyere region of Switzerland and France have eroded the meaning of that term and rendered it generic.”

How could this happen? Champagne is hardly the only example of brand protection. There’s even a cheese example from a similar part of the world. Roquefort can only come from the village of Roquefort-sur-Soulzon in southern France. Why not Gruyere?

It all comes down to brand identity protection.

The originators of Champagne have spent nearly 200 years protecting their brand identity.

Regulations for Roquefort have been in place for nearly 100 years.

But because decades were allowed to pass without the producers of Gruyere protecting their brand identity, consumers (and an influential judge) perceived it to be a generic word.

In our world of audio entertainment, it’s a reminder to review your station, show, podcast, and streaming channel to ensure that your brand identity is protected at all times, and that no other entity is attempting to infringe upon it. While it requires an investment of time and money, the consequences of inaction may be a far worse fate.

Brand Subtraction: Less May Be More

Let’s say you’re responsible for overseeing a brand. If something is not working, you add something to make it more appealing. Right?

If something is working, you add more things to make it even better. Right?

We’ve addressed this instinct of addition a number of times in our Tuesdays With Coleman blogs. In “Too Many Messages,” Warren Kurtzman illustrated how adding messages to advertisements lowers the likelihood of remembering any single message from the ad. Jay Nachlis alluded to the explosion in entertainment options while quoting Jerry Seinfeld in “Lack of Focus=Lack of Greatness.” HBO’s ascent to juggernaut status happened by focusing on one great show at a time on Sunday nights, which Jon Coleman points out in “Can HBO and Radio Have it All?”

Now, there’s new science to back up addition by subtraction. Inc.’s Jeff Haden refers to a new University of Virginia study that revealed when people attempt to improve something, they default to “additive transformations,” while ignoring “subtractive transformations.”

It’s why a bar owner may think adding Taco Tuesday to his already loaded list of promotions will be just the thing to boost profit margins.

It’s why software developers think adding more features will make their applications easier to use.

And it’s why a radio program director may think adding more music or special features for the sake of quantity will result in more listening and higher ratings.

So, if we know that we’re inclined to add to solve problems, what happens when we’re prompted to subtract to solve the same problems?

When reminded they could remove items or elements, participants in the University of Virginia study were twice as likely to make subtractive changes than additive changes. And the changes were more effective.

Instead of considering what you can add to solve a problem, consider what you can subtract.

How would that focus your radio station’s music message? Or your podcast’s topic? Or one of your streaming service’s channels?

The takeaway is the take away.

 

 

A Researcher Goes to Therapy

Hi, my name is David, and I obsess over research questionnaires.

“Hi, David. What exactly are you obsessing about?”

I think about the coding that goes into the data file. What if there’s a typo? What if the answer key is incorrectly ordered? What if there’s a mindless copy and paste and the code we meant to assign an answer doesn’t match the code that was captured in the data file? What then??

“Are these the only things keeping you up at night?”

Besides my dogs? No, I also worry about what devices respondents use to take the surveys. We’d like to think they’re all using a shiny 48-inch OLED monitor, but let’s face it–lots of them are taking it on a small phone with a cracked screen! What if the survey isn’t optimized properly for them??

“That seems like a lot of pressure.”

Oh, it is. It’s been more than 16 years since my last on-air shift, and I still have that off-the-air alarm dream. But more often than not, I think, did I check to make sure that the 5-point on the scale says “love it” and the 1-point on the scale says “dislike it a lot?” Did the introduction for that section say “click the button on the left” when the button is actually at the bottom of the screen when you look at the survey on a smartphone?

In this example from an entertainment study, respondents are asked to read the statement on the left and right, but in this mobile view the statements are on the top and bottom.

Are the questions being asked in such a way that will truly get the unbiased answers we’re seeking???

“Well, are they David?”

(takes a deep breath) Yes. Of course they are.

“And why is that? Doesn’t everyone do that?”

(icy cold stare followed by sarcastic eye roll)

“I see.”

It’s so important to get the right people. I’ll dream about how important the sample is.

So, what should I do about this obsession?

Drawing by Charles Barsotti

 

“Do your clients worry about this kind of thing? Are they concerned these kind of mistakes will be made and things will be overlooked?”

No.

“And why is that?”

We do it so they don’t have to worry.

(silence, followed by pondering)

So, you uh…think I should…

“Keep obsessing?”

Yes.

“Yes.”

Have a good day.

“Bye, David.”