What do you mean customers don’t know what they want?

If I’d asked customers what they want, they’d have said more convenience and relevance.

Look familiar? I’ve riffed on that Henry Ford quote about faster horses, yada, yada. It’s not too far off from what customers would theoretically have been seeking in faster horses.

Makerbot Replicator 2I altered that quote to fit a modern day phenomenon: 3D printers. If you haven’t paid attention to them yet, these are machines that manufacture physical, 3 dimensional objects. These objects can be solid, or have more intricate internal workings. One leading manufacturer is MakerBot. In September it released its latest 3D printer, the Replicator 2.

Why is this relevant to a discussion on “customer wants”? Because 3D printing is one of those technologies that holds high disruption potential and is a significant departure from existing products. In other words, it’s all the things that disruptive-innovation enthusiasts look for in innovation. And many of the same people will argue such innovations cannot be identified via customer needs and desires.

There is truth there, but the argument is stunted, incomplete, even glib. It’s the inventor’s argument, not that of the innovator.

We’re talking different things

In discussing the role of customer needs and wants in innovation, we must separate the process, as illustrated below:

Decoupling customer JTBD from solutions

Start from the position that we, as humans, have a pretty good idea of what we want. Define this as our job-to-be-done. We are a bundle of many, many varied jobs-to-be-done. We have personal jobs, family jobs, social jobs, workplace jobs, athletic jobs, etc. The global economy runs by finding ways to satisfy these jobs-to-be-done.

I have heard the argument that customers cannot express all their jobs, that they have latent needs. I tend to side with Tony Ulwick’s view that latent needs are a myth. I do think it can be challenging to get at all the jobs-to-be-done a customer has. But I ascribe that more to the methodology of eliciting them than to the idea that customers cannot express them. There are good ways to understand customer needs and wants, such as Strategyn’s Outcome-Driven Innovation, Gerald Zaltman’s ZMET, and Stanford d.school design thinking concepts.

But the key point is that customers do know what they want. Their jobs-to-be-done are actually fairly stable. They are the keepers of the source basis of success.

It’s the next step where inventors come in. They either:

  1. Haven’t grounded themselves in customers’ jobs-to-be-done and the level  of satisfaction with each
  2. Understand the true jobs-to-be-done and know where underserved outcomes are

When some people pronounce that “customers don’t know what they want”, I worry that they’re actually operating under the #1 scenario. They don’t really understand what jobs are valid and underserved (e.g. see Cuil’s ill-fated attempt to displace Google). They’re pursuing a Hope Principle. Hey, someone always wins the lottery too.

It’s the #2 scenario where the potential for success exists. But it’s not guaranteed. Ideas are generated to improve the outcomes of jobs-to-be-done. Who generates them? Entrepreneurs. Corporations. Customers themselves. Researchers.

Here’s where the “customers don’t know what they want” concept has more validity. There’s no reason a customer is uniquely positioned to generate the best ideas. Others may be focused on new technologies, adjacent market trends, biomimicry, innovations pulled from distant fields, etc.  This is where the art and magic of innovation surfaces. The fun creative part, if you will.

Ideas which best improve outcomes on jobs-to-be-done have the advantage here. Each idea will do so to varying degrees. The ones that best fit multiple jobs-to-be-done and significantly improve outcomes for those jobs win the market.

3D printing is an idea that could satisfy a number of jobs-to-be-done

This is my take on the difference between invention and innovation:

Invention creates. Innovation changes.

Invention is the creative act. Innovation is the adoption of an invention to improve jobs-to-be-done.

Which brings us back to those 3D printers. Right now, they are an invention. Will every home have one the way we do PCs, televisions, dishwashers, etc.? We don’t know yet, as the technology continues to improve and prices need to come down. Indeed, here are the sorts of questions one finds currently:

“Who would buy this?”, they ask. “Why would anyone want to create objects themselves?”

But you know, customers do know their jobs-to-be-done. Here are is a sample of jobs-to-be-done where 3D printers can potentially improve outcomes:

Type Context Job Success metric
Toys When I plan out gifts for my children’s special events (birthdays, Christmas, Hannukah, etc.)… I want to give presents that are targeted to their specific interests. Increased satisfaction by my children with the presents provide
Medical When I need to provide a prosthetic replacement for a patient… I want a prosthetic that matches the patient’s specific size and characteristics. Reduced time and cost  to provide a perfect-fit replacement for the patient.
Pharma When I am on a drug regimen for a condition… I want to have my pills available as I need them. Reduced time to procure the pills I need.
Fashion When I am getting dressed for various activities… I want accessories tailored to my unique style. Increased personalization in my daily look.
Education When I am teaching kids about a specific subject… I want to provide physical objects that aid hands-on learning about the concept. Increased understanding of the topic.

Will 3D printing take off?  Or will it be the new version of a kitchen bread-making machine (cool concept, never used much after getting one)? I’m optimistic on 3D printers, as I can see them fulfilling a number of jobs-to-be-done.

But the key point here is that customers do know what they want. Now let the Henry Fords and Steve Jobs of the world dazzle us with their ideas to better serve the outcomes of our jobs-to-be-done.

I’m @bhc3 on Twitter.

About these ads

Finding opportunities to unseat incumbents

On Quora, this question was asked:

Competition: How do you assess the value of a new product or service vs an incumbent’s?

Is there a starting set of criteria? eg. price, quantity provided, ease of use, breadth and so on. I’m thinking specifically of a product to supply financial news and information and prices.

What struck me about this question is that it has the entrepreneur’s optimism in it, while also running into the classic issue of running into entrenched players in the market (e.g. Bloomberg, Reuters). Entrenched players can be quite hard to displace. Not impossible of course, as we’ve seen with RIM’s one-dominant Blackberry.

I put together an answer that combines two concepts. It’s re-published below.

———————-

Focus on two areas to distinguish yourself from the competition:

  • Jobs to be done
  • 9x-improvement ideas

JOBS TO BE DONE

Start from the customers’ perspective. Always. In this case, get a handle on their Jobs-To-Be-Done. What are they hiring incumbent providers for? How are they using the financial information?

Given you’re looking at a startup in this field, I’m sure you have a good initial sense of what customers are doing. But I’d wager it’s incomplete. I work in the innovation management software realm, but I know I have incomplete knowledge about the jobs-to-be-done.

By knowing three things, you will be a long way toward identifying the competitive opportunities for your idea:

  1. The jobs-to-be-done
  2. The level of satisfaction with each
  3. The ranked importance of each

Next, I want to borrow a phrase from Jack London, “You can’t wait to know the jobs-to-be-done. You have to go after them with a club.” This means engaging prospects. There are some methodologies out there, such as Steve Blank’s The Four Steps to the Epiphany (2005 Book).

One thing I’d stress is that in soliciting the jobs-to-be-done, I’d stress three elements that should be known:

  • Context: “When I…”
  • Job: “I want to…”
  • Success metric: “Decreased…”

I recently wrote up an approach to doing this, you can see it here:
Applying jobs-to-be-done to product and service design by Hutch Carpenter on Jobs-to-be-Done

An important result of that process is the generation of an opportunity map:

JTBD Opportunity Map

 

See where the highest priority, lowest satisfaction jobs-to-be-done are. Then…

9X-IMPROVEMENT IDEAS

OK, after talking with different prospects in your target market, you’ve got a good sense of what they’re trying to get done. You know where they feel current solutions are falling short, and how important the various jobs are.

And you know what they value in an outcome (success metric).

Here’s the tricky part of innovation. You need to displace the incumbents. Which is not easy. MIT researcher Andrew McAfee has a great post on the subject of displacing an incumbent: The 9X Email Problem

In it, he highlights research by a colleague regarding customers’ behavior when it comes to replacing an existing product/service with a new one. The gist of it is:

  • People tend to underweight the prospective benefits of a technology by a factor of 3
  • People tend to overweight the value of whatever it is they are being asked to give up by a factor of 3

Together, you get the need to improve on the current situation by 9x.

The good news is that the success metrics described by prospective customers in the job-to-be-done phase point to where a 9x improvement could potentially be designed.

Certainly, though, this is the art of innovation. How well does an idea deliver on improving those success metrics?

I’m @bhc3 on Twitter.

McDonald’s wins on the fast food jobs-to-be-done that matter

Consumer Edge Insight conducted a survey of consumer perceptions about 20 different fast food restaurants. Specifically, how are they ranked by consumer perceptions on different attributes, such as:

  • Good value
  • Convenience
  • Low prices
  • Fast service
  • Great tasting food
  • More…

The customers were asked to rank order the different attributes, and “great tasting food” actually ranked 8th. The first four above were the top ranked attributes.

Which explains this unusual finding when it comes to McDonald’s:

McDonald’s scored very low in “satisfaction with last visit”. Only 22% of respondents were extremely satisfied with their last McDonald’s experience. Highest satisfaction scores went to Chick-fil-A (66%), Long John Silver (56%), and Whataburger (54%).

McDonald’s scored very high in “extremely likely to visit again”. McDonald’s 64% score on that measure was third behind Subway (68%) and Chick-fil-A (67%).

Wha…? Yeah, low satisfaction combined with high intent to visit again. Strange isn’t it? Are consumers masochists? Well, no. The key here is recognizing that customers have a number of jobs-to-be-done when it comes to eating. Translating the four attributes into jobs-to-be-done (using the previously defined structure):

Attribute Context Job Success Metric
Good value When I purchase food… I want to spend the same or less than what I would for preparing the same food myself. Perception that the food quantity and quality is commensurate with the price paid.
Convenience When I need to eat with limited time… I want to find food to eat quickly Decreased time to get to the food that I will eat.
Low prices When I need to feed myself and others… I want food costs that fits within my budget. Food that costs less than [X]% of my daily income.
Fast service When I need to eat with limited time.. I want food that is served quickly after I’ve ordered. Food is served within [2 minutes] after I order it.

On the highest ranked jobs-to-be-done (remember, jobs should be ranked ordered), McDonald’s is at or near the top. What’s interesting is that the “satisfaction with last visit” score was low for McDonald’s. But it turns out that’s not the most important question. Rather, the question should be, “how satisfied are you with the jobs-to-be-done that matter?”

I’m @bhc3 on Twitter.

A Method for Applying Jobs-to-Be-Done to Product and Service Design

Say you’re designing something new for a product or service. Of course, you have your own ideas for what to do. But, how informed are you really about what is needed?

This is a question I faced in thinking about game mechanics used in a social platform. A common product approach is to work up some game mechanics ideas, get them designed and deployed. The source for ideas? My own fertile mind. Inbound suggestions (“in World of Warcraft, you can…”). Competitors. What companies in other markets are doing.

But that wasn’t sufficient. Game mechanics are an evolving, somewhat complex field.  I wanted to understand at a more fundamental level: why game mechanics? So I decided to learn more from our customers. What needs would game mechanics address? Initial question: what’s the best way to go about this?

Jobs-to-Be-Done: Only for game-changing innovation?

The jobs-to-be-done framework struck me as the right approach here. What are customers trying to get done? As legendary professor Theodore Levitt said:

People don’t want to buy a quarter-inch drill. They want a quarter-inch hole.

Similarly, I didn’t believe customers wanted to buy “game mechanics”. They want to buy results, which game mechanics can help deliver. Using the jobs-to-be-done framework, what jobs were game mechanics being hired for?

Yet, in reading the advice on jobs-to-be-done, one gets the impression that eliciting jobs-to-be-done can only be done effectively via intensive in-person interviews. Well, I didn’t have the capacity to fly around for one-day deep-dive sessions to understand the jobs-to-be-done related to game mechanics.

Customer Insightini

And this gets at something related to jobs-to-be-done as it stands today. It’s very much positioned for high-impact, game-changing innovation. Which is awesome, by the way. Firms like Strategyn and ReWired Group are setting the tone here. When the payoff for intensive, expensive efforts like in-person interviews is high-value innovation, you do them.

But my needs were at a lower level than that. In the Customer Insightini™ to the right, I segment the types of initiatives where customer insight can be useful. The bottom is the minor stuff (“it should support colors red, green, blue…”). The top is the game changing endeavors (e.g. surgery stents). My game mechanics inquiry? Right there in the middle. Introduction of something new in the same market.

Since I couldn’t find a good framework to elicit customers’ jobs-to-be-done, I hacked together my own methodology. It’s described below.

  1. Job-to-be-done structure (link)
  2. Focus the effort (link)
  3. Rate satisfaction with fulfillment of each job (link)
  4. Rank order importance of jobs to create an Opportunity Map (link)
  5. Use a website to manage the jobs-to-be-done (link)
  6. Conversations are as valuable as the jobs themselves (link)
  7. Step-by-step plan (link)

Job-to-be-done structure

I needed a common language for the various jobs-to-be-done. Specifically, I needed a reliable format that provided the right information. I came up with the following:

Context: “When I am…”

Job: “I want to…”

Success metric: “Increased…”

Context is important, because I want to understand the background for the job to be done. When did it happen? What was the larger goal? The job itself is the core information to be collected. The success metric told me what the customer valued in an outcome, and provided a basis for measuring whether the idea implemented to fulfill the job was actually doing so.

Focus the effort

Something I’ve learned in the realm of innovation management: focused initiatives outperform post-whatever-you-want initiatives. In other words, participants should be asked for insight on a specific topic. Otherwise the exercise risks spinning off in many directions you’re not ready to pursue.

In the game mechanics effort, I started with a definition of gamification itself. This set the tone for the discussion. I believed there were several areas that could benefit, so I focused the discussion around collaboration, engagement and three other areas. This framed the discussion without corralling customers too tightly in what they wanted to express. It also gave a nice rhythm, as we worked through each of the five areas.

Unsurprisingly in the discussions with customers, they had ideas for applying game mechanics to a job-to-be-done. Since the discussion was focused on their needs and wants, I would take these ideas and add them to a separate Spigit idea community.

Rate satisfaction with fulfillment of each job

This step was critical. It wasn’t enough to have the various jobs-to-be-done. Understanding the level of satisfaction with each one is the metric which shows where good opportunities lie.  I asked customers to bucket each job-to-be-done as:

  • Satisfaction with current outcomes = HIGH
  • Satisfaction with current outcomes = MODERATE
  • Satisfaction with current outcomes = LOW

Now, there was a natural bias for customers to provide jobs where their satisfaction was lower. They wanted to talk about things that need to be improved. But I wanted to ensure a broader look at the landscape of jobs. So in the course of the discussion, there were three sources of jobs-to-be-done that came outside of these  low-satisfaction ones:

  1. Seeded obvious jobs: I seeded the site with some of the more obvious jobs, to provide examples.
  2. Jobs provided by previous customers: As I learned new jobs from a previous discussion, I’d add them to the new discussion. This was good to see how customers felt about what others were trying to get done.
  3. Jobs elicited in discussions: After getting one job from a  customer, we’d discuss it. In that discussion, you’d hear another job-to-be-done. While that one may not be low satisfaction, it was important to capture it for a fuller understanding.

As you can imagine, there were varying views on level of satisfaction for the same job across customers. Is the software performing differently for each? No. But each customer was communicating the level of outcome they deemed satisfactory.

Rank order importance of jobs to create an Opportunity Map

After the jobs were sorted into the LOW, MODERATE, HIGH satisfaction buckets, I asked the customer to rank them in relative importance, highest to lowest. This was their chance to tell me just what they valued most. Even if their satisfaction was moderate with a job’s outcome, it was valuable to know what they deem most important. Useful for fuller understanding of why customers buy. Because you want to avoid being one of these companies:

The vast majority of companies have no clue what their customers value in the products and services they buy.

Here’s what you get after you’ve done this: an Opportunity Map as determined by the customer’s expressed needs.

JTBD Opportunity Map

After talking with each customer, you’ll be able to generate an Opportunity Map. By aggregating the responses by customers, you have a broader Opportunity Map    that begins to reflect something of the market.

Use a website to manage the jobs-to-be-done

The preceding elements of eliciting jobs-to-be-done are the method. The method needs a place to execute it. For my gamification project, I used the free post-it note site Listhings. With that site, I can add unlimited canvases (for different customers) and individual notes (for the jobs). You can color code the different sub-topics within the question you are asking.

Examples of Listhings culled from an actual customer discussion:

Listhings example

Conversations are as valuable as the jobs themselves

In the process of collecting the jobs-to-be-done, I found the discussions around each job-to-be-done to be incredibly valuable. And this is an important point: customers want to talk to you about what they’re trying to get done! The discussions were intelligent and gave me insight into their world. An insight I cannot get from data about usage or the user stories I write in a vacuum.

This experience is what makes me cringe when I read others throwing around the old Henry Ford chestnut: “If I had asked people what they wanted, they’d have said faster horses.” It assigns customers to the Dumb Bucket.

Interesting experience in doing these with 8 different customers. I would schedule a one-hour session with our admin leads at each. Inevitably, we’d run out of time in that first session. Every single customer was up for a second session. One customer even wanted a third and fourth session, bringing actual end users into it for their perspective.

Perhaps this can be a good path for a design thinking approach, as it really boosts your empathy for what customers are trying to get done as you discover their jobs-to-be-done.

Step-by-step plan

OK, that was a lot of information about individual parts of this jobs-to-be-done methodology. Let’s put it together into a plan:

  1. Establish a topic you want to explore more deeply with customers.
  2. If the topic is somewhat broad, break it down into sub-themes.
  3. Sign up for a site where you can collect jobs. Criteria for such a site:
    • Each job is visible in full on screen
    • Ability to segment the jobs by sub-themes
    • Ability to categorize jobs by level of satisfaction
  4. Seed the site with some obvious jobs that your product/service provides.
  5. Select customers to engage.
  6. Use a web/screen sharing tool to run the discussion (e.h. WebEx, GoToMeeting, Skype, Google Plus).
  7. Plan for an hour, expect to need a second one.
  8. As you talk with the customer, post the jobs in real time so she sees them on screen.
  9. Run through the satisfaction bucketing (LOW, MODERATE, HIGH)
  10. Rank order the jobs within each satisfaction bucket
  11. Collate and aggregate the responses after you have finished the customer discussion. I used Excel for this.
  12. Identify the jobs that were most important and received LOW or MODERATE satisfaction across your customers.
  13. Plumb your notes from the discussions for additional insight that will be useful

The other thing you’ll gain from this are customers who have a demonstrated interest in the phases that follow in the design and development process: ideas, prototypes, early purchasers.

I’m @bhc3 on Twitter.

Net Promoter Score is a window into jobs-to-be-done fulfillment

I’m a big advocate for better understanding customer needs, particularly in the jobs-to-be-done form. Companies should spend more time on this, instead of the all-too-common approach of implementing someone’s vision in a near vacuum. Although I admit it isn’t easy to do. Focus groups are a start, but are both logistically and financially hard to scale, and fraught with their own issues. So the state of getting customer insights is still fairly immature.

So I was interested when I received this email invitation from American Express:

See there? AmEx wants to better understand my needs. Charge cards fall into that overall payment realm which includes PayPal, Square, Stripe, Google Wallet, etc. It’s a deep part of our society and something we can all relate to.

Sure, the most basic job-to-be-done is:

When I am purchasing something, I want to provide payment to the seller. Success means I complete the purchase.

But is that all there is? No, of course not. I have jobs around paying off AmEx, understanding my spending habits, merchandise assurance, along with emotional ones like a feeling of assurance I can buy when I want to. AmEx even works on fulfilling a status-based job-to-be-done. Extending out from there, there are adjacent jobs related to the purchase decision process before the transaction and better understanding my financial activity after the transaction. Heck, I’ll bet AmEx could come with more areas where I have relevant jobs-to-be-done.

 I click on the Begin Survey button in the email, passing through three set-up screens first:

Now, if you look at those three screens, that’s a good amount of setup. An intro screen, a list of “helpful hints” and finally confirmation of the product I’m using. Feels like I’m about to undergo a weighty exercise.

Well…no. Rather, this is the meat of the entire survey:

A net promoter score question. NPS has become more and more popular, and is a simple report card on how your customer perceive your product or service. Customers who click 9 or 10 are called Promoters, 7 or 8 are Passives, and 1 to 6 are Detractors (read more on net promoter scores). For the record, I picked ’7′. AmEx is a fine card, but in my wallet I can’t really distinguish it from my Visa or Mastercard. It’s the only charge card Costco takes, so I can recommend it based on that.

But a broader question occurred to me. What will AmEx do once they have all the NPS’s collected from customers? Say the NPS comes in averaging ’9′. They’re done, right? Pretty much nailing it. If it comes in around ’7′, they’ll wonder what is wrong, why people aren’t more gung ho.

Assuming they will take action based on the NPS collected from us customers, I can see a few paths here for what happens next.

Marketing focus: Product is fine as-is, it’s the messaging around it that we need to improve. Also, we’re not reaching customers where they are. TV is declining, we need new ways to get across why our card is better. That will get our NPS’s up.

Internal product development focus: Work on ways the card features and experience can be improved. Smart people work at AmEx, and they can come up with some interesting approaches. Focus group the ideas after they’ve honed them down to a few. That is, get customer insight after the fact.

Jobs-to-be-done focus: As Steve Blank espouses, there are no facts inside your company’s walls, get outside of your purely internal focus. Initiate a program of exploring jobs-to-be-done by customers. Incorporate customer wants into determining the design of new products. This is insight before committing to any ideas.

Indeed, the NPS is a great first cut on identifying customers to approach about getting deeper insight. Each person’s NPS is essentially a window telling you how well AmEx Green matches their particular jobs-to-be-done.

What do you think AmEx will do next?

I’m @bhc3 on Twitter.

What’s your view on customers’ value to innovation?

More and more, customer-centricity is becoming a thing. As in, an increasingly important philosophy to companies in managing day-to-day and even longer term planning. In comes in different forms: design thinking, social CRM, service-dominant logic, value co-creation.

But it’s not pervasive at this point. Companies still are spotty on how much they integrate customers into their processes. This is a revolution that will take some time to unfold.

In terms of innovation and product or service development, there is a spectrum of where organizations are today:

Quick descriptions of each point on the spectrum…

Customers have thoughts?: For these firms, customers are transactions. How will I know if I’m attuned to the customer? I look at my daily sales receipts. If they’re up, I’m attuned. If they’re down, I’m not!

Customers don’t know what they want: What was it Steve Jobs said again? Ah, yes: “A lot of times, people don’t know what they want until you show it to them.” Unlike the previous point on the spectrum, here, companies have considered that their customers have thoughts. They just don’t think there’s much point in paying attention to them. In a more charitable vein, Roberto Verganti cites companies that “make proposals to people”. While there’s no direct customer engagement, these companies build product intuition through trends changing other sectors. Unfortunately, many companies with the “customers don’t know” aren’t actually doing that either. It’s more someone’s whim defining the offering.

We respond to questions and issues: In this part of the spectrum, companies may proudly say they listen to their customers. Not too deeply though. It’s more a surface-level valuation of customer input. It doesn’t fundamentally change the company culture, or really draw customer insights more deeply into the organizational workings. The hip companies have extended this work out into social media. They monitor tweets, Facebook posts, Pinterest pins, etc. for complaints, questions and sentiment analysis.

We have a Customer Advisory Council: Take some of your best customers, and appoint them to a special panel that meets periodically during the year. Good forum for airing bigger picture issues. In this case, companies asttempt to more directly solicit customer input into their thinking. These sessions are good, because otherwise the only way customer feedback gets into an organization is during the sales process and then one-on-one with an account/customer rep. Insight gets trapped in a CRM account somewhere. While progressing on being attuned to customer insight, CACs are still siloed affairs. Many in the company have no idea what comes out of them. And they are removed from the day-to-day work that truly defines an organization.

We focus group new innovations we’ve already developed: As opposed to developing something and putting it out there, these companies work with focus groups to understand what is liked or disliked about an offering they have developed. This can be quite valuable done right, and becomes a direct conduit for customer insight into the company. The biggest problem here is that it’s after-the-fact: the product or service has already been designed. Now, in the lean startup methodology, this approach of develop and test is a core principle. In corporate land, focus groups may be less about test-and-learn, and more about affirming one’s pre-held views.

We solicit customer jobs-to-be-done: As part of their planning and design process, companies solicit customers’ jobs-to-be-done. They want to get a bead on customers are trying to accomplish with their products and services. This is no small feat. I’ve done this work myself, and it does take a willingness to open one’s mind beyond your own personal beliefs. But getting and using jobs-to-be-done in product and service design is a basis for better, more valued offerings to the market. Key here is not just engaging customers on their jobs, but actually incorporating that into design.

We gather customer ideas: Customers are using your offerings, and can see opportunities where new features and services would help them. While certainly product, R&D and marketing will come up with ideas on their own, what about the people who actually use your products? This is a form of open innovation. The amount of ingenuity outside your company walls dwarfs what you have internally. Key here is to solicit around focused areas for development, which makes using the ideas more feasible inside companies. Wide open idea sites can be harder for companies to process, as they don’t fit an existing initiative. Defined projects have a receptive audience and a commitment to progress forward.

We co-design with customers: The most advanced form of customer-centricity. Customers have a seat at the table in the actual development of products and services. This is, frankly, pretty radical. Their input guides the development, their objections can remove a pet feature favored by an executive. This is hard to pull off, as it is counter to the reason you have employees in the first place (“experts on the offering”). It requires a mentality change from being the primary source of thought to a coordinator and curator. Key here is deciding which customers to involve at what point in the process.

My guess is that most companies are still toward the left side of the spectrum, but as I say, it is a changing business world.

I’m @bhc3 on Twitter.

Tweets Offer Little Value in Understanding Customer Needs

Social media. A rich source of insight and opportunity for companies. Why, it’s an article of faith that customers are talking…on their terms…where they want. So get out there and learn from them! See what this IBM executive says:

Companies that embrace social media as a source of insight will be rewarded. They’ll develop a deeper understanding of customer needs and will be able to attract new customers more easily. They’ll have a better shot at providing the products and services that the market wants – before the competition does.

It’s true, there are opportunities. But really, my sense is the opportunities lie on the marketing (read: sell) side of the house. Now social media occupies a large landscape. So how about narrowing focus, to Twitter. How useful are people’s tweets for customer insight? Specifically, giving companies a better handle on customers’ jobs-to-be-done?

tl;dr answer: Not so much. Lots of grousing about personal circumstances, and some silliness. But not much insight.

Saving and paying for college, in 450 tweets

Source: Mark J. Perry

To examine this question, I assumed the perspective of a financial firm trying to get a better handle on the “paying for college” jobs-to-be-done. In aspirational, emotional terms,  college continues to be a top goal of parents for their children, and of teenagers as well. In economic terms, colleges have an insatiable appetite for tuition increases.

Importance for our children, increasing costs, need to save. Surely, there are some unfulfilled jobs-to-be-done out there. So I turned to Twitter to see what people were talking about. What needs were they expressing? What insight on this topic?

To see what people are saying, I ran Twitter searches on three terms:

  1. college savings
  2. “saving for college”
  3. “pay for college”

I collected 150 tweets each for those three Twitter search terms (you can see them in this Google spreadsheet). With that data, I looked at (i) how many contained usable insight, (ii) what were the common words, and (iii) the collective sentiment.

Now, my research here is one of…oh say…a quadrillion possible customer insight areas to explore. Conclusions I draw here are not necessarily applicable to all areas. But it’s a good start.

Mining for jobs-to-be-done

Imagine you work for a large financial services company. You know in the U.S., people have put nearly $150 billion into 529 college savings plans. It’s a potent cocktail: lots of money; aspirations for, and symbolism of, a college degree; and escalating tuition. There have got to be opportunities to improve people’s lives here!

You want jobs-to-be-done, defined as people’s expressions of things they’re trying to get done in relation to saving and paying for college. Just what are they tweeting about out there?

You collect the tweets, and then categorize each tweet according to its value in understanding jobs-to-be-done:

  • No value
  • Points toward a job-to-be-done (a shadow of a job)
  • Direct expression of a job-to-be-done

In reviewing 450 separate tweets, here are the results:

Twitter search term No value Points to a JTBD Direct JTBD
college savings 137 12 1
“saving for college” 141 9 0
“pay for college” 150 0 0
Totals 428 21 1

Looking at those, you begin to understand the challenge of looking at tweets as sources of customer insight.

Tweets with no value

By far, the most prevalent case was that the tweets provide no value in understanding what jobs people are trying to get done. At least, no actionable value. Below are examples of these types of tweets:

Many tweets in the “no value” category were of this type. Honest, authentic? You bet. Fuel for developing new innovations in products and services? Not so much. I’ll admit that value may be in the eye of the beholder. Perhaps someone wants to target scholarship-winning kids to buy new cars. But for the financial services firm, looking for insight from customers, these tweets don’t help.

Note that many of the tweets in this category weren’t from real people. They were marketing tweets by institutions. Which makes it hard to just dig in to those tweets. First you need to separate the manufactured marketing tweets from the honest expressions of individuals. Welcome to the jungle.

Tweets pointing to a job-to-be-done

I’ll admit, this categorization sounds funny: “pointing toward” a job. What does that mean? Look at a couple examples:

The tweets are not themselves the jobs-to-be-done. But they reflect jobs, if you read them carefully. In the first tweet, Raeleen wants to contribute to the college fund of her nephew. The larger story is that family, beyond the kid’s parents, can be part of the college savings effort. Here’s a definition of the job-to-be-done:

Situation: When I am planning my child’s college savings…
Job: I want participation from family members and friends.
Success means: Increased savings from a broad cross-section of family and friends.

The job reflected in the second tweet is one of structurally managing the college savings apart from other savings and cash expenditures.

There weren’t a lot of these, and many of them were pretty obvious jobs-to-be-done. But in hunting for the elusive job-to-be-done in the wild, their gamey, tough meat was better than nothing.

Direct expressions of jobs-to-be-done

After going through 450 tweets, I was sure I’d find at least one person tweeting a job-to-be-done. Maybe dazed by collecting and analyzing that many, I settled on the one below:

I see here an emotional job-to-be-done. Namely, the feeling of accomplishment that one feels in preparing financially for college. That’s a feeling that should be built on. I can tell you, when my wife and I put money into our kids’ 529 plans, we get that sense of accomplishment. Something that a financial institution should plug into more strongly.

So that was a nice job-to-be-done. However, as I said, slim pickings in finding jobs-to-be-done in tweets. Which should make you question how much of the presumed insight waiting to be gathered out there is actually…there.

But I did run the tweets through a couple other analyses to see what they turn up.

Sentiment analysis

For all these tweets about saving and paying for college, how was the sentiment? Does the mood tell us something about the jobs-to-be-done? Or at least provide some form of insight?

I ran them through a couple different tools: Sentiment Analyzer and Sentiment140. Sentiment Analyzer analyzed the 450 tweets I had collected. Sentiment140 ran an analysis on the most recent 19-25 tweets it could find related to a search term. While the bases of tweets differed, the two engines came up with remarkably similar results. Sentiment140 is on top, Sentiment Analyzer is on the bottom of the graphic below:

See how the college savings tweets are strongly positive. The general idea of college savings is a positive one, as college is a very strong emotional element for us. We may have attended ourselves, with memories from that period, and we want our kids to go. Then see how the mood swings to a darker one when tweets contain the phrase “pay for college”. It’s as if the more ‘transactional’ the experience becomes, the more negative the mood gets. Another difference is that tweets about “pay for college” overwhelmingly were by teenagers and young adults, expressing frustration related to affording college.

For marketing purposes at least, this sentiment analysis may have value in targeting people in different stages of the college saving spectrum.

Word trends

Another area explored is the commonality of words in the tweets used. Do they reveal latent jobs-to-be-done? I ran the tweets through Wordle:

The Wordles do reveal some interesting patterns. When people tweet about college savings, the most common words are plan, account, day, get. In this case, day is driven by the timing of when I collected the tweets. May 29th was upcoming, and it was U.S. national 529 Day (get it? 5/29). The most frequent word plan certainly makes sense, and in some ways fits the positive sentiment seen earlier. Thinking ahead about what’s needed to pay for college.

Notice the most frequent terms switch to start, money, need, parents in the “saving for college” Wordle. Let’s focus on the transition from plan seen in the college savings Wordle to start in the “saving for college” Wordle. It’s a transition from a more abstract concept to a task that one must undertake. The vibe switches to a get-things-done mentality.

Finally, note what dominates the “pay for college” Wordle: money, gonna, help, stripper. You might look at that and say, “stripper”? First, note that I converted the various stems of strip in the tweets to a single word, stripper, so as to better capture what showed up in a lot of the tweets. Essentially, a number of people (female and male)  joking about becoming strippers to pay for school. I read these tweets as reflecting the steep costs of college, and teenagers/young adults not feeling like they have options to pay for it. A reflection of escalating tuition and cases where college savings were not available.

Usable insight on customer needs?

The title of this post highlights a particular aspect of insight that interests me: customer needs. On that score, I don’t find the tweets to be that valuable. As someone who is outside the financial services industry, I do find them to be gauges of what’s going on out there. An industry insider might already have a handle on what I discovered.

Here’s what makes tweets challenging to use for insight on customer needs:

  • Wide range to subjects: tweets run the gamut, even for a specific search term, and their volume makes it tough to sift through to find areas you want to explore
  • Odds are low that they’re speaking about core things they are looking to get done
  • People tweeting are not part of the market you’re seeking: for example, although there is $150 billion saved in U.S. 529 plans, these parents weren’t tweeting about saving and paying for college
  • Tweets have a one-off quality: follow-up and discussion to get deeper insights doesn’t happen

That’s my take. What do you think? Wouldn’t surprise me if others are seeing more value than I am. If you’re interested, you can check out the tweets I used for analysis on this Google spreadsheet.

I’m @bhc3 on Twitter.

Follow

Get every new post delivered to your Inbox.

Join 540 other followers