Fostering Innovation: Lots of Little Fires or One Inferno?

An area that I find really interesting is role that social media can play in improving innovation. Before the advent of social media applications, innovation needed two primary drivers:

  1. Someone with the passion and time to see it through
  2. The luck that someone’s offline social sphere picked up on an idea and helped spread it

Today, innovation can occur much more easily than before, courtesy of social media. An idea can be disseminated and discussed far beyond (i) the originating person’s social sphere; and (ii) their level of energy to pursue it.

Which brings me back to the ongoing discussion about distributed conversations. Is innovation the product of lots of little conversational fires or one raging talk inferno? The answer is ‘both’, but I think people have undervalued the potential in lots of little fires.

The Myth of the Iconic Genius

Recently, Malcolm Gladwell wrote a great article for The New Yorker, In the Air – Who says big ideas are rare? The piece examines the history of innovation, with Alexander Graham Bell’s role in inventing the telephone as a case study. Turns out Bell wasn’t the only one working on the telephone. Elisha Gray also had a working telephone at the same time. As Gladwell describes it, this is but one example of what science historians call “multiples” – cases of simultaneous invention by completely independent persons. It happened in calculus, evolution, decimal fractions, and many, many other fields.

After discussing the findings of two researchers, Gladwell puts context to the common occurrence of “multiples” in history:

For Ogburn and Thomas, the sheer number of multiples could mean only one thing: scientific discoveries must, in some sense, be inevitable. They must be in the air, products of the intellectual climate of a specific time and place.

In other words, it’s a fallacy to think that innovation only channels through one singular genius. Which brings us back to this idea that distributed conversations are a bad thing.

The Value of Lots of Little Fires

Lets use innovation inside the enterprise as an example. An employee comes up with an idea. Not a perfect idea, perhaps not a fully formed idea. But an idea that’s got some shine to it. I hope that sounds plausible to you if you work inside a corporation. It rings true to me.

Assume the company has a good platform for this employee to propagate it. She blogs the idea on some internal web application. Other people pick up on the idea. Now stop here for second.

If her idea is to gain traction, what makes the most sense? Employees from other departments, divisions, countries all interacting with this person they don’t know? Or employees thinking through the idea with their own social circle?

I argue that employees should be free to discuss the idea how they want and with whom they want. Why? It goes back to the observation of Ogburn and Thomas – invention is often the product of current broader thinking and prior discoveries. Inside a company, this likely means an emerging issue or opportunity that employees are starting to sense.

Little fires become big fires because they burn areas that are dry and ready to ignite. In the same way, letting employees hold their own conversations is a great way to find those patches of dry tinder that are ready for your idea. Some conversations will snuff out due to lack of good kindling. But other conversations will grow as the sparks from the originating fire find lots of wood to burn.

And that’s the importance of distributed conversations. You never know from where the energy and support for your idea is going to come.

Don’t Underestimate the Value and Motivations of People

So little conversational fires are important for building a buzz inside your company. What else do they do?

  • Provide different perspectives from outside your sphere
  • Motivate employees to care about your idea

In our company example, lets say the originator of the idea is in Field Operations. She knows the customers well and has a good sense of what they’re feeling. So she writes up her idea in a blog post.

But her idea would affect a lot of different groups: product, operations, development, finance, marketing, sales, etc. Each of these departments will have a unique understanding of the idea’s requirements. Would you force all of these different perspectives through that one blog? Of course not.

Stepping outside the employee motif for a second, I think it’s important to understand that people have different experiences, interests and talents. And they have their existing peers with whom they talk. When it comes to discussing a newly presented idea, it’s unnatural to force them to abandon these existing connections and prior conversations. If that means the originating author has to chase down the conversation, so be it.

Stepping back into the employee motif, the other value of little fires is the motivational aspect. If you want an idea to take hold, you have to relinquish some control of it. If you don’t don’t, you’re going to run right into a wall of indifference.

This sounds bad to say – aren’t employees only interested in the greater company good? Maybe. But lets not make that the only basis for the success of an idea. Acknowledge that people work hard and have ambitions. The little fires of distributed conversations give them ownership of the idea within their particular social sphere. They can point out the flaws, come up with improvements and relate the idea to previous thinking.

Forcing everyone back through the originating blog post loses this dynamic, and you’ve just killed the personal motivation of some people to participate.

But Isn’t This All Messy?

Yes. It is.

Proper recognition for the idea will be an issue. Going back to Malcolm Gladwell’s article, he lists a number of people who came up with an idea at the same time as more famous inventors and discoverers. But they didn’t become household names (e.g. Elisha Gray).

Also, as different groups work through an idea, fiefdoms might emerge. Different groups laying claim to having the best vision and plan for the idea. Who’s right and who should drive it forward?

But here’s the good news – the idea got traction. Senior managers are well-paid to figure out the other issues (I’ll pause here for your Dilbert snicker…).

Now if the company’s blogging software is any good, the original author of the idea will be recognized. And more than likely, our heroine was involved in several of the distributed conversations that occurred. She is not divorced from the whole innovation process.

Final Thoughts

Distributed conversations are an important component of gaining traction for innovative ideas. They enable a greater percentage of ideas to come to fruition than in traditional company settings where dialogue is limited to your own social sphere.

I’ve used life inside the enterprise to describe why distributed conversations have value. I think a lot of the same motivations apply out on the world wide web as well. If you’re a blogger and you think you’ve got a good idea or insight, recognize that you most likely were not the only person thinking that way. So don’t be too bothered when little conversational fires start elsewhere – your spark landed in some dry tinder.

Grab some marshmallows and join the fun.

*****

See this item on FriendFeed: http://friendfeed.com/search?q=%22Fostering+Innovation%3A+Lots+of+Little+Fires+or+One+Inferno%3F%22&public=1

Filtering FriendFeed – How Crowdsourcing Can Solve This

It would be nice to have filters on FriendFeed. For instance, it would be nice to be able to hide any post containing the word “Obama” without having to hide someone’s other stuff. Or the ability to hide any entry containing the word “ubuntu”, etc.

Thomas Hawk, FriendFeed direct post, May 1, 2008

The need for filters on FriendFeed is a recurring topic. Click here to see the numerous entries that contain the words ‘friendfeed’ and ‘filters’. Louis Gray notes the need for this in a recent post.

I want present an idea for filters that has two pieces:

  • Category filters
  • Keyword filters

The two pieces are interrelated, and crowdsourcing will be used to build out the category filters.

Let’s get to it, shall we?

Category Filters

FriendFeed already has a “Feed Preferences” page for each member. Here is where you can manage your category and keyword filters. The graphic below is mockup of this:

A. Category Filters

Various categories will be displayed, along with a link to the full list of categories. In the example, above, I say that I’d like to filter out all FriendFeed entries that relate to politics.

The value of category filtering is that it prevents you from having to manage every keyword that might relate to a category. In a recent post, I noted Dave Winer’s 38 different politics-related terms. For instance, he used the terms: Hillary, HRC, Clinton, Edwards, Obama, Rove, etc. Having the ability to automatically filter those out without having to set up keyword hides over and over would be a great benefit to many members. Particularly as FriendFeed gains traction with a flood of new members.

Now how would FriendFeed know that Hillary, Obama, HRC, etc. are part of the politics category? Keep reading.

B. Keyword Filters

Members will need the ability to see what words they have hidden. They can un-hide keywords, or add new keywords to hide directly on the Feed Preferences UI.

Keyword-Based Hides

FriendFeed currently supports hiding specific entries, plus entries from specific members and services. For instance, you can hide all Twitter updates. What is lacking is the ability to filter out entries with specific terms in them.

For instance, shown below are three tweets from Dave Winer regarding politics:

What I’d like to do is apply the Hide function to anything with ‘Harold Ickes’ or ‘Henry Waxman’. This is a mock up of that screen below:

A. Full Text of Entry Displays

The full text of the entry appears. Each word of the entry includes a link. The links are easy ways for members to populate the ‘hide terms’ input box.

B. Hide Terms Input Box

Commas separate each term.

C. Categorize the Terms to Be Hidden

As the member hides the terms, they will be asked to apply a category. The most popular categories previously applied to the keywords will be displayed. Or the member can type a category into the input box, and FriendFeed will auto-suggest different categories with each character entered.

Why do this? This is the basis of the crowdsourced solution.

Let the People Decide

People will have a much better handle on the categories that apply to a keyword than will a heavy-duty algorithm. Such human filtering is the basis of tagging.

Two elements are relevant here:

  • The need to prevent bad categories being assigned to keywords
  • The motivation to do this categorizing

Use Bayesian Stats to Prevent Bad Categories

Here’s the issue you want to avoid. Some prankster assigns the football category to the term “Paris Hilton” while hiding all entries containing her name. Suddenly, members who are filtering out football entries stop seeing their Paris Hilton updates (yes I know, horrors…).

Enter Bayesian statistics. Carl Bialik, a columnist for the Wall Street Journal, has a great column on the use of Bayesian stats for online ratings. The gist of this approach is that all items in a rating system are born with identical ratings. Their ratings only change as people vote, and it takes a sufficient number of votes to really move the rating of an item. Here’s an example of this from the WSJ column:

For instance, as noted in the column, IMDB.com doesn’t use straight averages to list the top 250 movies of all time, as voted on by its users. Instead, each movie starts out with 1,300 votes and a ranking of 6.7, which is the site’s average. That helps smooth the effects of a few intense votes; it takes a lot of votes to budge the IMDB meter up or down from 6.7

That same approach would be applied inside FriendFeed. It would take a large number of people putting a keyword into the same category before the keyword actually became “part” of that category.

Once a keyword graduates to a category, any users filtering that category won’t see entries with those keywords.

Motivation

Why would anyone bother to categorize the keywords they hide? One answer – not everyone will. But there are two drivers of members doing some keyword categorization.

First, members need to recognize that they are contributing to a system from which they are likely benefiting. If you filter any category, you will be benefiting from the work of others’ who have categorized keywords.

Second, the categorization experience has to be simple and fast. You’ve got the member right there, motivated to hide a term. Make it easy for them to channel that motivation into a simple categorization. The most popular previous categories are displayed, making it easy check them. And the auto-suggest feature can be done fairly quickly. I like how Faviki is doing it:

Faviki draws from thousands of different Wikipedia entries for this list.

Final Thoughts

One thing to consider here is that every entry coming into FriendFeed would need to be filtered for keywords. Serious processing power will be required. Fortunately, the FriendFeed guys have firsthand experience with high volumes of real-time queries for keywords at Google.

With regard to this proposal, I haven’t (yet) seen anything on the market that will provide the category tags that would help filter FriendFeed. Since it’s the members who are most in tune with what they want to filter, their common sense and motivation should be leveraged.

As FriendFeed grows, imagine new members easily managing the flow of information by simply filtering the politics category rather than having to set up an extensive list of new keywords. It would make the experience that much better for everyone.

*****

See this item on FriendFeed: http://friendfeed.com/search?q=%22Filtering+FriendFeed+-+How+Crowdsourcing+Can+Solve+This%22&public=1