Tag Recommendations for Content: Ready to Filter Noise?

In a recent post, I suggested that the semantic web might hold a solution for managing noise in social media. The semantic web can auto-generate tags for content, and these tags can be used to filter out subjects you don’t want to see.

As a follow-up, I wanted to see how four different services perform in terms of recommending tags for different content.

I’ve looked at the four services, each of which provide tag recommendations. Here they are, along with some information about how they approach their tag recommendations:

  • del.icio.us: Popular tags are what other people have tagged this page as, and recommended tags are a combination of tags you have already used and tags that other people have used.
  • Twine: Applies natural language processing and semantic indexing to just that data (via TechCrunch)
  • Diigo: We’ll automatically analyze the page content and recommend suitable tags for you
  • Faviki: Allows you to tag webpages you want to remember with Wikipedia terms.

Twine and Diigo take the initiaitve, and apply tags based on analyzing the content. del.icio.us and Faviki follow a crowdsourced approach, leveraging the previous tag work of members to provide recommendations.

Note that Faviki just opened its public beta. So it suffers from a lack of activity around content thus far. That will be noticed in the following analysis.

I ran the six articles through the four tagging services:

  1. The Guessing Game Has Begun on the Next iPhone – New York Times
  2. TiVo: The Gossip Girl of DVRs – Robert Seidman’s ‘TV by the Numbers’ blog
  3. Twitter! – TechCrunch
  4. Injury ‘bombshell’ hits Radcliffe – BBC Sport
  5. Why FriendFeed Is Disruptive: There’s Only 24 Hours in a Day – this blog
  6. Antioxidant Users Don’t Live Longer, Analysis Of Studies Concludes – Science Daily

The tag recommendations are below. Headline on the results? Recommendations appear to be a work in progress.

First, the New York Times iPhone article. Twine wins. Handily. At Diigo gave it a shot, but the nytimes tags really miss the mark. del.icio.us and Faviki weren’t even in the game.

Next, Robert Seidman’s post about Tivo. Twine comes up with several good tags. Diigo has something relevant. And again, del.icio.us and Faviki weren’t even in the game.

Now we get to the trick article, Michael Arrington’s no text blog entry Twitter! The table turn here. Twine comes up empty for the post. Based on the post’s presence on Techmeme and the 400+ comments on the blog post, a lot of people apparently bookmarked this post. This gives del.icio.us and Faviki something to work with, as seen below. And Diigo offers the single tag of…twitter!

Switching gears, this is a running-related article covering one of the top athletes in the world, Paula Radcliffe. Twine comes up the best here. Diigo manages “bombshell”…nice. del.icio.us and Faviki come up empty, presumably because no users bookmarked this article. And none of them could come up with tags of “running” or “marathon”.

I figured I’d run one of my own blog posts through this test. The post has been saved to del.icio.us a few times, so I figured there’d be something to work with there. Strangely, Twine comes up empty. Faviki…nuthin’.


Finally, I threw some science at the services. This article says that antioxidants don’t actually deliver what is promised. Twine comes up with a lot of tags, but misses the word “antioxidants”. Diigo only gets antioxidant. And someone must have bookmarked the article on del.icio.us, because it has a tag. Faviki…nada.

Conclusions

Twine clearly has the most advanced tag recommendation engine. It generates a bevy of tags. One thing I noticed between Twine and Diigo:

  • Twine most often draws tags from the content
  • Diigo more often draws tags from the title

Obviously my sample size isn’t statistically relevant, but I see that pattern in the above results.

The other thing to note is that these services do a really great job with auto-generating tags. For instance, the antioxidant article has 685 words. Both Twine and Diigo were able to come up with only what’s relevant out of all those words.

With del.icio.us and Faviki, if someone else hasn’t previously tagged the content, they don’t generate tags. Crowdsourced tagging – free form on del.icio.us, structured per Wikipedia on Faviki – still has a lot of value though. Nothing like human eyes assessing what an article is about. Faviki will get better with time and activity.

Note that both Twine and Diigo allow manually entered tags as well, getting the best of both auto-generated and human-generated.

When it comes to using tags as a way to filter noise in social media, both system- and human-generated tags will be needed.

  • System-generated tags ensures some level of tagging for most new content. This is important in an app like FriendFeed, where new content is constantly streaming in.
  • Human-generated tags pick up where the system leaves off. In the Paula Radcliffe example above, I’d expect people to use common sense tags like “running” and “marathon”.

The results of this simple test show the promise of tagging, and where the work lies ahead to create a robust semantic tagging system that could be used for noise control.

*****

See this item on FriendFeed: http://friendfeed.com/search?q=%22Tag+Recommendations+for+Content%3A+Ready+to+Filter+Noise%3F%22&public=1

Why FriendFeed is Disruptive: There’s Only 24 Hours in a Day

Forget fractured conversations. How about fractured attention?

MG Siegler has a post up at ParisLemon titled FriendFeed Should Kill Those Who Accuse It of Murder. In the post, he writes that the current meme about FriendFeed killing Twitter and Google Reader is overblown and that all the services will exist in relative harmony for the foreseeable future.

To which I ask: did someone just extend the day to 25 hours?

Because there really is a zero sum game aspect to social media. We only have 24 hours in a day, and we have to decide where to spend those hours.

That daily time limit is what makes FriendFeed so disruptive.

Allocation of the 24 Hour Day

The chart below is a hypothetical day of a relatively advanced social media user (no laughs about Facebook please):

The chart shows our social media user at three different points. I’ve taken the liberty of assuming that certain core life stuff is maintained consistently: sleep, eat, work, family. All else is flex time.

So with the core life stuff constant at 19.5 hours, and more time spent on FriendFeed, something’s got to give? But what?

Not websites and blogs. In fact, their page views go up because of FriendFeed. Their content is the currency of FriendFeed conversations.

I think the two services that get hit the hardest as FriendFeed grows will be:

  • Twitter
  • Crowdsourced aggregators: Digg, Stumbleupon, LinkRiver, Reddit

Twitter

I left this comment on Corvida’s post The #1 Reason FriendFeed Will Not “Dethrone” Twitter at SheGeeks.net:

My two cents. FriendFeed direct posts feel like Twitters, only you can see the whole conversation, not just part of it. FriendFeed lacks the @reply and DM, so if those are important use cases, yeah it’s not replacing Twitter. But for putting something out there and having your subscribers weigh in…well, it feels like Twitter.

I’m not the only one. Two heavyweights in the blogging world have expressed their feelings about using FriendFeed in lieu of Twitter:

  • Steve Rubel :”Who’s spending less time on Twitter and more time here? I am.”
  • Duncan Riley: “@geechee_girl true, and if I can switch to FF with everyone on Twitter, I’d start considering swapping most if not all of the time”

The key to Twitter’s success is not it’s haiku format, it’s the community, as Duncan Riley mentions. Twitter is growing fantastically, as more people adopt it (and unfortunately stress its current platform). That community is what makes it vibrant special. FriendFeed appears to be rapidly growing its own community. I’ll be curious what the Compete.com May numbers look like for FriendFeed.

Note in the allocation of the day, I don’t eliminate Twitter. People have built up their networks there, and tweeting has become a habit. Also, the @reply function is quite popular, as is the DM. One might ask if those functions aren’t essentially covered by instant messaging and email, but Twitter fans love ’em.

But I see the direct post + comments as taking interaction away from Twitter.

Crowdsourced Aggregators

The basic function of these applications is to surface the content receiving the most votes. Digg, StumbleUpon, Reddit and LinkRiver are great for discovering content that others have found valuable. Digg includes robust, active commenting.

Well, doesn’t that sound like FriendFeed? The system of ‘Likes’ and comments ensures that community-ranked content appears at the top of your FriendFeed page.

Again, FriendFeed doesn’t kill these services. StumbleUpon, for example, has a persistence to it that FriendFeed lacks. Content gets its moment in the sun on FriendFeed, then gets buried in pages further back. I’ve noticed the StumbleUpon activity around content can last for days, weeks.

But over time, as users discover ranked content on FriendFeed, I’d expect them to cut back their time on the other crowdsourced aggregators. Not stop using these other services, but check in on them less frequently.

Final Thoughts

Perhaps as MG Siegler said, there really is room for all of these social media apps. Folks will just expand the amount of time they devote to them. But I question that assumption. Your employer still pays you for your hours. Your kids still want your time. The human body needs its sleep. And you still need to eat.

FriendFeed is disruptive because it challenges a number of other applications. If you find something that offers an outstanding experience and provides a good percentage of what you like in other social media apps, wouldn’t you spend more time there?

I mean, there’s only but so many hours in a day.

*****

See this item on FriendFeed: http://friendfeed.com/search?q=who%3Aeveryone++%22Why+FriendFeed+is+Disruptive%3A+There%E2%80%99s+Only+24+Hours+in+a+Day%22

Weekly Recap 052308: If You Love Your Blog, Set It Free

The week that was…

*****

Things kicked off with a pair of posts about the next stage of blogging. Yes, fractured comments and all…Duncan Riley wrote Blogging 2.0: It’s All About The User. He writes: If blogging 1.0 was about enabling the conversation on each blog, blogging 2.0 is about enabling the conversation across many blogs and supporting sites and services…Louis Gray followed up with Blogging 2.0 Causing Friction With 1.0 Bloggers…Louis nicely defines the old blogging paradigm: Blogging 1.0 centered around who could: (i)Amass the most page views; (ii) Display the most ads; (iii) Get the most comments; and (iv) Attract the most RSS subscribers

As a relatively novice blogger, I pretty easily fall into the Blogging 2.0 camp…why on earth would I want to keep the conversations limited to my little blog?…that’d be a recipe for having a stale blog…

But Blogging 1.0 is still a strong instinct out there…one example: see Allen Stern’s post on CenterNetworks, Let’s Get Serious About FriendFeed; the 1995 Message Board, the Smart Consolidator and the Stolen Conversation…read not just the post, but check out some of the comments…Blogging 1.0 will die hard…

*****

Help! I’ve fallen, and I can’t get up!…bad week for Twitter, everyone’s favorite social chat room: outages, outages, outages…this seems to be getting progressively worse, as Twitter’s success is killing it…

To show disapproval for Twitter’s handling of these outages, several folks staged a Twit-Out on Wednesday May 21…a number of regular Twitterers went the whole day without going over to Twitter…they also hid tweets from their FriendFeed streams…even the biggest Twitterer of all, Robert Scoble, joined in…

It wasn’t met with universal love, but they made their point…oh, and Twitter did go down that day…

But one bright spot: Twitter apparently scored a new $15 million round of VC funding…

*****

One outcome of the twitter issues this week…some bigger names in the social media world started to embrace it much more…Jeremiah Owyang, who previously marked the date when new Twitter subscribers could not be considered as early adopters, got into it again with FriendFeed…first he posted on FriendFeed that he now had a new place (FriendFeed) to look for conversations, which elicited a bunch of hearty “welcome aboard” type of messages…

Well that got Jeremiah fired up, and went into throw-down mode: Dudes, I’ve been on FriendFeed for a while, not a late adopter…he challenged Robert Scoble to list his date of FriendFeed registration…geek cred…

Of course, if you looked at his activity stats at that time, he had no comments, no likes…but he’s much more engaged now, which is cool…he even wrote a post about FriendFeed…

*****

One thing I’ve noticed in some favorited Flickr photos…models wearing little to nothing…not that I’m complaining, I love art…Thomas Hawk has some strong opinions about making this even easier here

*****

FriendFeed now has Rooms!…Rooms are separate spaces on FriendFeed where people can direct post items, and re-share items into a Room…they accomplish two things: (i) allow a focus around specific topics to follow; (ii) remove some of the items that were considered noise by many users…

Bwana McCall (second reference in this post, nice!) has a good initial set of use cases for rooms here…my favorite is the use of Rooms for live blogging like from one of those Apple events…

One bit of hilarity was the land grab that occurred for Room topics…Michael Nielsen asked Any plans to prevent squatting? I can see people snapping up thousands of “rooms” on the off chance that one day they’ll be worth something…um, well, uh…I managed to score Web 2.0, Enterprise 2.0, Running, Obama 2008 and Coca Cola among others…no idea what I’ll do with them, but anyone’s free to join…I wonder if the Obama campaign will want their Room?

Something that Rooms will foster: an increase in FriendFeed direct posts…regular feeds from your social media sites won’t stream automatically into Rooms…

*****

See this item on FriendFeed: http://friendfeed.com/search?q=%22weekly+recap+052308%22&public=1

Analyzing My FriendFeed Stats: I Should Be Direct Posting More

I’m curious about the level of interaction that occurs around the different content that streams through FriendFeed. Distributed conversations are fine by me, and I wonder what sparks them most often for content. So I did a little analysis of the ‘likes’ and comments that have happened for me.

Below are some pie charts. The first set analyze the ‘likes’. To the left is the percentage of my FriendFeed stream that comes from different content sources. To the right, I counted the number of ‘likes’ for the various content sources. For the ‘likes’ I only counted for the month of May, but I think it’s a decent approximation of my overall activity.

A couple observations:

  • Blog posts and FriendFeed Direct Posts are the biggest sources of ‘likes’
  • Google Reader shares and Twitter are a big part of my stream, but don’t generate a comparable percent of ‘likes’

Now let’s see how the comments look:

Would you look at that? FriendFeed direct posts dominate the comments. My blog posts are #2.

What’s It Mean?

I imagine everyone’s experience will vary. For me, I draw four conclusions.

My FriendFeed use is similar to people who Twitter: With FriendFeed direct posts, I’ll sometimes just make an observation. Other times, I direct post a website, generally with a graphic. This strikes me as similar to Twitter in that I’m posting something that can be consumed by anyone who subscribes to me. Also, these posts mean someone can stay within FriendFeed. Seems to make a difference in interaction when people can stay on the site. Like Twitter.

‘Likes’ dominate my blog posts: The Likes:Comments ratio for my blog posts is running at 4:1. For all the concern about fractured comments, I’d say people are overlooking basic recommendations of your content via ‘likes’. It’s not about the comments, it’s about the ‘likes’!

Comments on my posts frequently occur on someone else’s stream: There are several of my blog posts that have generated good comments. They just haven’t occurred on the RSS feed from my blog. These bigger comment fests have been when someone with much larger following and FriendFeed ‘presence’ (and I’m not going to write his name, because I use it too often…). But you know what? I’ll take those comments! They obviously weren’t happening just off my own post. In the long run that kind of exposure is vital for us smaller bloggers.

Google Reader shares suffer from repetition: Good blog posts will often be shared by several FriendFeed members, including those with larger followings. So when I share, I may be following others. So the repetition diminishes the interaction. I still share – there is some interaction. And Google Reader shares end up in several other places, like RSSmeme and ReadBurner. These services will show the most popular shares, so I want to vote for these blog posts.

Final Thoughts

Colin Walker has some interesting thoughts about using FriendFeed as a blogging platform. Looking at how FriendFeed Direct Posts and my blog generate the biggest activity, maybe he’s on to something.

*****

See this item on FriendFeed: http://friendfeed.com/search?q=%22analyzing+my+friendfeed+stats%22&public=1

FriendFeed Noise Control, Semantic Web and Dave Winer

On a FriendFeed discussion about the noise on the Web in general, Lindsay Donaghe posted this comment:

Actually I think it’s the same problem we have in general with the firehose of information we’re exposed (or expose ourselves) to on a daily basis. The struggle of where to apply our attention will only be resolved once someone develops intelligent agents to filter the bad stuff and alert us to the good stuff. Wish someone would hurry up and make those. That will be the ultimate killer app.

Louis Gray wrote this recently in his post Content Filters Proving Evasive for RSS, Social Media Sites:

So far, despite many users calling for content-based filters, solutions to block keywords or topics are missing from the vast majority of information spigots.

The recent meme about FriendFeed noise points to the frustration of some people with an inability to manage what content hits their screens. The two comments above underscore this feeling.

Here’s me own example. Dave Winer has two passions: technology and politics. For me personally, technology = signal. Politics = noise. I went through his FriendFeed stream for the month of May, and here are the 38 different political terms that show up:

So what to do? I’d like to suggest that the semantic web might be a solution for down the road.

What Is the Semantic Web?

Semantic web is still a confusing term. Two quotes from Wikipedia help describe it. This quote tells you generally what it’s about and importantly notes that there’s much development for the future:

The Semantic Web is an evolving extension of the World Wide Web in which the semantics of information and services on the web is defined, making it possible for the web to understand and satisfy the requests of people and machines to use the web content. At its core, the semantic web comprises a set of design principles, collaborative working groups, and a variety of enabling technologies. Some elements of the semantic web are expressed as prospective future possibilities that are yet to be implemented or realized.

This quote describes the problem that the semantic web will solve:

With HTML and a tool to render it (perhaps Web browser software, perhaps another user agent), one can create and present a page that lists items for sale. The HTML of this catalog page can make simple, document-level assertions such as “this document’s title is ‘Widget Superstore'”. But there is no capability within the HTML itself to assert unambiguously that, for example, item number X586172 is an Acme Gizmo with a retail price of €199, or that it is a consumer product.

It’s that last sentence there that addresses the noise issue. How does a server know that part X586172 can be categorized as a “consumer product”? That’s where the semantic web comes into play.

And how the noise can be controlled on FriendFeed.

Noise Control: Simplify Users’ Lives

One way to think of the semantic web is as tagging on steroids. In the example above, part X586172 is tagged as “consumer product”. And the tagging occurs without human intervention.

This is what’s needed on FriendFeed. The ability to take a wide range of terms that humans can understand are related. The relationship among the terms is tag.

Here’s what such an algorithm would do for Dave Winer’s political terms:

Now, imagine this in FriendFeed. Semantically-derived tags are appended to every item that flows through. Meanwhile, users have a new ‘Hide’ feature. Hide by topic. They could elect to hide streams with terms on a one-by-one basis. For instance, I’ll hide “robert reich”. I’ll hide “republicans”. I’ll hide “congress”. I’ll hide “obama”. I’ll hide “mitt romney”. I’ll hide…well, you get the picture.

In addition, users could just hide all items with the tag “politics”, and be done with it. Simple.

This could apply for all manner of topics: football, banking, Iraq, etc.

Just How Would These Semantic Tags Be Generated?

I’m not sure anything quite with this purpose exists yet. Reuters has been a leading player in the semantic web with its Open Calais initiative. However, Open Calais focuses of its tagging on people, places, and companies. So if Open Calais was applied to Dave Winder’s FriendFeed stream would have a lot of tags related to those topics. But not metadata tags.

A company called GroupSwim described their semantic tagging approach:

We use natural language processing to analyze the data our customers put into their sites. Our datasets tend to be much smaller but are high quality since someone doesn’t add something to GroupSwim unless they want to share it. Then, we compare the language used in the content to other semantic sources including WordNet, Wikipedia, etc. to do our automatic tagging and analysis.

Interesting, not sure what the tags they produce are. But it does give insight into a requirement: a core foundation of data against which all other data can be compared to derive tags. Something that would correctly map Obama and Clinton to a politics tag.

I’m sure there are other interesting approaches. It’d be great if someone was working on something in this area.

If anyone reading this knows of any semantic approaches that can apply metadata type of tags, feel free to leave a comment.

*****

See this item on FriendFeed: http://friendfeed.com/search?q=who%3Aeveryone+%22friendfeed+noise+control+semantic+web+dave+winer%22

Yes, FriendFeed Will Be Mainstream (by 2018) and Here’s Why

We recently went through a Twitter meme about whether it was mainstream yet. There is no debate as to whether FriendFeed is mainstream today – it’s not. The question really is, will FriendFeed ever see mainstream adoption? Robert Scoble played both sides of the coin (here, here).

FriendFeed will go mainstream. My definition of mainstream: 33% of Internet users are on it. It’s just going to take time, and it’ll look different from the way it does now.

Four points to cover in this mainstreaming question:

  1. What will FriendFeed replace?
  2. What is a reasonable timeline?
  3. What content will drive the activity on FriendFeed?
  4. What topics will drive engagement?

What Will FriendFeed Replace?

Harvard professor John Gourville has a great framework for analyzing whether a new technology will succeed. His “9x problem” says a new technology has to be nine times better than what it replaces. This is because of two reasons:

  • We overvalue what we already have by three times
  • We undervalue the benefits of a new technology by three times

What does this mean in everyday terms? There’s comfort in the status quo, and fear of the unknown.

There’s the argument that FriendFeed is a complement, not a replacement to existing services. There’s some truth there, but the bottom line is that we only have 24 hours in day. Where will end up spending our time?

Here’s what FriendFeed will replace:

  • Time spent on the individual social media that stream into FriendFeed (blogs, Flickr, etc.)
  • Visits to static, top-down media properties (e.g. CNN, ESPN, Drudge Report, etc.)
  • Visits to other user-driven aggregator sites (Digg, StumbleUpon, Yahoo! Buzz)
  • Usage of Google search (search human-filtered content on FriendFeed)

In terms of the “9x problem”, the nice thing is that people do not have to replace what they already do. Visit CNN? You can keep doing that. Like to see what’s on Digg? You can keep doing that.

Searching on FriendFeed will advance. You can do a search on a keyword or a semantically-derived tag, and specify the number of shares, likes or comments.

FriendFeed doesn’t require you to leave your favorite service. It’s the FriendFeed experience that will slowly steal more of your time. That mitigates the issue of people overvaluing what they already have. They won’t lose it, they’ll just spend less time on it. Thomas Hawk continues to be an active participant on Flickr, but more of his time is migrating to FriendFeed. As he says:

One of the best things about FriendFeed is that it gives you much of what you get from your favorite sites on the internet but in better ways.

I think FriendFeed will have the 9x problem beat, but it will take time.

What Is a Reasonable Timeline for FriendFeed to Go Mainstream?

The chart below, courtesy of Visualizing Economics, shows how long several popular technologies took to be adopted in the U.S.

Using my mainstream definition of 33% household penetration, here’s roughly when several technologies went mainstream:

  • Color TV = 11 years
  • Computer = 15 years
  • Internet = 8 years

In addition, here are some rough estimates of current levels of adoption for other technologies. Estimates are based on the number of U.S. Internet users, the recent Universal McCann survey of social media usage (warning, PDF opens with this link) and search engine rankings.

  • Google search = 68% of searches after 10 years
  • RSS = 19% of active Internet users after 4.5 years of RSS readers
  • Facebook = 9% of Internet users after 4.5 years (20mm U.S. members / 211mm U.S. Internet users)
  • Twitter = 0.6% of Internet users after 2.2 years (1.3mm members / 211mm U.S. Internet users)

Yes, the date of FriendFeed mainstream adoption is pure speculation. But looking at the adoption rates of several other technologies, ten years from now is within reason (i.e. 2018). The RSS adoption is a decent benchmark.

What Content Will Drive FriendFeed Activity?

Alexander van Elsas had a recent post where he listed the percentage for different content sources inside FriendFeed. The results were compiled by Benjamin Golub.

Not surprisingly, Twitter dominates the content sources. Original blog posts are a distant #2 content source, and Google Reader shares are #3. That speaks volumes into the world of early technology adopters.

When FriendFeed becomes mainstream, the sources of content will change pretty dramatically as shown in this table:

The biggest change is in the FriendFeed Direct Post. Relative to blogging or Twittering, putting someone else’s content into the FriendFeed stream is the easiest thing for people to do. FriendFeed Direct Posts are similar to Diggs or Stumbles. Since all the content we create, submit, like or comment is part of our personal TV broadcast on FriendFeed, Direct Posts can be just as much fun for users as newly created content by someone you know.

Direct Posts will draw from both traditional media sites as well as from other people’s blogs. Expect media sites and blogs to have a “Post to FriendFeed” link on every article.

Twitter drops as a percentage of content here. Why? FriendFeed’s commenting system replaces a lot of what people like about Twitter. Blogs drop a bit as well. More people will blog in 2018, but many of those will be sporadic bloggers. Still, 10% of the content consisting of original author submissions is pretty good.

Google Reader shares hold as a percentage as more people recognize the value of RSS versus regular-old bookmarks inside their browsers. ‘Other’ goes up, because who knows what cool other stuff will be introduced over the next ten years.

What Topics Will Drive Engagement?

Human nature won’t change. The same stuff that animates people today will continue to do so in the future. Politics, sex, technology and sports will be leaders in terms of what the content will be. There will be plenty of other topics as well. I can see the Iowa Chicks Knitting Club sharing and commenting on new patterns via FriendFeed.

One issue that will arise is that people will have multiple interests. They’ll essentially have various types of programming on their FriendFeed “TV channels”. For a good example of that today, see Dave Winer’s FriendFeed stream. Dave has two passions: technology and politics. I like the technology stuff, but I tend to ignore the political streams.

Well, this will become a bigger issue as FriendFeed expands. I personally like the noise of the people I follow, but my subscriptions seem to generally stick with recurring topics. But as more mainstream users come on board, the divergence of topics for any single person will likely increase.

FriendFeed will employ semantic web technologies to identify the topic of submitted items. These semantically-derived tags will be used to categorize content. Users can then subscribe only to content matching specific categories. How might this work?

A Dave Winer post with “Obama” in it is categorized as Politics. I could choose to hide all Dave Winer updates that are categorized in Politics.

Final Thoughts

The constant flow of new content, the rich comments and easy ‘Likes’, and the social aspect of FriendFeed will drive its mainstream adoption. It’s a terrific platform for self-expression and for engaging others who share your interests. It’s also got real potential to be a dominant platform for research. In the future, look for stories in magazines and newspapers asking, “Are we losing productivity because of FriendFeed?”

So what do you think? Will FriendFeed ever be mainstream? In ten years?

*****

See this item on FriendFeed : http://friendfeed.com/search?q=who%3Aeveryone+%22yes.+friendfeed+will+be+mainstream+%28by+2018%29%22

Hey Yahoo! Forget MSFT, GOOG. Change the Search Rules.

These I wish I knew the moment I was turned off on Yahoo and what the root cause may be, but I no longer use anything Yahoo (except my Flickr account if you want to count that).

Vince DeGeorge, on FriendFeed

I was doing the same thing until I started using delicious as a search tool. Finally realized how powerful it was, and have been using it since.

Shaun McLane, on FriendFeed

I have previously written that Delicious search is one of the best ways of searching for things when a standard search doesn’t pull up what you are looking for. After Google, it is my favorite “search engine.”

Michael Arrington, TechCrunch, Delicious Integrated Into Yahoo Search Results

The latest news is that Microsoft is reaching out to Yahoo again. In fact, a couple reports (here, here) say that Microsoft wants to buy Yahoo’s search business.

Before any such transaction occurs, it seems worthwhile to think about what Yahoo could do with its existing assets. The three comments above are insightful. Yahoo is slowly losing share of mind, although it’s existing base of users will be around for a while. At the same time, there are nuggets in the Yahoo empire.

Search via del.icio.us ranks as one of those nuggets. Another nugget? Yahoo! Buzz. According to ReadWriteWeb, Yahoo! Buzz has surpassed Digg in terms of traffic, and its demographics better reflect web users.

Yet, Yahoo struggles against Google in the highly lucrative search market. Google increased to 67.9% of searches in April 2008, compared to Yahoo’s decline to 20.3% of searches.

What should Yahoo do? Stop playing Google’s game. Rewrite the search rules by embracing the social web fully, leveraging the social media assets it has.

And in doing so, demonstrate an aggressive path to make Yahoo a social media titan.

A Proposal for “Socializing” Yahoo Search

In January 2008, TechCrunch ran a post with a preview of del.icio.us integrated with regular Yahoo search results. Included in the search result links would be stats that tell a user:

  • Number of del.icio.us users who bookmarked the page
  • The top tags they used on the page

Both of those stats appear to be clickable. By clicking on the number of users stat, I assume a user would be taken to the del.icio.us page showing the users who bookmarked the page. If one clicked a tag, you’d land on the del.icio.us page for all web pages with that tag.

That’s a good start. But Yahoo can do better. Below is a diagram that shows how Yahoo can use its existing assets, combined with a good dose of the new social media experience, to radically change search:

Here’s a breakdown of what’s going on with the proposal.

Search Rankings

From what I’ve read, Yahoo has pretty much caught up to Google in terms of search performance. That means the use of links and clicks to rank websites is pretty common across the two search engines. However, Google does have the advantage of three times the traffic, which makes its insight into what’s relevant better than Yahoo.

But Yahoo has its own in-house advantages: del.icio.us and Yahoo! Buzz. Both address shortcomings in the links and clicks rankings for search engines:

  • Links require a media site or blogger to take the time to link. These links are insightful, but lack the broader reach of what Web users find relevant.
  • Clicks occur before a searcher knows whether the landing site is valuable. They don’t describe its usefulness after someone has clicked onto the site.

With del.icio.us and Yahoo! Buzz, Yahoo can tap into users sentiments about websites in a way that Google cannot. These insights can be used to influence the ranking of search results.

Search Results – Your Friends or Everyone

Here’s where it can really interesting. Notice I keep the general search results outside the influence of what your friends think. I think that’s important. A person should see results outside their own social circle. Otherwise, it will be hard to find new content.

But there is real power in seeing what your friends find valuable (e.g. see FriendFeed). So Yahoo should let you easily subscribe to other people for content discovery. Yahoo already has a head start on letting you set up your subscriptions:

  • Yahoo Mail
  • Yahoo Instant Messenger

In addition to that, you should be able to easily subscribe to anyone who publicly shares content they find interesting. Both del.icio.us and Yahoo! Buzz have public-facing lists for every user of what they bookmark or ‘buzz’. After viewing those lists, I should be able to easily subscribe to these users.

Once your network is developed, it becomes a powerful basis for improving information discovery.

Search Results – Associated Tags

Whenever tags are available from del.icio.us, they should be visible for each web site shown in the search results. This is what TechCrunch previewed. What do tags tell a user?

  • A way to discover other sites that might be relevant
  • Context for the web site
  • That someone thought enough of the web page to actually tag it

Tags should come in two flavors: everyone and your network. Clicking on a tag should display the top 10 associated sites right on the search results page. For more sites associated to the tag, the user is taken to del.icio.us.

Keeping the top sites on the search results page is important to make people use the functionality. Leaving the search results page just to see the sites associated to a tag will cause adoption to drop signficantly.

Search Results – Associated People

Each web page in the search results will show the number of people who have (i) bookmarked the site; or (ii) Yahoo! Buzzed the site. These numbers give a direct indication of how many people, not websites, found the web page valuable.

Clicking these numbers displays a list of the people, along with their most recent activity. This gives users a sense of whether they want to subscribe to a given user or not.

Search Agent

Once users perform a search, they will be able to subscribe to new content matching their search results. These subscriptions can be based on different criteria:

  • Any new content matching the search term (Google does this via Google Alerts) or a tag
  • Any new content matching the search term/tag and bookmarked by someone to whom the user subscribes
  • Any new content matching the search term/tag and Yahoo! Buzzed by someone to whom the user subscribes
  • Any new bookmarks or Yahoo! Buzzes by someone to whom the user subscribes

New content notifications occur via email or RSS. RSS can be anywhere, including on the user’s My Yahoo page. Again, FriendFeed has shown the power of these content streams.

Final Thoughts

My little post here isn’t the only idea someone could float. But it does at least address taking Yahoo much more deeply into the social media world, where users drive the value.

Yahoo revealed details of a proposed del.icio.us integration back in mid-January. And then nothing. Yahoo previewed Yahoo Mash, a new social network in September 2007. And then…nothing. The last post on the Yahoo Mash blog was January 11, 2008.

Yahoo has so many amazing assets. Search, email, portal home page. Several beloved social media apps (Flickr, del.icio.us, Upcoming). Yet they have not put them together into a cohesive strategy and experience.

And now, talk of selling the search business? C’mon Yahoo. You’ve got too much going on to give up yet. Stop playing by others’ rules. Make your own rules with the amazing assets you have.

*****

See this item on FriendFeed: http://friendfeed.com/e/1b07226a-b51b-f386-fbb8-bdaece83e9fe

The Noise About FriendFeed Noise

I’m actually enjoying the “noise” of FriendFeed. Anyone else?

Corvida, one of my favorite bloggers, has a post up on ReadWriteWeb titled Don’t Be So Naive: Friendfeed Adds to the Noise. In the post, she argues that FriendFeed is contributing to the noise with a lot of stream that hold no interest to her. Her examples include Flickr and Seesmic streams, as well as Twitters without a comment.

Now there is some truth to the noise issue, but I don’t think it rises to a “we’ve GOT to correct this ASAP” level.

In fact, I find the whole thing somewhat confusing. I love seeing the variety of topics and services that cross my FriendFeed page. Heck, I even added the Greasemonkey script to expand the list of items per page to 100 from the current 30. I hated missing stuff by relying only on the 30 items that appear on the first page.

So what am I doing differently from Corvida? Not sure really. Here’s what I know.

Number subscribers. I checked her subscriptions, and I’m subscribed to 55 more people than she is. So seemingly my risk of noise is higher. But it doesn’t bother me.

Blogger bias. I choose my subscriptions carefully. When I’m deciding whether to subscribe to someone, I tend to prefer someone who blogs. That requirement right there is a good one for managing noise. Bloggers seem to have a good level of signal in their FriendFeed streams. If someone only Twitters or shares items on Google Reader, I tend to hold off on subscribing. These rules aren’t ironclad, but they guide me.

Hiding. As I said, I’m not hiding much. I subscribe to one person, whose friends tend to blog in Chinese. I can’t read those, so I’ve been hiding these friends-of-friend on a one-by-one basis. I may need to hide all of his friends. I’m also close to hiding Jason Calacanis tweets as well. His tweets have a low signal-to-noise ratio for me. But it’s only a fraction of what I’m seeing.

See Louis Gray’s post about the various Hide features FriendFeed has – they’ll help clean up any noise issues you have.

Let’s Keep It Simple

Over-engineering a solution to noise is exactly the wrong thing to do. Beware the unintended consequences. The FriendFeed guys have put a lot of power in users’ hands to manage what is seen.

I have suggested a couple possibilities for cleaning up the duplicate links that can show up in FriendFeed. My guess is the FriendFeed guys are working on something related to that. That would be a help.

But really, let the streams flow. Your noise is my signal. I’m enjoying the content and conversations a lot. I even like the multiple times the same link shows up, because I’m piecing together an implicit social network based on that.

Bring the noise!

*****

See this item on FriendFeed: http://friendfeed.com/search?q=%22the+noise+about+friendfeed+noise%22&public=1

Weekly Recap 051608: Duncan Riley ‘Likes’ FriendFeed

The week that was…

The awards for some of my blogger comrades just keep coming…Eric Berlin, of the Online Media Cultist, was named by The Industry Standard to its Top 25 B-to-Z List Blogs…the list covers blogs that have not yet achieved A-List status, but that readers should be following…Colin Walker was honored with placement in Guy Kawasaki’s Alltop list for social media…and whoa, check out his placement there, it’s pretty high..congrats to both Eric and Colin…

*****

Blogger disclosure got a good airing this week…in this case, “disclosure” means bloggers should reveal any conflicts of interest they have in the companies they cover, or even avoid covering those companies altogether…in discussing Michael Arrington’s conflicts of interest, Wired managed to use the tag “ButtMunch” for its blog post…I mean, they could have been a little more clever…”ButtCrunch“….

Michael Arrington, Fred Wilson, plenty of others….I’ve got no beef with them blogging about their investments…we’re talking blogs for goodness sakes…and obviously something was notable about the companies to make them invest, so it’s no surprise they write favorably about their companies…Wired does make a valid point about crossing the line from blogging to journalism, but not to the point of stopping the Washington Post from running TechCrunch stories on its website…

One conflict of interest that I’ve never been able to resolve for newspapers is the political endorsements…you come out in favor of a given candidate, what should readers expect when they read your campaign coverage?

*****

Duncan Riley, recently of TechCrunch and now writing The Inquisitr, seems to have turned around when it comes to FriendFeed…back in March on TechCrunch, he wrote FriendFeed Is This Years Twitter, But Why?, where he wondered what all the fuss was about…on his personal blog he later wrote FriendFeed = More Hyped Yawn

Well, this week he ran a couple pieces that reflected a change of heart…on Monday, there was a post on The Inquisitr in which he asked Louis Gray to explain what’s great about FriendFeed…later, in The Inquisitr Update: One Week In, he noted that he’s added inline support for FriendFeed commenting to his blog…heck, he even added a comment to something I shared on FriendFeed…yes, interacting with us little folks, which is a great part of FriendFeed…

Louis Gray has a nice blog post up describing in more detail the dust-up he had with Duncan Riley over FriendFeed…check that out to get a full measure of how far Duncan Riley has come in terms of FriendFeed…

*****

Have you read Robin Cannon’s blog, Fog of Eternity?…lots of good posts there….my favorite line from a post today, Can’t Get Off the Blog Merry-Go-Round:

Downtime is vital though. Even if we enjoy blogging it’s still important that we get time off. Otherwise we burn out, the quality of our posts decreases, and we offer less value to our visitors.

Also, some really good, helpful posts analyzing traffic to his blog, like this one…check Fog of Eternity out sometime…

*****

See this item on FriendFeed: http://friendfeed.com/e/31dcb3bb-df74-8dd1-7081-183a366d10a3

Could WordPress.com Create a Disqus Killer?

Disqus is an application that hosts comments for blogs, applying some nice features to improve and make more social the commenting process. Here’s what Fred Wilson said recently:

Since I converted from TypePad comments to Disqus last August, the number of comments I regularly get have gone up by a factor of at least five and maybe ten. It seems that each week I have a post that gets over 100 comments (not this past week though). That never used to happen. And the discussions in the comments have improved dramatically.

Fred Wilson, A VC, Three Reasons To Use Disqus

Automattic, the company that runs WordPress.com, has not enabled disqus to work on its blogs (including this one). Here’s what Robert Scoble reported about that:

I’ve been talking with Toni Schneider, CEO of Automattic (the folks who run my blog) and they are looking at a raft of things to do to make commenting better for WordPress.com users.

So, let the commenting wars begin!

Robert Scoble, Scobleizer.com, Seesmic & Disqus add up to video comments and more

Scoble’s update is intriguing. Commenting wars? Might WordPress.com have something in the works that could undermine Disqus?

What’s Cool about Disqus

Because I don’t have disqus implemented on this blog, I’m a bit handicapped in my assessment of disqus. But here are the things I like:

  • Easy to track where you’ve left a comment
  • You can follow others, and see their comments across various blogs
  • You can create an RSS feed for your disqus comments, and pipe that into FriendFeed. Vastly increases the social nature of blog comments.

Here’s a screen shot of my comments on several blogs with the disqus commenting system:

Four comments, across four different blogs. Really nice to see that. You’ll also see a couple people that I’m following, on the left hand side of the disqus profile.

And here’s what a disqus comment looks like as it comes through FriendFeed:

As a commenter, you can extend your conversation outside the blog. Notice the ‘Likes’ and Franklin Pettit’s comment. And as a blogger, all the conversatin’ showing up in FriendFeed gets your blog post much more play.

Alas, disqus is not enabled on WordPress.com.

WordPress.com Snuffs Out Disqus?

Which brings us to Robert Scoble’s update. Sounds like the folks at Automattic aren’t sitting still. And that could be bad news for disqus. Why?

Volume, volume, volume.

On disqus’s site, they say that over 4,000 blogs are using their commenting service. Fred Wilson said it was over 10,000 blogs using disqus. Neither number compares to all the blogs hosted by WordPress.com.

If Automattic turned on similar commenting capabilities for its blogs, you’d have a sea of comments on that service. Take a look at the number of comments made on WordPress.com blogs each day:

Imagine if a lot of those folks streamed their comments into FriendFeed. The viral nature of FriendFeed would be an accelerator on that volume. A WordPress.com commenting system would dwarf disqus.

WordPress.com has the built-in advantage of already hosting millions of blogs and comments. Disqus is still in its infancy in acquiring new blogs.

If Automattic is serious about this, they should enable a new commenting system to work on non WordPress.com blogs as well. As a blog reader, once you have a profile set up, you’d like to use it everywhere.

Final Thoughts

Disqus has done an amazing job of customer service so far. That’s worth a lot of goodwill right there. I also love the upstart companies who show the world new ways of doing things.

And who knows? Automattic might be thinking of integrating disqus as one of the “raft of things to do to make commenting better for WordPress.com users”. I know I’ve requested the addition of disqus.

But if Automattic smells a good opportunity here and recognizes the value of its huge user base, then as Scoble says, “let the commenting wars begin!”

*****

See this item on FriendFeed: http://friendfeed.com/e/b0d09b39-26e0-2681-7b58-8fc234709b30

On FriendFeed, We’re All TV Channels

Husband: Hey honey, what’s on TV tonight?

Wife: Just seeing what’s new on Do you KNOW Clarence?

Husband: Cool. Any tech updates on Scobleizer?

Wife: Always! But I just want to chill tonight. Let’s see what’s up with Hawaii over at Roxanne.

Husband:Nice. Let me get a quick NBA update over on Odenized.

Wife: Give me that remote. No sports tonight!

Husband:I know what we need. Glasses of wine and some Thomas Hawk photos.

Wife: That’s it! Perfect!

When you watch TV, you have channels and shows that fit your interests. When you surf the Web, you have sites that you enjoy. All are forms of media, of programming, of content. That pretty well describes FriendFeed.

We’re all TV channels on FriendFeed.

You choose to follow people on FriendFeed because they stream content, comments and likes that fit your interests. Isn’t this like TV? ESPN gives you sports. Comedy Central gives you humor. MSNBC gives you prison lockdown stories…

Imagine if you tuned into ESPN and saw shows recounting the battles of World War II? Or if the Oxygen network was showing a hockey game? You’d be confused. And annoyed!

Which is an interesting take on the signal vs noise meme. One person’s signal is another person’s noise.

Select Your Channels Wisely

This is a theme which I’ve stressed before. If you subscribe to people who are not giving you programming you like, you’re going to run into the ‘noise’ issue.

Personally, I wouldn’t watch the Oxygen network. It just doesn’t interest me. It would be noise to me. But there are millions of women who do enjoy it. It’s signal to them.

Which is why I don’t follow any sort of auto-subscribe philosophy, in FriendFeed or Twitter. If someone subscribes to me, I may not subscribe back. Their programming just doesn’t fit my interests. It’s a very egalitarian thing to automatically subscribe back, but you’re bringing noise into your information stream.

Programming Changes

My FriendFeed mostly consists of social media stuff. I also enjoy the world of track and competitive running. If I suddenly switched programming, and fed a lot of running things through the stream, my existing network would look at that as noise. Just like if ESPN started running sci-fi movies. Not what people were expecting.

Louis Gray had another example of this in a recent blog post. Tony Chung switched his programming from Apple and next gen technologies, to covering the arts.

Final Thoughts

Mia Dand and Steven Hodson have nice blog posts on how content forms the relationship between a blog and its readers. They are good examinations of social media as programming.

FriendFeed is even larger than blogs. We get someone’s interests beyond just their blog. Heck, you don’t even need to blog in order to become a FriendFeed channel.

If you value having subscribers and developing a network of like-minded individuals, think about what your Friendfeed streams mean in terms of your programming. Even the simple ‘Like’ function brings content into others’ streams. I’d hate to be too careful about what I ‘like’ or comment on! Just recognize what it’s doing to your subscribers.

And with that…back to our regularly scheduled programming.

*****

See this item on FriendFeed: http://friendfeed.com/e/64843b5f-f950-c815-72ad-bb7931540ff9

Do Companies Need Social Media Managers?

There are few institutions in the modern world that are not being transformed today by social media.

Shel Israel, Global Neighborhoods, 5 New Social Media Turn-ons for me.

Encouraging use and engagement with [social] tools is an area that all organizations find they have a need for at some point and time. Use of these tools and engagement by people in an organization often does not happen easily. Why? Normally, most of the people in the organization do not have a conceptual framework for what the tools do and the value the individuals will derive.

Thomas Vander Wal, vanderwal.net, Enterprise Social Tools: Components for Success

Social media is taps into a deep well of user knowledge and innovation that previously had been limited to people’s close offline contacts. FriendFeed, Twitter, Facebook, Flickr, del.icio.us and others have not so much invented new ways of thinking as they have created new ways to surface intellectual energy and creativity, and significantly expanded the conversations one has.

How does this translate into the workplace? Thomas Vander Wal’s quote above hits on one of the biggest hindrances. Just throwing tools at people and saying “have at it!” will be a colossal failure. For many people, social media requires a slow romance before they become wed to it. Want to see how much romancing is needed? Read this guy’s comment about Twitter on TechCrunch.

The thing about social media is that once people get it, they really get excited about it. Facebook has experienced terrific growth. Twitter is edging more closely to early mainstream. FriendFeed is rapidly growing. But all of these companies had a chance to incubate and grow an enthusiastic set of early adopters, which leads to broader usage.

There are two issues for companies to address in the adoption of social media:

  • Slow internal adoption can cause the initiative to die from lack of focus and budget.
  • The real benefit of social media comes when many people participate. Slow adoption means companies won’t see good benefit for a while.

How can companies accelerate adoption of social media inside by employees? An enthusiastic group of innovators is always a requirement. In addition to that, how about creating a new position? The social media manager.

The Social Media Manager?

I know such a suggestion will get eye-rolls by some. Fair enough. But hear me out.

I mentioned this idea of an employee emerging as a social media manager to someone the other day. His response was that it sounded like another version of the head of knowledge management inside a company. That was interesting take. The role of the Chief Knowledge Officer seems to include a role for social media adoption, at least as I read the definition of the role on wikipedia (here).

I’m not nearly literate enough in the field of knowledge management to know what works and doesn’t work. But I suspect there’s a big difference between a knowledge manager and a social media manager:

The social media manager is a personality-driven role

Getting people out of their shells to participate in social media will take more than a handbook and a set of best practices. The successful social media manager will be someone who can engage a wide variety of personality types. Who can handle a variety of viewpoints. Who has a thick skin, because…

The social media manager should have some skin in the game

By that, I mean the person should have some opinion about what’s best for the company. Not an absolute, draconian opinion. But a confident feeling for what makes sense for the company relative to its customers, markets, competitors and products and services. And that confidence extends to entertaining differing positions from her own. A social media manager should exemplify F. Scott Fitzgerald’s famous quote:

The test of a first-rate intelligence is the ability to hold two opposed ideas in the mind at the same time, and still retain the ability to function.

After reading this, I realize that it makes the social media manager seem like some sort of uber-participant, eclipsing all others. If that happens, then we have social media FAIL. Rather, a good social media manager will have the ability to stir up enough interest in subjects to get people participating amongst themselves.

Work of the Social Media Manager

There are three basic functions of the social media manager:

  1. Initiate discussions
  2. Participate in discussions
  3. Report on discussions

Initiation is particularly important in the early stages of the social media rollout. People need a jump start to participate, and someone willing to show how it’s done is important.

Participation keeps the social media manager relevant and build connections with others. In a large organization, no one will know everybody. So participation – the crux of social media – is a requirement.

Reporting is a way to show the benefit of participating. The social media manager can report out all sorts of things to foster interest and participation:

  • Good discussions
  • Tag buzz – hottest tags right now
  • Interesting activity streams (e.g. sales closed)
  • Rising wikis
  • Etc.

Reporting occurs via RSS and that reliable corporate communication method…email. Why report? Make sure people are aware of good stuff. And ensure good participants are recognized. This latter point is important, as it speaks to the motivation of employees. Employees are ambitious and want to succeed. Burnishing reputations via social media is a strong motivation.

It turns out this motivation dovetails with the goals of the company as well. Good social media usage benefits companies in a number of ways.

Final Thoughts

Ideally, the social media manager likely emerges organically from early users. Someone who’s a natural. If needed, someone can be appointed to the position. I’d also expect the position to change hands over time.

Note that there are those out there on the web who serve these de facto positions for a lot of us.

The thing about social media out on the world wide web is that it attracts a large number of people from all over the place, all around the world. It just takes a relatively small percentage of people to get social media going. Inside companies, more motivation is required to get things moving because there is a much more limited pool of users from which to draw adoption.

What do you think?

[UPDATE – this article mentions someone who has exactly this role: http://tinyurl.com/5zehew]

*****

See this item on FriendFeed: http://friendfeed.com/search?q=%22Do+Companies+Need+Social+Media+Managers%3F%22&public=1