Advertisements

Social Media “Glue” and Gnip’s Co-opetition with FriendFeed

We believe that enabling web technologies are going through a similar development cycle as enterprise application integration technology did 10+ years ago. Companies are creating tools, applications and platforms to enable more productive and automated uses of resources that have become ubiquitous parts of the online ecosystem. We think about these enabling technologies as the glue that will increasingly hold together that ecosystem.

Seth Levine, Foundry Group

Venture capital firm Foundry Group, which includes partner Brad Feld, described an important investment theme for their firm. Titled Theme: Glue, the thesis is that the growing number of web services and content-generating sites are causing increased complexity, and that there is a need for an infrastructure to handle all this.

This can seem a bit dry (“I know this back end plumbing stuff is boring to most of you”, as Michael Arrington says), but its relevance is can be considered in the context of:

Foundry’s thesis extends beyond server-load management. But its initial investment in Gnip starts on that part of the “Glue” story.

The Problem Gnip Solves

The rise of user generated content has made this problem particularly acute. We’re creating so much content, all over the place. Flickr, Del.icio.us, Digg, YouTube, Twitter, WordPress.com, Google Reader, etc. I mean, there’s a lot of stuff!

It turns out a lot of other sites want to consume this stuff – FriendFeed, Plaxo Pulse, Strands, SocialMedian and many, many other sites. And the direction for production and consumption of all this content is only going one way –> up.

The problem that arises is the way consuming services, such as FriendFeed, have had to find out if you’ve got a new tweet, blog post, Digg, etc. The consuming services need to ping every individual user’s account on some site, such as Flickr,  with the query, “got anything new?” For most people, the answer is no. But that query is the cause of a lot of traffic and latency. Imagine all these new web services pinging en masse all the UGC sites. It can be quite a load to handle. In Twitter’s case, it was too much to handle.

Gnip addresses this issue, standing between UGC sites and consuming sites:

gnip-flowThe UGC sites (aka producers) push updates for their various users to Gnip. These updates are either change notifications, or full content for each user. So Gnip becomes the reference layer for anything occurring for a UGC site’s users.

The consuming sites then look to Gnip as a “single throat to choke” in terms of updates. Gnip handles the updates, and gets them out to consuming sites in real-time. Gnip also removes the burden on consuming sites to write and maintain polling scripts for all the various UGC sites of users.

The idea is a good one, as it offloads a lot of the burden for both producers and consumers. Of course, it shines a light on Gnip’s scalability and uptime stats.

Initial consuming sites using Gnip include:

Gnip is off to a nice start. But what about FriendFeed?

FriendFeed’s Ex-Googlers Roll Their Own

FriendFeed is one of those consuming sites. But they’ve not signed on for Gnip so far. Not surprising, considering their Google background. Lots of good knowledge about scalability to be learned from Google.

Rather than sign on to Gnip’s service, Friendfeed has proposed the simple update protocol (SUP). What’s SUP?

SUP (Simple Update Protocol) is a simple and compact “ping feed” that web services can produce in order to alert the consumers of their feeds when a feed has been updated.

The idea is that the UGC sites provide a single point for posting notifications of new user activities. Rather than the consuming sites running the “got anything new?” query for every single user on their platform, they go to a single place to see what’s new. They have a list of the user IDs they want to check, which they run against the SUP location. Much more efficient.

Which does sound a little like Gnip, doesn’t it? Here’s a Q&A between Marshall Kirkpatrick of ReadWriteWeb and FriendFeed co-founder Paul Buchheit:

RWW: [Where is this relative to] Gnip? (See our coverage of Gnip, a startup that appears to be aiming to do what SUP will do and more.)

Buchheit: We’re talking with several companies about supporting SUP, but aren’t ready to announce anything.

On the TechCrunch post about Gnip 2.0, commenter Nikolay Kolev writes:

Even if I like Gnip’s concept a lot at this moment, I think it’s just a temporary solution of the real problem. It solves deficiencies of the vast majority of the data producers nowadays, yes, but if more implement XMPP PubSub, FriendFeed SUP and other similar technologies, there will be less incentives for data consumers to make their business rely on a single provider that supposedly aggregates and replicates all of the Web…

On FriendFeed, user Dani Radu writes this in response to Gnip:

pretty interesting, I mean making all this data handling drop dead simple is great – but this means they want to cache and route the direction of interest. Own the process and sell it. Again, perfectly sane – but I’d rather go for the SUP (simple update protocol) which in a way – if adopted widely – does the same but keeps the handling free (as free as the services are anyway) We shall see what future brings tho…

The Gnip vs. SUP question came up on Hacker News, which included this exchange with FriendFeed’s Paul Buchheit:

ryanwaggoner: Isn’t this what Gnip is doing, except that Gnip’s solution is readily available to anyone who wants it? In fact, I believe Gnip uses XMPP to push notifications to data consumers, which seems even more efficient. Am I missing something?

paul: No, Gnip is a complementary service and will likely consume SUP. SUP is intended to make it easier for feed publishers to expose information about which feeds have been updated. Without this information, Gnip can’t know when feeds have updated except by polling all of them. SUP allows them to poll a single URL instead.

ryanwaggoner: Got it. So this is designed to be the piece that allows publishers to easily integrate with intermediate services like Gnip, or with aggregation services like FF, SocialThing, etc.

paul: Exactly

Paul’s right, but the earlier comments are also right. Gnip may want to get updates for its UGC producing sites using SUP. But there’s truth to the idea that if producers offer SUP, some of the value proposition of Gnip is eroded.

Gnip: More Than Real-Time Updates

But Gnip appears to provide a range of services above and beyond simple update notifications. My guess is that those extra services Gnip provides above and beyond providing a single place to get notifications will be their secret sauce.

On the Gnip blog, product head Shane Pearson writes the four use cases on which Gnip is focused:

  1. Eliminate the need for developers to write dozens of pollers for UGC sites, all of which must be maintained and updated
  2. Target business specific applications that need this data. There may be interesting functional or vertical application that SUP won’t cover.
  3. Offload the overhead on UGC producers’ sites (which sounds like SUP). But beyond that, create an alternative channel for their content, provide analytics on the data consumed through Gnip ,and add filters an d target endpoints.
  4. Use Gnip as a source of market research and brand analysis for what consumers are saying about companies.

So what you see here is that the developer world sees SUP competition in the infrastructure part of Gnip. Gnip is looking beyond the developer world in terms of where it delivers value.

I wouldn’t be surprised if other companies enter the mix. “Glue” is an early, interesting space right now.

*****

See this post on FriendFeed: http://friendfeed.com/search?q=%22Social+Media+%E2%80%9CGlue%E2%80%9D+and+Gnip%E2%80%99s+Co-opetition+with+FriendFeed%22&who=everyone

Advertisements

Would You Apply a ‘Dislike’ to Your Co-Workers’ Content?

On Digg, you can apply the “bury” rating to stories. On Amazon.com, you can apply a single star to rate something negatively.

Would you ever do that to the work of your colleagues?

I’m not talking the annual HR exercise of 360 reviews. I’m talking Enterprise 2.0 apps, which incorporate the features we see out in Web 2.0. The ability of people to rate the content they see.

A few social media sites have taken a binary approach to ratings: (1) positive rating, or (2) abstain:

While some others are incorporating the notion of negative ratings:

Out on the Web, where you’re interacting on platforms with thousands of anonymous or unknown people, negative ratings make sense and help bring some order to the scrum of content and products.

See Louis Gray’s post for a good perspective on this whole rating thing in social media.

Inside companies, things are a little different. There’s a vetting of other Enterprise 2.0 users, in the form of the hiring and annual review process. This automatically raises the average quality of contributions.

And there’s this….Enterprise 2.0 apps are used by people you know and work with. People you’re going to see in meetings, on projects and who have common connections. A negative rating to someone’s Yammer or wiki entry or social bookmark is a big deal. You’re essentially saying:

“Dude, this is bad. I mean really bad. So bad that I had to ‘dis you and let the rest of the organization know how bad it is.”

Personally, I’d have a hard time with this. In the most egregious cases, I’d apply the negative rating. But I’d strongly prefer to “work it out” in the comments to the original content.

My concern is that a negative rating turns into a basis for internal feuding and chills open discussion about ideas, information and observations. But in a large organization with a heavy flow of content, maybe the negative rating is the most efficient way to handle the value if information.

Perhaps I’m in the minority here. How about you? Would you give a thumbs down to your co-workers’ content via Enterprise 2.0 apps?

*****

See this post on DFriendFeed: http://friendfeed.com/search?q=%22Would+You+Apply+a+%E2%80%98Dislike%E2%80%99+to+Your+Co-Workers%E2%80%99+Content%3F%22&who=everyone

Riding Coach: A Day in the TechCrunch50 DemoPit

I spent a day in the DemoPit of the TechCrunch50 launch conference on behalf of my company Connectbeam. We didn’t debut at TC50 (two year-old company already has customers), but it was an opportunity to raise awareness among different communities.

I’ll say this: DemoPit is like flying coach, while the folks on-stage are flying first class. You don’t get the amenities or attention, but you still get to travel.

Here’s a quick summary of the experience.

Demo Tables

The tables are like 30 inches across. Not huge, but they were fine. Enough for a big display screen, a sign and a laptop. And that chip tip jar.

Wifi

Absolutely awful. The wifi was spotty early in the morning. Then it went down for several hours. That’s right…several hours. A bunch web-based companies without Internet access. Brilliant.

Jason Goldberg of SocialMedian went out for an EDVO card at the local Best Buy. He was back in business, so my colleague went out for one too. After an initial blue screen of death, we had Internet access again.

Late in the day, a TechCrunch staffer came by to offer another day to do demos since we had it pretty rough. Cool that they acknowledged the issue, and came up with a solution.

Demo-ing

Enjoyed myself when I could show off the product. It was great to take real-live data from someone visiting, punch it in the app and have it do all the cools things I said it could.

Lots of Visits by Tuesday-Wednesday DemoPitters

A lot of guys hitting the DemoPit on Tuesday and Wednesday came through the area on Monday. Smart. They wanted to see how we pitched, and find out what to watch out for (uh..the wifi).

Ashton Kutcher

Yup, Ashton Kutcher was in the house. He was up on stage pitching his start-up Blah Girls. You can read people’s tweet reactions here. It was amusing to see him on stage talking up his site. 10-12 year old girls might like it. Might…

Later this entourage-like crowd of people came through the DemoPit. It was Ashton Kutcher and Jason Calacanis’s were walking Jason’s bulldogs. There were several people accompanying them. Quite the scene.

And still later, Sarah Lacy was interviewing Kutcher. Do you think he got Zuckerberg’d?

FriendFeed Friends

I had a couple unplanned FriendFeed meet-ups, which was really cool.

Here are their handles on FriendFeed:

Weblebrities

Saw a few weblebrities: Michael Arrington, Robert Scoble, Stowe Boyd, Jason Calacanis, Dan Farber, Loren Feldman.

Big Companies

Three big communities were out in the DemoPit: Yahoo, Salesforce, MySpace.

Jason Goldberg of SocialMedian

Jason’s Social Median table had a steady flow of traffic during the day. And he did well with those DemoPit chips. People give poker chips to companies whose products they like. The company with the most chips gets to go on-stage at TechCrunch50 on Wednesday.

Social Media had a pretty good haul. Hope Jason makes it on-stage Wednesday.

Yammer

I liked TechCrunch50 participant Yammer. Enterprise Twitter.

On to Other Conferences

TechCrunch50 was tiring but fun. I enjoyed the scene. Next, Connectbeam will be at the KMWorld Expo September 23. And Defrag after that.

*****

See this post on FriendFeed: http://friendfeed.com/search?q=who%3Aeveryone+%22Riding+Coach%3A+A+Day+in+the+TechCrunch50+DemoPit%22