My Ten Favorite Tweets – Week Ending 031309

From the home office in Austin, Texas…

#1: @defrag has been saying he thinks the economy is slowly coming around. To that end: http://bit.ly/pP5bd and http://bit.ly/nRkzv

#2: “I think the days of the traditional San Francisco startup approach are numbered.” http://bit.ly/jyw4H

#3: @petefields Companies should follow all who follow them. I’d bet companies’ tweet reading is more keyword & @reply based, not person based.

#4: Maybe it’s just me, but Techmeme has improved a lot recently in terms of the variety of interesting stories. Human editor + user tips = +1

#5: “Facebook is the SharePoint of the Internet” http://bit.ly/4fu73o

#6: This shouldn’t be too controversial…The Case Against Breast-Feeding in April’s Atlantic Magazine http://bit.ly/Xs4ZG

#7: If browsers were women http://bit.ly/kO1su (h/t @mona)

#8: I’ve been blissfully unaware of what Sophie’s Choice is about all these years. My wife told me about it last night. Never gonna watch that.

#9: Actively banishing artists showing up in my Last.fm recommendations: Peter Cetera, Richard Marx, John Parr.

#10: In an email f/ my son’s preschool: One kid: “We’ll take them home in the future”. My son Harrison: “But I’ve never been to the future.”

Advertisement

The Migration of Web Techniques to In-Store Retail Practices

Via ralphbijker on Flickr

Via ralphbijker on Flickr

Think about the companies doing the most technologically advanced stuff. Amazon. Google.

Grocery stores.

Say what…? The place where oranges sit in piles in the produce section. Boxes of cereal lines the aisles. The frigid ice cream aisle.

Well, they’re not in the league of Google and Amazon. But grocers are more than those aisles of food and ceilings of fluorescent lights you see. Two trends in the industry borrow heavily from the advancements on the Web:

  1. Website optimization
  2. Recommendations

I’m not talking about monitors with web pages inside stores. I mean the shopping experience has been affected by these developments. Here’s how.

Website Optimization => Store Layout and Merchandising

E-commerce sites live and die by their conversion rates. A key piece of the conversion rate puzzle is effective navigation and presentation of items to site visitors. One company that helps with that is  Tealeaf, which records and analyzes visitor behavior to help site owners optimize conversions and return visits.

In a physical space, you can’t record people’s clicks and actions. Or can you?

As reported in a recent Economist article, retailers are starting to video record shoppers’ behavior in the aisles. For instance, here’s how one supermarket used technology provided VideoMining to understand visitor behavior in its juice section:

Another study in a supermarket some 12% of people spent 90 seconds looking at juices, studying the labels but not selecting any. In supermarket decision-making time, that is forever. This implies that shoppers are very interested in juices as a healthy alternative to carbonated drinks, but are not sure which to buy. So there is a lot of scope for persuasion.

These are exactly the kind of metrics that e-commerce sites track to improve their conversion rates. Use of cameras in-store to do the same thing is analogous to tracking visitors to your website.

Personalized Recommendations

Amazon.com really led the movement to provide effective recommendations to existing customers. One report I’ve seen says that Amazon derives 35% of its sales from these recommendations. Amazon’s recommendations are generated from your shopping history, compared to others via collaborative filtering. The success of these recommendations has inspired others to build recommendation engine services, including Aggregate Knowledge, Baynote, MyBuys, RichRelevance and others.

The same thing is happening in-store as well. You know that loyalty card you present to your grocer to get discounts? It’s used to record your shopping history. Historically, grocers have done little with that information. It was more of a device to keep you coming back to the store.

But in the past few years, grocers have been getting hip to the idea that their customers’ shopping history can be used to personalize the shopping experience.

Once, I was product manager for just such a system, called SmartShop. Pay By Touch’s SmartShop used a Bayesian model to compare your purchases against those of other shoppers, and determine whether you exhibited stronger or weaker preferences for a category or product than the overall average. A set of 10 personalized item discounts were then selected for you based on your specific purchase preferences.

On a website, returning customers are presented with a set of recommendations as they shop. In-store, what’s the analog? Kiosks. Kiosks are the in-store interaction basis with customers. SmartShop notified you of discounts via a print-out from a kiosk at the front of the store. This was key – get you the discounts right at the point of decision, when you’re shopping. Not unlike e-commerce recommendations.

Prior to Pay By Touch’s demise, SmartShop was getting good traction among grocers, who were looking for ways to increase basket size, increase loyalty and differentiate themselves. And it wasn’t just SmartShop. Price Chopper and Ukrops use a recommendation system from Entry Point Communications. UK-based Tesco is the granddaddy of personalized recommendations, provided through Dunnhumby.

Teaching Old Dogs New Tricks

While e-commerce benefits from being all-digital and various identification mechanisms, grocery historically lacked these. But that’s changing. Retailer have picked up the best practices of their online brethren. Things are now much more measurable and personalization is no longer the province of the online players.

Looking forward to grocers introducing Twitter into the shopping experience…

*****

For reference, here’s a white paper I wrote about SmartShop when I was at Pay By Touch:

*****

See this post on FriendFeed: http://friendfeed.com/search?q=%22The+Migration+of+Web+Techniques+to+In-Store+Retail+Practices%22&who=everyone

The Best Blogs You’re Not Reading? Toluu Knows

Toluu has entered the ever-growing recommendation space with something different: blog recommendations. And the service does a good job of finding blogs you’ll like.

I love the RSS experience of reading various blogs, loading up my reader with a lot of them and checking updates several times a day. So I was happy to have the chance to try this out. The service is new, launching in mid or late March. Louis Gray has a good post detailing its initial launch. Here’s a description of how it works from the Toluu site:

  • After joining, you will be prompted to import your feeds. We have many methods of importing your feeds such as OPML import, URL input, and a nifty bookmarklet.
  • Toluu will do some crazy math to find others in the system who have similar tastes as you.

One thing founder Caleb stressed on his blog: “Toluu is not another social network. I repeat Toluu is not another social network.”

So with that intro, let’s look at the user experience and how Toluu rates versus competitors. First, a brief discussion of recommendations.

Quick Note on Recommendations

The recommendations space is a hot area right now. For instance, Loomia, which recommends web content based on what your friends read, just raised $5 million. Amazon.com has been a real pioneer here with its “customers who bought this item also bought…” recommendations.

Ideally, recommendations are exactly matched to your interests. That’s pretty much impossible, but recommendations engines will employ proxies to get a bunch of recommendations that are close to your interests. And hopefully one or more click with you.

There are myriad ways to approximate your interests, and the world of recommendation engines is full of different methodologies. The key thing for most of them is (i) the amount and quality of information about your preferences, and (ii) the amount of population data available to build out recommendations. Toluu uses your OPML file of feeds, which is a very good source of data about your preferences. And Toluu improves as more people participate.

Finally, I’d want a recommendation service to mix highly popular items that I may be missing, as well as less popular items that are relevant to me. That latter category is the real jewel of a recommendation engine, and its the hardest to get right.

Toluu’s Organizing Principle: Match Percentage

Toluu’s primary organizing basis is its Match %. As Caleb mentioned above, this is their “crazy math” secret sauce. After you log in, you click on matches. A list of 5 people are displayed, sorted according to the Match %. The first 5 people you see are your highest matches. Each subsequent page shows the next 5 highest rated people. Each person has 5 feeds listed beside them. These “feeds you might like” are the top 5 recommendations per person.

I had 60 people in my list of matches. My highest match was at 91%. The bottom of the list was guy with whom I matched at 31%.

As I looked through the people that I matched, I noticed a trend. The best Match %’s were with people who had fewer blogs. The lower Match %’s seemed to be with people that had large numbers of blogs. I pulled together some numbers for 30 people to see if this was true. My top 10 matches, 10 people that fell just below the 50% Match %, and my bottom 10 matches. I then graphed it:


Sure enough, the higher the number of feeds for a given user (red line), the lower the Match % (blue line). I’m not quite sure what to make of that. It may be an outcome of the math – the match percentage is lower just because a user has so many feeds there’s no way to match. Or maybe I don’t match up well with the hard-core RSS addicts. I dunno.

One effect is that people who go deeper in their blog interests will fall lower in my matches. Assuming users don’t go too far down in viewing their matches, this could reduce the chance for finding those golden nuggets of less popular, but valuable blogs.

Top Toluu Recommendations Can Be Limited

I cruised through my people matches, and read the 5 “feeds you might like” for each one. There is a high degree of commonality on the recommendations. The 5 recommendations seem to use popularity as an primary input. And that makes sense. You’re providing a service, and popularity means somethings been deemed worthy by the public at large. Start with that!

Again, I looked at the top 5 recommendations for the 30 people I analyzed above. That meant I was looking at my top matches, my mid-tier matches, and my lowest matches.

There wasn’t a lot of variation in the top 5 recommendations for people in the different groups. Micro Persuasion, Engadget, Lifehacker, a couple Google company blogs and Boing Boing consistently showed up, regardless of the Match %.

This narrowness in the recommendations was something that Allen Stern at CenterNetworks wrote about. If you see a recommendation once, you’ll tend to see it repeatedly.

The Rubber Meets the Road: Toluu vs. Google Reader vs. NewsGator

So all that’s well and good. But how does the service perform? I decided to see how Toluu worked relative to two big established market players: Google Reader and NewsGator.

Google Reader has a Discover function. Here’s how it’s described: “Recommendations for new feeds are generated by comparing your interests with the feeds of users similar to you.” Sounds like Toluu, doesn’t it?

NewsGator has a Recommended for Me function: “NewsGator has analyzed your current subscriptions and post ratings, and recommended these new feeds for you.” Doesn’t say how that’s done.

I compared the top dozen recommendations for each of the three services. To assemble my top 12 for Toluu, I calculated the number of times the different blogs appeared in the 30 people I analyzed above. For instance, the blog Micro Persuasion appeared in 19 of the 30 matched users, making it #1. The table below shows those top 12 for each service:

One thing that immediately was apparent. No blog appeared more than once! Three different sets of recommendations and no overlap among Toluu, Google and NewsGator. Incredible!

I then checked out the 36 different sites. After a quick scan of each one, I decided whether it was one I would add to my RSS feeds. Those are highlighted in yellow above. NewsGator’s recommendations fell flat with me. They were too hard-core tech. Several had blog posts with lines of code on them.

Google Reader’s recommendations were the most relevant for me, with 5 that I liked. I subscribe to a number of Enterprise 2.0 blogs, so blogs like Intranet Benchmarking Forum and Portals and KM were good.

But Toluu did well here. The crowd was right – I like Micro Persuasion. Webware.com and Web Worker Daily are also interesting. There are a lot of Google blogs that show up in the recommendations. Maybe a bunch of Google employees are trying out the service?

More people joining Toluu will probably improve this some. At least push the Google blogs off the top recommendations. But there will be some reinforcing behavior as people join. Sites like Engadget and Lifehacker have large followings, and I’d expect a number of new folks joining Toluu to have those already.

Serendipity: Looking at My Top Matches’ Other Blogs

For each person in your match list, you see all the blogs they have that you don’t. It’s here where some of those golden nuggets, and even better known blogs, can be found. It takes work. You need to click each person, and then click each blog. There’s a limit to how much of this I wanted to do.

So I only looked at the feeds of my top 3 matches. And, I did find more blogs I’m going to add to my Google Reader:

  • Marshall Kirkpatrick
  • Adam Ostrow
  • BubbleGeneration
  • SocialTimes.com
  • mathewingram.com/work

Toluu Assessment = These Guys Are Doing It Right

I picked up 8 new blogs to follow courtesy of Toluu. That’s no small accomplishment. And considering they’re just getting underway and don’t have a ton of users yet, they compete quite well against Google.

I haven’t touched on other features of Toluu has. You can favorite a blog in your collection. I assume this helps the matching algorithm? You can track the activities of others to see what blogs and contacts they’re adding. But remember…this is not a social network!!!

Things I’d Like to See

I’d like to have an easier experience seeing the feeds for my top matches. Since there’s such a commonality in the top 5 for each of them, it would help me discover other blogs if I could see several of my matches’ unique blogs at once.

Show the top ten blogs recommended for me based on my top 10 matches. Criteria = frequency of a blog’s recommendations, with overall popularity as a tie breaker.

I’d like to get a little more info about some of these blogs in a summary fashion, without having to click each one. Maybe the headlines for the most recent 3 posts, or top tags of the blog?

But all in all, a very nice start for Toluu. Thumbs up here. Now I’ve got to go scan my RSS feeds.