Tagged: rss

Lifestream: whats the big deal?

I really don’t get what all the hoopla is about “lifestreams” or “social aggregators”. They are //all over// the place these days and frankly I’m getting quite sick of them. If you have no clue what I’m talking about, Dan Taylor has a [[http://www.fabricoffolly.com/2008/03/review-of-social-aggregators.html|great review]] of 15 lifestream services ([[http://mashable.com|Mashable]] has a [[http://mashable.com/2007/07/17/social-network-aggregators/|similar survey]] of 20 aggregators).

First of all, there is **nothing new** in the technology. It is almost trivial to write your own bare bones feed aggregator. Here is a ugly, skeletal social aggregator in **THREE** lines of Python (note that I’m not counting the list of the feeds itself) using the excellent [[http://feedparser.org|Feed Parser]] module:

feeds = [

import feedparser
for feed in feeds:
result = feedparser.parse(feed)
print result.entries

Granted its not pretty, but you can imagine its not terribly hard to make it pretty. Even otherwise, [[http://www.planetplanet.org/|Planet]] has been around for almost forever, even before RSS and feeds took off like they have recently. There are plugins that achieve the same for pretty much any platform you can think of: WordPress, Drupal, Dokuwiki, Mambo, Joomla — you name it, and they probably have RSS aggregation built in.

So if technology is not the bling, what is? Undoubtedly its the social aspect of it, I hear you say! Don’t we have enough social networks already? Are you so bored by the flood of updates in your FaceBook mini-feed, that you want to engage in //yet another// social network that has //all// of your feeds?

And finally, what exactly is the business model? Everyone likes to throw around words like “revenue”, “monetization”, “personalization”, “value aggregation”, “API” etc but we have yet to see a demonstrably sustainable model. Others have raised [[http://headphono.us/2008/02/28/48-friendfeed-launches-wheres-lifestreaming-headed/|similar concerns]].

I can’t help but sense a much-ado-about-nothing kind of feeling. I rest my case with [[http://www.friendfeedfeed.com/|FriendFeedFeed]].

FeedTree is half the solution

I mentioned [[http://feedtree.net|FeedTree]] yesterday — I’ve been thinking about it on and off since then, trying to judge the magnitude of the problem, and the value of the solution.

Let me step back a second. For those of you who don’t know about FeedTree, its basically a tool to help the distribution of RSS feeds (what they call “micronews”). The premise is that these days there are a large number of blogs, an equally large number of people who read these blogs, and a significant portion of readers come via RSS feeds.

Infact, this is an over simplication of the problem, for RSS feeds are becoming ubiquitous these days. Pretty much any kind of content can have an associated RSS feeds — newspapers, magazines, calendars, project management tools, software releases, email. Things are further complicated because RSS feeds are trivially easy to embed in other content (thanks to the large number of tools and libraries available for almost all languages). So you can see my del.icio.us tags on my home page, fetched via RSS. Ditto with flickr.

So the basic problem FeedTree is trying to address is that of efficient utilization of network bandwidth and efficient distribution of content. This is useful for pubishers (I pay for my bandwidth, so I want to get the best value out of it); useful for ISPs (if RSS feeds end up eating a substantial chuck of the backbone traffic, like BitTorrent does right now, you can be sure ISPs will be interested); and end users (I don’t have to wait for my aggregator to “pull” feeds every so often, news will be pushed to me instantly).

The key idea is that a large chunk of this traffic is redundant (say 50% of the participants read Slashdot) — so instead of everyone pulling data from Slashdot directly, we can share the data among each other in a peer-to-peer fashion. The technology is not new, but the idea is. You can read a lot more about the [[http://trac.feedtree.net/project/wiki/FeedTree|gory details and some pretty pictures]] on FeedTree’s website.

So if everyone starts using FeedTree, will all our problems disappear? Leaving the social aspects of adoption etc aside, I think there will still be problems.

First of all, the distribution model for feeds is not as simple as everyone pulling feeds from the publisher. A good example of this are the various [[http://www.planetplanet.org/|Planets]]. Technorati just released Favorites. Then there is Memeorandum and other meme-trackers. So some kind of network aggregation is already happening, though its hardly anything as organized as what FeedTree proposes.

Secondly, these feeds are growing richer in content. Podcasts are just the beginning. Imagine if all feeds had some rich content (audio/video) embedded in them (basically, when the size of feeds grows to more than just a few KB), a P2P distribution system will not necessarily solve the problem (we have already seen the problems that BitTorrent has run into, because its a **highly effective** P2P content distribution mechanism).

Thirdly, I would expect content distribution giants such as Akamai to step into this business soon (if they haven’t already). If NYT and CNN can use Akamai for delivering their audio/video content, they most certainly can use them for RSS feeds. Akamai has a huge, robust content distribution infrastructure that can simply be plugged in.

And finally, as an end user, my biggest gripe with RSS feeds is not the ‘pulling’ aspect. Its the way they are aggregated and presented. Its the way meta data is maintained. I don’t want to have to statically maintain my OPML — I want it to evolve dynamically, learning from my reading patterns and automatically picking up stuff that I might find interesting. I don’t want to have to read feeds in order of their arrival, or categorized by some tags — I want Google news like clustering across my feeds. When I am overwhelmed by the number of feeds, I want to see the largest clusters only and zoom in as I feel like reading more.

I’m looking forward to further results from FeedTree!

Show some love to the fuzzy orange icons

You’ll notice some new warm-fuzzy [[http://feedicons.com/|orange icons]] next to the links to the tags. I decided to make it a little easier for people to subscribe to specifc types of content on this blog — so now each tag link has a link to its RSS feed next to it. Thats right, each tag has its own RSS feed.

Here’s a run down of the navigation structure:

* [[http://floatingsun.net/blog/feed/]] — the main site feed
* [[http://floatingsun.net/blog/tags/tagname]] — index page for the tag “tagname”
* [[http://floatingsun.net/blog/tags/tagname/feed/rss2]] — RSS2 feed for the tag “tagname”

Have fun!