Showing posts with label social software. Show all posts
Showing posts with label social software. Show all posts

Friday, March 31, 2006

Frisson de Folksonomie

Oh, look at the date. It's been a while, hasn't it? Indulge me if you will in part 6 of the Things Fall Apart series. A slight detour perhaps, or rather a journey into the heart of dar- ... technology, and matrimony.

A Social Bookmarking Affair


Catharsis — Seduction — Intimacy — Play — Reconciliation

Cherrelle's Affair


Journal — Music

Catharsis


I have a crush. There, I finally said it. I feel better already. I'm confessing that I have a serious case of folksonomic titillation. I can no longer stand this conflicted life... The pastor counseled us before marriage that these things are best dealt with in the open. So Dear Wife, I must confess a previously secret admiration.

The object of my affection is meryn. More precisely my belle-de-jour is del.icio.us/meryn. Even more accurate is that I'm jonesing for the set of tags at del.icio.us/meryn. I get a frisson de folksonomie every time I look at her assets, those tags of hers.

Seduction


Stay! Don't you walk out that door. Please stay... Let me explain... Oh... Where should I start in discussing this social bookmarking affair of ours? Of mine, I mean. It's so hard to know how to talk about these things... I know that you think that I must be used to it since I spent those years in France, but believe me, affairs are not my kind of thing. It never crossed my mind, it's just... Well maybe I should start at the beginning... I know you have questions... It hurts... but please... please, let me tell the story my way...

We first met about a year ago at the bar of a hotel called del.icio.us, regulars don't use those two periodic seperators in the official name. As you might know I've been spending some time at that joint since... well, I think it was September 2004. My first bookmark was called Writing Well on the Web, I disagreed with that piece (keep everything brief?). Anyway, del.icio.us isn't a bad joint as social bookmarking hotels go, a little minimalist on the eyes but it's getting quite crowded these days and of late you hear a lot of yahoos. She, on the other hand, started frequenting the bar sometime in the dark days of winter 2004, you know, after that election...

I can remember the exact day we met. I had written something on People, Processes and Things in the morning and, after giving it the day to simmer, settled down after work to bookmark the post with the benefit of a few hours reflection. After the act, I noticed that a certain meryn had been quicker on the tag to my own musings, and with nice tags to boot (communication, association, collaboration, interaction, facilitation and mediation were the words she used). Interesting, I thought, not quite how I would have tagged it, but you know, different strokes for different folks.

The name vaguely rang a bell, perhaps I had overhead it in one of those community software dives I sometimes frequent. Or was it some network economics something or other? Oh well, I thought nothing of it.

Later on I noticed some intertwingling and bookmarking consonance. She seemed to have picked up some of the same links as me, or was it the other way round? But I didn't care. It was just an occasional flirtation with groupthink, nothing serious you know. No serendipity really. No one made any moves.

Things really got going started just days before I proposed to you. Uh-huh. I had been writing about the importance of syntax in technology adoption. I had even posited "cognitive impedance" as the theme of that article. What a mouthful. That day, I beat her to the tag, I had learned my lesson about delayed gratification. Yet when I came home that evening... That's right, you were away at a conference, remember? Bryn Mawr or something. Anyway, there I was, home alone, eating a TV dinner of kelewele and promiscuously surfing the web. I'm a habitual browser... Anyway...

There it was! A coup de foudre.

By her simple act of tagging, I saw a new way to conceptualize my material.

Yes! She walked right past me wearing a tag named "comprehension".

"Aha", I said. "That's what I had been writing about. The word I had been circling around, the conceptual truth I had been avoiding. Oh, what a tag."

Sure, she was also wearing a perfumed tag named "adoption" and shoes designed by a tag named "rejection", but who cares? I could no longer deny it.

Comprehension was the basis of my attraction.

And so it came to pass, things moved quickly from there on. It's quite a blur really... By June, I was using that term in my discourse. In barely three months I had internalized one of her goods.

Thus I'm confessing that every month or so, I secretly fire up the browser to look at her, to see if I can mine some more of her glorious tags.

They look so... well... how to put it? ... I just love... her... classification scheme... Her tags all end in "tion". There's a "je ne sais quoi" to her categorization... Great, great tags, they are...She... She puts words to concepts I had been thinking about but couldn't articulate... Such tags. All 319 of them, I've counted. Their contours are so... delicious.

Now I don't know why this happened. I can't say that I haven't been happy at home, I am verbose myself and have 1,266 tags of my own. Why aren't I satisfied? After all, those folks working on Dogear point out to me as an outlier with a gigantic folksonomic vocabulary.

Our marriage is still young... I feel I can tell you these things. I know you'll understand.

As it is, I've worked out that meryn and I now have 28 tags in common, I've adopted six of them after our monthly encounters.

Don't get me wrong. The links are fine to be sure, but it's rather that the tags give me the chills - I mean, it's that I look at them. I seek release in her folksonomy.

Intimacy


Mind you, I haven't acted on the attraction... Well that's not exactly true... I did succumb late last year and added meryn to the subscriptions in my del.icio.us inbox. It's such a useful feature; being able to subscribe to the bookmarks of others to see the ebb and flow of their ongoing reading. You can see the books I read, the photos I take and the music I listen to. Why not the bookmarks?

Don't look at me that way. Please... I'm not alone. There's nothing wrong with me! I saw that Jason Kottke was thanking his del.icio.us inbox just the other day. It's just data, says Sam Ruby. We're all wired together in a web of data say Adam Bosworth and Ray Ozzie. Let atomic feeds bind us together.

Of course like any episode of R Kelly's Trapped In The Closet, there are a few complications to my story. It's not quite the midget hiding under the kitchen sink, or Rosie, the nosy neighbour, who comes knocking on the door with a spatula on hand. Remember that wonderful musical moment we shared? You remember, don't you? You and I. Ahh. Remember how hard we laughed when that man Kelly delicately crooned the word "Spa-tula"? That was great wasn't it? How we laughed. That boy's lost his mind... Ha... Okay, Okay, I'll continue.

Anyway, I don't know how to put this, but no doubt you'll find out so I might as well tell you now. At the beginning of this year I found out that behind meryn is a man. His name is Meryn, Dutch I believe, an economist or some social scientist or other, with an affinity for things technological. I suspect he used to read me in the past but I was relegated to dinosaur status when I took that blogging hiatus to get married to you.

Now to tell the truth I had suspected as much. That she was a man, I mean, Most of the early adopters in the software world are men for some reason. You know, boys with toys. Let's face it, we make things difficult for women in technology. Such a shame really... Still he seems like a reasonable guy. All true man, heck he recently announced reaching the milestone of 1,000 bookmarks in del.icio.us.

Pssh... The size of her... I mean, the size of his bookmark collection doesn't matter to me. My interest was purely folksonomic. It was all about the tags. I was rather bent on mining her, I mean his, conceptual framework. This isn't Brokeback Mountain, it's more like Pimp My Tag. Sacré bleu. I can just see the case before the judge, "She only loves me for my tags, not my bookmarks". These social bookmarking feelings are so confusing sometimes.

Baby... Honey. Don't walk out of this room. Stay. Let me finish...

Where was I? Ah yes, two can play this game. I know that some people like me for my bookmarks. Then there are others who like me for my tags (size matters apparently and with a long tag list, there is evidence of my roving mind - you know too the stereotype about black men, that we have large... vocabularies). Still others like me for my occasionally jaundiced comments on said bookmarks. Well in meryn's case, it was all about the tags. I want to recapture the feeling of that first time. Their aggregation, consolidation, combination, interoperation, participation...

There have been others of course, I must admit... Don't throw that. Please... That won't help anything... Okay sure, I'll come clean. Yes, there've been other attractions in this social bookmarking world. At work for example, there's Mr Feinberg, but you know Jonathan after all, he even came to our wedding. I don't like him for his tags, it's more the bookmarks, he tends to dig up stimulating stuff about programming in the trenches. Then there's Carol on mass amateurization, Andy on collaboration, Tessa on glue. Outside there's Ethan on Africa and serial entrepreneurship, David and others too. I even occasionally snatch a peek at Coté's good enough tag and I'm flirting with The Governor's declarative living meme but haven't bitten that apple yet. I'm a prime example of that perhaps.

But here's the thing, all of those have been affairs of the bookmark not of the tag. Rather, I'm curious about how we name things. I want to internalize the concepts. The heart of the matter for me has always been the tag.

Play


Okay, Okay. I'll start over... What? You want me to explain? Explain what? Don't turn this around on me...Okay... I'll bite, I'll be a man about this... Whatever... I'll tag this social bookmarking thing. I'll break it down for you. I don't want to get all software engineer on you but you know I can do this. I've thought about it quite a bit, I've got a lot of tags you know... All right, here goes...

In social software, there are "people", there are "places", and there are "things". Oh some say that there are also "processes" and of course those exist, but let's stick to the fun stuff. Oh, you like the Rule of Four? Okay, whatever... it's just that processes are so... what's that new tag? enterprisey... Anyway, the "things" and the "places" are the shared context in a community. The places are like homes or land, things we feel proprietary about. The people however are where the action is found. We like to chat, we like to form groups, basically we're social beasts.

That man Metcalfe has a law which says that the value is all about the people. I think he means that communication is key. That man Reed has a law which claims the value is all about group forming - all those tribes and clans we like to form and the comfort and entertainment they provide us. The man Odlyzko says those two are overselling things (pdf) but even he says that the network has great value and it's quite considerable in the aggregate. Needless to say, there's money to be minted in software that aids collaboration or serves communities.

With social bookmarking, the "things" are
  • The bookmark
    the URI that we use to remember the site (identification of resources)
  • The web page that you see
    that's the representation (and I've even got a pitch about that)
  • The metadata
    That's the data about the data. It's the eternal headache. Things like
    • the title of the page
    • any comments you have
    • those newfangled tags you can use to remember the site
    • how you might rate it
    • what you were doing when you encountered the page
    • who referred you to the page etc.
That's it. There's nothing more to it. All that hullabaloo boils down to that. Well let me tell you about the social bookmarking scene, those hotels I've been cruising.

It's quite simple really, you merrily go around your surfing way and decide you'd like to remember a site. You click on a button, or right click, perhaps you select some text, and then you get shown a basic form, you enter some information and then most of those things are saved. That's the way of all social software: you gather the data, you explore the data, you search the data and you interact with people and exchange messages. The data could be anything at all; we have examples from music, films, books, food, places, lists etc. In this case it's bookmarks. The best social software will try to make it relatively painless to do the mundane things like entering and managing data and easy to do the more fun things like exploring and communicating. It may intrude a little in directing you around and suggesting new avenues but then everyone needs a little handholding from time to time.

I've hung out at 3 of these joints. What? You I think I am afraid to commit? That I have a split personality? Whatever.
  • Furl - which allows you to save a copy of the page along with everything else. I started out here because of said feature.
  • del.icio.us - well everyone likes Joshua Schachter's baby - it's lightweight, sweet and has most of the mindshare if not the users.
  • Dogear - It's very nice on the eyes. I use it to keep up with the IBM tribe and monitor things inside that Big Blue firewall. Plus they keep adding all the features I request and fixing the obscure corner cases I detect, thus I have a little hand in it. That pitch is about "social bookmarking for the enterprise". I hope it graduates from research to product, it certainly deserves to.
I know there are many other services out there but these three cover the essentials.

All right then, you wanted tags, I'll give you tags.

Language


Furl and Dogear are good names. You can use them as verbs. "I dogeared that page". "I furled that site". Indeed that's what the word dogear is used for in common language. Jonathan was suitably chuffed when I started using that felicitous phrase. You can't use delicious as a verb but it remains a powerful brand. It's rather like calling a "country" a "homeland" - hard to argue with, indeed one must love it, you're "treasonous" if you criticize it...

Identity and Security


Furl and del.icio.us care only that you have a valid email address. Dogear makes you use your real life identity or whatever your corporate directory would require. Obviously this can be changed and like the others, it can simply run off a user name or email address. Which leads us to...

Memorability


Ideally you can choose a handle or at least a persona to use in the service. With a name as long as mine, a nickname is far preferable. Of course this means that there's always going to be a land grab when it comes to names. It's much like when I signed up for 16 different free email accounts to hedge my bets in those glorious dot com days of yore.

Adoption


All these applications give you freebies; you don't need to login to get benefits from the system. You can browse bookmarks, tags and users and see what's current or popular. These social bookmarking hotels are like tobacco companies or drug dealers, they make sure you get a free taste before they hook you. Great capitalists they are. In economics they call this lowering the barriers to entry, I tag the concept as adoption, impedance and lubrication. The sociologists believe that this notion of lurking is important in all our communities. We may be social beasts but we're often shy and inarticulate and that's fine - well most of us are shy. Because one can behave relatively anonymously with these applications, at the very least, the service can monetize our eyeballs with advertising.

Notification


You can subscribe to feeds for almost every page that you might encounter in these applications. This allows you to peruse later at your leisure. Notification and alerts are good ways to stimulate your interest. One feature that I haven't seen is a simple indication when new links have been suggested for you or if there are new subscribers to your links.

Navigation


These are web applications hence interaction is all about hyperlinks and forms which are the currency of the web. Thus there lots of links, and they follow the hyperlink imperative to allow you to pivot around and navigate the site. The front pages feature recent links, popular links, popular tags, link clusters, random tags, links to your personalized view etc. Presumably if group features are implemented, they will also have prominent links.

Search


Search becomes more important as you gather lots of bookmarks or tags and navigation becomes more difficult; also sometimes it's the title or comment that you entered that was what you remember. That human brain is a weird one.

Latency


del.icio.us and dogear use a simple textbox for entering the list of tags and they throw in some auto-completion to make entering tags easier. The suggestions can also be sorted by relevance or popularity. You can also get frequency counts. They both seem to be moving towards adding in-line editing so that all you need to do is click to edit. Metadata is generally annoying hence the lower the latency, the more likely you'll enter and manage it. This again is to promote immediacy in the interaction.

Usability and Interaction


Furl is the worst of the three in one significant respect; the way it handles multiple tags is problematic for verbose people like me who use lots of tags. The proof is that I have half the number of tags in Furl than in the others even though I've been using it for longer. I can't count the number of times have I written to their technical support asking them for just a few tweaks to their system. Take a look at their dialog for saving a new bookmark.

furl bookmarking ui


It's a little cluttered as it's trying to gather a fair amount of information. I'd like wider text boxes for the title and URI - a wider dialog in general would be good.

Note that the select box only displays 4 tags at a time. This doesn't scale if you have more than 50 or so tags, let alone if you have several hundred. You simply can't scroll quickly through that many tags and pause to do that shift-click business.

Then they've deliberately made the "New topic" textbox small, implying that only one new topic can be created. This is not so; you can create multiple tags if you type them in separated by a semi-colon. This last fact is still not documented anywhere in their user interface, let alone their help. Indeed I learned of this hidden feature in passing on the delicious-discuss mailing list. It's as if Furl wants to actively discourage proliferation of tags.

Yeah, yeah. I know I could write my own interface and that those glue layer people at Freshblog have lots of bookmarklets and interfaces that let you post to Furl and del.icio.us simultaneously. But that's social bookmarking polygamy, who wants that?

On the other hand, Furl can collect far more metadata in that dialog than the others allowing you to separate your comments from article clippings. It even goes beyond the call of duty by inspecting the meta tags on the page, referrer pages and any HTTP headers from the page snapshot it saves.

Data and Storage


This last feature though, saving the web page along with the link and associated metadata, is probably what is giving the Furl folk their biggest headache. Plainly put, their storage needs are several orders of magnitude greater than the others. The vision of providing personalized snapshots of the web makes them face issues that are akin to what the Internet Archive and search engines face. One mitigating factor is that most users don't check their personal copies often since most links will continue to work. Further web pages are fairly small compared to the photos in Flickr or the videos in YouTube or Google Video.

Scaling


Thus scale is a great concern, first in terms of the number of users, the amount of data that the applications need to handle and the number of tags that are used. This affects the backend and the performance of the application but also the user interface. If you have huge numbers of tags the interface can get overwhelming thus you need to filter out the little used tags. Tag bundles in del.icio.us are an interesting way to manage this, you can group tags into bundles to help with filtering. Also with increasing scale, search becomes more important, that's why Google is popular in the web and likely why Yahoo bought del.icio.us.

Comprehension


Ah that glorious concept... In the social bookmarking setting, it's the matter of the syntax used for tags. Dogear and del.icio.us use spaces as separators, as does Flickr in the photo arena. Furl uses semi colons and All Consuming (books, music, food) uses commas.

Then there's the treatment of multiple words, the first two use quotes around them since the space character is not a separator character.

Then there's case sensitivity, Furl seems to treat "Technology" and "technology" as different tags which would be a problem most of the time I believe. I can just hear Jonathan tell me that 'dogear is case-preserving, but case-insensitive; it remembers that you tagged with "foo", but a click on "Foo" will find your bookmark'.

Then there are the perennial issue of "special characters". Tags have their own web pages and consequently each have their own URIs. As you know, there are restrictions to the characters that you can use in URIs (even though there are those newfangled things called Internationalized Resource Identifiers, IRIs, that might help). These difficulties however might mean that areas of the world that use characters that are outside the set normally allowed in URIs might have more problems and will likely see slower adoption. Combine this with the dissonance over separator characters and you get confusion. The Gruesome Twosome of Computer Science (Structured Data and Character Encoding) strike again.

Recommendation


The remedy that some of these applications have implemented is to display related tags to suggest alternatives. You can put a nice cluster of suggestions that might interest the user. Recommendation systems are a pet topic of mine and it has been interesting to see the various ways in which the applications try to direct you towards interesting things whether people, links or tags.

Discovery and Exploration


Dogear has a very nice interface for exploring subscriptions and the networks that can arise among users. Furl and del.icio.us only concentrate on your subscriptions; it would be interesting however to also see those who subscribe to you. Further one can imagine lots of social network analysis tooling applied to the corpus of data to discover and suggest latent and implicit communities of interest.

Privacy


The 'social' in social bookmarking is a little at odds with selfish uses of bookmarking. Thus these applications encourage sharing and only grudgingly added the feature of private bookmarks. Now I'm a promiscuous bookmarker myself, I've never used private bookmarks but I can see that if I'm researching for a patent, I might not want others to see those links I'm gathering on a particular subject. Still it appears that most people don't use private bookmarks although, when available, a small minority do make use of it. All subscriptions are public by default in the spirit of openness yet perhaps one could make a case for limiting the visibility of subscriptions in the same way as bookmarks. The same applies to user profiles, you can pick and choose what aspects about yourself you expose. Bookmarks are not as sensitive as things like photos hence the concern for privacy is less pronounced. Eventually if the group features mature in this area there will likely be a movement beyond the public/private dichotomy to things like friends, family, and named interest groups. Selective disclosure perhaps.

Visualization


I'm only human. I like to slice and dice what I see to explore and discern patterns. One of the most important interfaces in social bookmarking is the page for a given uri. This is constantly being tweaked and designers have a hard task. They are trying to show the users who saved the link, the tags that were used, the titles and the history for that link while throwing in things like recommendations. del.icio.us recently had a makeover that is not entirely satisfactory. The idea they had was to split the screen into well-defined areas concentrating on comments and tags and use the length of the page to show the history.

delicious-ui


The bad thing is that they've split up the metadata for each posting except for the initial post (or if you've saved that bookmark, your own entry on the bookmark). They've removed the tags from the user notes for all other entries. Also they no longer show what title each person used. You remember Ruby's Postulate don't you? You know Sam Ruby's postulate that
The accuracy of metadata is inversely proportional to the square of the distance between the data and the metadata.
Here del.icio.us has succumbed to variant of that rule. The value of the metadata is reduced by being separated from the data. And indeed here there is also fragmentation of the metadata. I'd prefer to see everything in context. There's enough space to show the tags used alongside the user name, comments and title.

There's also those tag clouds, aren't they glorious?

my tag cloud dogear


Evolution


You want to see how tags vary over time and the frequency of activity but also if people are bothered enough to change the title when they entered. These are valuable things to know and indeed every such act should be celebrated.

Take the history of an article I wrote about On Gmail and DHTML architecture again. It was always DOM scripting to me but after 15 months, people had started tagging it as web2.0, webOS and bleach. You know: bleach, Bleached Unobtrusive DOM Scripting (BUDS). Fancy that, someone just came up with a snappy acronym and now people start lecturing you about things that you used to do, talking about "all you need is a bleach call" and everything will be better. Remember that Prince sang, "Put The Right Letters Together And Make A Better Day".

In visualizing the evolution over tags over time, I can imagine sparklines or perhaps another application of History Flow beyond the wikis that it was developed for. Or throw in some clustering and perhaps there could be a treemap. And perhaps there should be some animation written to dynamically show the evolution of tags. Moving images have always worked their magic.

Presence


You could probably make a case for making the names of users in pages active so that you can check their online status. Remember back when I was working on the person tag to integrate Sametime into K-station and WebSphere Portal? Yeah, it's the same idea, these days you throw in some microformat buzzword, decorate the name with an hCard something or other, throw in a contextual menu and voila, "people-enabled collaboration". Add some chat, screen sharing, profile viewing etc and you're all set. For bonus points, you can scope presence to the place, not just who's online but who's online and looking at this tag and throw in scoping to members of the current user's groups. Allow others to plug in their instant messaging systems and customize the contextual menu that is brought up and you're done. The rest is left as exercise for the eavesdropper but I'd note in passing Prior Art™ for anyone considering patenting such things.

Classification and Aggregation


Dogear has the concept of inside and outside, being able to scope a link to figure out if it is "inside" or outside the firewall. del.icio.us automatically classifies certain types of links such mp3s. You can imagine that you could present a different interface depending on what is represented by the link. If it's music, you might offer a nice link to sample the music, or buy the cd. This then gets into the issue of aggregation. In general, this argues for a generic and pluggable link classifier for other applications that want to embed these social bookmarking environments as components. Simply define the semantics of a special system tag and off you go. This arguably will allow for better-targeted user interfaces but we should also dwell on the commercial possibilities. As the Pet Shop Boys sang in Opportunities:
I've Got The Brains
You've Got The Looks
Let's Make Lot Of Money

You've Got The Brawn
I've Got The Brains
Let's Make Lot Of Money
Quel frisson de folksonomie. No wonder this stuff is hot.

Group Forming


del.icio.us allows you to suggest links to others using a special for:username tag. Dogear lets you comment on an entry. Furl builds in emailing of links thus fulfilling Zawinkski's Law. You're able to see people's names or identities and browse their links and tags. All of these gestures are ways to enable communities to form, conversations to begin and communication to flow. The photography and music sites do a much better job in the area of group forming but that is only because the content is intrinsically more interesting, bookmarks are not quite as amenable to groups, still there is much room for innovation. These services don't seem to allow you to easily discover see how many links or tags you have in common with someone. That's a feature that should be one click away. Flickr has group pools of photos with different levels of access public, private by invitation etc. Last.fm gives you shoutboxes on almost every page allowing you to comment as well as a journal. All of these leverage the tribal instinct and human propensity for orgiastic connection.

Metrics


We all seem to like statistics and there are many metrics that are interesting in this land: when things were first posted, how many people have bookmarked the same thing, who is most active, who discovers the most influential links, which tag is most popular etc. I'd like to be able to see the number of tags a user has. For example in Library Thing you'll see things like this
Tag info: The tag "current" is used 153 times by 42 users
Some of these however come to seen as popularity contests and therein lies the seed to a problem.

Attention, Arbitrage and Exploitation


The paradox of social bookmarking is that it provides considerable externalities to an ostensibly selfish endeavour. Since many of us use different computers during the day, it makes sense to have our bookmarks in the network cloud so that we don't have to deal with synchronization. These externalities mean that, like all social software, social bookmarking is prime for targeting by parasites. Arbitrage in inevitable in this environment since attention is important and a scarce commodity. Thus the mortgage and insurance tags will always get gamed by succubuses with commercial concerns and who can blame them since advertising pays. Reportedly the most expensive AdWords at Google are concerned with asbestos and mortgage refinancing and it stands to reason, we're all parasites. In my case, I hope I'm just a benign gnat on meryn's tags.

Moderation


All communities eventually need to add some filtering and moderation to keep the parasites at bay or at a tolerable level. That Clay Shirky keeps harping on the unbearable irksomeness of groups to the extent that he's trying to invent a pattern language for fighting group pathologies. That Christopher Allen thinks it's basically about the emotional amplification of text. Who knows? In any case, you'll eventually have to support flagging people as anti-social or detecting overly abusive behaviour or instituting the occasional calming periods. As group features come on board, there'll be more of an emphasis on moderation. I can also imagine a "Safe Tag"© or "Safe Bookmark"® mode just as with all search engines, something based on fuzzy notions of "community standards". Oh well, c'est la vie, it is a wild wide web.

Reconciliation


I could go on of course. But anyway all this is just beating around the bush, you understand this stuff now don't you? I've given you a folksonomy of social bookmarking off the top of my head. What more could you want?

Which reminds me, you aren't entirely blameless yourself. I've seen you seduced by the wiles of the social bookmarking scene. I saw you looking over my shoulder, spying on me as I bookmarked away these past years, saving urls to send to you on demand. And then I pointed you to Jon Udell's screencast on del.icio.us and it all clicked, that moving image thing again. You got all social scientist on me, "This could be very useful for my research". I saw you on Furl. I saw you on Flickr, I saw you on All Consuming. I saw you on 43 Things.

For you the attraction wasn't really the bookmark but rather the ability to save a copy of the page. So you can stash away things from when you're inside the campus network. I think that's why you're on Furl right? Anyway, I like that feature too, it comes in handy when lawyers or the Scientologists force people to remove their thoughts from the web. Anyway, now we're even. Don't hate me for my tags. You made me spill my guts and it turns out that you're just as selfish as me and you play the social bookmarking scene too.

I know you want to call me a social software slut but try to understand. Collaboration software has been my Lotus life, don't take that away from me. To paraphrase James Bond in Thunderball,
"You don't think I enjoyed what I did those evenings, do you? What I did was for Queen and metadata!"
Or like Dragnet, it's "Just the tags, Ma'am." That's right. That's what I'm saying.

Well anyway, with all that said, the reason I came forward today and confessed all this was that I took a big step yesterday, I feel a little guilty. Hmm... Yes I was seduced by that thing we call "integration on the glass". That's what they call it these days: it takes just one line of javascript in a webpage to bring those tags to life on a browser screen. So I put up a webpage last night. It displays my tags side by side with meryn's.

Now I promise I'll only look at the page once a month to check out that tag cloud of hers/his. I've worked out that even if more tags aren't added I have a good 25 years in which to assimilate that folksonomy.

I know we can work through this trying time. Come here, give me a hug. Sing with me.
"Spa-tu-laaaaa".
P.S. Cheers, meryn. I mean, "Cheers, Meryn".

[Ducks to avoid thrown cup of coffee]

Journal


Wait. Why are you laughing? After I've told you everything... I've come clean and you're standing there laughing at me. What's that behind your back? A book? What book? What's the title? It's about an affair? A social bookmarking affair? No... Oh. It's about Africa? And England? Let's see... Oh yeah, The Heart of the Matter by Graham Greene. I remember that. Good book. It's all about how things fall apart and come together again. Good choice. I'll tag it with "fiction, observation, insight, Africa, intimacy, perception, re-reading, things fall apart" in my All Consuming account. Yeah... I agree, it's a great book by a great writer. Graham Greene believed in personal triumphs and tragedies on a bite-sized scale. I fully agree, bite-sized is all one could hope for in the 20th century. He didn't get the Nobel Prize but he's quite the conflicted conscience of that bloodthirsty century, and memorable too in his own way. I wonder who's writing today's equivalent.

The Heart of the Matter

Music


You're turning on the stereo, plugging in your iPod... Hmmm. It would stand to reason that the soundtrack for this affair would be Cherrelle's 1990 album by that name.

Cherrelle - Affair


The best albums that Jam and Lewis produced (that is Jimmy Jam and Terry Lewis) were not necessarily the Janet Jackson ones, much as I loved Control and Rhythm Nation. The trio of albums that best defined their great take on the Minneapolis Sound were Alexander O'Neal's Hearsay, New Edition's Heartbreak, and the album I'll highlight here, Cherrelle's Affair. Each of these albums were concept albums: a party, the perils of fame, and an affair, respectively. The music however was all soul.

Cherrelle sings about the love affair she had with Randy Ran who was one of the musicians in the Flyte Tyme stable, a frequent collaborator over the years. It was a tumultuous affair and the album consequently runs the gamut of emotions; the song titles tell the tale. There was excitement, fun and ultimately heartbreak and you are privy to the various stages of the relationship. There's the irresistible seduction of Pick Me Up
If You Really Want My Love
Just Pick Me Up...
Be A Man And Make The First Move Towards Me
If I Say Yes, Don't Worry I'll Do All The Rest
Musically the arrangement is quite spare, a few drums, a funky bass and the occasional keyboards, the emphasis is on the soulful side of things. Then there's the conspiratorial imperative of Discreet with the driving drums sounding the alarm as in the temptation, vulnerability and exuberance of Looks Aren't Everything, the blistering album opener. The title track, Affair, is classic industrial funk, better than the contemporaneous tracks Janet was gifted by that production duo. Imagine the sentiment of Janet's Nasty doubled if you will. It is driven by a righteous anger in the chorus
"What Do You Call This Thing We Had?
Are You My Woman? Are You My Man?
I Don't Need Commitment,
I Don't Need A Man To Tell Me How To Feel"
The couple of tracks that are ligher weight such as What More Can I Do For You are still fun grooves on the dancefloor.

The ballads on the b-side, however, showcase some of the most heartfelt singing I've had the pleasure to hear. She sings of things she's lived through. Interestingly enough Randy Ran co-produces the most tumultuous trio of songs. Crazy is plaintive, the desperation and longing underlined with an amazing vocal performance. It's the kind of thing that tickles your sensibility. This is the Quiet Storm that Smokey Robinson sang about. At the end she dwells on the very real friendship that was at the core of the relationship, there's real pathos in My Friend and when the horns come in during the bridge you can't help but be moved. In Lucky she sings
I Dreamed All My Life For Mr. Right
But Mr. Wrong Always Seems To Come Along

Someday I'll Be As Lucky As The Next Girl
Some Way I Know Love Will Fill My Heart
When she bemoans that "Love has turned his back on me", Randy Ran's keyboards punctuate the feeling. Oh to have been a fly on the wall of that recording session. This is a slow burner with jazz inflections which distills raw emotion.

Everything I Miss At Home is the heart of the album and she continues her musical conversation with Alexander O'Neal in this glorious duet. This follows the earlier Saturday Love, I Didn't Mean To Turn You On, and Never Knew Love (Like This). He also appears on Keep It Inside another heartbreak featured on this album. These two wonderful soul singers were the Marvin Gaye and Tammy Terrell of the Eighties. They had a chemistry together, hearing them sing the line "Home Is Where The Heart Is Baby" gives me the chills to the day.

The reprise of Home is two instrumental minutes of soulful bliss to close out the album, floating pianos, lush keyboards, subtle bass, atmospherics etc. The kind of thing that Jam and Lewis always threw in to let you know that these were real thinking musicians who had paid all their dues in church and in long nights of performances and jam sessions. Thus the album ends wistfully in a contemplative mood. It is surely fitting that Graham Greene also wrote that wonderful novel called The End of the Affair. I find that simply sublime, perhaps because I too aspire to manufacture serendipity on this web.

The End of The Affair


Next in part 7: Angola.

File under: , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Wednesday, June 15, 2005

Calling Things By Their Names

So I heard that sanity has returned to these parts. [1]

Our marketing folks are now going to call Lotus QuickPlace, QuickPlace instead of whatever bland and insipid name that had been previously mandated. IBM Lotus Team-Workplace-something or-the-other?

Similarly Sametime will now be called Sametime instead of "IBM Lotus Instant Messaging and Web Conferencing". For a while the Lotus in that designation had been deprecated.

This probably portends that our marketing teams now better understand how to sell the Lotus portfolio. A few years ago, the perception from the trenches where I live was that there was a rush away from the land of Lotus simply because (in my estimation) it wasn't understood or didn't mesh well with the compensation structure of our sales teams. Presumably we've adjusted and now understand what these products are capable of instead of dismissing them out of hand.

Now when belts tighten in the IT industry (and right now, it is a deep retrenchment), people fall back on things that work, whether it is the glue, spackle or wrenches that I keep referencing. And much in the Lotus portfolio works even if it isn't pretty sometimes. And it works especially in the SMB space that is in the Long Tail of software. See our recent acquisitions of more Glue Layer People or even my recent hand-waving thoughts on Lotus Notes:

"For those unfamiliar with Notes/Domino, my handwaving elevator pitch is that it is a platform essentially based on the fundamental insight that a huge class of applications can be built based on just a few compositional building blocks: Forms, Views and a standard file format, the note in Notes terms. The brouhahas made about messaging, security, directory services, and all that paraphernalia that marketing people throw about when they pitch the platform to you are all syntactic sugar around the core competency of Forms and Views and the client and server processes that can manage them. A whole cottage industry of business partners are doing very fine thank you building custom and evolvable applications for businesses, small and large, everywhere. The fact that email can be construed as a forms application is just a side benefit and detracts from the real focus of the platform. This is much misunderstood by people whose only encounter with Notes is as a Mail client. It's really just a forms and view app for people and processes. Incidentally this same platform is most likely what is funding my current work and much of the IBM Software Group, even as resources are spent on other "sanctioned" and more "strategic" approaches. C'est la vie."

So that's the good news.

The not so good news:

Coincidentally the [redacted] domain was removed from the internal dns without notice sometime in the last 2 weeks. I was wondering for a few days why I coudn't couldn't post to [redacted product] or vnc into my development servers from home. I thought it was a temporary flaw and added temporary entries to my hosts file. Of course I eventually realized that nothing in the internal [redacted] hierarchy would ever resolve again that this was part of the reason why [redacted product] moved away from [redacted domain]to its current location at [redacted new location]

Some of us who had to jump through hoops to get static ip addresses like [redacted] were a little disgruntled for a good 15 minutes. Mr Feinberg even brought Godwin's law into the mix albeit with a smiley at the end of that invocation.

I guess it was approriate that the hard drive for that twilight zone machine died 2 days later. Cosmic justice or Sign of the times. These are strange days...

Now this was probably just a case of run-of-the-mill miscommunication, but let's remember that simple things like naming bring out the tribal instinct in people with sometimes shocking reactions... A lot of goodwill could well be lost.

Take for example the time 5 years ago when it was not announced that Lotus Development Corporation had been deincorporated and a good 7,000 people suddenly received payslips from the IBM corporation saying that they had received only their thousand or so dollars year-to-date (and it was mid-year). Indeed it was only months later, after prompting by an atypically tough question in an Lotus all hands meeting and seeing the quite hurt and vociferous articulation of pent-up feeling that the question belied that this was acknowledged in a subsequent prickly corporate message. Perhaps we were being babies (after all we were still getting paid), why should we care about trivial things like the name on our paycheck? I didn't attend said meeting but I caught the fallout since I just became "reverse-mentor" to [redacted executive] and had to explain why such things would matter to us "[redacted] folks"...

The identity of a community is to be found in the most unlikely of things. The things that draw people together to form a cohesive whole are not the explicit things that one thinks, it's not a kind of warlike territoriality or dedication to some mission statement or other, it is rather in small insignificant items that the tribal instinct is articulated.
People will rally round the most surprising items (Elian Gonzalez, OJ Simpson, Teri Schiavo) and they quickly become litmus tests. Think of some of the most intractable political conflicts (say Serbia/Croatia/Bosnia or and here I hesitate, I wonder who else will have an Israel/Palestine category on Blogcentral) and wonder whether the political, religious or economic arguments were really the cause of the conflict or if there weren't instead some more mundane hurt feelings that then blossomed into what we have seen and subsequently rationalized by opportunist political or religious hacks.

Or take this example form my part of the woods: for the past 9 years, Northern Ghana has been in turmoil because of an argument at a market stall over a chicken or guinea fowl (the historians will have to figure this out at some point). Two ethnic groups, the Dagbons and the Kokonbas who have lived peacefully together for centuries are now in open dispute. Many, many lives have been lost, and a huge amount of money, goodwill, diplomacy, cajoling and outright bribing has had to to done to try to cool things down and to get that part of the country to begin to contribute again to the rest of the community. This in a place that can ill afford such distractions. Now in my analogy, the guinea fowl is the stand-in for the name or for a dns entry.

All this to say that when nurturing communities, it is best to keep such sensitivities in mind and call things by their names. If not all those Sensational Fruity Delights might come home to roost.

Things come home to roost



Editors note: I posted this piece on May 18 on my internal blog but now that the information is no longer a rumour but has received confirmation, I decided to remove the embargo since it speaks to the tribal instinct in communities, something that interests me as an anthropologist of social software

File under: , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Tuesday, June 14, 2005

On The Long Tail of Music, Metrics and Recommendations

Responding to Chris Anderson's Bring tha Noise post with some commentary, some metrics from my music collection and pointers to artists who inhabit this Long Tail of music...

On The Long Tail of Music, Metrics and Recommendations


Some lunch break ego-surfing prompts this piece. Chris "Long Tail" Anderson tries to use real world data to validate some of his theorizing about music trends. Yours truly is one of the guinea pigs for this exercise in Bringing tha noise as he, and Public Enemy and Anthrax would have it. He's trying to figure out the signal to noise ratio in the fringe.

I seem to be a good source of metrics for this kind of thing because my tastes are not too mainstream and also because I augment my writing with lots of allusions and links to music and books that I champion or lean on to underline the slightest point. "Mining the cultural zeitgeist" is how I have described this tendency of mine when Jon Udell's metrics leaped out to me. I also tend to just use Amazon links which helps those seeking statistics. So then, what to say about the Long Tail of music?

First this: there's a difference between
  1. the things that I write about, and quote or link to (i.e. what you'll see if you mined this blog)
  2. the things I actually listen to or read
  3. the things I've bought - my entire collection of music and books
I recently wrote a piece On Recommendation Systems that is in much the same area as this Long Tail discussion.

On the matter of recommendation systems, a couple of comments are in order.
  • Leonard Richardson felt a little guilty that he hadn't spent time enhancing Ultra-Gleeper but that's the way things go, we're all stretched thin. Like he suggests, sometimes it's the idea that is important and not the embodiment in code, we see that all the time in technology. If one manages to give some intern somewhere an itch to scratch, as that paper should do, that is a contribution to knowledge and we are all the better for it.
  • Robert Jamison seems to have a made a great contribution in ideas (Searching, Sharing and Stumbling), if not in code (kindakarma.com) to the recommendation systems debate and points to a few others of note. I will be playing with said code and services in coming weeks
But back to Anderson and Udell's search for metrics...

One thing I didn't comment on in Jon's post was that he was looking at statistics of bloggers he reads who most frequently cite books on Amazon.com. The problem was that many of the links from this site are about music rather than books. This may have skewed his statistics a little.

In other words, what was required was some sort of link classifier to figure out what a link refers to (whether book, music cd, dvd etc.). The classifier would be like a regexp pre-processor that would figure out that, for example, a link to IMDB is probably about a movie in much the same way as the LibraryLookup project maps ASINS to APACS. I assume All Consuming uses the Amazon api to figure out what type a given item is (book, music, dvd, other). I continue to wonder if one can have a classifier that will determine when a link points to a person... All Consuming is in flux as they transfer to 43 Things and their old REST apis are orphaned in the transition but that product has an interesting take on link classification and tagging.

Items 2 (what I actually listen to) and 3 (what I've purchased) in the above list are also interesting.

I have a partial pass at item 2, what I actually listen to. You can check out my statistics at Audioscrobbler. I installed Audioscrobbler on my home machine and have been playing with it to figure out if its recommendation engine will prove useful, I'll report back in a couple of months. After a couple of weeks, it has me in quite good company on the basis of the 769 tracks I've played on the home computer.

With a music collection as large as I have, my listening habits tend to be
  • One third playlist-driven (I have numerous playlists for every mood as befits someone in the grip of musical obsession - thanks Gardner by the way for your kind comments and Autumn song playlist suggestions)
  • One third shuffle serendipity
  • The other third typically comes into play during shuffle; I'll hear something which will make me think of some other song and I'll do an ad-hoc thematic playlist, the problem is that I don't tend to save those tangential playlists borne of serendipity to feed back into the first category. I'm too lazy for that.
I'm a bit of an audiophile bigot and "can hear the difference" between original cds and even the 224 kbps VBR mp3 encodings I've done of my collection. Also some things have to be listened to loud (and one has to keep the neighbours on their toes every now and then). My computers haven't been hooked up to the big speakers and gleaming stereo system; the computer speakers are some generic $30 muffled fuzz boxes. Thus I need to get a Squeezebox, Audiotron or something although I'm a late adopter in such things. Thus, what is missing in the Audioscrobbler statistics is the music I listen to on my stereo. Still Audioscrobbler is a good proxy for much of my actual consumption of music.

On the topic of playlists, I'll be sharing some shortly so that others can get a sense of my beat matching juxtaposition insanity.

One problem with dealing with statistics from the blog is that for example, even though I'd estimate that 40 percent of my collection is jazz, I write about jazz only occasionally, like when I was Vibing with Abbey Lincoln or reminiscing about A Soul Jazz Thing with a belated appreciation of the late Jimmy Smith, or say alluding to Kamal (of The Roots) and his Ahmad Jamal keyboard stylings. There has only been one "proper posting" on jazz otherwise the allusions are all incidental say comparing Miles Davis's First Quintet to Rokia Traoré's band.

Jazz is less quotable and difficult to write about so perhaps that is why it wouldn't show up more readily in the statistics from the blog. Still the jazz idiom is a big part of my musical taste and outlook on life.

Metrics From My Music Collection


Anyway here is the data for number 3: I give you my music collection for your forensic analyses.

collection.m3u and collection.pls

My digitized music collection stands at 10,346 songs and amounts to 70.8 GB (about 36 days of continuous music). Note that this is larger than the largest iPod (hence my pause in not adopting that ubiquitous platform). I only ripped things that I liked so presumably one should add a good 50 percent filler for a fuller picture. I've been revisiting that notion since the Best Left Unread piece with a newfound appreciation of the bad things in my collection; disk space is cheap and I've just ordered a 250 GB spare hard drive to mitigate future disasters, that disk could be put to work.
Per contra I actually believe human psyches require a little imperfection.


Of the 1,527 artists therein, there were about 15 that were problematic (e.g. I'm sure there's no musician called Hawaii 5.0 or James Bond 007, to take some of the theme songs I occasionally play to spice things up, and similarly Ghana Highlife 1 to 10 are simply proxies for the unknowns I've picked up). I haven't digitized the 4 crates of records that I have lying about. That's a weekend project for this summer like my photo-digitization project of a few months ago (see Cultural Sensitivity in Technology)

Apparently there are 1,540 albums in the collection. I haven't quite diligent about tagging albums so 2,000 songs don't have album information. Handwaving a 10 song per album ratio that's another 200 albums, so lets say 1,750 albums). I'll fix that and update those files in the next few days.

Generating metadata for albums is difficult: what album would 50 Cent's blistering Jay-Z diss that was the talk of mixtapes in 2002 fall in? And there are also things that come from Greatest Hits, or Live albums as opposed to the original album, and I typically have multiple versions of things. I can't remember which version I actually ripped.

I am actually crazy to have spent cash money on most of these albums instead of downloading so if you assume that's $14,000 to $27982.50 (at $8 per album or $15.99 if I were to pay what record companies would prefer). Luckily I got a lot of these for free when I used to DJ and was on record company mailing lists, also I used Columbia House and BMG music zealously. Still that's a lot of money, I bought my first cd in 1992, previously it was all vinyl and tapes. I can't say that I've downloaded much from file sharing networks (I use Gnucleus). At the higher end of the scale of the cost estimates, $30,000 is a mortgage downpayment (well it was before this insane real-estate bubble that even leads to riots). Music companies should love me. I justify it by saying that my only hobbies are music and books; no drink, fast cars (I'm a public transport prole) or other flash.

I've tagged songs by genre but here you really want to be able to specify multiple tags just like in any of the new social software.

I suppose I should switch to iTunes to get an xml representation of these playlists. One of the bad versions of Winamp, the bloated one that which caused a backlash, used to export playlists in an xml format. That would have been better than m3u or pls. Still that is nothing that a capable regexp and Unix pipeline wizardry couldn't fix.

I'm still in disaster recovery mode but once I've got Cygwin set up, I'll be sure to download and install PlaylistManager and slice and dice the data with that Linux tool.

Anyway I hope this helps...

Full Force in the Long Tail


The obligatory musical note... While writing this note, I just rediscovered the wonderfully fresh sounds of Adriana Evans whose 1995 album for some reason didn't blow up (stupid record companies). Adriana Evans is the name that you drop when you want to put someone talking up Ashanti or Brandy in their place. Love is all Around and Seein' is Believing are some of the most laidback soul jams of all time.

Adriana Evans


Speaking of Seein' is Believin', how about Cheryl "Pepsii" Riley's (erstwhile of Thanks for my Child fame) song of the same name from 1988's Me, Myself and I album, produced by Full Force. That song is soul/funk perfection, much like Jerome Prister's sublime Say You'll Be that I recently found after 18 years.

Cheryl Pepsii Riley


And speaking of Full Force, what about that Hall of Fame production crew and House Party funkers? In recent years have been souping things up for Britney and Christine (you've got to pay bills). Their roots, like Jam and Lewis, are in pure soul and a hip-hop/funk aesthetic. Guess who's coming to the crib? is my favourite album of theirs although others preferred their eponymous debut album

Full Force


My picks in the Full Force canon
  • Your Love Is So Def
    My dad lost all respect for me when I used to sing this because he heard "deaf" in my loud singing rather than the 80s hip-hop notion of def.
  • Love Is For Suckers (Like You And Me)
    Shower crooners at school couldn't stop singing this song for weeks on end. Not to mention the lines we all primed to repeat on cue, their irresistible verbal tics:
    "Come on bust a move."
    "Full Force Get Busy One Time"
  • Take Care Of Homework
    "Yo homeboy, your girl looking kinda fly lately, know what I'm saying?"
    "No I don't know what you're saying."
    "What I'm saying is that she be like checking me out 'cos you been neglecting. D'you know what I mean?"
    "No I don't know what you mean!"
    "What I mean is that you better take care of homework or a dude like me will push up and take your place!"
    On the basis of the irreversibly funky break beat from Take Care of Homework, these brothers proved they were funky enough to revamp James Brown in his sadly neglected I'm Real album. The title track is a ferocious call to arms by The Godfather.

    James Brown is Real
  • I'd also note that their Smoove album is no spring chicken. It contains such gems as Ain't My Type Of Hype, the Smooved out title track and that phenomenal ballad, Kiss Those Lips. These are cases in point about the versatility of the crew
  • They gained fame with Alice, I Want You Just For Me with the famous opening.
    Testing, Testing One, Two
    Testing, One Two
    In The Place To Be...
    Girl I Want To Shower You With Diamonds And Pearls
    And When Were All Alone I'll Take You For A Trip Around The World
    Yes Indeed I Like Your Style
    Ooh You're Worth My While
    Baby, I'm Your Carpenter,
    Please Me Lay Your Tile
    I Don't Want To Share You With No Else
    Alice Be My Girl
    Can't You See?
    I Want You Just For Me?
    Full Force Get Busy One Time
  • Their repeated collaborations with Lisa Lisa & Cult Jam are also essential Spanish Fly.

    Lisa Lisa and Cult Jam with Full Force


    I Wonder If I Take You Home will still fill a dancefloor to this day.
    "Would You Still Be In Love, Baby?
    Because I Need You Tonight."
  • Their work with UTFO especially on Roxanne, Roxanne also gave rise to the legendary The Complete Story of Roxanne, those 103 responses to UTFO's 1985 novelty hit.

    The Story of Roxanne is one of the best stories of of the Long Tail of Music (the other great case in point is All Roads Lead to Apache).

    Roxanne, Roxanne brought to prominence The Real Roxanne and more importantly Roxanne Shante, possibly the best female MC of all time, Roxanne's Revenge will go down as the best response record of all time. One of my favourite songs of hers is Live on Stage which is Marley Marl's production at its best.

    Roxanne Shante
  • Full Force consolidated their fame with collaborations with Kid 'N Play in House Party and its two sequels. The movies were the inspired brainchild of the Hudlin Brothers, a decade before Barbershop.

    House Party


    Kid-N-Play 2 Hype


    Kid 'N Play were no slouches themselves even if they tended towards the pop side of the hip-hop spectrum. They were fun, their beats and lyrics focused on putting a groove in your step. More to the point, they could dance; at a time when Hip Hop was heading into inaccessible navel-gazing, they reminded everyone about the dance in Kool Herc's dancehall that was in the founding mythology of the music. As historians of Hip-Hop would write, break dancing (the B Boying and B Girling aesthetic) is an essential element - some would even term it the most important of the 4 elements of hip-hop, even more than MCing (rapping), DJing, and that maligned "social nuisance" element, Graffiti. Gittin Funky and Rollin' with Kid 'N Play will cause circles to form and Soul Train breakouts on the dancefloor. Funhouse is their best album and that's the spirit. And those flat tops!
Full Force have since cashed out of the soul side of things except to give some "urban" substance to blue-eyed pop, and who can blame them: "black" audiences are so fickle.

File under: , , , , , , , , , , , , , , , , , , , , , , , , ,

On Tags in Technorati

In the great tradition of blogging allowing one to cc the world, here's a short email to David Sifry and support@Technorati

Enhancements to Technorati Tags


Great to see the beginnings of tag aggregation at Technorati in the past few months, the beta UI is even better. It's a great glue layer solution, one that got me to tag the 100 or so posts I've written on my blog. One nitpick: you seem to give undue great prominence to tags that use the technorati.com namespace. From reading the guide to Technorati tags, I had thought that other namespaces using the rel=tag attribute would show up in the aggregation user interface, but they don't seem to, at least not yet... What gives?

In any case, I have a couple of enhancement requests:

For members who have claimed a blog, in addition to the cosmos for a given blog, please provide
  1. a list or "tag cloud" of all tags used by that blog (or link to said tag list or cloud)
  2. Also for members-only, and for claimed blogs only, I'd like to see the list of tags used for a given post
For example, if I tag my forthcoming post about those parasites that got my blog temporarily consigned to the "Spam Blackhole in Technorati" a couple of months ago with "blackholes, spam, technorati" I should be able to later on navigate and see the list of tags used and not just from my blog but also from technorati.

Ideally the tags should be listed as hyperlinks under the post (ala delicious) but I would settle for a nice new icon like the ubiquitous cosmos icon (great branding by the way). When clicked it would display the tags used.

Bonus points: display the list of tags others have used (extra credit) ranked by authority, or date. Some nice visualization could come into play also if one was to be ambitious to show the evolution of tags used over time. (And I'll buy you some Schnapps or Palm Wine).

I understand that such a feature would decrease performance since it ties the search engine more deeply with the tag aggregation engine. But it is so much nicer and promotes immediacy wouldn't you think? Being able to pivot on tags by simply clicking a link is very satisfying.

Bonus points, allow specification of uri parameters to slice and dice the tags, and blog posts, eg. being able to see all posts tagged with a given tag query. (with an option to specify internal tags and external). Your garden variety RESTful api at work here

I do that with del.icio.us as my poor man's categorization. For example, this is a link to my Cambridge Toli Chronicles

Lastly, and lowest on the totem pole of feature requests, how about some metrics about the tags used per blog. Statistics give some comfort to people. I'd like to know how many tags I've used. I can eyeball my tag list at delicious and figure out that its probably 100-200 or so (I'm so verbose). But I'm a lazy sort, and I believe in the Lazy Web.

A Technorati Tag Chat


P.S. don't you just love that Google has been so delinquent as to give you the opportunity to gain such a headstart not just in blog search but also now in tag aggregation since they don't even provide categories in Blogger. The current situation gives rise to chats like the following from just a few weeks ago:

Koranteng@Toli    did you mean this absurd sequence...< ol>
  • write a post...
  • post to blogger....
  • write tags in delicious (wait a few minutes to better get a sense of what to tag since, if you tag as you write, they aren't useful...
  • copy tags from delicious and generate technorati tags using technorati tag bookmarklet...
  • copy said technorati tags and paste in updated post to blogger...
  • and then if I feel like it (if I want to save it or if it is about to go into a for pay subscriber-only walled garden then furl my post copying keywords and navigating the awful ui for multiple topics therein...[Furl's UI for multiple topics is awful even though it could be easily fixed and I've sent suggestions to their support to no avail]
  • That's a twilight zone... not quite Orwellian but echoes of Beckett and Waiting for Godot

    JJMG    I have started three separate ST topics with you

    JJMG    (1) yes the absurd sequence although I thought it was
    1. add the technorati tags with the bookmarklet;
    2. copy the resulting tags out of the post and post your posting to delicious; I didn't know about furl
    JJMG    anyway, I can't believe how ridiculously many steps you have to make to post to your blog with tags

    JJMG    you'd think there would be a way to at least tag to delicious and technorati at once, and in fact these two postings imply that you can:

    JJMG    but you aren't using their technique

    JJMG    your HREFs at the bottom of your postings are all technorati hrefs

    JJMG    and then you just HAPPEN to post the same posting to delicious with the same tags

    Toli    all because Blogger doesn't implement categories.... I believe that typepad categories now get mapped to technorati tags...

    JJMG but those two pages imply that if you use HREFs that point to delicious, then they become technorati tags, but in fact it appears that they do not
    JJMG    (there is a rel="tag" thing in there which is supposedly what makes technorati think it's a tag
    JJMG    so, for instance, at the bottom of the freshblog's postings

    Toli    right but that is just technorati playing favourites in its aggregation ui to things that are 'proper' technorati tags

    JJMG    so at the bottom of the freshblog postings, all the hrefs are to http://del.icio.us/jrfj44
    JJMG    yours are all to technorati
    JJMG    yours actually work, but theirs don't, so I don't know why they document that theirs do
    JJMG    when I say yours "work" I mean that you can go to technorati.com/tag/ and you show up
    JJMG    when you do, say, technorati.com/tag/how-to, you don't get the freshblog thing in the technorati list, although you can get to it from the delicious list, so I kind of miss the point of what they are documenting in those two pages ...

    Toli    they might have but again technorati are the aggregator so they decide what happens... I really hope google buys all of these services up
    Toli    yep the spirit of the technorati inital proposal about the rel=tag implied the kind of flexibility but then reality stepped in

    JJMG    in fact those two postings I just sent you
    JJMG    they say
    JJMG    "I just learned that technorati tags do not need to actually link to technorati. This is important because for a while now I've been using delicious as a way to make categories on my blog posts. "
    JJMG    simply having the rel="tag" is supposed to make it a "technorati tag"
    JJMG    but -- again, the technorati UI doesn't seem to treat it the same way unless it really links TO technorati
    JJMG    anyway ...

    File under: , , , , , , , , , , , , , , , ,