Off the Top: Folksonomy Entries


October 3, 2020

Rebuilding My Note Taking and Management System and Model

The past many weeks I have been digging into a better note taking and management method, while also embracing what I have and my core underlying principles. A continual genre in YouTube I watch is around productivity, particularly around personal knowledge management methods and tools. A couple years back I ran into Zettelkasten Method, that comes from Niklas Luhmann, which focuses on his prolific reading and his card catalogue and related note taking system. Then a few months back I heard Jorge Arango’s interview with Beck Tench it drew Zettelkasten back into focus. The interview with Beck focussed on Tinderbox, which I love, but I also want mobile access to my notes from phone and tablet.

Early Exploration

I have been using Notion a little bit, but my only use the last few months is as an interstitial capture for YouTube and some other rich media. [I like Notion and it seems like a modern take on Podio and has a similar downfall of not sorting out an adaptive data structure for interoperability and consistency.] But, the communities that are interested in Notion became obsessed with Roam Research, so I looked at Roam. Roam and Notion are two vastly different approaches, which can complement each other but in to way replace each other. But, each has a similar faults, no API, no standard export for structured information, and fully cloud based. That is too many common failure points wrapped into one product (Notion is working on and API, which is really good). Roam bugged me most because it relies on an outline format but has no clue about OPML exporting, but worse has no good export model. The cloud based, which requires being connected and online is a model I really don’t like as, particularly if their isn’t a local sync nor standard data format model. What I really like about Roam is its block focussed format, that is akin to purple numbers model of small chunks that are addressable and reusable.

In this time of looking what a next generation of quick note taking would look like, but long used tool, NValt failed spectacularly, in that it would not find my directory where my 1,200+ notes were stored, nor could I add new notes. Fortunately all of my notes are in plain markdown text files, so all I was missing was my tagging of the files in NValt (Brett Terpstra who created NValt has been working on a new tool that can replace NValt but has been taking forever to show up and my need became immediate). This is one of the common reasons for owning my own notes and having them locally and not using somebody else’s model and framework. But, also using the [small apps loosely joined] model where many tools pointing at well formatted / structured data / information can function to their best ability and can use their strengths without breaking anything with the information / data.

Seriously Looking at Note Taking and Management Tools

I started looking at about five or six different note taking tools. I was building out a rough attribute model of tools to help see what each offered or didn’t. I am needing to write this up, but it started with watching Mike and Matty’s, Notion vs Roam vs Obsidian vs Remnote - How to best fit note taking app for you and using their criteria as a base, then building on it. Obsidian and Remnote were already on my list, but also included Zettelnote, Zettlr, and a couple that extended Tidlywiki for a Zettelkasten type model. I also included OmniOutliner as that has been (and will be) my core outlining tool that interplays well with OPML and I can back and forth with good mind mapping tools that also output and import OPML data standard. I also included DevonThink Pro as it is my long used (since 2005) note and information storage and smart search tool (it already was indexing my notes directories) that there is no chance I’m going to give up, but also knew it didn’t have the core functionality I was seeking, wiki-style back linking.

I did a quick test or Roam and ruled it out as it broke rules I try not to break, and it broke many of them (biggest one is know now you are going to exit before you enter anything and a lack of any structure nor API made it a giant risk I’ve been burned by too many times, but the developers have a lot of arrogance about their approach that far too often leads to disasters - sometimes the kindest, smartest, and solid planning people end up with disasters that I feel very badly about but arrogance and ignorant I don’t).

Zettlr and Remnote were next. But the setup took a bit more of me managing and building things and I know when I lose focus those may not be best choices for myself (my past self 15 years ago or more would have loved it and done well with it, but those days are not now).

Obsidian Ticks the Right Boxes and Adapts to My Existing Model

Obsidian is where I put some time. I pointed its “Vault” to my notes directory (and sub-directory) where I had my 1,200 markdown notes already (some of them were .txt extensions, which I did bulk extension swap on) and it could read everything perfectly. One of my first tests was adding backlinks to some of my social lenses and social scaling notes, which worked really well by making related elements connected. I started capturing my notes about what I was doing in Obsidian and the ease of not only connecting things with backlinks, but having the ability to set empty node wiki links (many notes with the same link to a note / page that doesn’t exist yet, but have the same link to it) and then being able to use backlink following from that non-existent notes link list of things pointing to it was insanely valuable.

I have quite a few book list and book note pages already and I started linking them and linking authors and making author pages. I also found I was wanting note page templates for simple book pages in a Zettelkasten model, a book notes template, author / creator template, and a few others. I created these from existing structured notes I’ve used for years and put the outlines in TextExpander using a simple input line or two to label all of the headers with author name or other name.

I started typing out my notes and highlights from books I’ve read and annotated over the years and after the first three or so books I was deeply hooked.

The Use Where Obsidian Showed I was Hooked

Where I knew I was sold was this last weekend I went back to one of Matt Webb’s blog posts on Small Groups that is dense and has links out to great resources. I captured my initial notes on Matt’s post, and annotated relating to his sections. But, I also quickly dug through the linked materials and created and filled out structured note pages for those as well. The James Mullholland post on Small Groups was fantastic and it spidered out to more related resources, so I followed those and took notes. All of this was cross-linked and back-linked and fleshed out small group notes that I have been building as part of social scaling I’ve been writing on and presenting (talks and workshops) for years. The small group size they focus on is roughly team size, but not a team. Both of these are cooperative social models, which scale from teams, groups (small to large groups with similar social interaction models, but the dynamics shift quite a bit around 75 people and break fully about 300 to 500 people), community (everybody inside a firewall or inside an walled off construct), and network (inside and outside a firewall - so for business it is customers, contractors, consultants, vendors, etc. where there needs to be a safe model for sharing information with shared goals as different roles with their purpose come together for back and forth exchange) - more can be found in my related write-up 5 Core Insights for Community Platforms Today.

This note taking and contextualizing and cross linking to rip through and gut a series of related and interrelated pieces has been something I’ve long looked for and wanted. Many dog years ago in college I took reading notes on note cards with citations and context. When writing a paper / essay I would assemble the note cards in an order that could tell a story. Then I would build an outline in WordStar and type in the quotes. Then I would write the narrative and wrapper. Obsidian is starting to get at that, but ripping through a resource to pull out highlights, quotes, annotations, and notes is utterly fantastic. It gives me a solid resource to easily pull together ideas and supporting information.

Other Obsidian Capabilities

Obsidian can show two note pages at once so to easily copy book citation information from the structured book note file into the book note page. The multiple notes in panels also works well for copying quotes to quote pages and cross linking.

Using Obsidian and Still Working from Mobile and Tablet

The mobile use essential had been broken for a bit after Dropbox stopped supporting softlinks in Mac and requiring that to be native in Dropbox and doing the softlink from the Mac to Dropbox. I moved the directory to Dropbox, which leaves a copy locally usable should something happen to Dropbox and added a softlink for local backups. I pointed DevonThink to this directory to index and I was back running. Now I can use Drafts to take a quick note from my iOS devices and push it to the notes directory (later go back and fix the file name) and I have good inbound notes and can use backlinks (which I test later). This method also works for share sheet to Drafts from Overcast or YouTube and having the link to the media and the notes all pulled in.

Happiness with notes has been missing for a while, perhaps happiness has returned.

Resources



July 7, 2018

The Sidebar is the New Back Bar

Back in the days when I had time to hangout with friends for drinks, many places had a “back bar” that was more quiet and private.

I haven’t been in the habit of posting here as much as I used to, but I still am putting things into Pinboard and somethings I flag with “linkfodder”, which is my relatively unique tag to pull out favorites. I use the API from Pinboard to pull the linkfodder tagged items into the sidebar here. Occasionally I annotate them and that is brought here as well. This sidebar mini blog feels sort of like the back bar, which is a little more quiet and calm and you can see some things of interest to me (if that is of interest to you) and track them down.



August 8, 2017

Mac and iOS Tagging with Brett Terpstra

If you are still following along here it is likely in hopes of something related to tagging or folksonomy (I have a stack of folksonomy and tagging things piled up, but not written-up) so today you win.

This week’s Mac Power Users is an interview on tagging with Brett Terpstra. This episode digs deep into what is coming in iOS and current state of tagging on Macs. While things are mostly tagging standards based, the implementations are still a bit on the manual and geek scripting side of things.

I am deeply excited about iOS getting tags that come over from Mac, which is why I have been tagging things for the past few years. I have been playing the long game with MacOS tagging in hopes that it would also sync to iOS. Years back I was really certain (the kind of certain driven by hope, more than knowing) Mac was going to provide a tag only option, which was going to be really good, as files have multiple contexts and tags can adapt for that reality (which is far closer to life than nested folders).

While we never got the world I swore was going to be the next logical step, or at least as an option, we do have something interesting now. It will be more capable and usable in the next few months with the iOS 11 and the next MacOS update, High Sierra. If this is your thing, give Brett’s sit down with MacSparky and Katie a go and you are more than likely going to find one or more tip to up your game, if not get much more out of it.



March 28, 2015

Inviewed on Shift Podcast

On Friday I had the pleasure of spending about an hour with two of my favorite people, Euan Semple and Megan Murray on the wonderful podcast, Shift. We covered tagging, taxonomies, meaning, power, and the future that we are all hurtling towards.

I am a big fan of their interviews (as their conversations between them are familiar from past conversations between us) with other. I still have a few to get to.



March 18, 2015

Blogfodder and Linkfodder

Not only do I have a blogfodder tag I use on my local drive and cross device idea repositories and writing spaces, but I have a linkfodder marker as well.

Blogfodder

Blogfodder are those things that are seeds of ideas for writing or are fleshed out, but not quite postable / publishable. As I wrote in Refinement can be a Hinderance I am trying to get back to my old pattern of writing regularly as a brain dump, which can drift to stream of consciousness (but, I find most of the things that inspire me to good thoughts and exploration are other’s expressions shared in a stream of consciousness manner). The heavy edit and reviews get in the way of thought and sharing, which often lead to interactions with others around those ideas. I am deeply missing that and have been for a few years, although I have had some great interactions the last 6 months or so.

I also use blogfodder as a tag for ideas and writing to easily search and aggregate the items, which I also keep track of in an outline in OmniOutliner. But, as soon as I have posted these I remove the blogfodder tag and use a “posted” tag and change the status in OmniOutliner to posted and place a link to the post.

Linkfodder

Linkfodder is a term I am using in bookmarking in Pinboard and other local applications. These started with the aim of being links I really want to share and bring back into the sidebar of this blog at vanderwal.net. I have also hoped to capture and write quick annotations for a week ending links of note post. That has yet to happen as I want to bring in all the months of prior linkfoddering.

I have been looking at Zeef to capture the feed from my Pinboard linkfodder page and use a Zeef widget in my blog sidebar. I have that running well on a test sight and may implement it soon here (it is a 5 minute task to do, but it is the “is it how I want to do it” question holding me back). In the past I used Delicious javascript, which the newest owners of Delicious gloriously broke in their great unknowing.

The Wrap

Both of these are helping filter and keep fleeting things more organized. And hopefully execution of these follows.



December 2, 2014

30 Days Had November

Well the attempt to blog every day in November didn’t get as much wind in its sails as I had hoped it would have. November had 30 days, but I had far fewer posts than 30. I didn’t get a new habit set. But, I am not yet deterred as I am keeping this attempt going.

One of the things I’ve thought about doing is doing a weekly link dump of items I found of interest through out the week. These are some of my favorite week end reads when I curl up with the laptop (or iPad), a cup of coffee and a blanket. I have long been a fan of Om’s weekend delivery of his 5 (or 7) things to read this weekend as they are nearly always high quality, in depth, and decent (meaning on the longer side) length. I’ve also grown to head toward Josh Ginter of “The Newsprint” weekly “The Sunday Edition” link dump of the week. Recently Michael Sippy has been back sharing on the web (just like the days of yore) and his Filtered Week series on Medium is an annotated link list gem.

One of the reasons I have been considering this (and actually tucking links away for posting) is the past few weeks I realized my blog’s link list on the side of this blog that was posted from Delicious is now dead and gone. The link roll that was a staple of Delicious from 2004 or so was nuked with many other helpful features and functionality that kept Delicious as one part of my workflow. I moved most of my social bookmarking to Pinboard a few years back, but I still fed Delicious and then Delicious fed Pinboard. Well, that was the case until the new owners of Delicious (sadly Delicious gets passed around the IT community like a hot potato with each new owner thinking they are going to update it and improve it, yet lack a rat’s clue of the basics nor how to keep (now kept) the workings that underpin many parts of the web running) fumbled things and Pinboard stopped automatically ingesting Delicious. I really missed the change at Pinboard (was heads down on a project when that happened), but now all my social bookmarking is happening there.

The lack of a link sidebar is the push to share things that I find as gems from the week. I could repoint the Delicious javascript to Pinboard, but Pinboard also captures all my starred / favorited items (I don’t use starring in Twitter as a favorite, but more of a hook for things to hold on to and / or come back to) and things favorited in Instagram, and imports from other services. Pinboard, because I use the paid archive service is an endpoint that serves also as a place to do full text search of the items bookmarked there. Until I can sort out a good filter or means of tagging in my workflow, I am keeping the link list off the sidebar. But, in its place I am likely going to do a weekly link list.



January 16, 2014

Brett Terpstra Focusses on His Work Full-time

I have been a fan of Brett Terpstra for some time. I found his site through a few buds who focus on productivity and personal workflows (including scripting). I have followed his Systematic podcast since the first episode and have found it is the one podcast I listen to when my weekly listening dwindles to just one podcast. His nvALT became an app that is always running and where a lot of writing snippets get stored on my Mac (that content I also reach on my iOS devices to edit and extend). His Marked2 app not only is my Markedown viewer, but a rather good writing analysis tool.

Not only all of this but Brett is a tagger and not only tags, belives tagging is helpful for personal filtering and workflow, but has built tools to greater extend tagging in and around Mac and iOS. If you talk folksonomy and pull the third leg of it, person / identity back into just your own perspective and keep the tag and objects in place you have the realm that Brett focusses and pushes farther for our own personal benefit.

Brett Steps Out to Focus on His Work

This week I have been incredibly happy to learn that Brett moved out of his daytime job to and his new job is to focus on his products, podcast, writing, and new projects and products. This is great news for all of us. Brett took this step before, but we can help him keep these tools and services flowing by supporting him.

If you have benefitted from Brett’s free products of want to ensure the great services and tools that Bret has created you paid for keep improving go help him out.



December 31, 2010

Closing Delicious? Lessons to be Learned

There was a kerfuffle a couple weeks back around Delicious when the social bookmarking service Delicious was marked for end of life by Yahoo, which caused a rather large number I know to go rather nuts. Yahoo, has made the claim that they are not shutting the service down, which only seems like a stall tactic, but perhaps they may actually sell it (many accounts from former Yahoo and Delicious teams have pointed out the difficulties in that, as it was ported to Yahoo’s own services and with their own peculiarities).

Redundancy

Never the less, this brings-up an important point: Redundancy. One lesson I learned many years ago related to the web (heck, related to any thing digital) is it will fail at some point. Cloud based services are not immune and the network connection to those services is often even more problematic. But, one of the tenants of the Personal InfoCloud is it is where you keep your information across trusted services and devices so you have continual and easy access to that information. Part of ensuring that continual access is ensuring redundancy and backing up. Optimally the redundancy or back-up is a usable service that permits ease of continuing use if one resource is not reachable (those sunny days where there's not a cloud to be seen). Performing regular back-ups of your blog posts and other places you post information is valuable. Another option is a central aggregation point (these are long dreamt of and yet to be really implemented well, this is a long brewing interest with many potential resources and conversations).

With regard to Delicious I’ve used redundant services and manually or automatically fed them. I was doing this with Ma.gnol.ia as it was (in part) my redundant social bookmarking service, but I also really liked a lot of its features and functionality (there were great social interaction design elements that were deployed there that were quite brilliant and made the service a real gem). I also used Diigo for a short while, but too many things there drove me crazy and continually broke. A few months back I started using Pinboard, as the private reincarnation of Ma.gnol.ia shut down. I have also used ZooTool, which has more of a visual design community (the community that self-aggregates to a service is an important characteristic to take into account after the viability of the service).

Pinboard has been a real gem as it uses the commonly implemented Delicious API (version 1) as its core API, which means most tools and services built on top of Delicious can be relatively easily ported over with just a change to the URL for source. This was similar for Ma.gnol.ia and other services. But, Pinboard also will continually pull in Delicious postings, so works very well for redundancy sake.

There are some things I quite like about Pinboard (some things I don’t and will get to them) such as the easy integration from Instapaper (anything you star in Instapaper gets sucked into your Pinboard). Pinboard has a rather good mobile web interface (something I loved about Ma.gnol.ia too). Pinboard was started by co-founders of Delicious and so has solid depth of understanding. Pinboard is also a pay service (based on an incremental one time fee and full archive of pages bookmarked (saves a copy of pages), which is great for its longevity as it has some sort of business model (I don’t have faith in the “underpants - something - profit” model) and it works brilliantly for keeping out spammer (another pain point for me with Diigo).

My biggest nit with Pinboard is the space delimited tag terms, which means multi-word tag terms (San Francisco, recent discovery, etc.) are not possible (use of non-alphabetic word delimiters (like underscores, hyphens, and dots) are a really problematic for clarity, easy aggregation with out scripting to disambiguate and assemble relevant related terms, and lack of mainstream user understanding). The lack of easily seeing who is following my shared items, so to find others to potentially follow is something from Delicious I miss.

For now I am still feeding Delicious as my primary source, which is naturally pulled into Pinboard with no extra effort (as it should be with many things), but I'm already looking for a redundancy for Pinboard given the questionable state of Delicious.

The Value of Delicious

Another thing that surfaced with the Delicious end of life (non-official) announcement from Yahoo was the incredible value it has across the web. Not only do people use it and deeply rely on it for storing, contextualizing links/bookmarks with tags and annotations, refinding their own aggregation, and sharing this out easily for others, but use Delicious in a wide variety of different ways. People use Delicious to surface relevant information of interest related to their affinities or work needs, as it is easy to get a feed for not only a person, a tag, but also a person and tag pairing. The immediate responses that sounded serious alarm with news of Delicious demise were those that had built valuable services on top of Delicious. There were many stories about well known publications and services not only programmatically aggregating potentially relevant and tangential information for research in ad hoc and relatively real time, but also sharing out of links for others. Some use Delicious to easily build “related information” resources for their web publications and offerings. One example is emoted by Marshall Kirkpatrick of ReadWriteWeb wonderfully describing their reliance on Delicious

It was clear very quickly that Yahoo is sitting on a real backbone of many things on the web, not the toy product some in Yahoo management seemed to think it was. The value of Delicious to Yahoo seemingly diminished greatly after they themselves were no longer in the search marketplace. Silently confirmed hunches that Delicious was used as fodder to greatly influence search algorithms for highly potential synonyms and related web content that is stored by explicit interest (a much higher value than inferred interest) made Delicious a quite valued property while it ran its own search property.

For ease of finding me (should you wish) on Pinboard I am http://pinboard.in/u:vanderwal

----

Good relevant posts from others:



September 28, 2010

As If Had Read

The idea of a tag "As If Had Read" started as a riff off of riffs with David Weinberger at Reboot 2008 regarding the "to read" tag that is prevalent in many social bookmarking sites. But, the "as if had read" is not as tongue-in-cheek at the moment, but is a moment of ah ha!

I have been using DevonThink on my Mac for 5 or more years. It is a document, note, web page, and general content catch all that is easily searched. But, it also pulls out relevance to other items that it sees as relevant. The connections it makes are often quite impressive.

My Info Churning Patterns

I have promised for quite a few years that I would write-up how I work through my inbound content. This process changes a lot, but it is back to a settled state again (mostly). Going back 10 years or more I would go through my links page and check all of the links on it (it was 75 to 100 links at that point) to see if there was something new or of interest.

But, that changed to using a feedreader (I used and am back to using Net News Wire on Mac as it has the features I love and it is fast and I can skim 4x to 5x the content I can in Google Reader (interface and design matters)) to pull in 400 or more RSS feeds that I would triage. I would skim the new (bold) titles and skim the content in the reader, if it was of potential interest I open the link into a browser tab in the background and just churn through the skimming of the 1,000 to 1,400 new items each night. Then I would open the browser to read the tabs. At this stage I actually read the content and if part way through it I don't think it has current or future value I close the tab. But, in about 90 minutes I could triage through 1,200 to 1,400 new RSS feed items, get 30 to 70 potential items of value open in tabs in a browser, and get this down to a usual 5 to 12 items of current or future value. Yes, in 90 minutes (keeping focus to sort the out the chaff is essential). But, from this point I would blog or at least put these items into Delicious and/or Ma.gnolia or Yahoo MyWeb 2.0 (this service was insanely amazing and was years ahead of its time and I will write-up its value).

The volume and tools have changed over time. Today the same number of feeds (approximately 400) turn out 500 to 800 new items each day. I now post less to Delicious and opt for DevonThink for 25 to 40 items each day. I stopped using DevonThink (DT) and opted for Yojimbo and then Together.app as they had tagging and I could add my context (I found my own context had more value than DevonThink's contextual relevance engine). But, when DevonThink added tagging it became an optimal service and I added my archives from Together and now use DT a lot.

Relevance of As if Had Read

But, one of the things I have been finding is I can not only search within the content of items in DT, but I can quickly aggregate related items by tag (work projects, long writing projects, etc.). But, its incredible value is how it has changed my information triage and process. I am now taking those 30 to 40 tabs and doing a more in depth read, but only rarely reading the full content, unless it is current value is high or the content is compelling. I am acting on the content more quickly and putting it into DT. When I need to recall information I use the search to find content and then pull related content closer. I not only have the item I was seeking, but have other related content that adds depth and breath to a subject. My own personal recall of the content is enough to start a search that will find what I was seeking with relative ease. But, were I did a deeper skim read in the past I will now do a deeper read of the prime focus. My augmented recall with the brilliance of DevonThink works just as well as if I had read the content deeply the first time.



September 22, 2010

Return to the Blog and Life

Things have been quiet here? Um, yes they have. The past couple years have been full of changes and struggles. It seemed that just as things were turning from a rough stretch on personal and work front, something would rise up and cripple that forward progress.

This past year it was my dad calling in June of 2009 saying he cancer of the stomach that had spread to the liver. He seemed to improve quite a bit by Christmas of 2009 as he and my mom came back to visit, which was quite wonderful. But, on the return home he started not doing well and they found a tumor on his brain. Things stopped improving after this and it became a bit of a rough road for him. Not paying close attention to my own well being it really had an impact on me. He was my best buddy and I knew time was running short.

In July of this year my dad died and while it was really hard to comprehend and sad, it was also freeing. Not only did that concern and un-noticed energy focus had shifted, but I also had the focus that the safety net of parents love, guidance, and all types of parental support had sifted from a set of two, to just one. But, I realized I still had two feet and put that energy and time back into work.

Time Spent Digging

During the past couple years during all the change and struggle, I've spent a lot of time sorting through the things I am deeply passionate about, which are many and fit wonderfully with the work I do. I have spent a lot of time digging quite deeply into social software and the whys and how it works, but more intrigued where it doesn't with the 90% of the world that make up the mainstream. I have a lot of writing I haven't posted or shared on this, but have some of it in workshops and presentations I have done in the past couple years. That will likely be finally getting posted over at Personal InfoCloud.

Over many years and as part of my formal education I have read much of the usual corpus of social theorists, whom I always finding myself having to set aside reality to embrace the theorists models enough to understand them, but then come back to reality and they don't fit as well as a whole. I've always been mindful of them, but as I have been digging back into my older frameworks of the Model of Atraction and Come to Me Web and how they helped me work through and understand interactions with information on the web and beyond to build and frame next generation services, along with helping others do the same.

This review and digging has lead me to a lot of understandings and realizations around the social web and echos all the years of building, managing, iterating, and maintaining social tools. The same problems always surface, which are the tools don't really allow humans to be social like humans are social with out a mediated interface. But there are basic understanding of how humans are social through tools as mediated interfaces that is counter to many of the ways many of the tools and services are developed and provided.

Now mixing the older Model of Attraction and come to me web frameworks for thinking with the models and understandings I have come to in the past few years regarding social software have really gelled. These ideas will be getting out there and have been the fodder for client work that is resurfacing now that the economy has become out of its dire state (for now).

About that Book

As many know I was writing a book on folksonomy for O'Reilly. That book hit a wall (no, not a Vander Wal), or a few of them and I was notified O'Reilly would not be publishing it. Early in writing it I got stumped by many things that I was seeing as they did not fit any of the social models being touted as core to understanding social in the Web 2.0 sense. It took me about 18 months to deconstruct all of what I knew, what others knew, and get to models I could use to think through some of the really strong values people were finding and the problems that people were having that seems completely counter to "how the social web works&qout;.

Following this there were many changes happening in my personal life that took attention and focus. But, at the same time the services and tools were changing drastically. Many of the really good tools that were addressing the hard problems, but not popular were shutting down. This was also happening for the tools for organizations to purchase and use internally (where my main focus has been). But, content for the book is still moving forward and I am looking for a publisher that fits well for it. Now that SharePoint 2010 has social bookmarking / tagging in it (although a really really rough interface for it) the book has much more value, so people deploying it can have a much better understanding of what is really needed to have it help remove the huge problem organizations face, of not being able to find and refind information they are sure they have when they need it. But, I am also free to blog much of what was heading into the book so it can get feedback and more eyes honing it.

Back Blogging?

Yes! I am back blogging. More non-work type posts will be here at Off the Top and work related content is over at Personal InfoCloud, but also am dropping odd bits in my Tumblr vanderwal blog. I am likely going to change the platform under this blog to something that I did not write in 2001 sometime in the next couple of months (nearly 2,000 post and categories to transfer).



June 27, 2009

Social Design for the Enterprise Workshop in Washington, DC Area

I am finally bringing workshop to my home base, the Washington, DC area. I am putting on a my “Social Design for the Enterprise” half-day workshop on the afternoon of July 17th at Viget Labs (register from this prior link).

Yes, it is a Friday in the Summer in Washington, DC area. This is the filter to sort out who really wants to improve what they offer and how successful they want their products and solutions to be.

Past Attendees have Said...

“A few hours and a few hundred dollar saved us tens of thousands, if not well into six figures dollars of value through improving our understanding” (Global insurance company intranet director)

From an in-house workshop…
“We are only an hour in, can we stop? We need to get many more people here to hear this as we have been on the wrong path as an organization” (National consumer service provider)

“Can you let us know when you give this again as we need our [big consulting firm] here, they need to hear that this is the path and focus we need” (Fortune 100 company senior manager for collaboration platforms)

“In the last 15 minutes what you walked us through helped us understand a problem we have had for 2 years and a provided manner to think about it in a way we can finally move forward and solve it” (CEO social tool product company)

Is the Workshop Only for Designers?

No, the workshop is aimed at a broad audience. The focus of the workshop gets beyond the tools’ features and functionality to provide understanding of the other elements that make a giant difference in adoption, use, and value derived by people using and the system owners.

The workshop is for user experience designers (information architects, interaction designers, social interaction designers, etc.), developers, product managers, buyers, implementers, and those with social tools running already running.

Not Only for Enterprise

This workshop with address problems for designing social tools for much better adoption in the enterprise (in-house use in business, government, & non-profit), but web facing social tools.

The Workshop will Address…

Designing for social comfort requires understanding how people interact in a non-mediated environment and what realities that we know from that understanding must we include in our design and development for use and adoption of our digital social tools if we want optimal adoption and use.

  • Tools do not need to be constrained by accepting the 1-9-90 myth.
  • Understanding the social build order and how to use that to identify gaps that need design solutions
  • Social comfort as a key component
  • Matrix of Perception to better understanding who the use types are and how deeply the use the tool so to build to their needs and delivering much greater value for them, which leads to improved use and adoption
  • Using the for elements for enterprise social tool success (as well as web facing) to better understand where and how to focus understanding gaps and needs for improvement.
  • Ways user experience design can be implemented to increase adoption, use, and value
  • How social design needs are different from Web 2.0 and what Web 2.0 could improve with this understanding

More info...

For more information and registration to to Viget Lab's Social Design for the Enterprise page.

I look forward to seeing you there.

Reblog this post [with Zemanta]


January 25, 2009

Optimizing Tagging UI for People & Search

Overview/Intro

One of my areas of focus is around social tools in the workplace (enterprise 2.0) is social bookmarking. Sadly, is does not have the reach it should as it and wiki (most enterprise focused wikis have collective voice pages (blogs) included now & enterprise blog tools have collaborative document pages (wikis). I focus a lot of my attention these days on what happens inside the organization’s firewall, as that is where their is incredible untapped potential for these tools to make a huge difference.

One of the things I see on a regular basis is tagging interfaces on a wide variety of social tools, not just in social bookmarking. This is good, but also problematic as it leads to a need for a central tagging repository (more on this in a later piece). It is good as emergent and connective tag terms can be used to link items across tools and services, but that requires consistency and identity (identity is a must for tagging on any platform and it is left out of many tagging instances. This greatly decreases the value of tagging - this is also for another piece). There are differences across tools and services, which leads to problems of use and adoption within tools is tagging user interface (UI).

Multi-term Tag Intro

multiterm tag constructionThe multi-term tag is one of the more helpful elements in tagging as it provides the capability to use related terms. These multi-term tags provide depth to understanding when keeping the related tag terms together. But the interfaces for doing this are more complex and confusing than they should be for human, as well as machine consumption.

In the instance illustrated to the tag is comprised or two related terms: social and network. When the tool references the tag, it is looking at both parts as a tag set, which has a distinct meaning. The individual terms can be easily used for searches seeking either of those terms, but knowing the composition of the set, it is relatively easy for the service to offer up "social network" when a person seeks just social or network in a search query.

One common hindrance with social bookmarking adoption is those familiar with it and fans of it for enterprise use point to Delicious, which has a couple huge drawbacks. The compound multi-term tag or disconnected multi-term tags is a deep drawback for most regular potential users (the second is lack of privacy for shared group items). Delicious breaks a basic construct in user focussed design: Tools should embrace human methods of interaction and not humans embracing tech constraints. Delicious is quite popular with those of us malleable in our approach to adopt a technology where we adapt our approach, but that percentage of potential people using the tools is quite thin as a percentage of the population.. Testing this concept takes very little time to prove.

So, what are the options? Glad you asked. But, first a quick additional excursion into why this matters.

Conceptual Models Missing in Social Tool Adoption

One common hinderance for social tool adoption is most people intended to use the tools are missing the conceptual model for what these tools do, the value they offer, and how to personally benefit from these values. There are even change costs involved in moving from a tool that may not work for someone to something that has potential for drastically improved value. The "what it does", "what value it has", and "what situations" are high enough hurdles to cross, but they can be done with some ease by people who have deep knowledge of how to bridge these conceptual model gaps.

What the tools must not do is increase hurdles for adoption by introducing foreign conceptual models into the understanding process. The Delicious model of multi-term tagging adds a very large conceptual barrier for many & it become problematic for even considering adoption. Optimally, Delicious should not be used alone as a means to introduce social bookmarking or tagging.

We must remove the barriers to entry to these powerful offerings as much as we can as designers and developers. We know the value, we know the future, but we need to extend this. It must be done now, as later is too late and these tools will be written off as just as complex and cumbersome as their predecessors.

If you are a buyer of these tools and services, this is you guideline for the minimum of what you should accept. There is much you should not accept. On this front, you need to push back. It is your money you are spending on the products, implementation, and people helping encourage adoption. Not pushing back on what is not acceptable will greatly hinder adoption and increase the costs for more people to ease the change and adoption processes. Both of these costs should not be acceptable to you.

Multi-term Tag UI Options

Compound Terms

I am starting with what we know to be problematic for broad adoption for input. But, compound terms also create problems for search as well as click retrieval. There are two UI interaction patterns that happen with compound multi-term tags. The first is the terms are mashed together as a compound single word, as shown in this example from Delicious.

Tag sample from Delicious

The problem here is the mashing the string of terms "architecture is politics" into one compound term "architectureispolitics". Outside of Germanic languages this is problematic and the compound term makes a quick scan of the terms by a person far more difficult. But it also complicates search as the terms need to be broken down to even have LIKE SQL search options work optimally. The biggest problem is for humans, as this is not natural in most language contexts. A look at misunderstood URLs makes the point easier to understand (Top Ten Worst URLs)

The second is an emergent model for compound multi-term tags is using a term delimiter. These delimiters are often underlines ( _ ), dots ( . ), or hyphens ( - ). A multi-term tag such as "enterprise search" becomes "enterprise.search", "enterprise_search" and "enterprise-search".

While these help visually they are less than optimal for reading. But, algorithmically this initially looks to be a simple solution, but it becomes more problematic. Some tools and services try to normalize the terms to identify similar and relevant items, which requires a little bit of work. The terms can be separated at their delimiters and used as properly separated terms, but since the systems are compound term centric more often than not the terms are compressed and have similar problems to the other approach.

Another reason this is problematic is term delimiters can often have semantic relevance for tribal differentiation. This first surface terms when talking to social computing researchers using Delicious a few years ago. They pointed out that social.network, social_network, and social-network had quite different communities using the tags and often did not agree on underlying foundations for what the term meant. The people in the various communities self identified and stuck to their tribes use of the term differentiated by delimiter.

The discovery that these variations were not fungible was an eye opener and quickly had me looking at other similar situations. I found this was not a one-off situation, but one with a fair amount of occurrence. When removing the delimiters between the terms the technologies removed the capability of understanding human variance and tribes. This method also breaks recommendation systems badly as well as hindering the capability of augmenting serendipity.

So how do these tribes identify without these markers? Often they use additional tags to identity. The social computing researchers add "social computing", marketing types add "marketing", etc. The tools then use their filtering by co-occurrence of tags to surface relevant information (yes, the ability to use co-occurrence is another tool essential). This additional tag addition help improve the service on the whole with disambiguation.

Disconnected Multi-term Tags

The use of distinct and disconnected term tags is often the intent for space delimited sites like Delicious, but the emergent approach of mashing terms together out of need surfaced. Delicious did not intend to create mashed terms or delimited terms, Joshua Schachter created a great tool and the community adapted it to their needs. Tagging services are not new, as they have been around for more than two decades already, but how they are built, used, and platforms are quite different now. The common web interface for tagging has been single terms as tags with many tags applied to an object. What made folksonomy different from previous tagging was the inclusion of identity and a collective (not collaborative) voice that intelligent semantics can be applied to.

The downside of disconnected terms in tagging is certainty of relevance between the terms, which leads to ambiguity. This discussion has been going on for more than a decade and builds upon semantic understanding in natural language processing. Did the tagger intend for a relationship between social & network or not. Tags out of the context of natural language constructs provide difficulties without some other construct for sense making around them. Additionally, the computational power needed to parse and pair potential relevant pairings is somethings that becomes prohibitive at scale.

Quoted Multi-term Tags

One of the methods that surfaced early in tagging interfaces was the quoted multi-term tags. This takes becomes #&039;research "social network" blog' so that the terms social network are bound together in the tool as one tag. The biggest problem is still on the human input side of things as this is yet again not a natural language construct. Systematically the downside is these break along single terms with quotes in many of the systems that have employed this method.

What begins with a simple helpful prompt...:

 SlideShare Tag Input UI

Still often can end up breaking as follows (from SlideShare):

SlideShare quoted multi-term tag parsing

Comma Delimited Tags

Non-space delimiters between tags allows for multi-term tags to exist and with relative ease. Well, that is relative ease for those writing Western European languages that commonly use commas as a string separator. This method allows the system to grasp there are multi-term tags and the humans can input the information in a format that may be natural for them. Using natural language constructs helps provide the ability ease of adoption. It also helps provide a solid base for building a synonym repository in and/or around the tagging tools.

Ma.gnolia comma separated multi-term tag output

While this is not optimal for all people because of variance in language constructs globally, it is a method that works well for a quasi-homogeneous population of people tagging. This also takes out much of the ambiguity computationally for information retrieval, which lowers computational resources needed for discernment.

Text Box Per Tag

Lastly, the option for input is the text box per tag. This allows for multi-term tags in one text box. Using the tab button on the keyboard after entering a tag the person using this interface will jump down to the next empty text box and have the ability to input a term. I first started seeing this a few years ago in tagging interfaces tools developed in Central Europe and Asia. The Yahoo! Bookmarks 2 UI adopted this in a slightly different implementation than I had seen before, but works much the same (it is shown here).

Yahoo! Bookmarks 2 text box per tag

There are many variations of this type of interface surfacing and are having rather good adoption rates with people unfamiliar to tagging. This approach tied to facets has been deployed in Knowledge Plaza by Whatever s/a and works wonderfully.

All of the benefits of comma delimited multi-term tag interfaces apply, but with the added benefit of having this interface work internationally. International usage not only helps build synonym resources but eases language translation as well, which is particularly helpful for capturing international variance on business or emergent terms.

Summary

This content has come from more than four years of research and discussions with people using tools, both inside enterprise and using consumer web tools. As enterprise moves more quickly toward more cost effective tools for capturing and connecting information, they are aware of not only the value of social tools, but tools that get out the way and allow humans to capture, share, and interact in a manner that is as natural as possible with the tools getting smart, not humans having to adopt technology patterns.

This is a syndicated version of the same post at Optimizing Tagging UI for People & Search :: Personal InfoCloud that has moderated comments available.



June 11, 2008

"Building the social web" Full-day Workshop in Copenhagen on June 30th

Through the wonderful cosponsoring of FatDUX I am going to be putting on a full-day workshop Building the Social Web on June 30th in Copenhagen, Denmark (the event is actually in Osterbro). This is the Monday following Reboot, where I will be presenting.

I am excited about the workshop as it will be including much of my work from the past nine months on setting social foundations for successful services, both on the web and inside organizations on the intranet. The workshop will help those who are considering, planning, or already working on social sites to improve the success of the services by providing frameworks that help evaluating and guiding the social interactions on the services.

Space is limited for this workshop to 15 seats and after its announcement yesterday there are only 10 seats left as of this moment.



May 30, 2008

Speaking at the International Forum on Enterprise 2.0 Near Milan, Italy

Under a month from now I have the wonderful pleasure of speaking at the International Forum on Enterprise 2.0, this is just outside of Milan in Varese, Italy on June 25, 2008. I am really looking forward to this event as there are many people whom I chat with on Skype with and chat with in other ways about enterprise and the use of social tools inside these organizations. It is a wonderful opportunity to meet them in person and to listen to them live as they present. Already I know many people attending the event from the United Kingdom, Switzerland, Germany, Austria, Spain, and (of course) Italy. If you are in Europe and have interest this should be a great event to get a good overview and talk with others with interest and experience. Oh, did I mention the conference is FREE?

I will be presenting an overview on social bookmarking and folksonomy and the values that come out of these tools, but also the understanding needed to make good early decisions about the way forward.

I look forward to meeting those of you who attend.



Enterprise 2.0 Boston - After Noah: What to do After the Flood (of Information)

I am looking forward to being at the Enterprise 2.0 Conference in Boston from June 10 to June 12, 2008. I am going to be presenting on June 10, 2008 at 1pm on After Noah: Making Sense of the Flood (of Information). This presentation looks at what to expect with social bookmarking tools inside an organization as they scale and mature. It also looks at how to manage the growth as well as encourage the growth.

Last year at the same Enterprise 2.0 conference I presented on Bottom-up Tagging (the presentation is found at Slideshare, Bottom-up All the Way Down: How Tags Help Businesses Organize, which has had over 8,800 viewing on Slideshare), which was more of a foundation presentation, but many in the audience were already running social bookmarking services in-house or trying them in some manner. This year my presentation is for those with an understanding of what social bookmarking and folksonomy are and are looking for what to expect and how to manage what is happening or will be coming along. I will be covering how to manage heavy growth as well as how to increase adoption so there is heavy usage to manage.

I look forward to seeing you there. Please say hello, if you get a chance.



May 7, 2008

Enterprise Social Tools: Components for Success

One of the things I continually run across talking with organizations deploying social tools inside their organization is the difficultly getting all the components to mesh. Nearly everybody is having or had a tough time with getting employees and partners to engage with the services, but everybody is finding out it is much more than just the tools that are needed to consider. The tools provide the foundation, but once service types and features are sorted out, it get much tougher. I get frustrated (as do many organizations whom I talk with lately) that social tools and services that make up enterprise 2.0, or whatever people want to call it, are far from the end of the need for getting it right. There is great value in these tools and the cost of the tools is much less than previous generations of enterprise (large organization) offerings.

Social tools require much more than just the tools for their implementation to be successful. Tool selection is tough as no tool is doing everything well and they all are focussing on niche areas. But, as difficult as the tool selection can be, there are three more elements that make up what the a successful deployment of the tools and can be considered part of the tools.

Four Rings of Enterprise Social Tools

Enterprise Social Tool: Components for Success The four elements really have to work together to make for a successful services that people will use and continue to use over time. Yes, I am using a venn diagram for the four rings as it helps point out the overlaps and gaps where the implementations can fall short. The overlaps in the diagram is where the interesting things are happening. A year ago I was running into organizations with self proclaimed success with deployments of social tools (blogs, wikis, social bookmarking, forums, etc.), but as the desire for more than a simple set of blogs (or whichever tool or set of tools was selected) in-house there is a desire for greater use beyond some internal early adopters. This requires paying close attention to the four rings.

Tools

The first ring is rather obvious, it is the tools. The tools come down to functionality and features that are offered, how they are run (OS, rack mount, other software needed, skills needed to keep them running, etc.), how the tools are integrated into the organization (authentication, back-up, etc.), external data services, and the rest of the the usual IT department checklist. The tools get a lot of attention from many analysts and tech evangelists. There is an incredible amount of attention on widgets, feeds, APIs, and elements for user generated contribution. But, the tools do not get you all of the way to a successful implementation. The tools are not a mix and match proposition.

Interface & Ease of Use

One thing that the social software tools from the consumer web have brought is ease of use and simple to understand interfaces. The tools basically get out of the way and bring in more advanced features and functionality as needed. The interface also needs to conform to expectations and understandings inside an organization to handle the flow of interaction. What works for one organization may be difficult for another organization, largely due to the tools and training, and exposure to services outside their organization. Many traditional enterprise tools have been trying to improve the usability and ease of use for their tools over the last 4 to 5 years or so, but those efforts still require massive training and large binders that walk people through the tools. If the people using the tools (not administering the tools need massive amounts of training or large binders for social software the wrong tool has been purchased).

Sociality

Sociality is the area where people manage their sharing of information and their connections to others. Many people make the assumption that social tools focus on everything being shared with everybody, but that is not the reality in organizations. Most organizations have tight boundaries on who can share what with whom, but most of those boundaries get in the way. One of the things I do to help organizations is help them realize what really needs to be private and not shared is often much less than what they regulate. Most people are not really comfortable sharing information with people they do not know, so having comfortable spaces for people to share things is important, but these spaces need to have permeable walls that encourage sharing and opening up when people are sure they are correct with their findings.

Sociality also includes the selective groups people belong to in organizations for project work, research, support, etc. that are normal inside organizations to optimize efficiency. But, where things get really difficult is when groups are working on similar tasks that will benefit from horizontal connections and sharing of information. This horizontal sharing (as well as diagonal sharing) is where the real power of social tools come into play as the vertical channels of traditional organization structures largely serve to make organizations inefficient and lacking intelligence. The real challenge for the tools is the capability to surface the information of relevance from selective groups to other selective groups (or share information more easily out) along the way. Most tools are not to this point yet, largely because customers have not been asking for this (it is a need that comes from use over time) and it can be a difficult problem to solve.

One prime ingredient for social tool use by people is providing a focus on the people using the tools and their needs for managing the information they share and the information from others that flow through the tool. Far too often the tools focus on the value the user generated content has on the system and information, which lacks the focus of why people use the tools over time. People use tools that provide value to them. The personal sociality elements of whom are they following and sharing things with, managing all contributions and activities they personally made in a tool, ease of tracking information they have interest in, and making modifications are all valuable elements for the tools to incorporate. The social tools are not in place just to serve the organization, they must also serve the people using the tools if adoption and long term use important.

Encouraging Use

Encouraging use and engagement with the tools is an area that all organizations find they have a need for at some point and time. Use of these tools and engagement by people in an organization often does not happen easily. Why? Normally, most of the people in the organization do not have a conceptual framework for what the tools do and the value the individuals will derive. The value they people using the tools will derive needs to be brought to the forefront. People also usually need to have it explained that the tools are as simple as they seem. People also need to be reassured that their voice matters and they are encouraged to share what they know (problems, solutions, and observations).

While the egregious actions that happen out on the open web are very rare inside an organization (transparency of who a person is keeps this from happening) there is a need for a community manager and social tool leader. This role highlights how the tools can be used. They are there to help people find value in the tools and provide comfort around understanding how the information is used and how sharing with others is beneficial. Encouraging use takes understanding the tools, interface, sociality, and the organization with its traditions and ways of working.

The Overlaps

The overlaps in the graphic are where things really start to surface with the value and the need for a holistic view. Where two rings over lap the value is easy to see, but where three rings overlap the missing element or element that is deficient is easier to understand its value.

Tools and Interface

Traditional enterprise offerings have focussed on the tools and interface through usability and personalization. But the tools have always been cumbersome and the interfaces are not easy to use. The combination of the tools and interface are the core capabilities that traditionally get considered. The interface is often quite flexible for modification to meet an organizations needs and desires, but the capabilities for the interface need to be there to be flexible. The interface design and interaction needs people who have depth in understanding the broad social and information needs the new tools require, which is going to be different than the consumer web offerings (many of them are not well thought through and do not warrant copying).

Tools and Sociality

Intelligence and business needs are what surface out of the tools capabilities and sociality. Having proper sociality that provides personal tools for managing information flows and sharing with groups as well as everybody as it makes sense to an individual is important. Opening up the sharing as early as possible will help an organization get smarter about itself and within itself. Sociality also include personal use and information management, which far few tools consider. This overlap of tools and sociality is where many tools are needing improvement today.

Interface and Encouraging Use

Good interfaces with easy interaction and general ease of use as well as support for encouraging use are where expanding use of the tools takes place, which in turn improves the return on investment. The ease of use and simple interfaces on combined with guidance that provides conceptual understanding of what these tools do as well as providing understanding that eases fears around using the tools (often people are fearful that what they share will be used against them or their job will go away because they shared what they know, rather than they become more valuable to an organization by sharing as they exhibit expertise). Many people are also unsure of tools that are not overly cumbersome and that get out of the way of putting information in to the tools. This needs explanation and encouragement, which is different than in-depth training sessions.

Sociality and Encouraging Use

The real advantages of social tools come from the combination of getting sociality and encouraging use correct. The sociality component provides the means to interact (or not) as needed. This is provided by the capabilities of the product or products used. This coupled with a person or persons encouraging use that show the value, take away the fears, and provide a common framework for people to think about and use the tools is where social comfort is created. From social comfort people come to rely on the tools and services more as a means to share, connect, and engage with the organization as a whole. The richness of the tools is enabled when these two elements are done well.

The Missing Piece in Overlaps

This section focusses on the graphic and the three-way overlaps (listed by letter: A; B; C; and D). The element missing in the overlap or where that element is deficient is the focus.

Overlap A

This overlap has sociality missing. When the tool, interface, and engagement are solid, but sociality is not done well for an organization there may be strong initial use, but use will often stagnate. This happens because the sharing is not done in a manner that provides comfort or the services are missing a personal management space to hold on to a person's own actions. Tracking one's own actions and the relevant activities of others around the personal actions is essential to engaging socially with the tools, people, and organization. Providing comfortable spaces to work with others is essential. One element of comfort is built from know who the others are whom people are working with, see Elements of Social Software and Selective Sociality and Social Villages (particularly the build order of social software elements) to understand the importance.

Overlap B

This overlap has tools missing, but has sociality, interface, and encouraging use done well. The tools can be deficient as they may not provide needed functionality, features, or may not scale as needed. Often organizations can grow out of a tool as their needs expand or change as people use the tools need more functionality. I have talked with a few organizations that have used tools that provide simple functionality as blogs, wikis, or social bookmarking tools find that as the use of the tools grows the tools do not keep up with the needs. At times the tools have to be heavily modified to provide functionality or additional elements are needed from a different type of tool.

Overlap C

Interface and ease of use is missing, while sociality, tool, and encouraging use are covered well. This is an area where traditional enterprise tools have problems or tools that are built internally often stumble. This scenario often leads to a lot more training or encouraging use. Another downfall is enterprise tools are focussed on having their tools look and interact like consumer social web tools, which often are lacking in solid interaction design and user testing. The use of social tools in-house will often not have broad use of these consumer services so the normal conventions are not understood or are not comfortable. Often the interfaces inside organizations will need to be tested and there many need to be more than one interface and feature set provided for depth of use and match to use perceptions.

Also, what works for one organization, subset of an organization, or reviewer/analyst will not work for others. The understanding of an organization along with user testing and evaluation with a cross section of real people will provide the best understanding of compatibility with interface. Interfaces can also take time to take hold and makes sense. Interfaces that focus on ease of use with more advanced capabilities with in reach, as well as being easily modified for look and interactions that are familiar to an organization can help resolve this.

Overlap D

Encouraging use and providing people to help ease people's engagement is missing in many organizations. This is a task that is often overlooked. The tools, interface, and proper sociality can all be in place, but not having people to help provide a framework to show the value people get from using the tools, easing concerns, giving examples of uses for different roles and needs, and continually showing people success others in an organization have with the social tool offerings is where many organization find they get stuck. The early adopters in an organization may use the tools as will those with some familiarity with the consumer web social services, but that is often a small percentage of an organization.

Summary

All of this is still emergent and early, but these trends and highlights are things I am finding common. The two areas that are toughest to get things right are sociality and encouraging use. Sociality is largely dependent on the tools, finding the limitations in the tools takes a fair amount of testing often to find limitations. Encouraging use is more difficult at the moment as there are relatively few people who understand the tools and the context that organizations bring to the tools, which is quite different from the context of the consumer social web tools. I personally only know of a handful or so of people who really grasp this well enough to be hired. Knowing the "it depends moments" is essential and knowing that use is granular as are the needs of the people in the organization. Often there are more than 10 different use personas if not more that are needed for evaluating tools, interface, sociality, and encouraging use (in some organizations it can be over 20). The tools can be simple, but getting this mix right is not simple, yet.

[Comments are open and moderated at Enterprise Social Tools: Components for Success :: Personal InfoCloud



April 16, 2008

Explaining the Granular Social Network

This post on Granular Social Networks has been years in the making and is a follow-up to one I previously made in January 2005 on Granular Social Networks as a concept I had been presenting and talking about for quite some time at that point. In the past few years it has floated in and out of my presentations, but is quite often mentioned when the problems of much of the current social networking ideology comes up. Most of the social networking tools and services assume we are broadline friends with people we connect to, even when we are just "contacts" or other less than "friend" labels. The interest we have in others (and others in us) is rarely 100 percent and even rarer is that this 100 percent interest and appreciation is equal in both directions (I have yet to run across this in any pairing of people, but I am open to the option that it exists somewhere).

Social Tools Need to Embrace Granularity

What we have is partial likes in others and their interests and offerings. Our social tools have yet to grasp this and the few that do have only taken small steps to get there (I am rather impressed with Jaiku and their granular listening capability for their feed aggregation, which should be the starting point for all feed aggregators). Part of grasping the problem is a lack of quickly understanding the complexity, which leads to deconstructing and getting to two variables: 1) people (their identities online and their personas on various services) and 2) interests. These two elements and their combinations can (hopefully) be seen in the quick annotated video of one of my slides I have been using in presentations and workshops lately.

Showing Granular Social Network


Granular Social Network from Thomas Vander Wal on Vimeo.

The Granular Social Network begins with one person, lets take the self, and the various interest we have. In the example I am using just five elements of interest (work, music, movies, food, and biking). These are interest we have and share information about that we create or find. This sharing may be on one service or across many services and digital environments. The interests are taken as a whole as they make up our interests (most of us have more interests than five and we have various degrees of interest, but I am leaving that out for the sake of simplicity).

Connections with Others

Our digital social lives contain our interests, but as it is social it contains other people who are our contacts (friends is presumptive and gets in the way of understanding). These contacts have and share some interests in common with us. But, rarely do the share all of the same interest, let alone share the same perspective on these interests.

Mapping Interests with Contacts

But, we see when we map the interests across just six contacts that this lack of fully compatible interests makes things a wee bit more complicated than just a simple broadline friend. Even Facebook and their touted social graph does not come close to grasping this granularity as it is still a clumsy tool for sharing, finding, claiming, and capturing this granularity. If we think about trying a new service that we enjoy around music we can not easily group and capture then try to identify the people we are connected to on that new service from a service like Facebook, but using another service focussed on that interest area it could be a little easier.

When we start mapping our own interest back to the interest that other have quickly see that it is even more complicated. We may not have the same reciprocal interest in the same thing or same perception or context as the people we connect to. I illustrate with the first contact in yellow that we have interest in what they share about work or their interest in work, even though they are not stating or sharing that information publicly or even in selective social means. We may e-mail, chat in IM or talk face to face about work and would like to work with them in some manner. We want to follow what they share and share with them in a closer manner and that is what this visual relationship intends to mean. As we move across the connections we see that the reciprocal relationships are not always consistent. We do not always want to listen to all those who are sharing things, with use or the social collective in a service or even across services.

Focus On One Interest

Taking the complexity and noise out of the visualization the focus is placed on just music. We can easily see that there are four of our six contacts that have interest in music and are sharing their interest out. But, for various reasons we only have interests in what two of the four contacts share out. This relationship is not capturing what interest our contacts have in what we are sharing, it only captures what they share out.

Moving Social Connections Forward

Grasping this as a relatively simple representation of Granular Social Networks allows for us to begin to think about the social tools we are building. They need to start accounting for our granular interests. The Facebook groups as well as listserves and other group lists need to grasp the nature of individuals interests and provide the means to explicitly or implicitly start to understand and use these as filter options over time. When we are discussing portable social networks this understanding has be understood and the move toward embracing this understanding taken forward and enabled in the tools we build. The portable social network as well as social graph begin to have a really good value when the who is tied with what and why of interest. We are not there yet and I have rarely seen or heard these elements mentioned in the discussions.

One area of social tools where I see this value beginning to surface in through tagging for individuals to start to state (personally I see this as a private or closed declaration that only the person tagging see with the option of sharing with the person being tagged, or at least have this capability) the reasons for interest. But, when I look at tools like Last.fm I am not seeing this really taking off and I hear people talking about not fully understanding tagging as as it sometimes narrows the interest too narrowly. It is all an area for exploration and growth in understanding, but digital social tools, for them to have more value for following and filtering the flows in more manageable ways need to more in grasping this more granular understanding of social interaction between people in a digital space.



Social Tools for Mergers and Acquisitions

The announcement yesterday of Delta and Northwest airlines merging triggered a couple thoughts. One of the thoughts was sadness as I love the unusually wonderful customer service I get with Northwest, and loathe the now expected poor and often nasty treatment by Delta staff. Northwest does not have all the perks of in seat entertainment, but I will go with great customer service and bags that once in nearly 50 flights did not arrive with me.

But, there is a second thing. It is something that all mergers and large organization changes trigger...

Social Tools Are Great Aids for Change

Stewart Mader brought this to mind again in his post Onboarding: getting your new employees cleared for takeoff, which focusses on using wikis (he works for Atlassian and has been a strong proponent of wikis for years and has a great book on Wiki Patterns) as a means to share and update the information that is needed for transitions and the joining of two organizations.

I really like his write-up and have been pushing the social tools approach for a few years. The wiki is one means of gathering and sharing information. It is a good match with social bookmarking, which allows organizations that are coming together have their people find and tag things in their own context and perspective. This provides finding common objects that exist, but also sharing and learning what things are called from the different perspectives.

Communication Build Common Ground

Communication is a key cornerstone to any organization working with, merging with, or becoming a part of another. Communication needs common ground and social bookmarking that allows for all context and perspectives to be captured is essential to making this a success.

This is something I have presented on and provided advice in the past and really think and have seen that social tools are essentials in these times of transition. It is really rewarding when I see this working as I have been through organization mergers, going public, and major transitions in the days before these tools existed. I can not imaging thinking of transitioning with out these tools and service today. I have talked to many organizations after the fact that wished they had social bookmarking, blogs, and wikis to find and annotate items, provide the means to get messages out efficiently (e-mail is becoming a poor means of sharing valuable information), and working toward common understanding.

One large pain point in mergers and other transitions is the cultural change that brings new terms, new processes, new workflow, and disruption to patterns of understanding that became natural to the people in the organization. The ability to map what something was called and the way it was done to what it is now called and the new processes and flows is essential to success. This is exactly what the social tools provide. Social bookmarking is great for capturing terms, context, and perspectives and providing the ability to refind these new items using prior understanding with low cognitive costs. Blogs help communicate people's understanding as they are going through the process as well as explain the way forward. Wikis help map these individual elements that have been collectively provided and pull them together in one central understanding (while still pointing out to the various individual contributions to hold on to that context) in a collaborative (working together with one common goal) environment.

Increasing Speed and Lowering Cost of Transition

Another attribute of the social tools is the speed and cost at which the information is shared, identified, and aggregated. In the past the large consulting firms and the slow and expensive models for working were have been the common way forward for these times of change. Seeing social tools along with a few smart and nimble experts on solid deployments and social engagement will see similar results in days and a handful of weeks compared to many weeks and months of expensive change management plodding. The key is the people in the organizations know their concerns and needs, while providing them the tools to map their understanding and finding information and objects empowers the individuals while giving them knowledge and the means to share with others. This also helps the individuals grasp that are essential to the success and speed to the change. Most people resent being pushed and prodded into change and new environments, giving them the tools to understand and guide their own change management is incredibly helpful. This decreases the time for transition (for processes and emotionally) while also keeping the costs lower.

[Comments are open and moderated as always in the post at: Social Tools to Efficiently Build Common Ground :: Personal InfoCloud]



March 30, 2008

Understanding Collective and Collaborative

I have finally blogged about the different between the two terms of collaborative and collective, which has been something bugging me for some time. Comments there are open, but are moderated (as they always have been). Those who have been to any of my workshops in the past year or so will see familiar information. Hopefully, the post will help those discussing and crafting social tools for the general web (or mobile) or large organizations will read and work to grasp the difference. I have had plenty of academics, researchers, and service developers push me to make this public for far too long so to start getting the misunderstanding around the two terms corrected.



February 22, 2008

Remote Presentation and Perception Matrix for Social Tools

This post is also found at: Remote Presentation and Perceptions Matrix for Social Tools :: Personal InfoCloud with moderated comments turned on.]

Today I did something I had never done before (actually a few things) I sat in my office in my home and gave a live web video presentation to a conference elsewhere on the globe. I presented my nearly all new presentation, Keeping Up With Social Tagging to the Expert Workshop in: Social Tagging and Knowledge Organization - Perspectives and Potential that was put on by the Knowledge Media Research Center in Tübingen, Germany.

Remote Presentation Feelings

While the remote video presentation is normal for many people inside their large organizations and I have presented at meetings and conferences where my presentation was provided to other location on live video feed (my recent Ann Arbor trip to present at STIET was HD broadcast to Wayne State in Detroit), this home office to conference presentation was new to me. The presentation and video link used Adobe Connect, which allowed me to see whom I was talking to, manage my slides, text chat, and see myself. This worked quite well, much better than I expected. I did have my full slide presentation in lightroom view set up in Keynote on my external monitor on the side and used Awaken on the side monitor as well to help with timing.

The ability to get feedback and watch the attendees body language and non-verbal responses was insanely helpful. I have given webinars and done phone presentations where I had not visual cues to the audience responses, which I find to be a horrible way to present (I often will expand on subjects or shorten explanations based on non-verbal feedback from the audience). Adobe Connect allowed this non-verbal feedback to be streamed back to me, which completely allows me to adjust the presentation as I normally do.

One thing that was a wee bit difficult was having to change focus (I suppose that comes with use and experience), but I would watch audience feedback while presenting, peek to the side to see where I was with time and slides (to work in the transitions), but would then try to look at the camera to "connect". Watching myself on the video feedback the moments I would try to connect through the camera I would open my eyes wide as if trying to see through my iSight and boy does that come across looking strange on a close range camera. I also (unknown to myself until recently watching a video of another presentation I had done) use a similar facial expression to add emphasis, I am realizing with a camera as close as it is for web presentation also really looks odd. I am sort of used to listening to myself (normally to write out new analogies I use or responses to questions), but watching myself in playback from that close of a range is really uncomfortable.

One thing I really missed in doing this web video presentation was extended interaction with the attendees. I rather enjoy conferences, particularly ones with this focussed a gathering as it makes for great socializing with people passionate about the same subjects I am passionate about. I like comparing note, perceptions, and widely differing views. It helps me grow my knowledge and understandings as well as helps change my perceptions. Live face-to-face conversation and sharing of interests is an incredibly value part of learning, experiencing, and shaping views and it is something I greatly enjoy attending conferences in person. I am not a fan of arriving at a conference just prior to a presentation, giving the presentation, and then leaving. The personal social interaction is valuable. The video presentation does not provide that and I really missed it, particularly with the people who are so closely tied to my deep interest areas as this workshop was focused.

New Content in Presentation

This presentation included a lot of new content, ideas, and concepts that I have not really presented or written about in as open of a forum. I have received really strong positive feedback from the Faces of Perception, Depth of Perception, and Perception Matrix when I have talked about it with people and companies. I have included this content in the book on social bookmarking and folksonomy I am writing for O&Reilly and pieces have been in public and private workshops I have given, but it was long past time to let the ideas out into the open.

The components of perception came about through reading formal analysis and research from others as well as not having a good models myself to lean on to explain a lot of what I find from social computing service providers (web tools in the Web 2.0 genre as well as inside the firewall Enterprise 2.0 tools) as tool makers or service owners. The understandings that are brought to the table on a lot of research and analysis is far too thin and far too often badly confuses the roles and faces of the tool that are being reviewed or analyzed. In my working with tool makers and organizations implementing social tools the analysis and research is less than helpful and often makes building products that meet the user needs and desires really difficult. I am not saying that this conceptual model fixes it, but from those who have considered what it shows almost all have had realizations they have had a less than perfect grasp and have lacked the granularity they have needed to build, analyze, or research these social tools.

I am hoping to write these perspectives up in more depth at some point in the not too distant future, but the video and slides start getting the ideas out there. As I have been walking people through how to use the tools I have been realizing the content needed to best us the model and matrix may take more than a day of a workshop of even a few days to get the most complete value from it. These tools have helped me drastically increase my value in consulting and training in the very short time I have used them. Some are finding that their copying of features and functionality in other social services has not helped them really understand what is best for their user needs and are less than optimal for the type of service they are offering or believe they are offering.



February 11, 2008

Challenges as Opportunities for Social Networks and Services

Jeremiah Owyang posts "The Many Challenges of Social Network Sites" that lays out many of the complaints that have risen around social networking sites (and other social computing services). He has a good list of complaints, which all sounded incredibly familiar from the glory days of 1990 to 1992 for IT in the enterprise (tongue firmly planted in cheek). We have been through these similar cycles before, but things are much more connected now, but things also have changed very little (other than many of the faces). His question really needs addressing when dealing with Enterprise 2.0 efforts as these are the things I hear initially when talking with organizations too. Jeremiah asked for responses and the following is what I posted...

Response to Challenges of Social Network/Services

The past year or two, largely with Facebook growing the social networks and social computing tools have grown into the edges of mainstream. Nearly every argument made against these tools and services was laid down against e-mail, rich UI desktops (people spent hours changing the colors and arranging the interfaces), and IM years ago.

Where these tools are "seemingly" not working is mostly attributed to a severe lack of defining the value derived from using the tools. These news tools and services, even more so those of us working around them, need to communicate how to use the tools effectively and efficiently (efficiently is difficult as the many of the tools are difficult to use or the task flows are not as simple as they should be). The conceptual models & frameworks for those of us analyzing the tools have been really poor and missing giant perspectives and frameworks.

One of the biggest problems with many of these tools and services is they have yet to move out of early product mode. The tools and services are working on maturity getting features in the tools that people need and want, working on scaling, and iterating based on early adopters (the first two or three waves of people), which is not necessarily how those who follow will use the tools or need the tools to work.

Simplicity and limited options on top of tools that work easily and provide good derived value for the worklife and . As the tools that were disrupters to work culture in the past learned the focus needs to be on what is getting done and let people do it. Friending people, adding applications, tweaking the interface, etc. are not things that lead to easy monetization. Tools that help people really be social, interact, and get more value in their life (fun, entertainment, connecting with people near in thought, filtering information from the massive flow, and using the information and social connections in context where people need it) from the tools is there things must head. We are building the platforms for this, but we need to also focus on how to improve use of these platforms and have strong vision of what this is and how to get there.

[This is also posted at Challenges as Oppotunities for Social Networks and Services :: Personal InfoCloud with moderated comments turned on.]



February 8, 2008

Getting More Value In Enterprise with Social Bookmarking

The last few weeks I have been running across a few companies postponing or canceling their social computing or Enterprise 2.0 efforts. The reasons vary from the usual budget shifts and staff changes (prior projects were not delivered on time), and leadership roles need filling. But two firms had new concerns of layoffs or budget cuts.

To both firms I pointed out now was the exact time they really needed to focus on some Enterprise 2.0 efforts, particularly social bookmarking as well as wikis and blogs. These solutions help gather information, find value across the organization, capture knowledge, build cohesiveness for members of the organization in time where there there is uncertainty. One of the biggest reasons that these tools make sense is their cost to deploy and receive solid value. As Josh Bernoff  (and others in from Forrester) points out in the Strategies For Interactive Marketing In A Recession free report from Forrester, the cost to deploy is in the $50,000 to $300,000 range (usually more expensive for large and more complex deployments).

Social Bookmarking has Great Value in the Enterprise

Every organization needs to know itself better then they currently do. The employees and members of the organization are all trying to do their job better and smarter. The need to connect people inside an organization with others with similar interest, contexts, and perceptions is really needed. I am a huge fan of social bookmarking tools to help along these lines as it helps people hold on to information they have need, want, or have interest in (particularly with future uses) and put things in their own context and perception. Once people understand the value they derive from using the tools to hold on to information out of their vast flow and streams of information and data that run before them each day they quickly "get it". As people also share these bookmarks in the organization with their tags and annotations, they also realize quickly they are becoming a valuable conduit to helping others find information and they grasp the value they will derive from being a resource that adds value in the organization. Other people derive value from information in the organization and outside it being augmented with individual perspectives and context. When this is pair with search, as Connectbeam does with their social search that pairs with existing FAST, Google Search Appliance, and others in-house search engines, the value the whole organization receives is far beyond the cost and minimal effort people are putting into the tools to get smarter, by more easily holding on and sharing what they know.

Nearly every attendee to the workshops I have put on around this subject quickly realizes they undervalued the impact and capability of social bookmarking (as well as other social computing tools) in the enterprise. The also provides a strong foundation for better understanding social computing to increase the derived value for all parties (individuals, collective users, collaborative users, and the organization).

Is is time for your enterprise to get smarter and provide more value inside and out?

[This is also blogged at Getting More Value In Enterprise with Social Bookmarking :: Personal InfoCloud with moderated comments turned on.]



February 5, 2008

Social Computing Summit in Miami, Florida in April, 2008

ASIS&T has a new event they are putting on this year, the Social Computing Summit in Miami, Florida on April 10-11, 2008 (a reminder page is up at Yahoo's Upcoming - Social Computing Summit). The event is a single-track event on both days with keynote presentations, panels, and discussion.

The opening keynote is by Nancy Baym. I have been helping assist with organization of the Social Computing Summit and was asked by the other organizers to speak, which I am doing on the second day. The conference is a mix of academic, consumer, and business perspectives across social networking, politics, mobile, developing world, research, enterprise, open social networks (social graph and portable social networks) as well as other subjects. The Summit will be a broad view of the digital social world and the current state of understanding from various leaders in social computing.

There is an open call for posters for the event that closes on February 25, 2008. Please submit as this is looking to be a great event and more perspectives and expertise will only make this event more fantastic.



January 14, 2008

Ma.gnolia Goes Mobile

On Friday Ma.gnolia rolled out a mobile version of their site, M.gnolia - Mobile Ma.gnolia. This had me really excited as I now have access to my bookmarks in my pocket on my mobile. Ma.gnolia gives a quick preview in their blog post Ma.gnolia Blog: Flowers on the Go.

What Mobile Ma.gnolia Does and Does Not Do

First, off the mobile Ma.gnolia does not have easy bookmarking, which is not surprising given the state things in mobile browsers. I really do not see this as a huge downside. What I am head over heals happy about is access to my bookmarks (all 2800 plus). The mobile version allows searching through your own tags (if you are logged in). It currently has easy access to see that is newly bookmarked in Ma.gnolia groups you follow, your contact's bookmarks, popular bookmarks, your own tags, and your profile.

Mobile Site Bookmarks

One thing that is helpful for those that use mobile web browsing is having easy access to mobile versions of web sites. Yes, the iPhone and many smartphone users (I am in the Nokia camp with my well liked E61i) can easily browse and read regular web pages, but mobile optimized pages are quicker to load and have less clutter on a smaller screen. The iPhone, WebKit-based browsers (Nokia), Opera Mini, and other decent mobile web browsers all have eased mobile browsing use of regular webpages, but having a list of mobile versions is really nice.

Yesterday, Saturday, I created a Ma.gnolia Mobile Version Group so people can share web pages optimized for mobile devices (quicker/smaler downloads, smaller screens, less rich ads, etc.). One of the ways I was thinking people could use this is to find sites in this group then bookmark them for their own use with tags and organization that makes sense for themself. The aim is just to collect and share with others what you find helpful and valuable for yourself. This group will be monitored for spam as the rest of Ma.gnolia is (Ma.gnolia uses "rel="no-follow"" so there really is little value to spammers).

Ways You Can Use Mobile Ma.gnolia

This means if you tagged a store, restaurant, bar, transit site, or other item that has value when out walking around it is really nice to have quick access to it. It can also be a great way to read those items you have tagged "to read" (if you are a person that tags things in that manner) so you can read what you want in the doctor's office, bus, train, or wherever.

I have a lot of content I have bookmarked for locations I am work, live, and visit. When I come across something I want to remember (places to eat, drink, learn, hang, be entertained, etc.) I often dump them into the bookmarks. But, getting to this information has been painful from a mobile in the past. I am now starting to go back to things I have tagged with locations and add a "togo" tag so they are easier for me to find and use in the Ma.gnolia mobile interface. I have already added a bookmark for an museum exhibit that I really want to see that is not far from where I am. When a meeting is dropped, postponed, or runs short near the museum I can make a trip over and see it. There is so much information flowing through my devices and it is nice to be able to better use this info across my Personal InfoCloud in my trusted devices I have with me and use the information in context it is well suited for, when have stepped away from my desk or laptop.

I am looking forward to see where this goes. Bravo and deep thanks to the Larry and others at Ma.gnolia that made this happen!



December 31, 2007

Another Blogging Year

Another year is passing as if it were just a brief moment and blink. I am not one for making New Year's resolutions, but I often look back and often look at what needs improving and do my best to make modifications along the way.

Starting Blog Year 8

New Year's Eve is my blogging anniversary as I started on New Year's Eve 2000 on Pyra's Blogger. So in 7 years things have changed on this blog quite a bit. The technology has changed a little, but since 2002 there have been very few modifications (other than turning off comments in October 2004, for what then was intended to be a brief moment, but they are now still closed waiting for the ever coming move to a real blogging tool).

My content style has changed and what I write about has changed as my shorter notes to self (shared publicly) have moved to del.icio.us then Ma.gnolia as social bookmarks and I am now dropping things into my vanderwal on Tumblr. My content is also posted over at Personal InfoCloud, but that content is often syndicated here and then points to there, as the comments are open there.

Content here got longer, which lead to adding headers (h3) between ideas, often each paragraph will have a header so to make the content easy to scan. These days much of the traffic is related to folksonomy, social web, social software, and InfoCloud commentary, review and analysis. Other observations get thrown in as well, but nowhere as often as they used to.

Future Changes

I still hope to move off of my personally built blogging tool (part of an experimentation and testing for a CMS I was writing for work at the time, or was it the other way around). I have other projects ahead of this transformation, like getting the folksonomy book moving more quickly and finishing it (life took some large sideways moves this year, including the holiday acting as health attendant, both parents, and my regular load with my wife's accident). There will be some large posts in the very short future that are the result of unsticking my framework and perceptions around social software and folksonomy that has had me twisting and turning to write and represent ideas (it seems it has impacted many others too, as most everything I read runs into the same wall and leads to criticism that may not be on target).

A Great Year Passes and Another Approaches

I made an incredible amount of new contacts and friends this year with many people with the same and similar passions and interests. This was the result of the web, conferences, workshops, and social software leading to attracting similar mindsets together. I am looking forward to the workshops, presentations, and projects planned so far for 2008 as well as all that fills in the gaps and fills out the year. I am quite excited to get the New Year under way and enjoying the time and work with all interested.

Happy New Year!



November 29, 2007

Wikipedia Folksonomy is a Mess with Collaborative Misunderstanding

There are days I really wish there were a test for people to get the ability to have access to edit Wikipedia. In the past month I have been asked over and over about folksonomy being a collaborative tagging, which makes no sense to people. It is tough to makes sense of the relationship to folksonomy as there is no relationship, as folksonomy is a collective tagging practice not collaborative. People depend on Wikipedia, which is the case of folksonomy they should not.

Collaboration and collective efforts are often confused by those not familiar with both terms, but they are not similar and they are two distinctly different efforts. Collaboration is people working together (often with a common goal) to build one thing (think wiki page with one understanding). Collective efforts are the aggregation of people's individual efforts, sometimes in the same service, but do not have common goal or common effort (del.icio.us page for a URL is the collective understanding of individuals tagging of that page for their own use.

Call to Fix Wikipedia entry on Folksonomy, Again

Can we get the mis-understood "collaborative tagging" out of the folksonomy page, since the descriptions around collective tagging are clearly a mis-understanding of the term collaborative, when they meant collective. There are collaborative tagging efforts in content management tools, where they are working toward one single on a limited understanding of terms, but that is not what has been described.

You ask why I do not change the page Wikipedia Folksonomy page. I did it a long time ago to fix the understanding and a friend pointed out that the edit was mine and I got irate e-mail. A since that time Wikipedia has modified its policies to improve the virtrol in Wikipedia.



August 30, 2007

A Stale State of Tagging?

David Weinberger posted a comment about Tagging like it was 2002, which quotes Matt Mower discussing the state of tagging. I mostly agree, but not completely. In the consumer space thing have been stagnant for a while, but in the enterprise space there is some good forward movement and some innovation taking place. But, let me break down a bit of what has gone on in the consumer space.

History of Tagging

The history of tagging in the consumer space is a much deeper and older topic than most have thought. One of the first consumer products to include tagging or annotations was the Lotus Magellan product, which appeared in 1988 and allowed annotations of documents and objects on one's hard drive to ease finding and refinding the them (it was a full text search which was remarkably fast for its day). By the mid-90s Compuserve had tagging for objects uploaded into its forum libraries. In 2001 Bitzi allowed tagging of any media what had a URL.

The down side of this tagging was the it did not capture identity and assuming every person uses words (tag terms) in the same manner is a quick trip to the tag dump where tags are not fully useful. In 2003 Joshua Schacter showed the way with del.icio.us that not only allowed identity, upon which we can disambiguate, but it also had a set object in common with all those identities tagging it. The common object being annotated allows for a beginning point to discern similarity of identityĵs tag terms. Part of this has been driven on Joshua's focus on the person consuming the content and allowing a means for that consumer to get back to their information and objects of interest. (It is around this concept that folksonomy was coined to separate it from the content publisher tagging and non-identity related tagging.) This picked up on the tagging for one's self that was in Lotus Magellan and brings it forward to the web.

Valuable Tagging

It was in del.icio.us that we saw tagging that really did not work well in the past begin to become valuable as the clarity in tag terms that was missing in most all other tagging systems was corrected for in the use of a common object being tagged and the identity of the tagger. This set the foundation for some great things to happen, but have great things happened?

Tagging Future Promise

Del.icio.us set many of out minds a flutter with insight into the dreams of the capability of tagging having a good foothold with proper structure under them. A brilliant next step was made by RawSugar (now gone) to use this structure to make ease of disambiguating the tag terms (by appleseed did you mean: Johnny Appleseed, appleseeds for gardening/farming, the appleseed in the fruit apple, or appleseed the anime movie?). RawSugar was a wee bit before its time as it is a tool that is needed after there tagging (particularly folksonomy related tagging systems) start scaling. It is a tool that many in enterprise are beginning to seek to help find clarity and greater value in their internal tagging systems they built 12 to 18 months ago or longer. Unfortunately, the venture capitalists did not have the vision that the creators of RawSugar did nor the patience needed for the market to catch-up to the need in a more mature market and they pulled the plug on the development of RawSugar to put the technology to use for another purpose (ironically as the market they needed was just easing into maturity).

The del.icio.us movement drove blog tags, laid out by Technorati. This mirrored the previous methods of publisher tagging, which is most often better served from set categories that usually are derived from a taxonomy or simple set (small or large) of controlled vocabulary terms. Part of the problem inherent in publisher tags and categories is that they are difficult to use outside of their own domain (however wide their domain is intended - a specific site or cross-sites of a publisher). Using tags from one blog to another blog has problems for the same reason that Bitzi and all other publisher tags have and had problems, they are missing identity of the tagger AND a clear common object being tagged. Publisher tags can work well as categories for aggregating similar content within a site or set of commonly published sites where a tag definition has been set (but that really makes them set categories) and used consistently. Using Technorati tag search most often surfaces this problem quickly with many variation of tag use surfacing or tag terms being used to attract traffic for non-related content (Technorati's keyword search is less problematic as it relies on the terms being used in context in the content - unfortunately the two searches have been tied together making search really messy at the moment). There is need for an improved tool that could take the blog tags and marry them to the linked items in the content (if that is what is being talked about - discerning predicate in blog tags is not clear yet).

Current Tools that Advanced

As of a year ago there were more than 140 social bookmarking tools in the consumer space, but there was little advancement. But, there are a few services that have innovated and brought new and valuable features to market in tagging. As mentioned recently Ma.gnolia has done a really good job of taking the next steps with social interaction in social bookmarking. Clipmarks pioneered the sub-page tagging and annotation in the consumer tagging space and has a really valuable resource in that tool. ConnectBeam is doing some really good things in the enterprise space, mostly taking the next couple steps that Yahoo MyWeb2 should have taken and pairing it with enterprise search. Sadly, del.icio.us (according to comments in their discussion board) is under a slow rebuilding of the underlying framework (but many complaints from enterprise companies I have worked with and spoken indepth with complain del.icio.us continually blocks their access and they prefer not to use the service and are finding current solutions and options to be better for them).

A Long Way to Go

While there are examples that tagging services have moved forward, there is so much more room to advance and improve. As people's own collection of tagged pages and objects have grown the tools are needed to better refind them. This will require time search and time related viewing/scanning of items. The ability to use co-occurance of tag terms (what other tags were used on the object), with useful interfaces to view and scan the possibilities.

Portability and interoperability is extremely important for both the individual person and enterprise to aggregate, migrate, and search across their collections across services and devices (now that devices have tagging and have had for some time, as in Mac OS X Tiger and now Vista). Enterprises should also have the ability to move external tagged items in through their firewall and publish out as needed, mostly on an employee level. There is also desire to have B2B tagging with customers tagging items purchased so the invoicing can be in the customers terminology rather than the seller terminology.

One of the advances in personal tagging portability and interoperability can easily be seen when we tag on one device and move the object to a second device or service (parts of this are not quite available yet). Some people will take a photo on their mobile phone and add quick tags like "sset" and others to a photo of a sunset. They send that photo to a service or move it to their desktop (or laptop) and import the photo and the tag goes along with it. The application sees the "sset" and knows the photo was transfered from that person's mobile device and knows it is their short code for "sunset" and expands the tag to sunset accordingly. The person then adds some color attribute tags to the photo and moves the photo to their photo sharing service of choice with the tags appended.

The current tools and services need tools and functionality to heal some of the messiness. This includes stemming to align versions of the same word (e.g. tag, tags, tagging, bookmark, bookmarking). Tag with disambiguation in mind by offering co-occurrence options (e.g. appleseed and anime or johnny or gardening or apple). String matching to identify facets for time and date, names (from your address book), products, secret tag terms (to have them blocked from sharing), etc. (similar to Stikkit and GMail).

Monitoring Tools

Enterprise is what the next development steps really need to take off (these needs also apply to the power knowledge worker as well). The monitoring tools for tags from others and around objects (URLs) really need to fleshed out and come to market. The tag monitoring tools need to become granular based on identity and co-occurance so to more tightly filter content. The ability to monitor a URL and how it is tagged across various services is a really strong need (there are kludgy and manual means of doing this today) particularly for simple and efficient tools (respecting the tagging service processing and privacy).

Analysis Tools

Enterprise and power knowledge workers also are in need of some solid analysis tools. These tools should be able to identify others in a service that have similar interests and vocabulary, this helps to surface people that should be collaborating. It should also look at shifts in terminology and vocabulary so to identify terms to be added to a taxonomy, but also provide an easy step for adding current emergent terms to related older tagged items. Identify system use patterns.

Just the Tip

We are still at the tip of the usefulness of tagging and the tools really need to make some big leaps. The demands are there in the enterprise marketplace, some in the enterprise are aware of them and many more a getting to there everyday as the find the value real and ability to improve the worklife and workflow for their knowledge workers is great.

The people using the tools, including enterprise need to grasp what is possible beyond that is offered and start asking for it. We are back to where we were in 2003 when del.icio.us arrived on the scene, we need new and improved tools that understand what we need and provide usable tools for those solutions. We are developing tag islands and silos that desperately need interoperability and portability to get real value out of these stranded tag silos around or digital life.



August 20, 2007

Why Ma.gnolia is One of My Favorite Social Bookmarking Tools

After starting the Portable Social Network Group in Ma.gnolia yesterday I received a few e-mails and IMs regarding my choice. Most of the questions were why not just use tags and del.icio.us. After I posted my Ma.Del Tagging Bookmarklet post I have had a lot of questions about Ma.gnolia and my preference as well as people thought I was not a fan of it. I have been thinking I would blog about my usage, but given my work advising on social bookmarking and social web, I shy away talking about what I use as what I like is likely not what is going to be a good fit for others. But, my work is one of the reasons I want to talk about what I like using as nearly every customer of mine and many presentation attendees look at del.icio.us first (it kicked the door wide open with a tool that was light years ahead of all others), but it is not for everybody and there are many other options. Much of my work is with enterprise and organizations of various size, which del.icio.us is not right for them for privacy reasons. I still add to del.icio.us along with my favorite as there are many people that have subscribed to the at feed as they derive value from that subscription so I take the extra step to keep that feed as current.

Ma.gnolia Offers Great Features for Sociality

I have two favorite tools for my own personal social bookmarking reasons Ma.gnolia and Clipmarks (I don't think I have anything publicly shared in Clipmarks). First the later, I use Clipmarks primarily when I only want to bookmark a sub-page element out on the web, which are paragraphs, sentences, quotes, images, etc.

I moved to try Ma.gnolia again last Fall when something changed in del.icio.us search and the results were not returning things that were in del.icio.us. My trying Ma.gnolia, by importing all of my 2200 plus bookmarks not only allowed me to search and find things I wanted, but I quickly became a fan of their many social features. In the past year or less they have become more social in insanely helpful and kind ways. Not only does Ma.gnolia have groups that you can share bookmarks with but there is the ability to have discussions around the subject in those groups. Sharing with a group is insanely easy. Groups can be private if the manager wishes, which makes it a good test ground for businesses or other organizations to test the social bookmarking waters. I was not a huge fan of rating bookmarks as if I bookmarked something I am wanting to refind it, but in a more social context is has value for others to see the strength of my interest (normall 3 to 5 stars). One of my favorite social features is giving "thanks", which is not a trigger for social gaming like Digg, but is an interpersonal expression of appreciation that really makes Ma.gnolia a friendly and positive social environment.

Started with Beauty, but Now with Ease

Ma.gnolia started as a beautiful del.icio.us (it was not the first) and the beauty got in the way of usability for many. But, Ma.gnolia has kept the beautiful strains and added simple ease of use in a very Apple delightful moments sort of way. The thanks are a nice treat, but the latest interactions that provide non-disruptive ease of use to accomplish a task, without completely taking you away from your previous flow (freaking brilliant in my viewpoint - anything that preserves flow to accomplish a short task is a great step). Another killer feature is Ma.gnolia Roots, which is a bookmarklet that when clicked hovers a semi-transparent layer over the webpage to show information from Ma.gnolia about that page (who has linked to it, tags, annotations, etc.) and makes it really easy to bookmark that page from that screen. The API (including a replica of the del.icio.us API that nearly all services use as the standard), add-ons, Creative Commons license for your bookmarks, many bookmarklet options, and feed options. But, there are also the little things that are not usually seen or noticed, such as great URLs that can be easily parsed, all pages are properly marked up semantically, and Microformats are broadly and properly used throughout the site (nearly at every pivot).

Intelligently Designed

For me Ma.gnolia is not only a great site to look at, a great social bookmarking site that is really social (as well as polite and respectful of my wishes), but a great example for semantic web mark-up (including microformats). There is so much attention to detail in the page markup that for those of us that care it is amazingly beautiful. The visual layer can be optimized for more white space and detail or for much easier scrolling. The interactions, ease of use, and delightful moments that assist you rather than taking you out of your flow (workflow, taskflow, etc.) and make you ask why all applications and social sites are not this wonderful.

Ma.gnolia is not perfect as it needs some tools to better manage and bulk edit your own bookmarks. It could use a sort on search items (as well as narrow by date range). Search could use some RedBull at times. It could improve with filtering by using co-occurance of tag terms as well as for disambiguation.

Overall for me personally, Ma.gnolia is a tool I absolutely love. It took the basic social bookmarking idea in del.icio.us and really made it social. It has added features and functionality that are very helpful and well executed. It is an utter pleasure to use. I can not only share things easily and get the wonderful effects of social interaction, but I can refind things in my now 2,500 plus bookmarks rather easily.



Ma.gnolia Portable Social Networking Group Now Open

I have been talking with people about portable social networks for 18 months or more and initially blogged about it last November (2006) in my post Following Friends Across Walled Gardens. Recently the portable social network effort has flowed into Microformats: Social Network Portability. I have been following Brian Oberkirk's portable social network blog posts and we have had more than a few chats about this in the last few months. Finally it seems that some core geeks are on this quest as well, thanks to a gathering of minds at Foo Camp with Brad Fitzpatrick and David Recordon posting Thoughts on the Social Graph and the starting of the Social Network Portability Google Group. The oauth (more info on OpenAuth). Kevin Lawver has been rocking the real world with his Portable Social Networks at Mashup Camp discussion and example.

Ma.gnolia Portable Social Network Group

Tracking these small bits that are loosely joined needed a little more glue. To this end I started a ma.gnolia group for portable social networking to aggregate links. Already there is a good groups of people joining the group, which is promising. I have been critical of Ma.gnolia in the past, but they have iterated and built a social bookmarking site that has become my favorite social bookmarking service (Clipmarks is my second favorite when I need to just hold onto sub-page items). If you want to keep follow, keep track of the current site, or (even better) contribute bookmarks as well as join in discussion join the group. Ma.gnolia makes joining insanely simple by using OpenID for account creation and login (should you be part of the modern web world - such as having an AOL AIM account).



July 18, 2007

Does IBM Get Folksonomy?

While I do not aim to be snarky, I often come off that way as I tend to critique and provide criticism to hopefully get the bumps in the road of life (mostly digital life) smoothed out. That said...

Please Understand What You Are Saying

I read an article this morning about IBM bringing clients to Second Life, which is rather interesting. There are two statements made by Lee Dierdorff and Jean-Paul Jacob, one is valuble and the other sinks their credibility as I am not sure they grasp what they actually talking about.

The good comment is the "5D" approach, which combines the 2D world of the web and the 3D world of Second Life to get improved search and relevance. This is worth some thinking about, not a whole lot as the solution as it is mentioned can have severe problems scaling. The solution of a virtual world is lacking where it does not augment our understanding much beyond 2D as it leaves out 4 of the 6 senses (it has visual and audio), and provides more noise into a pure conversation than a video chat with out the sensory benefits of video chat. The added value of augmented intelligence via text interaction is of interest.

I am not really sure that Lee Dierdorff actually gets what he is saying as he shows a complete lack of even partial understanding of what folksonomy is. Jacob states, "The Internet knows almost everything, but tells us almost nothing. When you want to find a Redbook, for instance, it can be very hard to do that search. But the only real way to search in 5D is to put a question to others who can ask others and the answer may or may not come back to you. It's part of social search. Getting information from colleagues (online) -- that's folksonomy." Um, no that is not folksonomy and not remotely close. It is something that stands apart and is socially augmented search that can viably use the diverse structures of a folksonomy to find relevant information, but asking people in a digital world for advise is not folksonomy. It has value and it is how many of us have used tools like Twitter and other social software that helps us keep those near in thought close (see Local InfoCloud). There could be a need for a term/word for that Jacob is talking about, but social search seems to be quite relevant as a term.

Related, I do have a really large stack of criticism for the IMB DogEar product that would improve it greatly. It needs a lot of improvement as a social bookmarking and folksonomy tool, but also from the social software interaction side there are things that really must get fixed for privacy interests in the enterprise before it really could be a viable solution. There are much better alternatives for social bookmarking inside an enterprise other than DogEar, which benefits from being part of the IBM social software stack Lotus Connections as the whole stack is decent together, but none of the parts are great, or even better than good by them self. DogEar really needs to get to a much more solid product quickly as their is a lot of interest now for this type of product, but it is only a viable solution if one is only looking at IBM products for solutions.



July 14, 2007

Understanding Taxonomy and Folksonmy Together

I deeply appreciate Joshua Porter's link to from his Taxonomies and Tags blog post. This is a discussion I have quite regularly as to the relation and it is in my presentations and workshops and much of my tagging (and social web) training, consulting, and advising focusses on getting smart on understanding the value and downfalls of folksonomy tagging (as well as traditional tagging - remember tagging has been around in commercial products since at least the 1980s). The following is my response in the comments to Josh' post...

Response to Taxonomy and Tags

Josh, thanks for the link. If the world of language were only this simple that this worked consistently. The folksonomy is a killer resource, but it lacks structure, which it crucial to disambiguating terms. There are algorithmic ways of getting close to this end, but they are insanely processor intensive (think days or weeks to churn out this structure). Working from a simple flat taxonomy or faceted system structure can be enabled for a folksonomy to adhere to.
This approach can help augment tags to objects, but it is not great at finding objects by tags as Apple would surface thousands of results and they would need to be narrowed greatly to find what one is seeking.
There was an insanely brilliant tool, RawSugar [(now gone thanks to venture capitalists pulling the plug on a one of a kind product that would be killer in the enterprise market)], that married taxonomy and folksonomy to help derive disambiguation (take appleseed as a tag, to you mean Johnny Appleseed, appleseed as it relates to gardening/farming, cooking, or the anime movie. The folksonomy can help decipher this through co-occurrence of terms, but a smart interface and system is needed to do this. Fortunately the type of system that is needed to do this is something we have, it is a taxonomy. Using a taxonomy will save processor time, and human time through creating an efficient structure.
Recently I have been approached by a small number of companies who implemented social bookmarking tools to develop a folksonomy and found the folksonomy was [initially] far more helpful than they had ever imagined and out paced their taxonomy-based tools by leaps and bounds (mostly because they did not have time or resources to implement an exhaustive taxonomy (I have yet to find an organization that has an exhaustive and emergent taxonomy)). The organizations either let their taxonomist go or did not replace them when they left as they seemed to think they did not need them with the folksonomy running. All was well and good for a while, but as the folksonomy grew the ability to find specific items decreased (it still worked fantastically for people refinding information they had personally tagged). These companies asked, "what tools they would need to start clearing this up?" The answer a person who understands information structure for ease of finding, which is often a taxonomist, and a tool that can aid in information structure, which is often a taxonomy tool.
The folksonomy does many things that are difficult and very costly to do in taxonomies. But taxonomies do things that folksonomies are rather poor at doing. Both need each other.

Complexity Increases as Folksonomies Grow

I am continually finding organizations are thinking the social bookmarking tools and folksonomy are going to be simple and a cure all, but it is much more complicated than that. The social bookmarking tools will really sing for a while, but then things need help and most of the tools out there are not to the point of providing that assistance yet. There are whole toolsets missing for monitoring and analyzing the collective folksonomy. There is also a need for a really good disambiguation tool and approach (particularly now that RawSugar is gone as a viable approach).



June 23, 2007

The Social Enterprise

I am just back from Enterprise 2.0 Conference held in Boston, where I presented Bottom-up All The Way Down: How Tags Help Businesses Organize (thanks to Stowe Boyd for the tantalizing session title), which was liveblog captured by Sandy Kemsley as "Enterprise 2.0: Thomas Vander Wal". I did not catch all of the conference due to some Boston business meetings and connecting with friends and meeting digi-friends whose work I really enjoy face-to-face. The sessions I made it to were good and enlightening and as always the hallway conversations were worth their weight in gold.

Ms. Perceptions and Fear Inside the Corporate Walls

Having not been at true business focussed conference in years (until the past few weeks) I was amazed with how much has changed and how much has stayed the same. I was impressed with the interest and adoption around the social enterprise tools (blogs, wikis, social bookmarking/folksonomy, etc.). But, the misperceptions (Miss Perceptions) are still around and have grown-up (Ms. Perception) and are now being documented by Forrester and others as being fact, but the questions are seemingly not being asked properly. Around the current social web tools (blogs, wikis, social bookmarking, favoriting, shared rating, open (and partially open collaboration) I have been finding little digital divide across the ages. Initially there is a gap when tools get introduced in the corporate environment. But this age gap very quickly disappears if the incredible value of the tools is made clear for peoples worklife, information workflow, and collaboration, as well as simple instructions (30 second to 3 minute videos) and simply written clear guidelines that outline acceptable use of these tools.

I have been working with technology and its adoption in corporations since the late 80s. The misperception that older people do not get technology, are foreign to the tools, and they will not ever get the technical tools has not changed. It is true that nearly all newer technologies come into the corporation by those just out of school and have relied on these tools in university to work intelligently to get their degree. But, those whom are older do see the value in the tools once they have exposure and see the value to their worklife (getting their job done), particularly if the tools are relatively simple to use and can be adopted with simple instruction (if it needs a 10 to 200 page manual and more than 15 minutes of training to start using the product effectively adoption will be low). Toby Redshaw of Motorola stated on a panel that he found in Motorola (4600 blogs and wikis and 2600 people using social bookmarking) "people of all ages adopt these tools if they understand the value connected to their work". Personally, I have seen this has always been the case in the last 20 years as this is how we got e-mail, messaging, Blackberries, web pages, word processing, digital collaboration tools (the last few rounds and the current ones), etc. in the doors of small to large organizations. I have worked in and with technically forward organizations and ones that are traditionally thought of as slow adopters and found adoption is based on value to work and ease of use and rarely based on age.

This lack of understanding around value added and (as Toby Redshaw reinforced) "competitive advantage" derived from the social tools available today for use in the enterprise is driven by fear. It is a fear of control that is lost from the top-down. But, the advantage to the company from having this information shared and easy found and used for collaboration to improve knowledge, understanding, and efficiency can not be dismissed and needs to be embraced. The competitive advantage is what is gained today, but next month or next quarter it could mean just staying even.

Getting Beyond Fear

But, what really is important is the communication and social enterprise tools are okay and add value, but the fear is overplayed, as a percentage rarely occurs, and handling the scary stuff it relatively easy to handle.

Tagging and Social Bookmarking in Enterprise

In the halls I had many conversations around tagging ranging from old school tagging being painful because the experts needed to tag things (meaning they were not doing the job as expert they were hired to do and their terms were not widely understood) all the way to the social bookmarking tools are not scaling and able to keep up with the complexity, nor need to disambiguate the terms used. But, I was really impressed with the number of organizations that have deployed some social bookmarking effort (officially or under somebody's desk) and found value (often great value).

Toby Redshaw: I though folksonomy was going to be some Bob Dillon touchy-feely hippy taxonomy thing, but it has off the chart value far and above any thing we had expected.

My presentation had 80 to 90 percent of the people there using social bookmarking tools in some manner in their organization or worklife. The non-verbal feed back as I was presenting showed interest in how to make better sense of what was being tagged, how to use it better in their business, how to integrate with their taxonomy, and how to work with the information as the tools scale. The answers to these are longer than the hour I have, they are more complex because it all depends on the tools, how they are set-up and designed, how they are used, and the structures of information inside and outside their organization.



June 16, 2007

New Profession Unfolding In Beauty and Geekery

A week or more ago I ran across the incredible video of Blaise Aguera y Arcas presentation of Photosynth and Seadragon at TEDTalks 2007. The video is stunning work of Seadragon and Photosynth bringing a collection of images to life from one or more resources.

While the video and ideas behind the tools are incredible displays of where we are today with technology and where we are heading, this caused some ideas I have been trying to get to gel to finally come together. In this video Blaise states (my own transcription):

So what the point here really is, is we can do things with the social environment taking data from everybody, from the entire collective memory of what the earth looks like, and link all of that together and make something emergent that is greater than the sum of the parts. You have a model that emerges of the entire earth, think of it as the long tail to Stephen Lawlers Virtual Earth work. This is something that grows in complexity as people use it and whose benefits become greater to the users as they use it. Their own photos are getting tagged with metadata that somebody else entered. If somebody bothered to tag all of these saints and say who they all are, then my photo of the Notre Dame Cathedral suddenly gets enriched with all of that data. I can use it as an entry point to dive into that space in that metaverse, using everybody else's photos, and do a cross-modal and cross-user social experience that way. Of course a by product of all of that is an immensely rich virtual models of every interesting part of the earth, collected not just from overhead flight and satellite images, but from the collective memory.

Torrent of Human Contributed Digital Content

What this brought together was the incredible amount of human contributed digital content we are sitting on top of at this moment in time. This is not a new concept, but what is different is the skills, tools, and understanding to make use and sense of all this content are having to change incredibly. The Photosynth team is making use of Flickr content that has been annotated by humans (tags, titles, and descriptions), as well as by devices (date, time, location, etc.). This meta information provides hooks put pull disparate information back from its sole beauty and make an even greater beauty and deeper understanding. The collective is better than the pieces, but pulling to collective together in a manner that is coherent, adds value, and brings deeper appreciation is where get hard.

Much of information understanding and sense making to date has relied on human understanding and we have used tools to augment our understanding. But, we now need to rely on deeper analytics in quantitative methods and advanced algorithms to make sense and beauty out of the bits and bytes. The models of understanding are changing to requiring visualizations methods (much like those of Stamen Design) to begin to grasp and see what is happening in our torrent of information at our finger tips and well as make sense of the social interactions of our digitally networked and digitally augmented lives.

Amalgamation of Designer and Quant Geek

What gelled in my mind watching the Blaise demonstration is there is a skill set missing in the next generation comprised of amalgamated design, information use, analytical foundation, and strong quantitative skills. I have clients in start-up businesses and in enterprise that are confronting these floods of information they need to make sense of from folksonomies and customer generated content (including annotations and regular feedback). The skills needed for building taxonomies are not translating well when the volume of information the information managers are dealing with is orders of magnitude higher than what they dealt with previously. The designer, information architect, and taxonomist who have traditionally have dealt with building the systems of information order, access, and use are missing the quantitative skills to analyze and make sense out of a torrent of loosely structured information and digital objects. Those with the quantitative and strong analytical skills have lacked the design and art skills to bring the understanding into frame for regular people grasp and understand.

This class of designer and quant geek is much like the renaissance men, but today the field of those forging new ground is open to men and women. The need to understand not only broad but deep sets of data and information so to contextualize it into understanding is the realm of few, unfortunately as there is a need for many.

I know of limited pockets of people with the skills to do the hard work of querying the vast array of information, objects, and raw data then make something of value of it. But, there needs to be more of these people getting trained as designers with solid quantitative and analytical skills (or the converse). Design shops are missing the quant geeks and engineering shops are missing the visualization geeks that bring this digital world rich in opportunity into something that makes sense and beauty.

If you know people like this that are bored, please let me know as I am finding opportunities flowing.



June 13, 2007

Full-Day Social Web & Folksonomy Workshop at d.construct

Tickets for the d.construct Workshops go on sale June 14, 2007. Buying a ticket for a full-day workshop provides free access to the full d.construct conference on September 7th. I am presenting the following workshop on September 6th...

Building the Social Web with Tagging / Folksonomies

On September 6th, 2007 Thomas Vander Wal will be holding his Building the Social Web with Tagging/Folksonomies — d.construct Workshop — at Brighton Dome, Brighton, England, UK.

Thomas Vander Wal, creator of the term folksonomy, provides a full-day workshop on building the social web through a detailed look at tagging systems. The workshop will provide a foundation for understanding social software from the perspective of the people who use it. This perspective helps site owners solve the ‘cold start’ problem of social software not starting out social.

The focus of the workshop is to provide a solid foundation for building and maintaining a social system from the design and management perspective. The workshop will cover policy issues, monitoring, analysis, and tagging systems as features that are added to the mix of existing tools.

The day will provide a brief history of tagging from the days of tagging in the desktop era to current web use. The exercises will focus on better understanding what happens in tagging systems and use those lessons to frame how to build better systems and make better use of the information that is made relevant through those tagging systems. The workshop includes overviews of social web pattern interaction design and the wide array of features.



Folksonomy Provides 70 Percent More Terms Than Taxonomy

While at the WWW Conference in Banff for the Tagging and Metadata for Social Information Organization Workshop and was chatting with Jennifer Trant about folksonomies validating and identifying gaps in taxonomy. She pointed out that at least 70% of the tags terms people submitted in Steve Museum were not in the taxonomy after cleaning-up the contributions for misspellings and errant terms. The formal paper indicates (linked to in her blog post on the research more steve ... tagger prototype preliminary analysis) the percentage may even be higher, but 70% is a comfortable and conservative number.

Is 70% New Terms from Folksonomy Tagging Normal?

In my discussion with enterprise organizations and other clients that are looking to evaluate their existing tagging services, have been finding 30 percent to nearly 70 percent of the terms used in tagging are not in their taxonomy. One chat with a firm who had just completed updating their taxonomy (second round) for their intranet found the social bookmarking tool on their intranet turned up nearly 45 percent new or unaccounted for terms. This firm knew they were not capturing all possibilities with their taxonomy update, but did not realize their was that large of a gap. In building their taxonomy they had harvested the search terms and had used tools that analyzed all the content on their intranet and offered the terms up. What they found in the folksonomy were common synonyms that were not used in search nor were in their content. They found vernacular, terms that were not official for their organization (sometimes competitors trademarked brand names), emergent terms, and some misunderstandings of what documents were.

In other informal talks these stories are not uncommon. It is not that the taxonomies are poorly done, but vast resources are needed to capture all the variants in traditional ways. A line needs to be drawn somewhere.

Comfort in Not Finding Information

The difference in the taxonomy or other formal categorization structure and what people actually call things (as expressed in bookmarking the item to make it easy to refind the item) is normally above 30 percent. But, what organization is comfortable with that level of inefficiency at the low end? What about 70 percent of an organizations information, documents, and media not being easily found by how people think of it?

I have yet to find any organization, be it enterprise or non-profit that is comfortable with that type of inefficiency on their intranet or internet. The good part is the cost is relatively low for capturing what people actually call things by using a social bookmarking tool or other folksonomy related tool. The analysis and making use of what is found in a folksonomy is the same cost of as building a taxonomy, but a large part of the resource intensive work is done in the folksonomy through data capture. The skills needed to build understanding from a folksonomy will lean a little more on the analytical and quantitative skills side than the traditional taxonomy development. This is due to the volume of information supplied can be orders of magnitude higher than the volume of research using traditional methods.



May 31, 2007

Folksonomy Book In Progress

Let me start with an announcement. I have not had any answer for continual question after I present on tagging and folksonomy (I also get the question after the Come to Me Web and Personal InfoCloud presentations), which is "where is your book?" Well I finally have an answer, I have signed with O'Reilly to write a book, initially titled Understanding Folksonomy (this may change) and it may also be a wee bit different from your normal O'Reilly book (we will see how it goes).

I am insanely excited to be writing for O'Reilly as I have a large collection of their books from over the years - from the programming PHP, Perl, Python, and Ruby to developer guides on JavaScript, XHTML, XML, & CSS to the Polar Bear book on information architecture, Information Dashboard Design, and Designing Interfaces: Patterns for Effective Interaction Design along with so many more.

Narrowing the Subject

One of the things that took a little more time than I realized it would take is narrowing the book down. I have been keeping a running outline of tagging and folksonomy related subjects that have been in my presentations and workshop as well as questions and answers from these sessions. The outline includes the deep knowledge that has some from client work on the subject (every single client has a different twist and set of constraints. Many of the questions have answers and for some the answers are still being worked out, but the parameters and guidelines are known to get to viable solutions.

Well, when I submitted the outline I was faced with the knowledge that I had submitted a framework for a 800 to 1,000 page book. Huh? I started doing the math based on page size, word counts, bullets in the outline, and projects words per bullet and those with knowledge were right. So, I have narrowed it down to an outline that should be about 300 pages (maybe 250 and maybe a few more than 300).

What Is In This Smaller Book?

I am using my tagging and folksonomy presentations as my base, as those have been iterated and well tested (now presented some version of it well over 50 times). While I have over 300 design patterns captured from tagging service sites (including related elements) only a few will likely be used and walked through. I am including the understanding from a cognitive perspective and the lessening of technology pain that tagging services can provide to people who use them. There will also be a focus on business uses for intranet and web.

When Will This Be Done

Given that I have a rather busy Fall with client work, workshops, and presentations I set a goal to finish the writing by the end of Summer. It sounds nuts and it really feels like grad school all over again, but that is my reality. I have most of the words in my head and have been speaking them. Now I need to write them (in a less dense form than I blog).

Your Questions and Feedback

If you have questions and things you would like covered please e-mail me (contact in the header nav above). I will likely be setting up a blog to share and post questions (this will happen in a couple weeks). I am also looking for sites, organizations, and people that would like to be included in the case studies and interviews (not all will end up in the book, but those that are done will end up tied to the book in some manner). Please submit suggestions for this section if you have any.



May 7, 2007

Hoping About

Things have been a wee bit busy the past few weeks. I am off to Banff tomorrow (Monday) and boomerang right back after the WWW Conference Tagging Workshop as I have two days of private workshops in DC just following days.

I am off to the 2007 Identity Workshop for a few days, in part to talk to the some TagCommons people face to face, as well as have some client work to follow-up on. I am then off to south of the boarder, for some work before heading back to the office.

Tagging Workshop at d.construct

I should let you know early that I will be doing a full-day tagging workshop prior to d.construct 2007 in Brighton, England in September. I will post more about this as it is announced. The space is rather limited so keep an eye out.

Workshops Near You & Packages

Those interested in the workshop and I will add you to a list for announcing them. If you would like one in your organization or city I can help get this moving. Toward the end of May I will be providing more information about these, the getting smart packages (workshop or presentation combined with days of advising over a set of months). As I have mentioned these to people the interest is quite strong, so if you want more info on these before they are public on the InfoCloud Solutions site drop me an e-mail.

E-mail

If you have an e-mail that may have an answer that would be longer than 2 minutes to write I likely still have it lined up, but if you want to jump that line, send the e-mail again (or a series of short e-mails with single questions). I am deeply sorry for my delay in responding. I have no excuse, but the need for more time.



April 17, 2007

Tagging That Works Presentation Links

Today#&039;s presentation at the O'Reilly Web 2.0 Expo seemed to go very well. My session was Tagging That Works had really good feedback, which I thought was good as I really did not know the audience coming in to the presentation.

The presentation can be downloaded as PDF from Tagging That Works or can be viewed on Tagging That Works at SlideShare or view below...



April 13, 2007

From the HQ Office

It has been a good stretch of travel, mostly for work/professional life, but also took a trip to Florida for family holiday. At the moment I am back in the office working on proposals for upcoming projects of various lengths for clients and working through the process of writing, which involves dead trees at the final stages.

Web 2.0 Expo and SF Bay Area

I am soon off again to the San Francisco Bay Area to speak at the O'Reilly Web 2.0 Expo and have business meetings around the Bay Area (please ping via e-mail if you would like to meet-up during this time).

WWW2007 Workshop on Tagging and Metadata

Early next month I am off to Banff to keynote the WWW2007 Workshop on Tagging and Metadata for Social Information Organization. I am not sure how long this trip will be as I will have some pressing work around this time.

Social Software Summit

Lastly, I should note there will be a Social Software Summit that will run at the same time as the ASIS&T IA Summit next Spring (Spring 2008) in Miami. The Social Software Summit is still in its early stages of planning (the idea, dates, location, and interest have been launched). The dates are April 10-11 2008. I have a role in the planning and preparation for this event, along with some other incredible people.



March 3, 2007

On SXSW Tag You're It Panel

I am a panelist on the Tag You're It Panel at South by SouthWest in Austin, Texas. Others on the panel are the ever fantastic: Heath Row (moderator), George Oates, and Ben Brown. The panel information:

Tag You're It on Saturday 10 March 2007 at 2:00 pm to 3:00 pm. The panel will be looking at what people are actually doing inside social tagging systems and where things have gone in the past couple years with tagging. We will get beyond the notion that tagging is cool by providing examples of how people are really using the tools in innovative and useful ways.

Stop by and say hello.



February 28, 2007

Analysis of LibraryThing vs. Amazon Tagging Analysis

I have posted my Breaking Down LibraryThing vs. Amazon Tagging Analysis over at Personal InfoCloud. I have spent a lot of time analyzing what Amazon is doing with tagging over the past 16 months. Much of it was missed, but that was not the disappointing bit in the analysis. Most of the comparisons being made were really apples to oranges.

At some point I will write-up an analysis of what Amazon is doing well (some things they are doing brilliantly) and where it has yet to really take advantage of what they have. This will likely have to be broken in to a series as my the two impromptu presentations on the subject have been about an hour long (yes, there is that much there), not including the background set up bits.

I have been including a highlevel view of Amazon tagging in my normally full tagging/folksonomy presentation for the last year or so as there are valuable examples in what is there and their iterations.



February 22, 2007

Ma.Del Tagging Bookmarklet

Out of frustration with Yahoo MyWeb no longer surfaces results in Yahoo Search, which made Yahoo Search much better for me than any other web search. Now that this is no long functioning and there is no response as to if or when it will return I am back to Google and Microsoft Live Search (the relevancy is better for me on many things). But, this change also removes the value of MyWeb and this has me looking back to Ma.gnolia (also am a huge fan of Raw Sugar and their facets, but that is another longer post).

New Tagging Combo Bookmarklet

When I became a fan of MyWeb I used some glue to make Del.icio.us and MyWeb Combo Bookmarklet.

So now I have done the same for Ma.gnolia and del.icio.us with the Ma.Del Marklet (drag to bookmark bar in FireFox and Safari only). This was built using the Ma.gnolia bookmarklet Ma.rker Mini as its base.



February 4, 2007

Static Folksonomy Definition Posted

After many requests, mostly from academics wanting a place to point their cite, I have written and posted a static Folksonomy page. This page may get some minor edits in the next day or so, but it is set. This page will not change, nor be impacted by any change to the blogging software (still my own hand-rolled tool from 2001).

You are now free to quote and point.

Yes, this took to long to put in place. It took a few requests in the past three weeks to put it higher up on the priority list.



February 1, 2007

Pew Research on Tagging

Lee Ranie of the Pew Internet and American Life Project announced the release of Pew Internet Project Report on Tagging in America. The report also includes an extensive interview with David Weinberger on the subject of tagging. The most interesting parts of this report at the percentages of people in America who tag (includes those who add categories). Based on their survey, which randomly selected and spoke to 2,373 adults, 28% of Americans online have added tags or categories. The survey found 7% of the respondents tag/categorize daily.

I am really happy with the report as it looks at the numbers from a use perspective. Up to this point I have been using tagging service provider numbers (few are made public) along with Alexa hit reports across many services and took that total and divided by the Neilsen report number of total people on the web (approximately 750 million people). This approach provided about .85% of all the people on the web are tagging (does not include tagging on blogs as that is more ad hoc categories, but that is a long post to explain or done over a beer or two).

The difference between the percentages in the Pew report and the numbers I backed into is the Pew is just an American view and mine was looking at things globally. Pew looks at tags and categories and many systems have categories. I am really comfortable with the daily number of 7% on the web are tagging/categorizing and I will likely use that number in future presentations. The 28% number is really surprising, but for one time use it is accurate. This represents a much larger user base than I thought, but is also includes categories with tagging.

Separating Tagging and Categories

The Pew Report on Tagging combines categories and tagging. While optimally it would be great to separate the two out, explaining the difference between the two to a regular person (non-geek) in America will be difficult. Asking if somebody has used certain functionality on a service or one of the 130 or so social bookmarking tools or the many hundreds of products that include tagging will negatively impact the results. The terms tagging and categories combined for a research question make for a question that is more easily answered yes or no.

The Pew Report provides a starting place for future research, hopefully delving into the subject with a little more clarity, where tagging and categories are separated.

Tagging and Race

If one looks at tagging as a means to refind information and looks at tagging as adding context by adding a person's own vocabulary and social terminology as one of the tools of tagging then looking at various social groups is a simple way to start to validate this (a much better approach is to ascertain why somebody is adding a tag). One simple way to look at different social structures is race. The inclusion of the break down of who tags by race can provide a good argument that people who tag are adding missing language terms, if the assumption is made that the content is missing metadata or is provided by somebody not of that race.

The Pew Report indicates the following tagging breakdown by race:

  • 26% of White, non-Hispanics
  • 36% of Black, non-Hispanic
  • 33% of English-speaking Hispanic

These higher numbers of people tagging who are not white seems to support the idea that those whose vocabulary and terminology is not represented will tag to ease their refinding the information. When things are in familiar terms they are easier to find and having the ability to tag from one's own context eases refindability. The Report does not dive into this and it is a really good subject for future research.

[I initially posted this at Personal InfoCloud :: Pew Research on Tagging, which has comments open



November 21, 2006

Beneath the Metadata - Pointer to Replies

I have read the "Beneath the Metadata: Some Philosophical Problems with Folksonomy in the November 2006 DLib. Boy, did I have problems with it, but so did David Weinberger, who responded with Beneath the Metadata - a reply.

My reading of the DLib article brought back the pain of taxonomies and the "expert" arrogance that occasionally accompanies taxonomies. I have worked in many enterprise organizations who have gone down the taxonomy route and had decent results. Taxonomies are essential parts of building information management tools. But taxonomies are never done, they are not easily emergent, they are incredibly resource intensive (they need a lot of money and people to build them and maintain them), and they don't work for everybody (sometimes large portions of the people who use the information system can not find or refind information they want or need using the taxonomy). When we would survey the people using our intranet or the internet application, one of the top responses was things were difficult to find as they were not called what they expected them to be called. This can be before or after a few hundred thousand dollars were spent building a taxonomy.

The remainder of this reply is posted at: Beneath the Metadata - Replies, where comments are turned on.



November 10, 2006

New Podcast Interview of Thomas Vander Wal by Brian Oberkirch

I have been slow in pointing to a recent Podcast interview of Thomas Vander Wal by Brian Oberkirch. Brian and I have been trying to schedule this chat for quite some time. We cover a broad range of subjects that are of interest to me and I have been thinking about and playing with lately.

Brian has a great collection of podcasts interviews from his edgework series. I have listened to many and really enjoy them.



November 1, 2006

No Personal or Work E-Mail to My Gmail Address

If you want to send an e-mail that gets my attention, please use an address other than my Gmail address. I mostly use that address for listserves. The ability to search, parse, and scan e-mail in Gmail just does not work for me and things I really want to follow-up with only get addressed if I forward them to myself at an other address. [Granted the amount of e-mail I am getting and daily communication is more then I can normally keep-up with at the moment. I deeply apologize if I owe you a response. I need to better embrace the DTD model as my GTOMG model leave too many things left unaddressed.]

Filters, Labels, and Tags

The Gmail interface does not work well for me personally to highlight, track, and respond to the mail. I had a lot of hope for Gmail and its ability to tag (or in Google terms, "label"), but its interface is really poor for doing this with anything more than 10 or 15 labels. When I want to manually applying more than one label the interface is really poor (at best).

GTDGmail

I have looked at the GTDGMail mail as a solution, as its interface is much much better than what Google has churned out. While the GTDGmail is a vast improvement the remainder of Gmail for personal or work mail does not scale to meet my needs on that front. If you are unpleased with the Gmail labelling, as most I know are, you owe it to yourself to look at GTDGmail.



October 26, 2006

Yahoo! Bookmarks Beta (or Alpha)

Yahoo! has released it fourth or fifth public bookmarking site, Yahoo! Bookmarks Beta to go along with Yahoo! Bookmarks, del.icio.us, and two versions of Yahoo! MyWeb. This new version seems aimed at being a long needed replacement for the relatively ancient Yahoo! Bookmarks. But, as the post on Better Bookmarks, Better Toolbar this new Bookmarks will do away with Yahoo! MyWeb, as MyWeb will be bundled into del.icio.us. This for me seems really odd as MyWeb2 was much better with the social network than del.icio.us has been. I am going to focus on the new Bookmarking site, because there are some things I like, but there are things that are quite broken and should have been caught with a decent quality assurance test or a decent interaction design heuristic test (some of the things that are broken have been broken in MyWeb 2 for months and it seems to have been imported here). I am normally a big fan of what Yahoo! does, but this release is horribly bumpy and would to be better suited with an Alpha moniker.

Y! Bookmarks Beta Good Things

Yahoo! Bookmarks has been needing an overhaul for years. It is great to see that the six or seven year old product is finally getting attention. Keeping the folder metaphor is good for those that have lived in that realm is a good thing and including tagging as well is a great step forward for this product (oddly, an odd interface for adding tags is used, but that is for later and a rather minor thing compared to the bigger bumps). Having the video for an introduction is a great step forward and would have been a great asset for MyWeb 2 (not so sure it would help adoption with del.icio.us as its interface seems to be a stopping point for regular people using the web) as it would illustrate the lightbulb moment for people to understand why MyWeb 2 is important and useful.

The basic interaction design improvements are very good, with the drag and drop (there are usability/accessibility limitations with drag-and-drop and it would seem like the click-and-stick would have been much better, but that is another long post). The three view options for the bookmarks is helpful too as it provides a nice visual interface with helpful information or ones that are more scannable for people. The layout of the full view is a really nice improvement over the existing MyWeb 2 interface. Another great step forward is the URLs are readable links in the status bar not the hash or unfriendly to human links that were in MyWeb 2.

The URLS overall are well designed in Bookmarks Beta. They can be guessed and edited easily. This is a wonderful change from MyWeb 2.

Bookmark Homepage Oddities

As mentioned above there are some (many) places that need help or some attention to detail in the new Bookmarks. I am using screen captures to help illustrate the points and the images are on Flickr and notations are there. Some of this seems snarky at times, but I am rather shocked that so many details and blatant errors made it public. I am a huge Yahoo fan, for a long list of reasons, but this does get me to question the attention to detail and care that goes into design and development. This was likely hundreds of hours of work by a team and a lot of testing. Just really surprised.

bookmarks_home_default_sort

When I first came to the new Bookmarks Home page I was surprised to see all of the content. My expectation was it was going to be my old bookmarks that were included in My Yahoo! pages, which I update and are extensions of bookmarks from 1999. There was no clue on the page that the content had come from MyWeb 2, it took some digging and the "imported delicious" in my tags was the clue. There is no explanation how the bookmarks would be integrated into My Yahoo (I don't want my 2,400 some MyWeb bookmarks in My Yahoo).

The interface on Bookmarks Beta, while nice is difficult to find the sorts and folder/tag view modification as the typeface is very small. The "Sort by:" does not state was the default sort is. The sort is a toggle between date and title (presumably title by alphabetical sort, but my assumptions seem to be off on many things on the site).

The tools bar with view selection, add, edit, move, send, and delete was a little confusing. Some of the tools relate to making a check box selection in the bookmarked items, but that is not clear. While, other tools are not related (view selector and add). I easily understood view, add, edit, and delete were. Move has an icon that indicates moving out of a folder, but I was not clear where a "move" would put the selected items. Was it going to a folder, into My Yahoo sidebar, into del.icio.us, etc. Where was it moving things to? Send had similar problems as one could send by e-mail (should it state e-mail instead?) Why not use the really helpful convention in Yahoo! Local, which is really clear as to where things can be sent? Lastly, I found out that deleting something from Bookmarks removes the item from MyWeb 2 and that should not happen, unless it is made clear in the page that your bookmarks are being pulled from that repository, which Bookmark Beta fails to do.

Edit Bookmarks Broken

edit_form

The Edit Form page was where I began to think that the Bookmark Beta was more an Alpha. I had first thought it was my using Firefox 2 as a browser, but the same if not worse problems also exist in my Safari browser. The edit bookmark screen is missing labels for the form fields, but it is also missing the existing content. It seems that this could be caused by relying on JavaScripting rather than a server generated page, as this page does not degrade well at all. Additionally the tag fields are empty, where the tag I want to edit should be. If the tag had been in the text box field I would have had a far more painful time separating the multi-term tag into its intended single term tags. Yahoo MyWeb 2 did this really well with a convention called commas. The social bookmarking site, Raw Sugar also uses this common convention and has wonderful affordance for assisting people with their comma separate string of tags. Having text box fields limits the ability for scaling, even if the interface populates the screen with a new text box when the five offered are filled it is still a really clumsy interaction it seems (I know Yahoo! test the living daylights out of their interfaces, which is a great thing, and I would love to know how this interface ended up in the public). Oddly, the one thing missing from this screen is the ability to add this bookmark into a folder. The new Bookmark tool is keeping the folders or is it not? Should not all of the possible interactions be available from the edit view?

Additionally, in a second view of the bookmark edit screen you will see the selected entry is not next to the bookmark edit screen. This likely means that the item being edited, if selected from the lower portion of the page, will not be anywhere near the editing box. There really must be closer. There is a lot of JavaScript being used on the page already, why not hide the items not selected for editing to provide a better proximity for people editing?

Bookmark Search Missing Items or Poor Sort

Y! Bookmark Beta Search Results

I tried "Search bookmarks" to get "tech" items. This search is supposed to query tags, titles, descriptions, etc. The resulting set was missing the first item from my default view, which is tagged "tech" is not in this set returned. This set is set for a sort order by date, which should put the item at the top of the returned set. This was something I really wanted to try in search as a similar returned set has been the result in MyWeb 2 and del.icio.us for at least a couple months. The algorithm is horribly off or the the sort is off. The good thing in the Bookmark Beta is it lets you know the sort order (the state in the default result is called out correctly),and lets you select a different sort order. Unfortunately, the search is broken as it is elsewhere. When I ran the search on tags (in the tag view portion of the page) the proper result set was returned with the most recently added item with a "tech" tag right at the top of the date order sort.

The labeling of the page and the type of search is missing from the page. The heading for the results states "Search Results 1-10 or 572", but it does not say what type of search I just ran. A proper heading should be should be "Search Your Bookmarks Results 1-10 of 572".

Add Bookmark Screen

Y! Bookmark Beta Add Bookmark Screen

This page has few oddities. The thing that stands out on this add bookmark page is the "My Tags" area. In the folder view of that content object you can drag-and-drop an item into a folder. The convention has been set that there is a drag-and-drop connection between that content object and my bookmarks. But in the tag view you can not drag one of the 20 tags into an empty (or filled) tag text field. The convention that was set, does not extend.

More troubling is the "My Tags" content object has find functionality stating "Type Tag here" in the text field next to the find button. When I have the add screen open I am not expecting that to take me to a new screen. Since the add tag interface does not have type ahead from by tag set, I would think had been hopeful that I could drop in a tag and have other related tags I have used on bookmarks would surface. What does get returned is a tag search result page and my add bookmark screen is blown away. I realize that the convention for what happens with tag search/find is already set, but since the convention for drag-and-drop is broken from folders, other things could be emergent as well.

All My Tags

Y! Bookmark Beta All My Tags

This page is held back by poor labeling with the "All Tags" label, but it is actually "All My Tags" or some similar convention, as they are not all the tags from all of the users. The tags are semantically well structured in the XHTML as they are an unordered list, which is easy to parse mechanically or for accessibility reasons. The layout of the tags would benefit from having the list be full justified, which would provide a little more space around the tags leading to easier scanning of the page full of tags.

It is odd that the page has a handful of weighted tags, the flat list of tags alphabetically is easier to scan than a weighted tag cloud but these five tags that are most often used seems to be rather odd. I am quite happy not to see a full tag cloud.

Recommended Bookmarks

Y! Bookmark Beta Recommended Bookmarks

The Recommended bookmarks tab is the old unuseful default page from MyWeb 2, also known as the Interesting Today page. Ironically, there has never been anything interesting on this MyWeb 2 page. Yahoo Bookmarks has a really good clue as to what I find interesting (or any other person using the tool) or pay attention to, it is our bookmarks. We make an explicit statement each time we bookmark something as to what we have an interest in. This can easily be paired to find people who have bookmarked the same items (this identifies people who may be good sources for new bookmarks to recommend) and what vocabulary they have used to call that bookmark something (if they use the same terms to describe the bookmark it can be easily and most often correctly deduced that we do really have similar interests) and we have a few similar matches like this that person, their terms, and bookmarks can be used to build a list of things I would be interested in. If you take that list and parse it against things I have already bookmarked you will have a killer list of things to recommend me that I will care about. This can be server intensive, but the matching and pairing does not need to be done on the production server for the bookmarks, it can be chugging away in the background and serving up recommendations. This flows directly out of the presentation I have given to Yahoo! Tech Dev and have had many long discussions about at Yahoo! Since this is part of a public presentation I give all of competitors to Yahoo! have the information and most are putting it to use in various ways.

Wrap-up

Some of this seems harsh, but it is a public release by Yahoo! with a Beta moniker thrown on to it. But, much of this information Yahoo! already has as they have asked for the feedback before and received it. Things just don't get fixed. Some of these things are minor, but others are not details, they are big glaring errors. Yahoo has some of the best brains, designers, and developers on the planet and they should be producing products, even with Beta moniker that are not this rough. This is much closer to a Google product that is launched and is really rough around the edges and will likely not get fixed. At least I know with Yahoo things normally get ironed out, or at least they did.

None-the-less this has promise and it should be more accessible to regular people than MyWeb 2, but it seems really silly to throw out MyWeb 2 as it does many things better than del.icio.us, but del.icio.us does many things insanely well. Seeing the two products mixed will be a really tough challenge as it could easily break the fan base in del.icio.us or make a social bookmarking site like MyWeb 2 less approachable by putting a more geek-centric del.icio.us interface on it.

[I have added a follow-up to this focusing on the Yahoo! Roadmap for Social Bookmarking.]



October 25, 2006

Presenting at UIE Web Applications Summit

I am trying to improve my notification of what events I will be presenting. It is with this goal in mind I am letting you know the following... I will be at the UIE Web Application Summit: 21 January 2007 to 23, at the Monterey Marriott, Monterey, CA. I have always been impressed with the quality of the User Interface Engineering (UIE) events and I am delighted to not only attend, but present.

There is an early bird discount available for those who register by November 14th.



September 30, 2006

OZ IA Presentation - Folksonomy for IA is Posted

My just delivered presentation to OZ IA on, Folksonomy for IA (PDF 4.3MB).

Now it is time to focus on other's presentations and get then finally enjoying Sydney and the surrounding area. I am thinking of heading to Manley for the Jazz Festival on Monday.



September 20, 2006

Understanding Folksonomy: Tagging that Works presentation posted

I have finally posted my Understanding Folksonomy: Tagging that Works (4MB PDF) presentation from d.construct. I have been presenting the content in this for nearly 2 years and have been iterating it. I have been wanting to get the Folksonomy Triad out in public as it has been getting really strong response in the 18 months that I have been using it (in the last 9 months I turned it into an animation that really drives the point home). I have not done a movie of the presentation yet, but that could be coming in the next few months.

I have not been posting the presentations, as the size has been increasing and when they get blogged elsewhere the bandwidth shoots up. But, I have been playing with Amazon S3 to store these files at lower cost and eat less bandwidth. I have been playing with the Python and Ruby scripts, but when Jeff Barr demonstrated the S3 Firefox Organizer I knew it was made really simple to upload, set permissions, and grab a sharable URL.



September 14, 2006

Trip and d.construct Wrap-up

I am back home from the d.construct trip, which included London and Brighton. The trip was very enjoyable, the d.construct conference is a pure winner, and I met fantastic people that keep my passion for the web alive.

d.construct

The d.construct conference had Jeff Barr from Amazon talking about Amazon Web Services, Paul Hammond and Simon Willison discussing Yahoo and its creation and use of web services for internal and external uses, Jeremy Keith discussing the Joy of the API, Aral Balkan presenting the use of Adobe Flex for web services, Derek Featherstone discussing accessibility for Javascript and Ajax and how they can hurt and help the web for those with disabilities, myself (Thomas) discussing tagging that works, and Jeff Veen pulling the day together with designing the complete user experience.

Jeff Barr provided not only a good overview of the Amazon offerings for developers, but his presentation kept me interested (the previous 2 times my mind wandered) and I got some new things out of it (like the S3 Organizer extension for Firefox.

Jeremy was his usual great presenting form (unfortunately a call from home caused me to miss the some of the middle, but he kept things going well and I heard after that many people learned something from the session, which they thought they knew it all already.

Paul and Simon did a wonderful tag team approach on what Yahoo is up to and how they "eat their own dog food" and how the Yahoo Local uses microformats (Wahoo!).

Aral was somebody I did not know before d.construct, but I really enjoyed getting to know him as well as his high energy presentation style and mastery of the content that showed Flash/Flex 2.0 are fluent in Web 2.0 rich interfaces for web services.

Derek was fantastic as he took a dry subject (accessibility) and brought it life, he also made me miss the world of accessibility by talking about how JavaScript and Ajax can actually improve the accessibility of a site (if the developer knows what they are doing - this is not an easy area to tread) and made it logical and relatively easy to grasp.

I can not comment on my own presentation, other than the many people what sought me out to express appreciation, and to ask questions (many questions about spamming, which is difficult if the tagging system is built well). I was also asked if I had somebody explain the term dogging (forgetting there was a rather bawdy use of the term in British culture and using the term as those people who are dog lovers - this lead to very heavy laughter). Given the odd technical problems at the beginning of the presentation (mouse not clicking) things went alright about 5 minutes or so in.

Lastly, the man I never want to follow when giving a presentation, Jeff Veen rocked the house with his easy style and lively interaction with his slides.

I am really wanting to hear much more from Aral and Derek now that I have heard them speak. I am looking forward to seeing their slides up and their podcasts, both should be posted on the d.construct schedule page.

London Stays

The trip also included an overnight stay in London on the front and back end of the conference. Through an on-line resource I had two last minute rooms booked at Best Western Premiers that were great rooms in well appointed hotels. The hotels even had free WiFi (yes, free in Europe is a huge savings), which was my main reason for staying at these hotels I knew nothing about. I really like both locations, one near Earls Court Tube Station and the other Charing Cross Road and SoHo. The rooms were well under 200 U.S. dollars, which is a rarity in central London. I think I have a new place to track down then next time I visit London.

London People & Places

I had a few impromptu meetings in London and an accidental chat. When I first got in I was able to clean-up and go meet friends Tom and Simon for lunch at China Experience. We had good conversations about the state of many things web. Then Tom showed me Cyber Candy, which I have been following online. I was then off to Neal's Yard Dairy to pick-up some Stinking Bishop (quite excellent), Oggleshield, and Berkswell. I then did a pilgrimage to Muji to stock up on pens and all the while using Yahoo Messanger in a mobile browser (a very painful way to communicate, as there is no alert for return messages and when moving the web connection seems to need resetting often).

That evening I met up with Eric Miraglia for a great chat and dinner, then included Christian Heillmann (who has a great new book (from my initial read) on Beginning JavaSctipt with DOM Scripting and Ajax) in our evening. The discussions were wonderful and it was a really good way to find people of similar minds and interests.

On my last day in London I ended up running into Ben Hammersley as he was waiting for a dinner meeting. It was great to meet Ben in person and have a good brief chat. Somehow when walking down the street and seeing a man in a black utilikilt, with short hair, and intently using his mobile there are a short list of possibilities who this may be.

Food

My trip I had a few full English breakfasts, including one in Brighton at 3:30am (using the term gut buster), which was my first full meal of the day. The breakfast at the Blanche House (the name of the hotel never stuck in my head and the keys just had their logo on them, so getting back to the hotel was a wee bit more challenging than normal) was quite good, particularly the scrambled eggs wrapped in smoked Scottish salmon. The food the first night in Brighton at the Seven Dials was fantastic and a great treat. Sunday brunch at SOHo Social in Brighton was quite good and needed to bring me back from another late night chatting, but the fish cakes were outstanding. The last evening in London I stopped in at Hamburger Union for a really good burger with rashers bacon. The burgers are made with only natural fed, grass-reared additive free beef. This is not only eco-friendly, but really tasty. I wish there were a Hamburger Union near where I work as I would make use of it regularly.

Too Short a Visit

As it is with nearly every trip this year, the time was too short and the people I met were fantastic. I really met some interesting and bright people while in Brighton and I really look forward to keeping in touch as well as seeing them again.



July 27, 2006

WebVisons and MIT TechReview

Back from WebVisions

I am back from WebVisions in Portland, Oregon (the most enjoyable city in the U.S. for me) where I presented on Tagging in the Real Web World (my slides will be available at the end of this week). I loved WebVisions again as it is a great developer/designer to developer/designer conference with people sharing methods and frameworks with others to raise the level of everybody. It is a wonderful open sharing conference in the spirit of SXSW Interactive on a little more manageable scale.

MIT Technology Review Mentions Personal InfoCloud

I came back to a really nice mention in the MIT Technology Review article by Wade Roush on The Internet Is Your Next Hard Drive, which points to the Personal InfoCloud as its framing idea. I am increasingly seeing people wanting to store and have access to information across devices and services (or control their own destiny, as Gina Tripiani wants). It is about personal choice where and how their data, information, and media is stored. We are wanting continual access to the information, but may not want or have continual access to the internet or may not want it stored on us. Wade's article brings up some interesting options for those that want some or all of their storage on-line. It is time to dig into these options and see how close they get from a Personal InfoCloud perspective and personal aggregation, when we want and need the information at our finger tips (you know, the technical nirvana we have always dreamed and talked about).



July 15, 2006

Preparing for Web Visions and Other Stuff

Things have been quiet around here as I have been working on my 'Tagging in the Real Web World' presentation for WebVisions in Portland, Oregon (you are going aren't you?), bring on some new clients at InfoCloud Solutions, and working on longer (okay, my normal length) pieces for Personal InfoCloud and some other places that flesh out single slides from recent, and not so recent presentations.

The Tagging in the Real Web World is a new presentation, it has a handful of slides from recent folksonomy presentations that helped the tagging light bulb click. I am not fully focussing on folksonomy, but looking at tagging services and tagging that is being included in other web services.

In September, I will be doing a deeper dive into Understanding Folksonomy at d.Construct in Brighton, England. More on this a little later, but you should note tickets go on sale (they sold out in 30 minutes last year) Tuesday, July 18th at 10am (GMT).



May 26, 2006

Memephoria

While I was responding to a friend's e-mail about another large corporation using the term folksonomy I realized that at the moment I do not care if somebody is using it correctly (often people use it to mean tagging -- not tagging that actually works or to mean a tag cloud (the things that are cute but provide little value)). I realized that on the path of a term becoming a buzz word it gets adopted by those who have a case of memephoria.

Memephoria is the state of believing that spreading the latest meme as a mantra will earn you transcendence. Memephoria does not require one to understand the term used in the meme mantra, just to use it (correctly or in-correctly).



May 24, 2006


May 16, 2006

Live Data Could Solve the Social Bookmarking Problem with Information Volatility

Alex brings up something in his Go and microformat stuff! covering what is in the works with Microformats at Microsoft. Scroll down to where Alex talks about "mRc = Live data wiring", now this live data access is incredibly important.

One of the elements that has been bugging me with social bookmarking it the volatility of the information is not taken into account when the bookmark is made. No, I am not talking about the information blowing up, but the blood pressure of the person bookmarking may rise if the data changes in some way. I look at social bookmarking, or bookmarking in general as a means to mark a place, but it fails as an indicator of state or status change of the information we are pointing to. The expressing of bookmarking and/or tagging is an expression of our explicit interest in that object we bookmarked and/or tagged. The problem is our systems so far are saying, "yes, you have interest, but so what".

What the live data approach does is makes our Personal InfoCloud active. If we could bookmark information and/or tag chunks of information as important we should be able to find out when that information changes, or better get an alert before the information changes. One area where this is essential and will add huge value is shopping. What happens with products in the real world? The prices change, they go out of stock, the product is modified, production of the product stopped, etc. The permeations are many, but those expressing interest should be alerted and have their information updated.

One of the things I have been including in my "Come to Me Web" presentations is the ability to think about what a person needs when they use and want to reuse information. We read about a product we desire, we read the price, but we may think about the product or put it on a wish list that is related to an event in the future. When we go to act on the purchase the information we have gathered and bookmarked may be out of date.

One solution I have been talking about in my presentations is providing an RSS/ATOM feed for the page as it is bookmarked so the person gets the ability to get updated information. I have built similar functionality into past products years ago that let people using data know when the data changed (e-mail) but also provided the means to show what the data was prior and what it had changed to. It was functionality that was deeply helpful to the users of the system. Live data seems a more elegant solution, if it provides the means to see what information had changed should the person relying on or desiring the information want it.



Upcoming Conferences I am Presenting at and Attending

Okay, things have been quite busy here. But, here will be changing as I am hitting the skies a bit in the short term. This means I may be near you so reach out and we can hang out and chat. I am completely looking forward to all the places on my schedule and seeing all of the people.

XTech

I am off to Amsterdam, Netherlands (no not that other one) this week to speak at XTech. I will be presenting Developing for the Personal InfoCloud on Thursday at 11:45 in the morning.

BarCamp Amsterdam

On Saturday I will be attending BarCamp Amsterdam for part of the time.

Seattle Area

Following the Amsterdam trip I should be in the Seattle area for work. I don't have dates as of yet, but if you shoot an e-mail I will be sure and connect.

Microlearning 2006 Conference

I will be heading to Innsbruck, Austria for the Microlearning Conference and preconference (June 7). I will be talking about microcontent in the Personal InfoCloud and our ability and desire to manage it (one means of doing this is folksonomy, but will be discussing much more).

Following Innsbruck I may be in Europe a bit longer and a little farther north. I will be in Amsterdam just following the conference, but beyond that my schedule has not yet fully jelled.

WebVisions 2006

I will be heading to WebVisions 2006 in Portland, Oregon July 20th and 21st. I will be speaking on Friday the 21st about Tagging in the Real World. This will look at how people are making use of tagging (particularly tagging services) and looking at the best practices.

The Fall

In September it looks like I will be in Brighton, UK for a wonderful event. I should also be in Australia later in September for another conference.

As these events get closer, I will be letting you know.

Yes, I know I need to be publishing this information in hCal, but I have been quite busy of late. But, I am moving in that direction very soon. You can also follow what I am watching and attending in Upcoming for vanderwal.



April 30, 2006

Popularity Overrated?

Matt McAlister brings up the problems of being popular. This is a subject I have been spending a fair amount of time thinking about the past few months. Matt has a statement that is at the core of my focus, "Popularity-driven models water down the value in those hard-to-find nuggets." I spend a lot of time with regular people talking to them about tagging and many of the newer web tools that are popular with the forward thinking web geek crowd. One of the biggest problems stated are around the popularity tools, like tag clouds and collective voting on news (e.g. digg, etc.).

The problems are related to popularity getting in the way of what they are seeking. The tag cloud is what gets noticed on pages, but most people think del.icio.us (or any other tool or service that uses tag clouds) is fully represented by the tag cloud. That is a huge problem as del.icio.us is a very broad tool, but a quick look at what is in a tag cloud or the new items on the front page has users thinking it is a very narrowly focussed social bookmarking tool that mostly attracts people with technical and web interests. This completely misses the communities that sit under that tag cloud. In popular tools most of the content and communities of interest are sitting below the tag cloud and are not represeted at all by the tag cloud.

Much of the value of human filtering, which is the capability of a social bookmarking tools (like del.icio.us, RawSugar, Shadows, and Yahoo's MyWeb 2) is in finding the those &#quot;hard-to-find nuggets" (as Matt states). The value in these tools is being able to follow certain people on specific subjects, which they bookmark and tag. Many of these tools are fairly good at this, but they must focus on the specific interests not just the person in that service. As the tools grow with more people using them the tools must scale to allow us to filter out the noise.

Popularity does not help filter, but it takes the fire hose of information and just focusses it. What we find with the popularity tools it that much of this information can be found elsewhere. Remember high school? Do the popular 10% represent the interests of the remaining 90%? Didn't think so. Now look at the popularity tools and interfaces and you begin to see the problems that the 95% of the web users have with these tools. They don't scale, they are tied to their interests that they celebrate as being popular. How do regular people fly below the tag cloud? How do regular people use a Digg or a memeorandum to find their interests (if these sites were that broad)? How do we (as web developers and designers) build for breadth and depths to surface that, which is lost in the regular web search engines?

Seeing how Yahoo's MyWeb 2 surfaces content that people in one's own community have found and bookmarked, it could be that tagging is one of the methods (MyWeb 2 is hands-down my favorite social bookmarking tool as it makes Yahoo Search the best search engine for me by a long shot because it focusses on my vocabulary and interests. Were my interests focussed on model railroading or knitting a tool along these lines would be far more valuble than any other tool. Finding new items, as well as the gems that are hidden, is quite tough on the web today and I don't see the popularity tools doing anything to fix this.

Does this mean that the popularity tools do not work? No, but their usage is limited.



April 26, 2006

Off to Hang at the Jersey Shore with Librarians

I am off to the New Jersey Library Association 2006 Conference to do a presentation on tagging and folksonomy. If you are there stop by and say hello. I am really looking forward to this event.



April 10, 2006

Now Blogging at Tagsonomy

Just because it was not difficult enough for you to follow everything I am writing, I am now starting to blog over at Tagsonomy, a group blog focussed on tagging (go figure). What will happen to tagging and folksonomy discussions here and over at Personal InfoCloud? They will continue, but may be syndicated. (Stop the snickering, there are things that are near posting shape for Personal InfoCloud and we have been a wee bit busy.)



April 7, 2006

CIO Magazine Gets Tagging and Folksonomy

CIO magazine has a wonderful article by Michael Fitzgerald on The Name Game: Tagging tools let users describe the world in their own terms as taxonomies become "folksonomies.". I get quoted in the piece, but aside from that the editorial is very good. Michael gets that putting information in each person's vocabulary is important. We loose so much information and having the means to pull it all back in and refind it is an incredible tool to have with in our reach.



April 3, 2006

Mr. Thackara Provides Fodder for Two Loose Thoughts

Things have been busy of late after a return from Vancouver, British Columbia from the IA Summit. It took a week to get through taxes stuff for a four month old company (as of January 1) and a large stack of e-mail (in which responding meant more e-mail).

Yesterday morning I had the pleasurable fortune to have breakfast with John Tackara of Doors of Perception fame. I really need to put two things out there that popped up in conversation that I need to think about more deeply.

Children today are not into the web tied to computers, but focus on their friends through the mobile voice and text messaging. I have been running into this comment quite a bit from Europeans, but increasingly from parents of teen and pre-teens in America. Having a computer is not a large interest for them, but they live in their mobiles as a means to connect, filter, share, convene, and stay tethered to those that matter to them, their friends. The quick 10 to 20 year scenario for this could mean the web is dead and is a technology that had an immense impact, but was a technology that was relatively short lived. Are our communication technologies trending through ever shorter life spans? This could bolster my thinking that the web is increasingly a temporary terminus for information to be shared and picked up and used in context in other media that is better situated within people's lives.

This leads us to context. I keep looking at much of the information that is on the web as being out of the proper use context for most people. We read information on the web, but the web is not the context in which we will make use of this information we find. The web as it has been traditionally built is marginally better than television, in that an address for a car lot flashed on the television screen is as usable as it is plastered on a web page. The address does us more good in our pocket, in driving (or mass transit) routes, in our mobile that is in our pocket, etc. than it does on the web page, but few web pages today get that clue.

I have also been thinking about tagging and particularly tagging in the folksonomy subset as the tags providing mental context to external information. We use the tags to pull back these bits of information or to aggregate this information when we pull on the digital threads that draw what is at the ends of these tag tethers closer to ourselves. A chunk of information or media out on the web is lacking context to our lives with out these tags. When we have needs, most always framed in the context of a need related to a subject we use tags related to that subject to draw back in that which we found or other people with similar vocabularies have found. These tags provide context for the few thousand chunks of information out of the billions that we have explicitly expressed interest in and have placed the context upon based on its relationship between the information or object and ourself.



March 20, 2006

Folksonomy in Physical Space

An example of folkonomy beyond the web. In a Flickr comment the person describes objects they found and strangers properly annotated. Folksonomy is not the content owner or creator tagging and annotating it is others.

This is quite apropos as Flickr, while not offering full tagging by others (if a photo is tagged orange, there is no reason (or way) for others to additionally tag the photo orange, which I wish would get fixed) Flickr does offer the ability for others to comment fully and add knowledge (or humor) to the photos. The string of comments, which this example is pulled is from a query Esther Dyson posted about the type of tree she photographed. Knowledge does not have to come from within but can come from around us as a collective.



March 17, 2006

SXSW Interactive and Austin BarCamp Overview

This year's SXSW was incredible. It started out a little overwhelming as I realized there were six distinct groups that I hang out with and they don't really intermix. But, this all worked out, as by Sunday I realized that there was enough time to spend time with each group. SXSW has always been the place I escape to so to have wonderful conversations and to hang with many like minds. This year was did not let me down, in fact there were many like minds.

The Tagging 2.0 panel I was on seemed to have gone well, based on the comments that followed. (My presentation with diagram will be posted in a week or so.)

BarCamp Austin

I went over to the BarCamp Austin and had a wonderful time for the hour or so I hung out there. I was a little late for Tara's "Marketing your project: Cluetrain style presentation, but I really enjoyed what I heard. I also got to finally meet Chris Messina and thank him for making the original BarCamp enjoyable and accessible for those of use that were attending virtually (he walked the laptop around when the people moved

Best Take Away Ever

My favorite part of SXSW Interactive this year was not only getting to meet Bruce Sterling (finally), but having him sign my copy (or one of them) of his Wired Magazine article on folksonomy and myself, ":Order Out of Chaos". I got a kick out of the "Dr. Folksonomy".

When you get a chance go grab the podcast of Bruce Sterling's closing remarks, which were stellar and moving.

Killer Digits for the Pocket or Hip

This year, not only did the official SXSW site have a wonderful service to for their pushing their schedule (only the things you want) to your mobile device, but there were other great tools used enforce. It seemed many people had logged into Dodgeball for Austin, a mobile service that lets you know where your friends are and lets you ping the service to share your location. This made connecting with your friends at the right party, restaurant, or bar really easy (I do not normally have a use for this at home). I also used Upcoming to track the events I had interest in and then push them to my phone so I had the time and location with me at all times.

This is a really great example of moving information that is of value out of the web and into our real lives. As a web developer I realized years ago that most of the information that is on the web is not really usable or reusable as it is not structured to be used in the place or context where it makes most sense. Most people do not live their lives on the web they live them in the real world. Information and media must be built with this understanding.



March 14, 2006

Tagsplosion and Sleep

SXSW Interactive has been quiet good so far. I was elated to see all of the people that turned out for the tagging panel yesterday and great follow-on questions.

The best thing was I got more than 8 hours of sleep last night. I have not had more than 5 for many days. I am really looking forward to what the added sleep will bring.



March 8, 2006

Upcoming Presentations and Conferences

Things have been a little busy around these parts, but activity and early Spring allergies will not keep me from letting you know that the road show is beginning again.

SXSW

I am heading off to SXSW Interactive to participate in Tagging 2.0 Panel where we will discuss growth, changes, and new ideas in the realm of tagging.

I will also be hanging out with the Web Standards Project (WaSP) people as we are having our WaSP Annual Meeting open to the public.

This year looks to have some killer content at SXSW, not that it has not in the past, but there are more things than ever that I am interested in attending. I certainly hope they found larger spaces this year. Usually the corridors are overly enticing, but the session rooms could pose a challenge this year. I am looking forward to hanging, chatting, learning, and recharging my web vibe.

IA Summit

I am headed to the IA Summit in Vancouver, British Columbia later in March. I am on the Wireframing Challenges in Modern Web Development panel, which I will be moderating Nathan Curtis, Livia Labate, Bill Scott, and Todd Warfel. We will be looking at the wireframing challenges and solutions of the current web.

I am also presenting my IA for Efficient Use and Reuse of Information. As the web 2.0 meme rings out we realize there is a greater need beyond that as people actually want to use and reuse the information in their own personal information workflows and not always in one web application. I will focus on granular content inventories as well as how to identify content objects for information reuse and set the structure of that information for better use and reuse.

I am incredibly happy to see that Kevin Chang (along with Jane Jao) are presenting Communicating with Comics as a panel as well as a full day workshop. This could be the hidden golden nugget at the IA Summit.

XTech

I will be heading to Amsterdam, Netherlands for XTech in May. I am presenting "Developing for the Personal InfoCloud" on Thursday May 18. I will be discussing the Model of Attraction and Come to Me Web as foundations to focus on building for personal use and reuse of digital information and objects.

Microlearning Conference 2006

I will be one of the keynote speakers at the Microlearning Conference in Innsbruck, Austria held on June 8-9, 2006.

More to Follow

There are a few more that will be added shortly. I am also keeping busy with in-house presentations on the Come to Me Web, Personal InfoCloud, Folksonomy, and other related topics. If you would have an interest in having me present at your conferece, workshop, or an in-house event please contact me.



February 20, 2006

Ma.Gnolia Review and Color Me Disapointed

I have been digging around Ma.gnolia since it became public and I am finding it missing a lot of things. It is closer to Yahoo! MyWeb2 than del.icio.us but not doing things as well. The design is nice to look at, but there is too much white space and it requires a lot of scrolling. Watching people use del.icio.us, MyWeb, and the many other social bookmarking tools I see scrolling inhibits finding information, as having bits of information in the same line of focus draws lines of connection for the person using the site and this is a great value for the person using the tool.

Rating Bookmarks and Retention Modes

The rating bookmarks is something people say they want, but it is not used to often. People only bookmark what they like, they do not bookmark things they have no interest in. In spending time talking to people using social bookmarking tools they have two or three retention modes: self-interest, others have interest whom the individual values that the person uses as a filter for their attention, and community tagging.

Private Bookmarks and Community

Ma.gnolia has two modes for privacy, on and off. MyWeb2 adds community, which is extremely valuable. MyWeb2 even needs refinement on this front to make that more granular to greatly help findability and valuable community filtering. Not including these social aspects leaves Ma.gnolia behind in the field with a lot of catching up to do.

API, Walled Garden, and In-site Findability

Lacking an API is a serious problem, but it may be in the site somewhere, but the information is really not easily found on the Ma.gnolia site. This seems to be a nice gesture that Ma.gnolia wants to be their own user community, but that is the thinking of two or four years ago. Communities are opening up and walled gardens are opening to let the information and beauty get discovered.

There is Good

All is not needing improvement. I love the beauty of the site. The broad folksonomy well, as the person tagging is clear, the object tagged is clear, and the tags are clear. The ability to pivot when using two of the objects to find the third. I do like the Ma.gnolia approach of marketing by using visible celebrities tagging on their site.

Saving Bookmarks and Wrap-up

Lastly, Ma.gnolia touts their saved pages, but many social bookmarking services provide this service (well, accept del.icio.us as it is missing this component). It seems Ma.gnolia was targeted as a del.icio.us alternative, but those are a dime a dozen. There is nothing new in Ma.gnolia and many things that could have been and should be done a lot better. As I read the Ma.gnolia site is sounds like it is believed to be fully baked at this point, which I deeply hope it is not as this should be a start of the project and quickly fix the project and listen to users.



February 15, 2006

Thomas Vander Wal on PodLeaders Podcast

I have been quite busy of late. Between some InfoCloud Solutions client work and some other things (including family).

I really need to pay attention to my blog a little bit as I do have things to post, like Thomas Vander Wal interviewed by Tom Raftery on PodLeaders podcast. The podcast covers the "come to me web", folksonomy, InfoClouds, and InfoCloud Solutions work. I wish I could talk more about my client work, but that will come.

This was recorded over a Skype connection with Tom sitting in Ireland. I was using my Apple iSight and it worked rather well. I have been enjoying Skype for chats with friends and business relations in Europe, I really like the quality as well as the price. But the thing that I really like is that it is really personal, much like a mobile phone, you are pretty much assured of getting the person you wish to talk with rather than some answering service or other interference.

I am back to working.



January 24, 2006

Bay Area Trip Jan 30 to Feb 1

A real quick note: I will be in the Bay Area Monday, January 30th through Wednesday, February 1st. Want to get together, please send me an e-mail.



January 17, 2006

Folksonomy Research Needs Cleaning Up

After getting flooded with e-mail yesterday about the Folksonomies: Tidying Up? in the January DLIB 2006 and yes I agree that by using Flickr as a base for much of their analysis they made a mess of their conclusions. Please go see Explaining and Showing Broad and Narrow Folksonomies to begin to get an understanding of why Flickr is not a great example of folksonomy. Showing tag distributions when tagging is limited by the tool (Flickr only permits one of each tag and does not allow identification of the person tagging, unless the API is used) is rather pointless. The central focus of a folksonomy is for personal refindability and derived from that point we get great value.

I would love to see this research redone with a better understanding of folksonomy and run the research on broad folksonomy tools like del.icio.us, Furl, Shadows, etc.



January 16, 2006

Folksonomy Presentation Posted

I have finally posted the folksonomy presentation from Online Information 2005 (1.3MB PDF) and provided a little write-up of the focus of the folksonomy presentation. If you have an interest, please go check it out.

Please note the bottom of the write-up discusses the delay in posting this. This is also not the most current version of this presentation. If you would like to find out more please write at the contact information here or over at InfoCloud Solutions.



December 29, 2005

A Year of Surfing Life

This was not the year I expected. This is a good thing. It was a year of personal and professional change, challenge, and growth. Sitting back and for a moment and looking at 2005 as it comes to a close I don't know that I could have ever planned this year. It could be the year I learned to surf life, in taking what is offered up and riding it to a place closer to one's dreams.

Personal Life Changes

It was a year that saw our extended family lose one member, which made life seem all that much more precious and every moment seem to be worth a lot more. It put a lot of things in perspective for me. I wanted more time quality time with my kid to watch him laugh, learn, and grow as well as be there for the tough times. I wanted home life to be more of a home, not just work away from the workplace. I wanted to finally get to put see the work I have been toiling at for the last four years come to life. At the end of this year I think I got to each of these or at least much closer.

Work Life Exposure

The press this year covering folksonomy and Personal InfoClouds was part of what enabled the change. Seeing folksonomy become something that made it into mainstream press was nice, but finding large businesses and cultural organization embrace the idea to improve their communication and information recovery has been even fantastic.

Seeing interest in folksonomy turn to look at the Model of Attraction and the InfoClouds was even more rewarding. This is the work I have been picking at for the last few years in my "spare time". I have been watching and working with organizations to adopt these models and frameworks to better build information resources that people could use more efficiently in their lives. Watching, talking to, and listening to people around me struggle to use information from the web in their own personal workflows has been one of the areas for opportunity for the work I have been doing.

From Dream to Making the Dream Work

Seeing the initial success that this work is having for those that are using it to frame their solutions and identify and solve the problems people have using information across devices and life's contexts has been rewarding. Now it is my job at InfoCloud Solutions, Inc. as the year comes to a close. The site for the company will get fleshed out in coming days and weeks. There are some interesting projects I am involved in through the company and have many more starting in the coming weeks and months.

Getting Around

This year was also one of travel, mostly for presentations, work, and work development. I have met some of the most wonderful people this year and I am looking forward to continuing the new friendships into the future. I have found a partial home for my ideas and work in many places around the United States and Europe and will be traveling again this coming year. The internet is a great connector for people of like minds as well as bringing those with problems and solutions together.

New Year Hopes

I am not one for the annual New Year's resolutions as I am one who likes to set out to make resolutions as they are needed, often every day, and not once a year. But I do hope that I continue to develop the relationships with those I have met this year as well as those whom I have known for longer. I am working to find time to update this site, Personal InfoCloud, and get InfoCloud Solutions site fully off the ground (those that said I should really focus on that early, were right as it is tough to get to when one's schedule is filling).

To each of you that stop by here and read, have a great New Year and please keep in touch.



December 11, 2005

Folksonomy in New York Times Magazine Year in Ideas

Today folksonomy gets more press and we have another post for our press coverage page. Go see the snippet Folksonomy in New York Times Magazine "Year in Ideas".

I need to write-up the folksonomy presentation at Online Information Conference in London as it pulls together the vital uses of folksonomy in organizations to help curb the costs and inefficiencies in taxonomies by using filling in the taxonomy with more emergent, broad, and exhaustive structure. This write-up will be posted over at the Personal InfoCloud folksonomy page.



December 9, 2005

Yahoo! and Del.icio.us come together

Today brings wonderful news on the folksonomy front, del.icio.us is now a Yahoo! property (Yahoo! announcement). The del.icio.us tool and Yahoo! MyWeb are two of my favorite tools out there.

There are many things I would like MyWeb to do, but would be difficult as they would be treading on IP of del.icio.us, which is delicate territory (just ask Blackberry/RIM). Del.icio.us would not be able to pull off the MyWeb improvements that come in the Yahoo! search, which now kicks anything Google is doing (Google has really fallen behind with search just because of this). Having both products, with del.icio.us hopefully becoming MyWeb 3, would make it nearly untouchable. Granted there is an insane amount of fixing that Yahoo needs to do with its social networking (or community tool as it calls it) under MyWeb, but that is not rocket science and hopefully would all be fixed in the next version of MyWeb.

Congrats all around on this one.



December 4, 2005

Back from England

I am back home after my trip to England (UK) with stops in Oxford, London, Brighton, and London (Heathrow). It was a very good trip on many fronts, which I will share later. I was amazed at the transportation problems in London (traffic jams even with Congestion Charging, outages on the Tube due to security issues and switching problems on the Central line, and clueless ticketing agents at Victoria Station (who asked if I wanted "day return" at 16.47 hours and I said no, still ticketed it for me, which really messed things up the following day trying to return from Brighton to London, but also took nearly 15 minutes to process my credit card payment).

None-the-less I met with fantastic people at each step of the way. Oxford had changed quite a bit since 1988 when I last lived there, but not so much I was lost. I had a great time meeting David Smith in person and chatting about everything it seemed in a little more than a couple hours (it is always great to meet people in person that you have known on-line as it gives understanding to the digital references we have in our heads, it also allows for asking questions we never get around to on-line). I really enjoyed going back to The Centre for Mediaeval and Renaissance Studies and meeting current students studying there from St. Mary's College of California to get the tour. The Centre is still wonderfully run and brought back a great part of my life. I also got to visit the QI (Quite Interesting) bookstore and private club. The bookstore is wonderful as it jogs the mind in wonderful ways in that it arranges books by there, intermixing fiction and non-fiction and various subjects to create wonderful themes. I had a meeting with somebody new to me at the club and really enjoyed the venue and my company (I would hope to have the fortune of both again in the not too distant future).

London was really turned around for me as I was staying in a different section that I had ever before and was approaching it from a different angle. I really enjoyed the Online Information Conference as it brought some good questions and regarding folksonomy and brought some very bright people together. The Open Rights Group initial gathering was fantastic and I met some great people there with stellar ideas and drive. I also had a great meeting at DNA on my InfoCloud work and they had some brilliant questions that followed (unfortunately my Mac did not want to drive their beautiful monitors (not sure what went wrong as it was the first presentation in more than 50 that my Mac did not just fall in love with the monitor and just want to run off with them).

I also had an utterly brilliant time in Brighton and Hove with the Clear Left gentlemen and Pete Barr-Watson. I had never been to Brighton and Hove, but found I really enjoyed it. It reminded me of Oxford in 1988 when I walked down the main street in Hove looking for breakfast.

The ticketing mix-up, poor traffic, increasingly bad weather, and the need to care for work related to running one's own business kept me from returning back into London proper on Friday afternoon. I dropped my things off at the hotel near Heathrow (and was berated by the taxi driver in a very un-polite British manner for having such a short inexpensive fare not the 40 to 50 pound fare he had been waiting in queue for three hours for). The weather turned and I had not heard back from two friends I was hoping to meet up with for pints after their work on Friday (turns out my stupid phone will not send e-mail while I am in Europe and my requests were still sitting in my phone).

I never got to do the shopping I intended to do (other than Muji, Neal's Yard Dairy (with Matt Biddulph making wonderful suggestions), and buying the Banksy book. I did realize I was not quite dressed properly as I thought would work, so I stopped into Charles Tyrwhitt at 92 Jermyn Street in London to fix the situation with a new shirt and seven fold tie (I picked up the tie from a much less expensive stack, but with the somewhat baffling price reduction it made it seem less that my other option).

I also hope I never have the mis-fortune of dealing with British Midland Airways (BMI) again. They did not have the capability to deal with an electronic ticket, they were completely disorganized (with the exception of one wonderfully patient and helpful gentleman at their customer service desk), and under trained. I sat at the gate a Heathrow Terminal 1 watching the flight departure time come and go before we boarded, which I was told by those sitting next to me is quite normal. At Heathrow Terminal 1 they only announce the gate for the flight 45 to 30 minutes prior to the flight. It does not seem they have the capability to plan beyond this, nor do they point you to the correct security entrance. This made for no shopping in their shops and no relaxing. It was a very poor experience and one I do not care to ever repeat. In all, the signage in Heathrow (Terminals 4 arrivals and 1 departures) was horrible. It was difficult to sort out what direction to go. Conflicting signage was up about the Tube and Heathrow Express, with some saying things were not running and others stating where to go. In all the rail transportation related information in the UK is a mess as there is no easy central place on the web to find travel times and prices. The privatization has seemed to lead to nicer rail cars, but poor service and poorly coordinated information. I will take the less nice cars from 1988 and much better service, thank you very much.

In all I had wonderful accommodations, great hospitality, and had wonderful conversations with bright people. This was what I really wanted from this trip. I also got a lot more, but that will be coming in time.



November 26, 2005

Off to London Oxford and Brighton

I am off to London, England tonight. I will be in Oxford Sunday night and through lunch Monday. I will be in London Monday afternoon through Thursday early afternoon. I am in Brighton Thursday late afternoon through Friday morning. Friday I am back to London to Saturday Morning.

I am speaking at Online Information on Wednesday on the topic of folksonomy. I have a handful of other gigs during the days along with seeing some of London that was not there when I lived in England in 1988. I am most interested in chatting, listening, and seeing people. Give a shout if you have an interest.

I am reachable by the usual e-mail.



November 21, 2005

Language as a Divider

A wonderful piece about language and experience by Meg had me recalling recent language adventures. Having been in the Netherlands, Brussels, Berlin, and Boston in recent weeks the shifting of language (and jet lag) and its impact on communication was brought back to me.

While much of the Netherlands (particularly Amsterdam) is fluent in English, I always feel badly using it as my default. The downside is I really do not speak Dutch, I have a vocabulary of about 20 or so words (although this last trip thank you was about the extent of it) so I fall back on English very quickly. Being of Dutch ancestry is the driver for the guilt, I feel like I am letting down previous generations.

The trip to Brussels was a little more problematic as English is not spoken everywhere, but they do speak French (I know a little more French than Dutch)and Flemish (close to Dutch, but not my forte). I had to rely on friends (mostly Dutch) to navigate menus and other essentials. But, Brussels is a very English friendly city.

Now we get to Berlin. I speak some German (Deutsch) from years of schooling. I can get by with my remedial Geutsch, but it does not get me as far as I would like. I can ask, "what beer is she drinking" and then follow-up with "I would like a large one of those, please". Food is fine, but complex directions (particularly with a city whose parts I am not familiar nor the transportation systems) were lost on me. These needed English. I also found that nearly all of the channels on my television at the hotel were in Deutsch (except for a time slice of CNN interwoven), although others friends in the hotel seemed to have more English channel access (could be related to my horribly flakey WiFi, which they did not experience either). All of the newspaper options in the hotel were in Deutsch, which made the Financial Times not quite as wonderful as usual.

When I got to Boston and checked into my hotel I went out to go to the reception and passed a newsstand on Harvard Square that was selling the Financial Times I had been trying all day (18 hours already) to get my hands on. When I went to ask for the paper my English had failed me. I had lost all languages for a moment. Language quickly returned, but I could easily ask for the paper in Deutsch, as well as for how much, and say thank you in Deutsch or Dutch. This I knew would not get me far. I just sort of mumbled something in some language and tucked my paper in the back pocket of my Barber coat and went off into the night.

I usually have this problem in English as I can always think of the larger words, but always pause to think of the more simple words or the one that is more culturally appropriate. English is not one language, but many culturally loaded variants. The use of sofa rather than couch or supper rather than dinner frames who you are in other people's minds. Let alone various terms from cross professional disciplines, which can quickly alienate you or engender you to those to whom you are speaking. So I often pause to pull from the appropriate vocabulary, but most often I can only think of one term and just go with it, then hope I get called on it so I can explain I am not exactly the person they think I am (that rarely happens and inferences of who I am are sealed). C'est la Vie!



November 2, 2005

Folksonomy Definition and Wikipedia

Today, having seen an new academic endeavor related to folksonomy quoting the Wikipedia entry on folksonomy and I realize the definition of Folksonomy has become completely unglued from anything I recognize (yes, I did create the word to define something that was undefined prior). It is not collaborative, it is not putting things in to categories, it is not related to taxonomy (more like the antithesis of a taxonomy), etc. The Wikipedia definition seems to have morphed into something that the people with Web 2.0 tagging tools can claim as something that can describe their tool (everybody wanted to be in the cool crowd). I hope folksonomy still has value as a word to point something different in the world of tagging than the mess that went before it. It is difficult to lose the pointer to something distinct makes understanding what works well. Using folksonomy and defining it to include the mess that was all of tagging and is still prevalent in many new tools dilutes the value.

Folksonomy Is

Folksonomy is the result of personal free tagging of information and objects (anything with a URL) for one's own retrival. The tagging is done in a social environment (shared and open to others). The act of tagging is done by the person consuming the information.

The value in this external tagging is derived from people using their own vocabulary and adding explicit meaning, which may come from inferred understanding of the information/object as well as. The people are not so much categorizing as providing a means to connect items and to provide their meaning in their own understanding.

Deriving Value from Folksonomy

There tremendous value that can be derived from this personal tagging when viewing it as a collective when you have the three needed data points in a folksonomy tool: 1) the person tagging; 2) the object being tagged as its own entity; and 3) the tag being used on that object. Flattening the three layers in a tool in any way makes that tool far less valuable for finding information. But keeping the three data elements you can use two of the elements to find a third element, which has value. If you know the object (in del.icio.us it is the web page being tagged) and the tag you can find other individuals who use the same tag on that object, which may lead (if a little more investigation) to somebody who has the same interest and vocabulary as you do. That person can become a filter for items on which they use that tag. You then know an individual and a tag combination to follow. The key is knowing who and what specifically is being tagged.

Social Tagging

There are other tagging efforts that are done for socially connecting others and others where people are tagging their own information for others. I have been to workshops where items on the web were tagged with a term that was agreed upon for tagging these objects across tools. This allows the person to retrieve information/objects connected with that event as well as others getting access to that information/object. Does it fall into the definition of folksonomy? This gets fuzzy. It is for the retrieval of the person tagging the information, so it could fit. It gets close to people tagging information solely for others, which does not get to a folksonomy, it is what Cory Doctorow labeled Metacrap.

Academics Quoting Wikipedia

Sadly, I have had 15 to 20 academic papers sent to me or links to them sent to me in the past year. No two of them use the same definition. Everyone of them points to Wikipedia. Not one of the papers points to the version of the page.

The lack of understanding the medium of a Wiki, which is very fluid, but not forgetful, is astonishing. They have been around for three or four years, if not longer. It is usually one of the first lessons anybody I have known learns when dealing with a Wiki, they move and when quoting them one must get the version of the information. They are a jumping off point, not destinations. They are true conversations, which have very real etherial qualities.

Is there no sence of research quality? Quoting a Wiki entry without pointing to the revision is like pointing to Time magazine without a date or issue number. Why is there no remedial instruction for using information in a Wiki?

Personal Love of Wikis

Personally, I love Wikis and they are incredible tools, but one has to understand the boundaries. Wikis are emergent information tools and they are social tools. They are one of the best collaboration tools around, they even work very well for personal uses. But, like anything else it takes understanding on how to use them and use the information in them.



October 31, 2005

BBC Knocks Audio Annotating Out of the Park

Tom Coates shows off the BBC's Annotatable Audio Project. Tom gave me a preview early on Saturday and I was ecstatic. You see, what the tool does is provide an interface to annotate and segment audio on the web. Yes, podcasts can be easily segmented and annotated. This has been my biggest complaint with podcasts over the past year, okay since they started getting big (that is big for an early early adopter). I complained to people I knew at Odeo about the problem and they said they were working on it. I mentioned this to podcast enthusiasts at Yahoo! about nine months to a year ago and they said if they did podcasting that would be one of the first things in it as it was a big complaint. Did they? No, they made a product not too indistinguishable from every other product out there? Where is the innovation?.

Why is this Huge

The reason I am so excited about this is voice/audio is not easily scannable, like type. I can not easily skip ahead in a 30 or 45 minute podcasts to find that which I am interested in. Many friends will forward me links to a podcasts stating I have to hear what somebody says. Finding that segment usually means listening to much of the whole podcast.

The other downside is if I hear something stellar in a podcast my mind will mull over that item for a little bit. This means the minute to five minutes that follow in the podcast are lost on me. This is not a problem with written materials as I can skim back through the content and pick-up where my mind drifted (it is usually in these moments of drifting that I find the best solutions to things that have bugging me - the Model of Attraction came out of one of these).

A couple other items of note about this product. It is great interface design as it is interactive helps the person using the product know exactly what they are doing. The second is the segmentation is a great asset. With segmentation I can easily see writing a script to grab items of interest (27 seconds for here and 36 seconds from there, etc.) and having an automated audio stream built for me. Not only do I have a personalized audio stream, but since the originals are annotated and I can keep track of where the information is extracted from I can easily point others to the spot so they (or I) at some later point can go back and listen to more so to get better context (personally I don't think people are against attribution, it is just that we have made it so hard to do so in the past).

Voice and Audio is a Common Problem

The last couple time I have travelled in the USA I have run across people quite similar to me. None of us like voice. We are not particularly fond of the phone, for much the same reasons as I have problems with podcasts. Too much information gets lost. In phone conversations I am often saying, "I am sorry can you repeat that", in part because I did not hear, but the something that was stated just triggered a good though process for me and I missed what came after that moment. (What would be a great application is Tivo for the phone.) I continually am running new ideas and thoughts through what I believe and see how they may change it. It is the examined life - I enjoy living.

So what Tom and his cohorts did was make podcasts and audio more usable. It makes it searchable. One thing that would be a very nice addition is to have those annotating the information each have their own distinct layer. Just like with folksonomies, the broad folksonomy where each individual and each annotation on a distinct element provides a richer understanding and richer layer. (Such things would be really nice in Wikipedia so that I could remove the people who I do not think add any value to entries (in not polite terms - those who I know are wrong and are polluting the value of Wikipedia, which is far too much noise for me on the entries I would love to point to), or conversely to use a "white hat" approach and subscribe to the annotations of people and the distinct tags or terms they use in annotations. I have many people whose opinions and view I value, but on rare occasions it is everything a person has to say.

Filtering information in a world of too much information to keep track of is a necessity. Filtering is a must. It is about time we got here.

Thank you Tom. I hope your new team can innovate as much as you were allowed at the BBC, which has been the most innovative large enterprise going.



October 20, 2005

Focussing and Shingle Hanging

Three trips in the last four weeks has me playing e-mail catch-up. My outbound e-mail is not fully functioning on the road as the provider changed the SMTP port recently I have not updated the settings.

In the same time period I also have left my job and am now consulting and working on my own projects. I am focussing on helping organization better connect with the people who have an interest in their information and media. Building efficient conversations and interaction is the key to successful relationships, be they interpersonal or organization and people. Organizations also need to better understand social networks and providing information that can be used and reused across devices and the Model of Attraction and Local and Personal InfoClouds are just the tools to help provide the framework to think about this as well as making smart decisions regarding Web 2.0. Lastly, the ever present folksonomy will be a focus as well. Along all these lines I am doing research, analyzing, and providing direction and focus to help people and organizations think clearly in these changing times.

I will be posting here a little more often and you can expect more postings over at the Personal InfoCloud. There is much to be investigated and written, which I have not had the time to do in the past. I am also tackling article writing that has been a victim of elusive time. I will also be launching a site for the new company in the near future.

Please send a note with questions or inquiries for services. My time is filling up, but I am always interested in helping others as well as looking for cool projects and difficult problems. I have quite a few people and organizations to keep in touch with and get back in touch with, but if you would like attention more quickly shoot an e-mail to get my attention.



October 16, 2005

Closing of the First Phase of the Fall European Tour 2005

I am back in Amsterdam tonight after a wonderful trip to Brussels for the Euro IA Summit. It was quite refreshing to talk to people that have a different perspective from Americans on IA, mobile, technology, privacy, and the possibilities for social interaction with digital devices. Last year after Design Engaged in Amsterdam I believed Europe to be farther ahead on internet and mobile (including mobile internet) than America. I now firmly believe Americans have a lot to learn from the Europeans.

I wanted to come and present the InfoCloud information in Europe because I thought they would be more ready for it. They would be able to provide criticism and questions that I do not get in America, mostly because the Europeans have been implementing mobile and trying to work through a means to access information in the environment and context where the information makes sense. Boy, was I right. The InfoClouds are more than mobile, as they are a means to think about information access, personally managing that information (or providing people the ability to manage, use, and reuse the information intelligently) and reusing it as that information is needed and framing the information in ways that make sense (web 2.0 fit this bill). I ran into smart thinking about web 2.0 here, not the just go do it, just open your information up, but working to think about if it made sense to do the cool and how they would do it intelligently.

The Europeans also really get cross-cultural sensitivity and are smart about how to approach working with other cultures. I was delighted to find what American's call internationalization is referred to as localization. How brilliant. How understanding. How unalienating. There is a distinct understanding that people are different and we need to understand that and embrace that. Hmm, there is a very strong reason why it is called the Personal InfoCloud and not the User InfoCloud. If you are not thinking in a local sense you will not get to the personal sense. You can get from localization to personalization, or from the Local InfoCloud to the Personal InfoCloud and also back. We all deal with more than one Local InfoCloud and I received some of the best questions about the interaction between the various Local InfoClouds and the Personal InfoClouds. Interaction be between the social part of personal it of immediate interest here. People are very tied to their communities here, it is a strong part of their identity.

I found myself surrounded this weekend by insanely smart people, who love what they do, and are doing things to help others. Everybody was incredibly friendly and genuinely interested in learning everything they could and sharing what they knew. I could not have asked for a better way to have spent any of this time. I would do all of this again in a heartbeat.

Thank you to all of those that I had the pleasure of sharing time with. Who were incredible hosts in their countries. Who asked and listened and from whom I learned to do the same, as when you listen you can learn. I learned an incredible amount. Thank you again. I am ever so much looking forward to my next two trips.

Peace!



October 5, 2005

Folksonomy in the New York Times

Folksonomy is in the New York Times. Yours truly gets some ink and photo, as the article covers del.icio.us as a social networking tool around ideas and terms.

The article is a light introduction piece to folksonomy and tagging in general. But, the nice thing is the the writer, Ethan Todras-Whitehill, focusses on the personal side of tagging. This personal perspective allows people with similar vocabularies and interests to self-aggregate and build an ad hoc community around the terms and interests. My life has been richer through meeting David, Michal, and Michal's co-workers Eric and Tomas at Stamen.



September 12, 2005

No More Waiting...

I suppose I should note here that the last day at my current job will be October 6, 2005. I am not sure what the next full step will be, but I will be focussing my full attention what I have been passionate about for the past few years. Rather than spending a few hours every evening and weekends on my passions, it will become my full-time job. The details will show themself in the next few weeks and months. I need the time to persue some options and have time to think about and consider others.

For the last couple years I have joked I commute to my day job, but telecommute to my private life. Well, my private life is where most of the Model of Attraction, Personal InfoCloud, Local InfoCloud, and work takes place. Pieces of this work make it into the day job, but not enough to keep me excited or engaged. I am really wanting to see more great work and products that easily functions for people across devices, across platforms, and is easy for real people to use and reuse.

The world has been shifting to a "come to me web". We are seeing the easiest way to make this easier for people attract what they want this is to learn what each person has an interest in, as well as what their friends and peers have interests in. This will help the findability of information and media for people, but the real problem is in the re-findability of that same information and media for people so they can have what the want and desire at their finger tips when they want it and need it. We have all of the technology needed to make this happen, but it needs research, quick iterative development, and removing the walls around the resources (information/media, unwarranted device restrictions (American cell companies have created the failure of the missing robust mobile market), and unwarranted software restrictions). Paying attention to people and people's interactions is the real key to getting things right, not trying to beat your competitor (focussing on the wrong goal gets the poor results). Make the products people need that solve problems people have (with out introducing problems) and you will have a winner. People have so many needs and desires and every person is different so one solution will not fit all and we should never make things just one way.

These will be a long few weeks with more small steps for me. There is a lot to get done and to consider in the next few weeks. In this is preparing for speaking and traveling on top of the other needed work to be done to prep for this next step. I will pop back up and fill you in when I know more. but, the count down has begun.



September 5, 2005

Old Dog New Blog Posts

So you are having problems figuring out what is posted here and what is posted at Personal InfoCloud? I am too, well I have habits that seem to be harder to break that I thought. I am going to be moving some content over to Personal InfoCloud (copying is more like it, as it will still reside here). I have a thing for my vanderwal.net posting interface (not pretty, but the text box is large enough for me to think) and I post with markup included, so I know exactly what the result will be.

I am going to make a concerted effort to post social networking, folksonomy, InfoCloud, mobile, personal information management, and other things along those lines over at Personal InfoCloud. What does that heave for vanderwal.net Off the Top? Everything else, I know that does not leave much, but I may include short versions of that is posted at the Personal InfoCloud, particularly since the category gets a good chunk of traffic on its own. I am also thinking strongly about putting the last three posts headings over in the side column.

The other confounding issue is the Quick Links (my del.icio.us bookmarks are displayed here and not on the Personal InfoCloud (some relate to the topics there, but not all of them and the personal ones that do not are really not appropriate there). I am not going to start another feed (although a subfeed could be somewhat appropriate) for there.

I am also working on feeds for each of the categories here, which would confound the bifurcating process I am discussing. This is down the to do list a short way, following turning comments here once again (time limitations are a problem at the moment). There are not only speaking preparation and travel arrangements, but some life subplots (some are divergent, which I really don't like thinking about work being for naught but that is what alternate plans are at times) in the works that are taking time.

So there we are. If you have responses that you think could help, please send them.



August 25, 2005

Del.icio.us and MyWeb Combo Bookmarklet

I took two of my favorite bookmarklets (for del.icio.us and Yahoo MyWeb 2, put them in my javascript collider to get a Combo Tag Tool (drag this to your browser's bookmark bar.

By clicking on this bookmarklet you get the del.icio.us tag interface populated with the title. You also get a MyWeb entry pop-up window.

I have been seeing the early benefits of Yahoo's MyWeb, but I also want to keep the community I have in del.icio.us. Keeping both up to date and in sync is my goal and hopefully this will help you do the same.



August 19, 2005

Yahoo! MyWeb Imports Del.icio.us Bookmarks and More Observations

Yesterday's post, MyWeb 2 Grows Up Quickly into a Usable Tool, had part of my answer delivered today by e-mail. Yahoo! had already built a del.icio.us import tool (as well as an Internet Explorer bookmark, Yahoo bookmark, and RSS import tools) to grab your bookmarks and tags out from del.icio.us.

My import went well, um it took four attempts to get all 1,440 of my bookmarks into Yahoo MyWeb 2, but they are all there along with the 20 or so I had stored in MyWeb already. I wish it could have kept the dates from my del.icio.us bookmarks as the time puts those links in context for me with other things I was working on at the time I made the bookmark.

I am not abandoning my del.icio.us bookmarks and will keep feeding it as it is my only easy option at work at the moment. Now I am interested in a JavaScript bookmark that would post to both MyWeb and del.icio.us from the same form. There is community around one's social bookmarks as I know there are people that pull my del.icio.us bookmark feed into their aggregator, just I do that with other's bookmarks. This is part of their being social, yes?

Now I want to play with MyWeb with my 1,459 plus pages in it. As a personal bookmarking tool this will be a good test. I am now also curious with searching with Yahoo! if my own bookmarks will appear on the search page. This would be nice as I found Google somewhat scary when I started seeing my own blog posts showing up in searches I was doing from work. But, I started my blog (nearly five years ago) as a note to self tool, which also happened to be open to everybody else in the world. It is my outboard memory. This is also the reason I started my own personal site nearly 10 years ago, as a link tool so I could keep access to my web links from any web connection I could get. A lot has changed in these nearly 10 years, but so much has stayed the same.

I have a laundry list of interface changes I would love to see in MyWeb that I will be shooting to them that are interface related. I also have many social network improvements for their tool to get more fine grained in their connections between people in the social engine, which may take more than just a few e-mails.



August 18, 2005

MyWeb 2 Grows Up Quickly into a Usable Tool

Earlier this week I chose to use Yahoo! search rather than the default Google that I usually use. The search page on Yahoo! had sponsored links at the top of the page, but then a few other offerings followed by the usual offerings. The second set was dead on what I was seeking. What were these second set of links? They were the results of those in "My Community" in MyWeb 2 Search, which is similar to del.icio.us in that it is a social bookmarking tool with tagging.

This discovery from a community of less than 40 people really surprised me. Of those 40 people less than 15 have more than 5 pages they have bookmarked, but this community is one I share interests and vocabulary. I was partial shocked with amazement as when MyWeb 2 launched in beta a few weeks ago (or a few months at this point) I was completely under whelmed as most of the links in MyWeb 2 were for things I not only had not interest in, but did not care to have recommended.

As the net effect of more people adding their bookmarks to this socially shared tool grew the value of the tool increased. As it grows I am positive it the aspects of my community will need to get more fine grained so I can say I like the tags from person X (similar to the granular social network which would make better use of the social network for recommender systems that actually could be used and trusted). One of the benefits of MyWeb 2 is that it gets layered on top of Yahoo's search results, which is a great place for this information.

I would love to replicate my del.icio.us bookmarks and tags into MyWeb 2 at Yahoo. The next step would be to feed both systems at the same time from one central interface. There are things in del.icio.us that I really like, but the layering of the social bookmarking and with tagging on top of other tools adds greater value to the user.



August 17, 2005

Fall Tour - Intitial Europe Stops Announced

I will let you in on the beginnings of my Fall Tour, which is still developing at this time. There will be a European flavor, which will be very good as the markets there are in the midsts of developing for robust cross-platform usage by people trying to connect their digital lives across devices. The mobile market is far more mature than in the United States and with broadband penetration rates over 50 percent in many European countries (through the help of government funding to make this a priority of their infrastructure and therefore a public good) the usage is driving richer media design perspectives. I am excited to have the opportunities to present and investigate more in these advanced digital life markets.

The European part of the Fall Tour (as it stands today with more stops still possilbe):

I am open to meeting, working, and presenting around these times in locations "relatively" close and I will most likely be flying in and out of Amsterdam for all portions of this tour, and yes each gig is its own trip. I may be in London and surrounding environs for a few days surrounding my panel.



July 28, 2005

Presented Personal InfoCloud and Folksonomy to MIM Class

Last night I presented my Designing for the Personal InfoCloud - Including a Focus on Folksonomy to the User Interaction with Information Systems class in the Master of Information Managment program at University of Maryland.

I had a blast doing this, maybe more than last year. This year's class is quite sharp and had great questions during the class and after. I have seen two classes in the MIM program and helped a student project last spring and I think the University of Maryland is on to something. The program is a professional masters program for information professionals in management positions.



July 25, 2005

Speaking at BayCHI August 9th

I will be in the San Francisco Bay Area August 9, 2005 to speak on the BayCHI - Are you ready for Web 2.0? panel. This will be at the PARC's George E. Pake Auditorium (formerly known as Xerox PARC). I am looking forward to the panel and being back in the Bay Area.

Did I mention I am only on the ground for 12 hours? I am flying in from vacation on the New Jersey Shore, but it will be worth it. I have a couple places I need to stop, but shoot me e-mail to meet-up or let me know you will be going to the panel. I have a long string of things to get to in the Bay Area that have been building since January, but this will not be the trip to knock all of them out.

I really need to get to the Bay Area more often, it is home (well where I was born and spent much of my life there).



July 9, 2005

Snippet on Getting Folksonomy Right

Today's summary on folksonomy... taxonomies and ontologies can help the many find information, but never help the whole of the people. The role of folksonomies is to fill in that gap to get far closer to the whole.

The failure that Google noted in other search companies in 1997 being happy with getting 80 to 85 percent of the correct answers for people, meant 15 to 20 percent of the people found the tools failed them (for me it seemed far higher than a 20 percent failure rate in 1998, which is why I switched to Google quite early). There are far too many that are complacent with their development of taxonomies and ontologies that are only helping the many and have no desire to change their practices to get to closer to the whole. It takes a diverse toolset to get the job down, which means including taxonomies and ontologies as well as other newer solutions.

So what is needed in a folksonomy? It must be broad to provide the best results. People must be tagging content or objects for their own purposes. The tags must be separated from the object so they are a point of reference. The person tagging must also be distinguishable from the objects to they are a point of reference. The objects must provide a point of aggregation to find common tags and common people and the matches on these three points. Tools like del.icio.us and CiteULike.com do this very well.

When we have these distinct elements we can begin filtering and aggregating, just as Jon Udell has been doing in his collaborative filtering.



July 2, 2005

Tagging Article at OK/Cancel

OK/Cancel posted a quick article on tagging I pulled wrote (mostly pulled out of e-mail responses). The article is Tagging for Fun and Finding, which includes mention of folksonomy.



June 29, 2005

Yahoo MyWeb 2.0 Goes Beta

Yahoo has launched Yahoo MyWeb 2.0 today. It has elements of Flickr but not the polish, nor the attention to detail. There are a lot of very rough edges, but there is a lot of potential also. I may spend some time playing around with it in the next few days and weeks. I surely will be sending a ton of feedback in. Hopefully MyWeb will iterate far more rapidly than their blogging software, which had rough edges and they still exist and no noticeable improvements have been made (I don't know many that will recommend it to nubies until the rough edges are fixed).

The tool from the very little I have looked at it seems like it has the broad folksonomy executed well. This seems to have many elements of del.icio.us integrated. I am curious is there is the capability to have community around tags (be same definition).

My curiosity is really piqued with the MyRank search engine. It seems to be a predictive engine of sorts, which really has my interest.

If you want to add me I can be found at tjvanderwal there in Yahoo! type places.



June 12, 2005

Designing with a Solution is the Problem

I finally put my finger on it. There has been growing frustration within me with where I work and as well with some of the leaders in the web design community of late. The problem and the solution has been known to me, but scattered in pieces and I did not pull all the pieces together until today. Why today? Well, it took a little doing, but I finally got my hands on this month's issue of Fast Company - June 2005, which I had been subscribed to until the May issue. It took a little bit of time to track down the issue as it was to the point in the month when the next months issues are getting put out. But, having that issue in hand (having read some on-line) I stumbled across my tipping point in the Be Cooler by Design column. I did not make it past the fouth paragraph when it hit.

It Begins with a Canyon

The paragraph has a header, "Show Them the Canyon" and discusses a designer at Ford, Giuseppe Delena, who would say, "Don't tell me you need a bridge, show me the canyon!" This was aimed at marketing people who would ask for specific design solutions, but not explain the problem.

That is my tipping point. Having to start with somebody's solution to design problems (most often solutions to the wrong problem). Not having the problems put forward, but an answer. An answer without anybody showing their work to how their arrived at the solution. For nearly four years I have been working, for the most part, with the end results of the work of others who started with a solution and worked that as a starting point, while never considering the problem (or in nearly all cases the multitude of problems they needed to solve). They did not understand the problems nor do they understand or know the standards and requirements that their end result must meet. Lastly they do not understand the medium in which they are working. In short it is a string of considerable messes that our team deals with continually. The sad complication is this is taxpayer money being spent (often quite nice sums) for end products that require incredible fixing to meet minimum standards and be usable on the web.

It is not my direct customer, who is in the same boat I am in as we support him (and he is one of the very few that really get what they are doing), but the "customer service" management and the management signing off on these projects that have become the problem. With the web, the business customer is not always right, the user is, as without the user their is no business customer. In our situation, by-and-large, the web being built is using what works for print and for multi-media, neither of which are solutions for text on the web. The business customer requires solutions for the wrong medium, which (as those who have sat through usability test find out) the tan text on brown background and all of the animated bits make using the information as is it is intended, nearly impossible.

Designers Must Explain Design Better

In part the design world is to blame as we have done a very poor job of educating the rest of the world as to what we do. We solve problems. We have spent an inordinate amount of time on learning everything we can about our medium, how people think, how people interact with our medium, how people interact with their devices (desktop, laptop, PDA, mobile, etc.) as they are all different, how to organize and structure for people interacting with what we design, how to build for people to give them freedom to choose the solution that is best for them, how to build for ease of use by people, and how to build for people to easily reuse what we provide (the list goes on). Yes, it is not a short list and I do not know a good designer who will truly claim they are done learning all of these aspects. We know what works best with everything we do know for the problems before us and we test everything we do and we iterate through our designs while always striving to make things better. Every designer I know loves to show how they got to their solution and document it for others to do, as their joy in designing is not repeating, but problem solving and innovating to better solutions. As designers we are always trying to learn what others do, so the good designers share in as much detail so others may learn what to follow and what to modify for even better solutions down the road.

In my current situation the lack of time to document and show our work is a major problem. The lack of documentation (or deliverables) is part of where the problem lies with the problems up the food chain (not that there are skilled designers or people that would understand up the food chain). If we had the time to show our work we could hand it to those at the beginning of the process so we could get better products with fewer problems when we receive them (although it is a very rare occasion that any of what we have produced for these purposes is ever followed). Many of the places up the food chain have sold a bridge with out ever seeing the canyon it is just a cookie cutter. It is rare when we get to solve the problems, either at the beginning or the end, we just get to fix it so it will just pass the minimum requirements, which are horribly low.

Understand and Explain the Problem First

This frustration has also flowed over to the web design community of late as there is excitement in the web community again. The excitement is not bad, actually it is great. But some of the new solutions are being framed as new wonder solutions without framing the problem they are solving. In the world of design (as it is with many other things) it is a realm where the answer to most every question is, "it depends". What is the solution? It all depends on many factors in the problem. Teaching how to understand problems and to walk through the decision process to get to the solution (or more correctly, one of many possible right solutions) is what raises the profession.

What has been happening of late in the web design/development community is looking at solutions that may be terrific implementations for a certain problem in a set environment, but proclaiming what is new is "the new way". For those that are not good designers or even designers at all, this approach reaches a problem point very quickly. It was not long after XMLHTTPRequest was coined AJAX that customers, and those I advise from farther away, started asking for their solutions to be AJAX. There are right places for AJAX, as it is just one of many solutions for problems where it may be one of the solutions. It is quite similar to aura around Flash as a solution, but AJAX has its benefits and detractors when compared to Flash.

Where the problem around the AJAX solution got tough was when AJAX was tied to a whole new exitement around the web. It was at this point the AJAX solution was being demanded from customers. I was hearing if from many corners, this great solution touted, was for customers the only way they would accept their final products. AJAX had quickly become the cure-all in customer's eyes, much like Flash had years before.

Our Responsibility

What we have to realize as designers, is people do listen and people want to believe there is one simple solution for all of their web problems, all of the information problems, etc. We know there is not a simple solution as of yet. In fact the digital information world is far more complex than it ever was, as Europe and Asia will attest, with the influx of mobile handheld use. (Europe and Asia have things a little better than the U.S. right now, as they have much less of a population that believes build for desktop (including laptop) solutions is the one way all design is heading.) Europe and Asia understand the world is far more complex and information far more useful when it can be used in context on a mobile device. The expanding of the devices and the realm of possibile solutions with their benefits and detractors across the many variables we monitor componded the problems we are solving. Simplicity is many designer's goal, but getting there is ever harder today and we must embrace the complexity (thank you Mike for turning that light on for me) and work through it. We also need to communicate the complexity to our customers so everybody understands it is not as simple as it seems.

It is this complexity of convergence around devices is also compounded by the flood of information people are experiencing, which is what has me loving the work I get to do around the Personal InfoCloud (and the Model of Attraction and folksonomy that are intertwined with it). This work is satisfying as it is not only defining the problems and working through possible solutions, but more importantly laying out frameworks to design and build solutions that others can use. There are increasingly people (who may become customers) that are coming and asking the right questions from the right perspective around the Personal InfoCloud, which may be another reason I really like working on it (we all love people asking smart questions). People are asking how to cross their canyon while describing the canyon and many times showing me the canyon they would like a solution designed for.

I think we all know what the next step is. It will not be happening tomorrow, but every day that passes makes the frustration that much worse. Knowing there is one point around which much of my frustration revolves may help me deal with it better.



May 30, 2005

Academic Cites for Interested Parties

One of the things that I am still mulling over that came out of the Social Software in the Academy Workshop is the relationship between academic cites and interested parties (non-academics researching, thinking deeply, and writing about a subject). Over the past year I have had some of the work I have posted on my web sites cited in academic papers. These papers have been for general coursework to graduate thesis.

In the academic realm these cites in other's works give credibility and ranking. In the realm of the professional or "interested party" these cites mean little (other than stroking one's ego). These cites do not translate to higher salary, but they may have some relationship to credibility in a subject area.

Another aspect is finding a way to tie into academic work around these subjects. There are often wonderful academic related gatherings (conferences, symposia, etc.) around these subject matters, but these are foreign to the "interested party". There is a chasm between academic and professional world that should be narrowed or at a minimum bridged in a better way. At SSAW there were some projects I found out about that I would love to follow, or even contribute to in some form (advisement, contributor, etc.).

I have a feeling I will be mulling this for some while, and will be writing about it again.



May 17, 2005

Post SSAW Snapshot

I had an utterly fantastic weekend at the Social Software in the Academy Workshop at the Annenberg Center for Communication. There were great conversations and shared observations from a broad spectrum of academic interests as well as outside (that was me).

The interview of Richard Cameron of CiteULike covering folksonomies and their value on social bookmarking sites went quite well in my opinion. There was a very robust backchannel (actually two of them, one steno-tracking the panels and the other was free space) that really had some good discussion going in parallel to the interview/conversation.

There are many people I really want to keep in touch with from this weekend as there are some things in the folkonomy and Personal InfoCloud work I am doing as well as general input on where and how to work through the walls between academia and the practitioners (interested and informed parties outside).

I can always tell when I have had a good time interacting with others as I have problems sleeping as I am digesting and culling through conversations and ideas that I have been exposed to. Any even that changes the work I am doing for the better or causes me to pause, reflect, and integrate a new perspective is a fantastic time by me. Although going through this on a 4.5 hour red-eye flight from Long Beach to DC was a little disruptive to normality this morning.

One idea that came up this week end was a workspace that is part academia and part think tank for technology/design ideas to gel and incubate. I had just run across a similar idea in John Thakara's In the Bubble, which he labeled something similar a "think-and-do tank". This sounds like a wonderful environment. Part research and part building to test and improve what is around us seems very well suited to where I am desiring to head. I get lost deep down in the details and most often have to pull my discussions up to a much higher level for others to benefit (not always the case of late, as exposing some of the under belly of the data flow diagrams and technical design elements really would have helped the cause, but I kept getting asked higher level questions and answered there, such is life).

I have been trying to figure out a good home for the Personal InfoCloud (including the related folksonomy and Model of Attraction) as regular work/obsession. I think I am somewhat closer to figuring that out as of this past weekend. I need to get a lot of this out of my head to help others move forward as well. I would love 30 hours days, but that will not happen so I need to deal with the constraints and hand and rework some things to finally get things moving fully in the right direction.



May 11, 2005

Heading to Los Angeles and SSAW at the Annenberg Center

I am off again this weekend. I will be in Los Angeles this weekend. So far I have most of Friday free. It looks like dinner may be taken on Friday evening as well as a beer or two to acclimate a Brit. Interesting things to see (other than my old house, junior high, and neighborhood) or meet-ups would be quite welcome.

I am at the Social Software in the Academy Workshop at the USC Annenberg Center on Saturday and Sunday. I will be chatting with Richard Cameron of CiteULike on Sunday. Not only does he run CiteULike, but he has been doing some interesting research on trends and patterns, which he is using to improve the probability the person using the service will find what they need more easily. We had a great chat last night and I am really looking forward to the public chat on Sunday.



April 22, 2005

O'Reilly Radar

I am adding the new O'Reilly Radar to my RSS aggregator to follow for a while to see if it is worth adding to my regular links page, which needs some pruning and planting. The Radar is a blog focussing on what four people at O'Reilly believe is new and interesting to them.

I found the link through a folksonomy feed, but found the developer mistook categories and general tagging for folksonomy and weighted tag use visualization for folksonomy. Both categories and tagging are very helpful tools, while weighted visualizations are already seeming passé due to over and improper use (sparklines are far more useful as are just having a numeric value). Folksonomy is not a tag applied by the content generator is is applied by the content consumer so the consumer can come back to find the information more easily. I like the irony that O'Reilly did not think a book on folksonomy would be needed, but they can not get it right on their own site (or their developer liked the buzz word and nobody knew any better).

What the do have is worth watching.



April 13, 2005

Presenting at Social Software in the Academy Workshop at the Annenberg Center for Communication

Add to my list of events where I will be presenting, Social Software in the Academy Workshop at the USC Annenberg Center for Communication. This will be May 14-15th. The focus my involvement will be around folksonomy and tagging. I will post more info as the time nears and I know more.



April 1, 2005

Folksonomy Sold

As of today I am no longer the person who coined the word folksonomy. After getting asked over and over how I was going to make money off coining a word, I had the answer. Today I sold the rights to claim the coining of the word folksonomy to another party. I had thought about selling the rights off of eBay, but the offer came to me and it was above anything I imagined. I can not say the amount this was sold for, but it was very generous and also provides a six figure payment for each of the next 12 years and payment over the following 8 years based on revenues generated from that word.

I am letting the group that bought the rights and word to make their annoucement later today. They are weaving the history of the term into their own marketing materials, packaging materials, and blog.

[We now return you to reality beyond April 1st and no we are not aware that a word can be sold either, well as of today at least. Posted April 2, 2005]



March 26, 2005

Yahoo360 and the Great Interaction Design Yardstick

Jeremy Zawodney talks about a Yahoo preview of Yahoo360 to which they invited "influencers" to provide honest feedback (Danah Boyd provides her wonderful view too).

What I really like about Jeremy's post is the repeated reference to Flickr when explaining things. The key thing is that Flickr (yes it is now owned by Yahoo) knocks the snot of of other's interaction design. Flickr set the standard and it is what many other web-based products are truly lacking. Getting the interface and interaction right is not half the battle, it is the battle. So few do it well and very few execs around the industry get that. What is lacking in so many products is design that creates, not just an ease of use, but a fun successful experience.

Flickr makes refindability of the pictures a person posts much easier by using tags that make sense to the person providing the tags. The interface for providing the tags is simple and does not take the user away from the interface (thanks to Ajax). The rest of the options are done simply from a person using the site's perspective. Everybody I know gets completely immersed in Flickr. This is something I can not say about Ofoto or other photo sharing sites, one goes to these sites to see the pictures somebody you know has taken. Flickr can be the most efficient photo sharing tool for uploading and managing one's own photos too.

Simply it is make things easy to accomplish tasks, focussing on what the person wants and need from the product. Accomplish this feat at the same time make it fun. There is no harm in making life enjoyable.



March 22, 2005

Folksonomy In Wired Magazine

Today was largely an exceptional day. I got a few nice e-mails today that really made my day (more on those some other time). But, today when I got home and settled Andrew popped up on iChat saying he had just opened the April issue of Wired and read the Bruce Sterling article. ["Order Out of Chaos"], about... me. My copy was on the steps and I had not really looked at the mail yet. Andrew pointed me to page 83, to which I had a jaw dropping holy expletive.

I have been getting interviewed a far amount this year and the novelty of seeing one's own name in print has not worn off. But, seeing my own name in Wired magazine, particularly in a Bruce Sterling article, as a little mind numbing. His fact checker had contacted me a few weeks back, but I was not expecting this.

The best thing about the article was Bruce nails folksonomy. But, he not only nails it he provides a couple explanations that stand out:

It was a mob of interested people - folks and the machines working behind the scenes that tossed in some technological onomy. .... Folksonomy emerges from a combination of two inventions: (1) machines that can automate at least some of what it takes to classify information and (b) social software that makes users willing to do at least some of the work for nothing.

It is well worth the read to get a good grasp of where folksonomies work and where they are lacking. Bruce does an excellent job pulling all of the ends together. Now I really wish I could have stayed one more and two more nights at SXSWi just to say hello to Bruce and be prescient enough to thank him in advance.



March 21, 2005

Outside of the 3rd World, Yahoo Buys Flickr

Once again we are back into living in the third world. It is the first day of Spring and we got a lightning storm and out goes the power. We have this to look forward to until Fall. Well, unless we move.

Once the power came on it was errand time, then time shout congratulations to Flickr and Yahoo!. The news was officially announced, that Yahoo! bought Flickr. The Flickr team is staying intact and in Vancouver. Flickr is one of the kick-ass products on the Web right now and with Yahoo! support it could stay at the forefront.



March 14, 2005

SXSW and Solipsism Presentation

I am having a great time at SXSW Interactive. I am heading back home this evening and will truly miss the remainder of the festival (it truly is a celebration of the web and digital design).

Yesterday I spoke on the panel, How to Leverage Solopsism. My slides for the session focussing on Personal Information Management (1.14MB PDF) is available.

I have has so many wonderful conversations. Please keep in touch and lets keep the conversations going.



March 11, 2005

Folksonomy: A Wrapper's Delight

As part of the IA Summit 2005 (Montreal) panel on Social Classification (Folksonomies) I presented Folksonomy: A Wrapper's Delight (2.6MB PDF), which refers to the ability to wrap from an emergent vocabulary to a formal controlled vocabulary using a folksonomy. In the discussion I brought up "the flood of information on the internet has turned the scent of information into the stench of information, but folksonomies and other tools help bring back the sweet smell of information". We get the sweet smell from ease of refindability.



February 24, 2005

Folksonomy Fixed in Wikipedia

It looks like somebody finally fixed Wikipedia entry for Folksonomy, it no longer makes the mistake of calling the a folksonomy a blend of folks and taxonomy. The taxonomy has connotations of being formally structured, which as far from what is going on in del.icio.us from what I see, as the user's of del.icio.us can free tag and choose what ever they wish to tag an object with

Bless you, whom ever fixed this. It looks like it was done today. I have tried to get this fixed before, but my change was bounced, I guess I did not know enough about folksonomies. There is a lot more in the entry that has been added, including the semantic derivation. Thanks to whom ever is getting it right, finally.

This gives me less to complain about Wikipedia than I had before (I have watched entries go from being correct to wrong and stay wrong for quite some time). A co-worker stated Wikipedia is stated to be the current day Hitchhickers Guide to the Galaxy, which was wrong in spots to mortal detriment at times. I somewhat agree, although a little less so today.



February 21, 2005

Explaining and Showing Broad and Narrow Folksonomies

I have been explaining the broad and narrow folksonomy in e-mail and in comments on others sites, as well as in the media (Wired News). There has still been some confusion, which is very understandable as it is a different concept that goes beyond a simple understanding of tagging. I have put together a couple graphics that should help provide a means to make this distinction some what clearer. The folksonomy is a means for people to tag objects (web pages, photos, videos, podcasts, etc., essentially anything that is internet addressable) using their own vocabulary so that it is easy for them to refind that information again. The folksonomy is most often also social so that others that use the same vocabulary will be able to find the object as well. It is important to note that folksonomies work best when the tags used to describe objects are in the common vocabulary and not what a person perceives others will call it (the tool works like no other for personal information management of information on the web, but is also shared with the world to help others find the information).

Broad Folksonomy

Let's begin with the broad folksonomy, as a tool like del.icio.us delivers. The broad folksonomy has many people tagging the same object and every person can tag the object with their own tags in their own vocabulary. This lends itself very easy to applying the power law curve (power curve) and/or net effect to the results of many people tagging. The power terms and the long tail both work.

The broad folksonomy is illustrated as follows.
visualization of the text on broad folksonomies that follows
From a high level we see a person creates the object (content) and makes it accessible to others. Other people (groups of people with the same vocabulary represented people blobs and noted with alphabet letters) tag the object (lines with arrows pointing away from the people) with their own terms (represented by numbers). The people also find the information (arrows on lines pointing from the numeric tags back to the people blobs) based on the tags.

Digging a little deeper we see quite a few people (8 people) in group "A" and they have tagged the object with a "1" and a "2" and they use this term to find the object again. Group "B" (2 people) have applied tag "1" and "2" to the object and they use tag terms "1", "2", and "3" to find the information. Group "C" (3 people) have tagged the object with "2" and "3" so that they can find the object. Group "D" has also tagged the object with tag "3" so that they may refind the information this group may have benefitted from the tagging that group "C" provided to help them find the information in the first place. Group "E" (2 people) uses a different term, "4", to tag the object than others before it and uses only this term to find the object. Lastly, group "F" (1 person) uses tag "5" on the object so that they may find it.

Broad Folksonomy and the Power Curve

The broad folksonomy provides a means to see trends in how a broad range are tagging one object. This is an opportunity to see the power law curve at work and show the long-tail.
Shows tag 2 with 13 people tagging, tag 1 with 10 people, tag 3 with 5 people, tag 4 with 2 people, and tag 5 with 1 person
The tags spike with tag "2" getting the largest portion of the tags with 13 entries and tag "1" receiving 10 identical tags. From this point the trends for popular tags are easy to see with the spikes on the left that there are some trends, based on only those that have tagged this object, that could be used extract a controlled vocabulary or at least know what to call the object to have a broad spectrum of people (similar to those that tagged the object, and keep in mind those that tag may not be representative of the whole). We also see those tags out at the right end of the curve, known as the long tail. This is where there is a small minority of people who call the object by a term, but those people tagging this object would allow others with a similar vocabulary mindset to find the object, even if they do not use the terms used by the masses over at the left end of the curve. If we take this example and spread it out over 400 or 1,000 people tagging the same object we will se a similar distribution with even more pronounced spikes and drop-off and a longer tail.

This long tail and power curve are benefits of the broad folksonomy. As we will see the narrow folksonomy does not have the same properties, but it will have benefits. These benefits are non-existent for those just simply tagging items, most often done by the content creator for their own content, as is the means Technorati has done, even with their following tag links to destinations other than Technorati (as they initially had laid out). The benefits of the long tail and power curve come from the richness provided by many people openly tagging the same object.

Narrow Folksonomy

The narrow folksonomy, which a tool like Flickr represents, provides benefit in tagging objects that are not easily searchable or have no other means of using text to describe or find the object. The narrow folksonomy is done by one or a few people providing tags that the person uses to get back to that information. The tags, unlike in the broad folksonomy, are singular in nature (only one tag with the term is used as compared to 13 people in the broad folksonomy using the same tag). Often in the narrow folksonomy the person creating the object is providing one or more of the tags to get things started. The goals and uses of the narrow folksonomy are different than the broad, but still very helpful as more than one person can describe the one object. In the narrow the tags are directly associated with the object. Also with the narrow there is little way of really knowing how the tags are consumed or what portion of the people using the object would call it what, therefore it is not quite as helpful as finding emerging vocabulary or emergent descriptions. We do find that tags used to describe are also used for grouping, which is particularly visible and relevant in Flickr (this is also done in broad folksonomies, but currently not to the degree of visibility that it is done on Flickr, which may be part of the killer interactive environment Ludicorp has created for Flickr).

The narrow folksonomy is illustrated as follows.
vizualization of the text on narrow folksonomies that follows
From a high level we see a person creates the object and applies a tag ("1") that represents what they call the object or believe describes the object. There are fewer tags provided than in a broad folksonomy and there is only one of each tag applied to the object. The consumers of the object also can apply tags that help them find the object or describe what they believe are the terms used to describe this object.

A closer look at the interaction between people and the object and tags in a narrow folksonomy shows us that group "A" uses tag "1" to find and come back to the object (did the creator do this on purpose? or did she just tag it with what was helpful to her). We see group "B" also using tag "1" to find the object, but they have tagged the object with tag "2" to also use as a means to find the object. Group "C" uses tag "1","2", and "3" to find the object and we also note this group did not apply any of its own tags to the object as so is only a consumer of the existing folksonomy. We see group "D" uses tags "2" and "3" to find the objects and it too does not add any tags. Group "E" is not able to find the object by using tags as the vocabulary it is using does not match any of the tags currently provided. Lastly, group "F" has their own tag for the object that they alone use to get back to the object. Group "F" did not find the object through existing tags, but may have found the object through other means, like a friend e-mailed them a link or the object was included in a group they subscribe to in their feed aggregator.

We see that the richness of the broad folksonomy is not quite there in a narrow folksonomy, but the folksonomy does add quite a bit of value. The value, as in the case of Flickr, is in text tags being applied to objects that were not findable using search or other text related tools that comprise much of how we find things on the internet today. The narrow folksonomy does provide various audiences the means to add tags in their own vocabulary that will help them and those like them to find the objects at a later time. We are much better off with folksonomies than we were with out them, even if it is a narrow folksonomy being used.

Conclusion

We benefit from folksonomies as the both the personal vocabulary and the social aspects help people to find and retain a tether to objects on the web that are an interest to them. Who is doing the tagging is important to understand and how the tags are consumed is an important factor. This also helps us see that not all tagging is a folksonomy, but is just tagging. Tagging in and of its self is a helpful step up from no tagging, but is no where near as beneficial as opening the tagging to all. Folksonomy tagging can provide connections across cultures and disciplines (an knowledge management consultant can find valuable information from an information architect because one object is tagged by both communities using their own differing terms of practice). Folksonomy tagging also makes up for missing terms in a site's own categorization system/taxonomy. This hopefully has made things a little clearer for all in our understanding the types of folksonomies and tagging and the benefits that can be derived.

This entry first appeared at Personal InfoCloud and comments are open for your use there.



February 12, 2005

It is Speaking Season

The next month or so has a few speaking engagements lined up. They are as follows:

Date: February 17th 2005 - Thursday (9am to 11:30am)
Event: The Web Mangers Roundtable
Topic: Blogging into 2005 panel (with Mike Lee of AARP and Lee Rainey of PEW Foundation
Location: Washington, DC, USA
Access: Sold Out

Date: March 5th 2005 - Saturday (10:30am - 12:15pm)
Event: ASIS&T Information Architecture Summit
Topic:
Sorting Out Classification - with Stewart Butterfield, Peter Merholz, Peter Morville, and Gene Smith
Location: Montreal, Quebec, Canada
Access: IA Summit Registration

Date: March 5th 2005 - Saturday (4pm to 4:45pm)
Event: ASIS&T Information Architecture Summit
Topic:
IA for the Personal InfoCloud
Location: Montreal, Quebec, Canada
Access: IA Summit Registration

Date: March 9th 2005 - 6:30pm
Event: ASIS&T Potomac Valley Chapter Panel
Topic:
From Soup to Nuts: Blogs, Blogging, and the Greater Impacts to Information Science -p with James Melzer of SRA International and Christina Pikas of Johns Hopkins University
Location: Laurel, MD, USA: Campus of Johns Hopkins Applied Physics Laboratory
Access: Registration Form

Date: March 14th (?), 2005 (Specifics to follow)
Event: South by Southwest Interactive Festival
Topic: How to Leverage Solipsism - with Peter Merholz and Stewart Butterfield
Location: Austin, TX, USA
Access: SXSW Interactive Registration



February 9, 2005

Personal InfoCloud has a Real Home

We finally (yes, finally) have Personal InfoCloud ( http://www.personalinfocloud.com ) up and running. This has been a long time coming. Items posted there will most likely be cross-posted here as well. The Personal InfoCloud will takes its place with some other things that are on their way in the next few months.

Personal InfoCloud (PIC) will be home to discussions around the PIC and related topics. More than likely folksonomy discussions will move there as they are a subset of the Personal InfoCloud. This will become clearer in relatively short order, but folksonomy allows people to track information they have previously found using their own organization and vocabulary. Personal organization of information using one's own vocabulary is central to the Personal InfoCloud. Nearly a year ago I started using Flickr as an example of a site building for the PIC.

Enjoy the new site. Yes, now that the domain is attached we will be posting to it more often.



January 30, 2005

Granular Social Networks to the Rescue

Things have been buzzing around these parts on the folksonomy subject. A few weeks ago I started thinking about social networks (Feedster, Orkut, and LinkedIn) and why they do not work, well other than LinkedIn I do not find much if any useful value. I do think there can be value in social networks and actually believe we will need social networks in the not too distant future.

Why will we need social networks? As personal electronic information publication continues to grow we have more opportunities for shared information that has value for us. The problem will be there will be even more of a deluge of information than there is today when we go seeking information. As people start annotating physical space and tagging physical space we will need the means to quickly parse through the information to find that information that may be the most valuable to us.

Consider standing in front of a restaurant in a city that is new to us. We are considering the menu and look to our mobile phone to see what others have said about the restaurant and there are more than 200 reviews and comments, which is far too many to be read on a mobile phone or even parsed on a mobile phone. But, before we request the reviews and comments our mobile device as noted our location and pushed that out to our predictive services in our Personal InfoCloud (looking at our own reviews, preferences (food and restaurants in this case), and contacts), and checks our social network based on food and restaurant interests. Our phone returns the top 3 reviews and comments that should be of value to us and two of these reviews are three and four degrees from us (could go even farther) in our social network, but based on our food preferences and our trust of our friends taste in food and restaurants and their service and their friend's same values, and so on. The other review is one who is considered to be the polar opposite of our preferences and can be used to shade our interest.

How did we get to a social network that has needed value? If we take the same folksonomy approach and apply it to social networks we could see social network tools that actually have value. This would work as a narrow folksonomy (like Flickr) with a person tagging people with the connections they trust (or even those they do not trust with a "-" prefix).

The folksonomy is just one option, but social networks have to get far more granular than the broad line that is drawn between people today.



January 19, 2005

Technorati Opens Spam Tagging - Updated

The talk this past week was all about Technorati and their tagging tool, but the tool offers very little value and may be an incubator for spam more than a folksonomy tool.

Where del.icio.us gets folksonomy right (I know this is reflexive) by having many people tag online objects, Technorati gets folksonomy backwards with one user spitting tags into an aggregator. The only link I would trust in Technorati's tool is one that I also found on del.icio.us.

Why so harsh? Technorati has created a tool not from social interaction and using the internet to build value through the network effect (Technorati made the power curve popular, which is the visualization of the net effect). Technorati has no moderating the content that can be dumped in my any slimy spammer that now has a ripe new target. Lacking moderation and any socially derived checks to the system I am quite disappointed with Technorati and this effort.

I use Technorati keywords to track things I have an interest in and their tool does a great job pulling in information (I also use Feedster for the same purpose) and find it to be the top of its class in this effort.

Updated

Eric Scheid provides an excellent suggestion, which made me realize it is easy for Technorati to get it right and much of my problem was the links went in the wrong direction. Eric states...

I have a suggestion for another link format for "technorati" tags which would turn things around ... it would look like this:

<a href="http://whatever.bloghost.com/page/etc" rel="tag.TAGNAME1 tag.TAGNAME2">descriptive text for the link</a>

This way I can tag the pages I *link* to, and not just the pages I publish.

I'm also able to assign multiple tags to the linked page, and of course since other people could well be linking to that same page they can apply their own tags too. Think of the social tagging nature of del.icio.us without the intermediary of del.icio.us.

All we need is the "tag." prefix to identify the tagging relationship, as distinct from other relationship types (eg. vote-for, XFN, the usual W3C things, etc).

Yes, this modification would make Technorati tags a true folksonomy. Will they fix it to get it right?



January 18, 2005

Folksonomy Explanations

The past few weeks have seen my inbox flooded with folksonomy questions. I am going to make things easier on my inbox by posting some common discussions here. Many of the items I am posting I have posted else where, but this will also be a great help for me.

There have been many people who have correctly discerned a difference between the two prime folksonomy examples, Flickr and del.icio.us. As I first stated in a comment to Clay Shirky's first article on Folksonomy, there are two derivations of folksonomy. There is a narrow folksonomy and a broad folksonomy. On August 26th I stated...

Clay, you bring in some very good points, particularly with the semantic differences of the terms film, movie, and cinema, which defy normalization. A broad folksonomy, like del.icio.us, allows for many layers of tagging. These many layers develop patterns of consistency (whether they are right or wrong in a professional's view is another matter, but that is what "the people" are calling things). These patterns eventually develop quasi power law for around the folk understanding of the terms as they relate to items.

Combining the power tags of "skateboarding, tricks, movie " (as you point out) will get to the desired information. The hard work of building a hierarchy is not truly essential, but a good tool that provides ease of use to tie the semantic tags is increasingly essential. This is a nascent example of a semantic web. What is really nice is the ability to use not only the power tags, but also the meta-noise (the tags that are not dominant, but add semantic understanding within a community). In the skateboarding example a meta-noise tag could be gnarly that has resonance in the skate community and adds another layer of refinement for them.

The narrow-folksonomy, where one or few users supply the tags for information, such as Flickr, does not supply power tags as easily. One or few people tagging one relatively narrowly distributed item makes normalizing more difficult to employ an tool that aggregates terms. This situation seems to require a tool up front that prompts the individuals creating the tags to add other, possibly, related tags to enhance the findability of the item. This could be a tool that pops up as the user is entering their tags that asks, "I see you entered mac do you want to add fruit, computer, artist, raincoat, macintosh, apple, friend, designer, hamburger, cosmetics, retail, daddy tag(s)?"

This same distinction is brought up on IAWiki' Folksonomy entry.

Since this time Flickr has added the ability for friends and family (and possibly contacts) to add tags, which gives Flickr a broader folksonomy. But, the focus point is still one object that is being tagged, where as del.icio.us has many people tagging one object. The broad-folksonomy is where much of the social benefit can be derived as synonyms and cross-discipline and cross-cultural vocabularies can be discovered. Flickr has an advantage in providing the individual the means to tag objects, which makes it easier for the object to get found.

This brings to the forefront the questions about Google's Gmail, which allows one person the ability to freely tag their e-mail entries. Is Gmail using a folksonomy? Since Gmail was included in the grouping of on-line tools that were in the discussion of what to call these things (along with Flickr and del.icio.us) when folksonomy was coined I say yes. But, my belief that Gmail uses a folksonomy (regular people's categorization through tagging) relates to it using the same means of one person adding tags so that object can be found by them. This is identical to how people tag in Flickr (as proven by the self-referential "me" that is ever prevalent) and del.icio.us. People tag in their own vocabulary for their own retrieval, but they also will tag for social context as well, such as Flickr's "MacWorld" tags. In this case Wikipedia is a little wrong and needs improving.

I suppose Gmail would be a personal folksonomy to the Flickr narrow folksonomy and the del.icio.us broad folksonomy. There are distinct futures for all three folkonomies to grow. Gmail is just the beginning of personal tagging of digital objects (and physical objects tagged with digital information). Lou Rosenfeld hit the nail on the head when he stated, "I'm not certain that the product of folksonomy development will have much long term value on their own, I'll bet dollars to donuts that the process of introducing a broader public to the act of developing and applying metadata will be incredibly invaluable.". These tools, including Gmail, are training for understanding metadata. People will learn new skills if they have a perceived greater value (this is why millions of people learned Palm's Graffiti as they found a benefit in learning the script).

Everybody has immense trouble finding information in their hierarchal folders on their hard drive. Documents and digital objects have more than one meaning than the one folder/directory, in which they reside. Sure there are short cuts, but tracking down and maintaining shortcuts is insanely awkward. Tags will be the step to the next generation of personal information managment.



January 13, 2005

San Francisco Bound

I will be in San Francisco and surounding Bay Area on the 20th and 21st of January. There are many folks I would like to hang and chat with. I have been swamped with a handful of things the past couple weeks, along with a huge flood of spam mail (I think I have spam abated for the moment). Interested in talking blogs, folksonomy, Personal InfoCloud, Model of Attraction, mobile, interaction design, Web Standards, etc. please drop a note. Thursday evening may be the best option at the moment. Use the contact link above (needs JavaScript on) or send to thomas at this domain.



January 8, 2005

From Tags to the Future

Merlin hit on something in his I Want a Pony: Snapshots of a Dream Productivity App where he discusses:

Tags - People have strong feelings about metadata and the smart money is usually against letting The User apply his or her own tags and titles for important shared data ("They do it wrong or not at all," the burghers moan). But things are changing for personal users. Two examples? iTunes and del.icio.us. Nobody cares what "metadata" means, but they for damn sure know they want their mp3s tagged correctly. Ditto for del.icio.us, where Master Joshua has shown the world that people will tag stuff that’s important in their world. Don't like someone else's homebrewed taxonomy? Doesn't matter, because you don't need to like it. If I have a repeatable system for tagging the information on just my Mac and it's working for me, that's really all that matters. I would definitley love that tagging ability for the most atomic piece of any work and personal information I touch.

This crossed my radar the same time as I read Jeff Hawkins' discussion about how he came up with Graffiti for Palm devices. He noticed people did not find touch typing intuitive, but they saw the benefit of it and it worked. Conversely in the early 90s people were interacting with handwriting interpreters that often did not understand one's own handwriting. Jeff came up with something that would give good results with a little bit of effort put in. Palm and Graffiti took off. (Personally, I was lucky when I got my first Palm, in that I was on the west coast and waking on east coast time, which gave me two or three hours of time to learn Graffiti before anybody else was awake. It only took two or three days to have it down perfectly).

Merlin's observation fits within these parameters. Where people have not cared at all about metadata they have learned to understand the value of good tags and often do so in a short period of time. iTunes really drives the value of proper tagging home to many (Napster and other shared music environments brought to light tagging to large segments of the population). In a sense folksonomies of del.icio.us and Flickr are decedents of the shared music environments. People could see that tagged objects, whose tags to be edited and leveraged had value in one's ability to find what one is looking for based on those tags.

As the web grew up on deep linking and open environments to find and share information. So to will tagging become that mantra for the masses. All objects, both digital and physical, will be tagged to provide immediacy of information access so to gain knowledge. Learning to search, parse, filter, and leverage predictive tools (ones that understand the person's desires, context, situation, and frame of reference so to quickly (if not instantly) gather, interpret, and make aware the information around the person). Should the person be late for a meeting their predictive filters are going to limit all be the required information, possibly a traffic jam on their normal route as well as their option A route. A person that has some free time may turn up the serendipity impact and get exposed to information they may normally have filtered out of their attention. The key will be understanding tags have value and just as metadata for other objects, like e-mail subject lines, can be erroneous and indicators of spam, our life filters will need the same or similar. We will want to attract information to us that we desire and will need to make smart and informed choices and tags are just one of the means to this end.



December 26, 2004

Flickr and the Future of the Internet

Peter's post on Flickr Wondering triggers some thoughts that have been gelling for a while, not only about what is good about Flickr, but what is missing on the internet as we try to move forward to mobile use, building for the Personal InfoCloud (allowing the user to better keep information the like attracted to them and find related information), and embracing Ubicomp. What follows is my response to Peter's posting, which I posted here so I could keep better track of it. E-mail feedback is welcome. Enjoy...

You seemed to have hit on the right blend of ideas to bring together. It is Lane's picture component and it is Nadav's integration of play. Flickr is a wonderfully written interactive tool that adds to photo managing and photo sharing in ways that are very easy and seemingly intuitive. The navigations is wonderful (although there are a few tweak that could put it over the top) and the integration of presentational elements (HTML and Flash) is probably the best on the web as they really seem to be the first to understand how to use which tools for what each does best. This leads to an interface that seems quick and responsive and works wonderfully in the hands of many. It does not function perfectly across platforms, yet, but using the open API it is completely possible that it can and will be done in short order. Imagine pulling your favorites or your own gallery onto your mobile device to show to others or just entertain yourself.

Flickr not only has done this phenomenally well, but may have tipped the scales in a couple of areas that are important for the web to move forward. One area is an easy tool to extract a person's vocabulary for what they call things. The other is a social network that makes sense.

First, the easy tool for people to add metadata in their own vocabulary for objects. One of the hinderances of digital environments is the lack of tools to find objects that do not contain words the people seeking them need to make the connection to that object they are desiring. Photos, movies, and audio files have no or limited inherent properties for text searching nor associated metadata. Flickr provides a tool that does this easily, but more importantly shows the importance of the addition of metadata as part of the benefit of the product, which seems to provide incentive to add metadata. Flickr is not the first to go down this path, but it does it in a manner that is light years ahead of nearly all that came before it. The only tools that have come close is HTML and Hyperlinks pointing to these objects, which is not as easy nor intuitive for normal folks as is Flickr. The web moving forward needs to leverage metadata tools that add text addressable means of finding objects.

Second, is the social network. This is a secondary draw to Flickr for many, but it is one that really seems to keep people coming back. It has a high level of attraction for people. Part of this is Flickr actually has a stated reason for being (web-based photo sharing and photo organizing tool), which few of the other social network tools really have (other than Amazon's shared Wish Lists and Linkedin). Flickr has modern life need solved with the ability to store, manage, access, and selectively share ones digital assets (there are many life needs and very few products aim to provide a solution for these life needs or aims to provide such ease of use). The social network component is extremely valuable. I am not sure that Flickr is the best, nor are they the first, but they have made it an easy added value.

Why is social network important? Helping to reduct the coming stench of information that is resultant of the over abundance of information in our digital flow. Sifting through the voluminous seas of bytes needs tools that provide some sorting using predictive methods. Amazon's ratings and that matching to other's similar patterns as well as those we claim as our friends, family, mentors, etc. will be very important in helping tools predict which information gets our initial attention.

As physical space gets annotated with digital layers we will need some means of quickly sorting through the pile of bytes at the location to get a handful that we can skim through. What better tool than one that leverages our social networks. These networks much get much better than they are currently, possibly using broader categories or tags for our personal relationships as well as means of better ranking extended relationships of others as with some people we consider friends we do not have to go far in their group of friends before we run into those who we really do not want to consider relevant in our life structures.

Flickr is showing itself to be a popular tool that has the right elements in place and the right elements done well (or at least well enough) to begin to show the way through the next steps of the web. Flickr is well designed on many levels and hopefully will not only reap the rewards, but also provide inspiration to guide more web-based tools to start getting things right.



December 20, 2004

Salon Writes Story on Flickr

Salon's Katharine Mieszkowski did a story on Flickr that captures what is really good about Flickr. She even, appropriately, includes folksonomy in the write-up.



December 17, 2004

Would We Create Hierarchies in a Computing Age?

Lou has posted my question:

Is hierarchy a means to classify and structure based on the tools available at the time (our minds)? Would we have structured things differently if we had computers from the beginning?

Hierarchy is a relatively easy means of classifying information, but only if people are familiar with the culture and topic of the item. We know there are problems with hierarchy and classification across disciplines and cultures and we know that items have many more attributes that which provide a means of classification. Think classification of animals, is it fish, mammal, reptile, etc.? It is a dolphin. Well what type of dolphin, as there are some that are mammal and some that are fish? Knowing that the dolphin swims in water does not help the matter at all in this case. It all depends on the context and the purpose.

Hierarchy and classification work well in limited domains. In the wild things are more difficult. On the web when we are building a site we often try to set hierarchies based on the intended or expected users of the information. But the web is open to anybody and outside the site anybody can link to any thing they wish that is on the web and addressable. The naming for the hyperlink can be whatever helps the person creating the link understand what that link is pointing to. This is the initial folksonomy, hyperlinks. Google was smart in using the link names in their algorithm for helping people find information they are seeking. Yes, people can disrupt the system with Googlebombing, but the it just takes a slightly smarter tool to get around these problems.

You see hierarchies are simple means of structuring information, but the world is not as neat nor simple. Things are far more complex and each person has their own derived means of structuring information in their memory that works for them. Some have been enculturated with scientific naming conventions, while others have not.

I have spent the last few years watching users of a site not understand some of the hierarchies developed as there are more than the one or two user-types that have found use in the information being provided. They can get to the information from search, but are lost in the hierarchies as the structure is foreign to them.

It is from this context that I asked the question. We are seeing new tools that allow for regular people to tag information objects with terms that these people would use to describe the object. We see tools that can help make sense of these tags in a manner that gets other people to information that is helpful to them. These folksonomy tools, like Flickr, del.icio.us, and Google (search and Gmail) provide the means to tame the whole in a manner that is addressable across cultures (including nationalities and language) and disciplines. This breadth is not easily achievable by hierarchies.

So looking back, would we build hierarchies given today's tools? Knowing the world is very complex and diverse do simple hierarchies make sense?



November 30, 2004

Flexibility in Folksonomies

Nick Mote posts his The New School of Ontologies essay, which is a nice overview of formal classification and folksonomies. The folksonomy is a good approach for bottom-up approach to information finding.

In Nick's paper I get quoted. I have cleaned up the quote that came out of an e-mail conversation. This quote pretty much summaries the many discussions I have had in the past couple months regarding folksonomies. Am I a great fan of the term? Not as much of a fan as what they are doing.

The problem of interest to me that folksonomies are solving is cross-discipline and cross-cultural access to information as well as non-hierarchical information structures. People call items different things depending on culture, discipline, and/or language. The folksonomy seems to be a way to find information based on what a person calls it. The network effect provides for more tagging of the information, which can be leveraged by those who have naming conventions that are divergent from the norm. The power law curve benefits the enculturated, but the tail of the curve also works for those out of the norm.



October 6, 2004

Personal Information Aggregation Nodes

Agnostic aggregators are the focal point of information aggregation. The tools that are growing increasingly popular for the information aggregation from internet sources are those that permit the incorportation of info from any valid source. The person in control of the aggregator is the one who chooses what she wants to draw in to their aggregator.

People desiring info agregation seemingly want to have control over all sources of info. She wants one place, a central resource node, to follow and to use as a starting point.

The syndication/pull model not only adds value to the central node for the user, but to those points that provide information. This personal node is similar (but conversely) to network nodes in that the node is gaining value as the individual users make use of the node. The central info aggregation node gains value for the individual the more information is centralized there. (The network nodes gain value the more people use them, e.g. the more people that use del.icio.us the more valuable the resource is for finding information.) This personal aggregation become a usable component of the person's Personal InfoCloud.

What drives the usefulness? Portability of information is the driver behind usefulness and value. The originating information source enables value by making the information usable and reusable by syndicating the info. Portabiliry is also important for the aggregators so that information can move easily between devices and formats.

Looking a del.icio.us we see an aggrgator that leverages a social network of people as aggregators and filters. Del.icio.us allows the user to build their own bookmarks that also provides a RSS feed for those bookmarks (actually most everything in del.icio.us provides feeds for most everything) and an API to access the feeds and use then as the user wishes. This even applies to using the feed in another aggregator.

The world of syndication leads to redundant information. This where developments like attention.xml will be extremely important. Attention.xml will parse out redundant info so that you only have one resource. This work could also help provide an Amazon like recommendation system for feeds and information.

The personal aggregation node also provides the user the means to categorize information as they wish and as makes most sense to themselves. Information is often not found and lost because it is not categorized in a way that is meaningful to the person seeking the information (either for the first time or to access the information again). A tool like del.icio.us, as well as Flickr, allows the individual person to add tags (metadata) that allows them to find the information again, hopefully easily. The tool also allows the multiple tagging of information. Information (be it text, photo, audio file, etc.) does not always permit itself easy narrow classification. Pushing a person to use distinct classifications can be problematic. On this site I built my category tool to provide broad structure rather than heirarchial, because it allows for more flexibility and can provide hooks to get back to information that is tangential or a minor topic in a larger piece. For me this works well and it seems the folksonomy systems in del.icio.us and Flickr are finding similar acceptance.



October 3, 2004

Feed On This

The "My" portal hype died for all but a few central "MyX" portals, like my.yahoo. Two to three years ago "My" was hot and everybody and their brother spent a ton of money building a personal portal to their site. Many newspapers had their own news portals, such as the my.washingtonpost.com and others. Building this personalization was expensive and there were very few takers. Companies fell down this same rabbit hole offering a personalized view to their sites and so some degree this made sense and to a for a few companies this works well for their paying customers. Many large organizations have moved in this direction with their corporate intranets, which does work rather well.

Where Do Personalization Portals Work Well

The places where personalization works points where information aggregation makes sense. The my.yahoo's work because it is the one place for a person to do their one-stop information aggregation. People that use personalized portals often have one for work and one for Personal life. People using personalized portals are used because they provide one place to look for information they need.

The corporate Intranet one place having one centralized portal works well. These interfaces to a centralized resource that has information each of the people wants according to their needs and desires can be found to be very helpful. Having more than one portal often leads to quick failure as their is no centralized point that is easy to work from to get to what is desired. The user uses these tools as part of their Personal InfoCloud, which has information aggregated as they need it and it is categorized and labeled in a manner that is easiest for them to understand (some organizations use portals as a means of enculturation the users to the common vocabulary that is desired for use in the organization - this top-down approach can work over time, but also leads to users not finding what they need). People in organizations often want information about the organization's changes, employee information, calendars, discussion areas, etc. to be easily found.

Think of personalized portals as very large umbrellas. If you can think of logical umbrellas above your organization then you probably are in the wrong place to build a personalized portal and your time and effort will be far better spent providing information in a format that can be easily used in a portal or information aggregator. Sites like the Washington Post's personalized portal did not last because of the cost's to keep the software running and the relatively small group of users that wanted or used that service. Was the Post wrong to move in this direction? No, not at the time, but now that there is an abundance of lesson's learned in this area it would be extremely foolish to move in this direction.

You ask about Amazon? Amazon does an incredible job at providing personalization, but like your local stores that is part of their customer service. In San Francisco I used to frequent a video store near my house on Arguello. I loved that neighborhood video store because the owner knew me and my preferences and off the top of his head he remembered what I had rented and what would be a great suggestion for me. The store was still set up for me to use just like it was for those that were not regulars, but he provided a wonderful service for me, which kept me from going to the large chains that recorded everything about me, but offered no service that helped me enjoy their offerings. Amazon does a similar thing and it does it behind the scenes as part of what it does.

How does Amazon differ from a personalized portal? Aggregation of the information. A personalized portal aggregates what you want and that is its main purpose. Amazon allows its information to be aggregated using its API. Amazon's goal is to help you buy from them. A personalized portal has as its goal to provide one-stop information access. Yes, my.yahoo does have advertising, but its goal is to aggregate information in an interface helps the users find out the information they want easily.

Should government agencies provide personalized portals? It makes the most sense to provide this at the government-wide level. Similar to First.gov a portal that allows tracking of government info would be very helpful. Why not the agency level? Cost and effort! If you believe in government running efficiently it makes sense to centralize a service such as a personalized portal. The U.S. Federal Government has very strong restriction on privacy, which greatly limits the login for a personalized service. The U.S. Government's e-gov initiatives could be other places to provide these services as their is information aggregation at these points also. The downside is having many login names and password to remember to get to the various aggregation points, which is one of the large downfalls of the MyX players of the past few years.

What Should We Provide

The best solution for many is to provide information that can be aggregated. The centralized personalized portals have been moving toward allowing the inclusion of any syndicated information feed. Yahoo has been moving in this direction for some time and in its new beta version of my.yahoo that was released in the past week it allows the users to select the feeds they would like in their portal, even from non-Yahoo resources. In the new my.yahoo any information that has a feed can be pulled into that information aggregator. Many of us have been doing this for some time with RSS Feeds and it has greatly changed the way we consume information, but making information consumption fore efficient.

There are at least three layers in this syndication model. The first is the information syndication layer, where information (or its abstraction and related metadata) are put into a feed. These feeds can then be aggregated with other feeds (similar to what del.icio.us provides (del.icio.us also provides a social software and sharing tool that can be helpful to share out personal tagged information and aggregations based on this bottom-up categorization (folksonomy). The next layer is the information aggregator or personalized portals, which is where people consume the information and choose whether they want to follow the links in the syndication to get more information.

There is little need to provide another personalized portal, but there is great need for information syndication. Just as people have learned with internet search, the information has to be structured properly. The model of information consumption relies on the information being found. Today information is often found through search and information aggregators and these trends seem to be the foundation of information use of tomorrow.


Previous Month

This work is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike License.