vanderwal.net

Is Mechanical Turk for Digital Human Filters?

The New York Times article, Software to Look for Experts Among Your Friends, brought to mind a couple conversations from my recent trip to Amsterdam. At XTech there were a couple presentations about Mechanical Turk (as well as other Amazon web services) and the big question was "what is a killer application for Mechanical Turk?" Many of us through out suggestions, many good, but I have kept thinking about one.

The one killer application is not really a problem a human solves, but the collective interests and amalgamation of information and trained services humans use and have trained. You see, for me Yahoo's MyWeb 2.0 is my killer search solution as it pays attention to what I and my "community" have interest in and mirrors our vocabulary (we used our own vocabulary to tag items of interest on the web in the MyWeb social bookmarking tool). These items of interest in MyWeb 2.0 are offered to me first in my web searches and more often than not what I am seeking is in this collection of mine or my contact's.

These searches that are based on human filters and collaborative filtering of information and structuring what we find of interest and bookmark bringing the information out from 5 to 40 pages deep in the web. It mirrors our interests and perspectives. But, what if we need information outside of our own interests? Now we need not our own corpus of items and possibly one outside those in our loose collective. Let us think I need information about transmission of disease between monkeys. This is not something I have interest in and I am not sure anybody I know (or would be couple of degrees of separation away) would have interest in. This is where I would love to turn to Mechanical Turk to use the filtering and aggregation capabilities of another person's life filtering. I may not want to add the monkey disease transmission to my own corpus, but I need to use a corpus of somebody who has this interest. In a sense I need to uses somebody's digital brain and information attraction mechanisms.

I am not sure if this is really a job for Mechanical Turk, but it requires another person's interests and permission. The Tacit company seems to have a similar product, but only works on Windows and most of the people I would want to tap are not Windows users, but most have web-based information resources.

An Overview of the Local InfoCloud is Available

I have finally posted a write-up on Exposing the Local InfoCloud, which explains the attributes and components that comprise the Local InfoCloud. This is a write-up of an explanation that has been bubbling for a couple years and I finally put into a presentation last Fall for Design Engaged. The Local InfoCloud include resources that are familiar to us and can often be the social software elements with which we interact as trusted resources.

During a recent symposium on social software (I attended virtually) there was much grumbling around the term "community" and when I stated I was going to try and redact that term from my usage, I was quickly asked what I was going to replace it with. Community is broadly used and for most of my uses the components in the Local InfoCloud are more distinct pointers to what people can mean when they discuss community. The components are also can help us describe the human and digital resources that bring data, information, and media objects closer to us.

When I have chatted with people about the attributes and components in the past it leads to more questions and wonderful discussions. The point of this piece is to clarify the framework for the Local InfoCloud and capture discussion. I have incorporated the feedback from chats I have had, where it was convincing, relevant, and I was happy with how it jelled. I am looking for more feedback and discussion, which is part of the reason it is posted at the Personal InfoCloud (comments and trackback capabilities are available, but moderated, there).

TechCrunch Party in Seattle

I am in Seattle next week for a few days and while there I will be heading to the TechCrunch Party on May 31st. It looks like a good event, as most TechCrunch events go. If you are around you will need to sign-up on the wiki to attend.

College is not about academics

The University of Washington has a new football recruit who seems to want to focus on the football field. When asked about the opportunity to go to Stanford on scholarship he stated, "The academic side of things there was kind of intriguing," Izbicki said. "But I decided it wasn't for me.".

Mind you, the University of Washington is a very good school, as is Stanford.

Memephoria

While I was responding to a friend's e-mail about another large corporation using the term folksonomy I realized that at the moment I do not care if somebody is using it correctly (often people use it to mean tagging -- not tagging that actually works or to mean a tag cloud (the things that are cute but provide little value)). I realized that on the path of a term becoming a buzz word it gets adopted by those who have a case of memephoria.

Memephoria is the state of believing that spreading the latest meme as a mantra will earn you transcendence. Memephoria does not require one to understand the term used in the meme mantra, just to use it (correctly or in-correctly).

Developing the Web for Whom?

Google Web Developer Toolkit for the Closed Web

Andrew in his post "Reading user interface libraries" brings in elements of yesterday's discussion on The Battle to Build the Personal InfoCloud. Andrew brings up something in his post regarding Google and their Google Web Developer Toolkit (GWT. He points out it is in Java and most of the personal web (or new web) is built in PHP, Ruby [(including Ruby on Rails), Python, and even Perl].

When GWT was launched I was at XTech in Amsterdam and much of the response was confusion as to why it was in Java and not something more widely used. It seems that by choosing Java for developing GWT it is aiming at those behind the firewall. There is still much development on the Intranet done in Java (as well as .Net). This environment needs help integrating rich interaction into their applications. The odd part is many Intranets are also user-experience challenged as well, which is not one of Google's public fortés.

Two Tribes: Inter and Intra

This whole process made me come back to the two differing worlds of Internet and Intranet. On the Internet the web is built largely with Open Source tools for many of the big services (Yahoo, Google, EBay, etc.) and nearly all of the smaller services are Open Source (the cost for hosting is much much lower). The Open Source community is also iterating their solutions insanely fast to build frameworks (Ruby on Rails, etc.) to meet ease of development needs. These sites also build for all operating systems and aim to work in all modern browsers.

On the Intranet the solutions are many times more likely to be Java or .Net as their is "corporate" support for these tools and training is easy to find and there is a phone number to get help from. The development is often for a narrower set of operating systems and browsers, which can be relatively easy to define in a closed environment. The Google solution seems to work well for this environment, but it seems that early reaction to its release in the personal web it fell very flat.

13 Reasons

A posting about Top 13 reasons to CONSIDER the Microsoft platform for Web 2.0 development and its response, "Top 13 reasons NOT to consider the Microsoft platform for Web 2.0 development" [which is on a .Net created site] had me thinking about these institutional solutions (Java and .Net) in an openly developed personal web. The institutional solutions seem like they MUST embrace the open solutions or work seamlessly with them. Take any one of the technical solutions brought up in the Microsoft list (not including Ray Ozzie or Robert Scoble as technical solutions) and think about how it would fit into personal site development or a Web 2.0 developed site. I am not so sure that in the current state of the MS tools they could easily drop in with out converting to the whole suite. Would the Visual .Net include a Python, PHP, Ruby, Ruby On Rails, or Perl plug-in?The Atlas solution is one option in now hundreds of Ajax frameworks. To get use the tools must had more value (not more cost or effort) and embrace what is known (frogs are happy in warm water, but will not enter hot water). Does Atlas work on all browsers? Do I or any Internet facing website developer want to fail for some part of their audience that are using modern browsers?

The Web is Open

The web is about being browser agnostic and OS agnostic. The web makes the OS on the machine irrelevant. The web is about information, media, data, content, and digital objects. The tools that allow us to do things with these elements are increasingly open and web-based and/or personal machine-based.

Build Upon Open Data and Open Access

The web is moving to making the content elements (including the microconent elements) open for use beyond the site. Look at the Amazon Web Services (AWS) and the open APIs in the Yahoo Developer Network. Both of these companies openly ease community access and use of their content and services. This draws people into Amazon and Yahoo media and properties. What programming and scripting languages are required to use these services? Any that the developer wants.. That is right, unlike Google pushing Java to use their solution, Amazon and Yahoo get it, it is up to the developer to use what is best for them. What browsers do the Amazon and Yahoo solutions work in? All browsers.

I have been watching Microsoft Live since I went to Search Champs as they were making sounds that they got it too. The Live Clipboard [TechCrunch review] that Ray Ozzie gave at O'Reilly ETech is being developed in an open community (including Microsoft) for the whole of the web to use. This is being done for use in all browsers, on all operating systems, for all applications, etc. It is open. This seems to show some understanding of the web that Microsoft has not exhibited before. For Microsoft to become relevant, get in the open web game, and stay in the game they must embrace this approach. I am never sure that Google gets this and there are times where I am not sure Yahoo fully gets it either (a "media company" that does not support Mac, which the Mac is comprised of a heavily media-centric community and use and consume media at a much higher rate than the supported community and the Mac community is where many of the trend setters are in the blogging community - just take a look around at SXSW Interactive or most any other web conference these days (even XTech had one third of the users on Mac).

Still an Open Playing Field

There is an open playing field for the company that truly gets it and focusses on the person and their needs. This playing field is behind firewalls on Intranet and out in the open Internet. It is increasingly all one space and it continues to be increasingly open.

Expansive Web 2.0 Conference List

Eric Weaver has put together a killer list of upcoming conferences for Web 2.0 related subjects. Now to get this list in Upcoming.

The Battle to Build the Personal InfoCloud

Over at Personal InfoCloud I posted The Future is Now for Information Access, which was triggered by an interview with Steve Ballmer (Microsoft) about the future of technology and information. I do not see his future 10 years out, but today. I see the technology in the pockets of people today. People are frustrated with the information not being easily accessed and use and reuse not being as simple as it should. Much of this is happening because of the structure of the information.

Personal InfoCloud is the Focus

One thing that struck me from the article, which I did not write about, was the focus on Google. Personally I find it odd as Yahoo is sitting on the content and the structure for more than 90 percent of what is needed to pull off the Personal InfoCloud. Yahoo is beginning to execute and open access to their data in proper structures. Ballmer lays out a nearly exact scenario for aggregating one's own information and putting it in our lives to the one I have been presenting the last few years. Yahoo has the components in place today to build on top of and make it happen. Google is not only lacking the structure, but they are not executing well on their products they produce. Google does the technically cool beta, but does not iterate and fix the beta nor are they connecting the dots. Yahoo on the other hand is iterating and connecting (they need to focus on this with more interest, passion, and coordinated direction).

The Real Battle

I really do not see the battle as being between Google and the others. The real battle is between Yahoo and Microsoft. Why? Both focus on the person and that person's use and need for information in their life and with their context. Information needs to be aggregated (My Yahoo is a great start, but it goes deeper and broader) and filtered based on interest and need. We are living in a flood of information that has crossed into information pollution territory. We need to remove the wretched stench of information to get back the sweet smell of information. We need to pull together our own creations across all of the places we create content. We need to attract information from others whom have similar interests, frameworks, and values (intellectual, social, political, technological, etc.). The only foundation piece Yahoo is missing is deep storage for each person's own information, files, and media.

Microsoft Live Gets It

Microsoft has the same focus on the person. I have become intrigued with the Microsoft Live properties (although still have a large disconnect with their operating systems and much of their software). Live is aiming where Yahoo is sitting and beyond. Microsoft has the cash and the interest to assemble the pieces and people to get there. Live could get there quickly. Looking at the Live products I saw in January at Search Champs with some in relatively early states and what was launched a few months later, the are iterating quickly and solidly based on what real people want and need in their lives (not the alpha geeks, which Google seems to target). Live products are not done and the teams are intact and the features and connections between the components are growing. They are leaving Google in the dust.

Can Yahoo Stay Ahead of Microsoft?

The question for Yahoo is can they keep up and keep ahead of Microsoft? Google has the focus in search as of today (not for me as the combination of Yahoo! MyWeb 2.0 and Yahoo! Search combined blow away anything that Google has done or seemingly can do. Yahoo! does need to greatly improve the simplicity, ease of use, and payoff (it takes a while for the insanely great value of MyWeb 2.0 to kick in and that needs to come much earlier in the use phase for regular people).

I am seeing Microsoft assembling teams of smart passionate people who want to build a killer web for regular people. It seems Ray Ozzie was the turn around for this and is part of the draw for many heading to work on Live products. The competition for minds of people who get it puts Live in competition with Google, Yahoo, EBay, Amazon, and even Apple. I am seeing Live getting the people in that they need. Recently (last week) Microsoft even started changing their benefits and employee review practices to better compete and keep people. It seems that they are quite serious and want to make it happen now.

Yahoo Under Valued

Recent comments about Yahoo being under valued in the long term are dead on in my view. A recent Economist article about Google pointed out how poorly they execute on everything but their core service (search). This waking up starts to bring a proper focus on what those of us who look at regular people and their needs from information and media in their lives have been seeing, Yahoo gets it and is sitting on a gold mine. Yahoo has to realize that Microsoft sees the same thing and is pushing hard with a proper focus and passion to get there as well.

Google Overvalued

What does this mean for Google? I am not sure. Google is a technology company that is focussed on some hard problems, but it has to focus on solutions that people can use. Google aims for simple interfaces, but does not provide simple solutions or leaves out part of the solutions to keep it simple. They need a person-centered approach to their products. The addition of Jeff Veen and his Measure Map team should help, if they listen. Google has some excellent designers who are focussed on usable design for the people, but it seems that the technology is still king. That needs to change for Google to stay in the game.

Information Architecture is Information Structure

There were many things that stood out at XTech, but Matt Biddulph's comment in his presentation about building the open data access to the BBC program data really hit home:

I am an information architect because I care about the structure of information and building things from that structure

This has been my framework from dog years ago. Data must be structured well to be used. It is a rant that I continually push, but had not heard back at me in years. Data must be structured and open to be used. All of this chatter about Web 2.0 is based on open and structured data. Microformats is allowing objects in documents on the web to be structured on the web consistently.

In all, XTech made my heart warm as it was all about properly structuring data for use and reuse. It is the geek side of information architecture. It is at the core of the Personal InfoCloud, it is my reason for my work with the Web Standards Project, it is the reason I participate in the Information Architecture Institute, it is the foundation for folksonomy as it allowing people to structure information in their own personal framework so it is easier to refind, it allows aggregation of information in this hyper-flood of information pollution, and it is what makes it so much easier to see the technical nirvana of having the information we want and need at our fingertips when we need it.

More XTech 2006

I have had a little time to sit back and think about XTech I am quite impressed with the conference. The caliber of presenter and the quality of their presentations was some of the best of any I have been to in a while. The presentations got beneath the surface level of the subjects and provided insight that I had not run across elsewhere.

The conference focus on browser, open data (XML), and high level presentations was a great mix. There was much cross-over in the presentations and once I got the hang that this was not a conference of stuff I already knew (or presented at a level that is more introductory), but things I wanted to dig deeper into. I began to realize late into the conference (or after in many cases) that the people presenting were people whose writting and contributions I had followed regularly when I was doing deep development (not managing web development) of web applications. I changed my focus last Fall to get back to developing innovative applications, working on projects that are built around open data, and that filled some of the many gaps in the Personal InfoCloud (I also left to write, but that did get side tracked).

As I mentioned before, XTech had the right amount of geek mindset in the presentations. The one that really brought this to the forefront of my mind was on XForms, an Alternative to Ajax by Erik Bruchez. It focussed on using XForms as a means to interact with structured data with Ajax.

Once it dawned on me that this conference was rather killer and I sould be paying attention to the content and not just those in the floating island of friends the event was nearly two-thirds the way through. This huge mistake on my part was the busy nature of things that lead up to XTech, as well as not getting there a day or two earlier to adjust to the time, and attend the pre-conference sessions and tutorials on Ajax.

I was thrilled ot see the Platial presentation and meet the makers of the service. When I went to attend Simon Willison's presentation rather than attending the GeoRSS session, I realized there was much good content at XTech and it is now one on my must attend list.

As the conference was progressing I was thinking of all of the people that would have really benefitted and enjoyed XTech as well. A conference about open data and systems to build applications with that meet real people's needs is essential for most developers working out on the live web these days.

If XTech sounded good this year in Amsterdam, you may want to note that it will be in Paris next year.

Light Overview of XTech and Amsterdam (including BarCamp Amsterdam)

This trip to Amsterdam for XTech 2006 (and now bits of BarCamp Amsterdam II has been quite different from previous trips, in that Amsterdam is now getting to be very familiar. I also did not spend a day on the front end of the trip walking around adjusting to the time change and spent it inside at XTech, where I saw many friends, which really made it feel more like a floating island comprised of geographically distributed friends that I see when I travel.

It has been great seeing good friends that I really wish I could see more and/or work with on projects as I believe some killer things could get done. I also met people and got to hang out with many new people, which is always great. I was pleased to spend time with people I have only partially spent time with in the past.

I quite enjoyed XTech as it was a good amount of geekery, which provided sparks of inspiration, very good feedback on the "Come to Me Web" and "Personal InfoCloud" stuff I presented. The session had Paul Hammond, Tom Coates, and then myself presenting ideas that focussed on open data, using open data, and building for personal use and reuse of information in our three presentations. It was a fantastic set up.

There were many Mozilla folks around, which was fantastic to hear where the Mozilla/Firefox development is going. This was a very good cross pollination of people, ideas, and interests.

I also realized I need to through out my presentation on Personal InfoCloud and Come to Me Web and rebuild it from scratch. I was finding that my presentation that I have been iterating on for the past year or so is something that needs restructuring and refocussing. I get very positive comments on the presentation, but in delivering the presentation I have made many minor tweaks that have disrupted my flow of delivery. I believe that starting from scratch will help me focus on what gets delivered when. I am really do not write out the presentation in long form as I think that would make it stale for me.

I am heading home tomorrow, but I have not quite felt like I was in Amsterdam as it is really no longer a foreign place. It is still one of my favorite places to be. I spent much time exploring thoughts, spending time with people, playing with digital things, but not deeply finding the new bits of Amsterdam (outside of a few hours this morning). Ah well, I am back in a few short weeks.

Nick Finck on XHTML Wireframes

Nick does a killer job in a post on XHML wireframing and use and reuse of deliverables. This is something I had been doing for years and found it really made the conception to inception process really quick. It also gives the means to keep your documentation up to date. The time savings with XHTML wireframes has been about a quarter to a third of the development time saved.

Those who don't like giving clients clickable wireframes, the pages can be printed/saved out in PDF and annotated.

The other knock is IAs not knowing XHTML or CSS. Somebody working in the practice of web development and web design that does not have an understanding of the handful of elements in XHTML needs to learn it quickly. Go look at CSS Zen Garden to get an idea of what design can be done on top of properly structured XHTML. Lift the hood and look at the mark-up. It is not that difficult.

In short go read Nick's wonderful piece and give XHTML wireframes a shot.

Live Data Could Solve the Social Bookmarking Problem with Information Volatility

Alex brings up something in his Go and microformat stuff! covering what is in the works with Microformats at Microsoft. Scroll down to where Alex talks about "mRc = Live data wiring", now this live data access is incredibly important.

One of the elements that has been bugging me with social bookmarking it the volatility of the information is not taken into account when the bookmark is made. No, I am not talking about the information blowing up, but the blood pressure of the person bookmarking may rise if the data changes in some way. I look at social bookmarking, or bookmarking in general as a means to mark a place, but it fails as an indicator of state or status change of the information we are pointing to. The expressing of bookmarking and/or tagging is an expression of our explicit interest in that object we bookmarked and/or tagged. The problem is our systems so far are saying, "yes, you have interest, but so what".

What the live data approach does is makes our Personal InfoCloud active. If we could bookmark information and/or tag chunks of information as important we should be able to find out when that information changes, or better get an alert before the information changes. One area where this is essential and will add huge value is shopping. What happens with products in the real world? The prices change, they go out of stock, the product is modified, production of the product stopped, etc. The permeations are many, but those expressing interest should be alerted and have their information updated.

One of the things I have been including in my "Come to Me Web" presentations is the ability to think about what a person needs when they use and want to reuse information. We read about a product we desire, we read the price, but we may think about the product or put it on a wish list that is related to an event in the future. When we go to act on the purchase the information we have gathered and bookmarked may be out of date.

One solution I have been talking about in my presentations is providing an RSS/ATOM feed for the page as it is bookmarked so the person gets the ability to get updated information. I have built similar functionality into past products years ago that let people using data know when the data changed (e-mail) but also provided the means to show what the data was prior and what it had changed to. It was functionality that was deeply helpful to the users of the system. Live data seems a more elegant solution, if it provides the means to see what information had changed should the person relying on or desiring the information want it.

Upcoming Conferences I am Presenting at and Attending

Okay, things have been quite busy here. But, here will be changing as I am hitting the skies a bit in the short term. This means I may be near you so reach out and we can hang out and chat. I am completely looking forward to all the places on my schedule and seeing all of the people.

XTech

I am off to Amsterdam, Netherlands (no not that other one) this week to speak at XTech. I will be presenting Developing for the Personal InfoCloud on Thursday at 11:45 in the morning.

BarCamp Amsterdam

On Saturday I will be attending BarCamp Amsterdam for part of the time.

Seattle Area

Following the Amsterdam trip I should be in the Seattle area for work. I don't have dates as of yet, but if you shoot an e-mail I will be sure and connect.

Microlearning 2006 Conference

I will be heading to Innsbruck, Austria for the Microlearning Conference and preconference (June 7). I will be talking about microcontent in the Personal InfoCloud and our ability and desire to manage it (one means of doing this is folksonomy, but will be discussing much more).

Following Innsbruck I may be in Europe a bit longer and a little farther north. I will be in Amsterdam just following the conference, but beyond that my schedule has not yet fully jelled.

WebVisions 2006

I will be heading to WebVisions 2006 in Portland, Oregon July 20th and 21st. I will be speaking on Friday the 21st about Tagging in the Real World. This will look at how people are making use of tagging (particularly tagging services) and looking at the best practices.

The Fall

In September it looks like I will be in Brighton, UK for a wonderful event. I should also be in Australia later in September for another conference.

As these events get closer, I will be letting you know.

Yes, I know I need to be publishing this information in hCal, but I have been quite busy of late. But, I am moving in that direction very soon. You can also follow what I am watching and attending in Upcoming for vanderwal.

Final Cut Pro Site is Stunning

I am not sure when this started, but Apple has started showing its product stories for Final Cut Pro in stunning video. I have been watching and saving down the movies. They are so much better than text for getting me sucked into the story and the pitch. They are each so stunning. So very Apple. Finally!

Apple Pro tools are some of the best on the market and not only put others to shame, they are much less expensive. I have been playing with the movie capabilities in iMovie HD this past week. In 10 minutes I can shoot a movie of my son, edit, and publish to a web page that I can mail those I want to see the page. That to me was hands down incredible. I am not dealing with HD quality video, but the capability is fully there. I just wanted to share a clip with friends and family quickly and get back to work.

Yes, 10 minutes. I have had iMovie for a few years and never played with it much. When I moved to a faster PowerBook this last year I started realizing the potential that was in my hands.

I am continually in awe of Apple for its simplicity, power, beauty, and potential it puts in my hands.

Ze Saves Me with Daily Humor

I have a new daily habit, The Show by Ze Frank. It is a great way to start my day with humor. Is it same for work? Well, that depends on where you work, doesn't it?

For those who have been familiar with the humor and geek renderings of Ze for years, this is a daily dose. I am not usually a fan of podcast or videocast as it is tough to focus on 15 to 45 minutes of chatting. This is the perfect length, 3 to 5 minutes, as is Rocketboom. This has become my television.

Now back to work, which is why I don't have time for 45 minutes of chatting at me from a podcast.

Mis-Marketing

I have been needing to turn comments back on here in Off the Top. I get really good, er, make that great responses in e-mail to many of my posts here. There needs to be a conversation, which is what blogs are all about and it is in comments that much of this conversation takes place. But, as we all know having comments on is a large problem. Why is it a problem?

Problems Created by the Clueless

The problem with comments is the mis-marketers. No, not those mass marketing, but people with little clue about finding a good information space and bringing up products and ideas when they are coherent, which would be good marketing. Good marketing can be annoying, but it is not good marketing that has made an utter mess of blog comments. These people have not clue, they think they are on to a good idea that will make them wealthy, but like most get rich ideas they do not work. Not only do they not work in this case they create animosity toward the product and site. They are putting themselves on black-lists and lowering the value of what they are trying to inflate the value of. It is a clueless approach. They think they are marketing and creating value, but are actually doing the opposite. These mis-marketers not only have shot themself in the foot (or worse) they have ruined great tools.

I am curious if there is a convention or summit for mis-marketers? Can we get a little Cluetrain juice for them to sip?

Looking At My Options

The mis-marketers have made a mess of e-mail with SPAM, referrer logs, blog comments, and trackbacks (I know I am missing many other good communication methods). My blog is broken, I know this. I am still running my own blogging software from 2001. No, I do not have the time for upkeep. But, I keep looking at the time to convert my database to a format for MovableType or WordPress and keep the nearly 2000 entries still working for historical purposes. I do not see that time coming any time soon.