Archive for the user experience Category

Mobile storytelling: an evolving story

Charles and Ray Eames: Powers of Ten

Charles and Ray Eames: Powers of Ten

I was recently invited to speak at DUXcamp hosted by NPR and then again at Microsoft Research around the subject of Mobile and Storytelling. I created a rather stream of consciousness presentation, bringing together various thoughts about storytelling in the mobile space. Still very rough around the edges but a central theme is beginning to emerge: Mobile allow stories have scale.

Here’s the presentation deck:

2011-11-02 Mobile Storytelling (@ Microsoft Research)

Preamble

With the arrival of smartphones, it’s amazing how much data we are collecting and consuming on our mobile devices. We tweet, checkin, google, blog, instagram, post status updates, yelp and a host of other things from our handheld devices. And somewhere on the internet this information is quietly collecting. In the ancient times, pharaohs had scribes that shadowed them, recording what they said. Now we have our mobile devices diligently collecting our data. There was once a time when people used to record their lives and thoughts in leather-bound diaries. Now we have smartphones, whose data, when strung together form a story of our lives.

Mobile Me

Mobile me: my story

My Story

I can’t remember when I heard it for the first time, but someone said, our identity is the story we repeat to ourselves. This is so true. I keep on telling my story of how I moved between the East and West, between physical environments (architecture, urban design) and virtual (web and mobile development and strategy), between technology and the humanities. I don’t have an identity grounded in an single culture, nation or land. At one time, I would have referred to this as being nomadic. Now I can just say I’m Mobile Me to borrow a term Apple has abandoned.

Our Stories

Today we have a wild abundance to the ways we collect our stories. Many of them track us automatically: Nike Plus tracks my run, Mint.com tracks my finances and spending patterns, and Trip It neatly organizes my travel plans.

At the rate that memory capacity of devices are increasing, in a couple of years we will have an iPhone which would hold 256GB of data. Battery-life permitting, this would mean (albeit at a low resolution) you’d be able save your whole life by dangling your iPhone around your neck and recording every moment. This is often referred to as life caching or lifelogging. But what’s the point? When will you have the time to go back through hours of video to find and edit the interesting or meaningful parts. Jorge Luis Borges points out that 1:1 scale map is useless. Aren’t we doing just that when we don’t filter to good from the mundane?

Nicholas Felton has been obsessively collecting data about himself and publishes them in annual reports about himself since 2005. And now with his own iPhone app Daytum, you too can be as obsessive about your data as he is.

But Felton does provide us with a insightful clue. What data is meaningful? For his 2010 Annual Report he compiled and presented data around his father’s life. It is surprisingly moving. He masterfully abstracted meaningful data from the numbers and constructs a picture that pays a deeply personal and loving tribute.

Nicholas Felton: Annual Report 2010

Nicholas Felton: Annual Report 2010

An iPhone app called Memento compiles the data from your various disparate personal information repositories such as Twitter, Facebook and Flickr, and brings them back into a diary format, of all things. What used to be manual labor is automagic and becomes personal again. You can even add diary entries. What emerges is a story – your story. You see densities of information where you had memorable events, and long silences where you were buried in depression being dumped.

Other People’s Stories

We live in the age of Facebook. But Facebook is horrible when it comes to telling stories. It presents fragmented pieces of people’s lives that we are often forced to react to rather than engage. The timeline, in its quest to present ever growing amounts of information to us, become as fleeting as the stock ticker feed in Times Square, and belittles the personal importance of each post, by rendering it in the same small block, with the same small profile icon, in the same small font as everyone else. Some people are simply more important than others and we want to pay more heed to them. They are larger in our minds. Why are they the same size as the person whom I casually had a short conversation with at a conference I don’t even remember? Facebook is addressing this issue by adding filters, but with all the data crunching power that they use already around analyzing my relationship with my friends, shouldn’t they know who is important to me already?

Flipboard: Remembering Steve Jobs

Flipboard iPad app

Newspapers know how to present information. They’ve had enough years to refine their art. Typeface sizes matter. The fold matters. Sections matter. Photos matter. They bring your attention to what they deem important. Flipboard is an iPad app that tries to do that, by providing an illusion of priority through a tactful manipulation of layout, font sizes and images. It provides much needed difference and rhythm we are attracted to, over the often mind-numbing flat Twitter or Facebook feed.

Our Collective Stories

Daum Communication, a leading internet services provider in Korea offers a map service with a streetview option, much like Google Maps does in the States. As of Feb 2011 however, they have added a feature that goes a step beyond: streetview history. You can select from various past dates when the streetview camera captured the image. As one example, you can view the building where Daum is located now, under construction in 2008.

Daum Map showing history

Daum Map showing history

Maybe it’s possible to take this further by using tools like Photosynth to crowdsource forgotten images from people’s photo albums or maybe even add historic archival images, so that when you are viewing a certain place through the streetview tool, you can actually go back in time and take a historical journey through a neighborhood. Historians can narrate stories of a city’s development or you can tell your own story of fond childhood memories. What was once a personal memory can now build up a crowdsourced collective memory.

Curtis Wong of Microsoft Research has an wonderful presentation of Microsoft’s World Wide Telescope project where the tool for presenting the universe around us sets a stage for storytelling by allowing researchers and students alike to create a narrative through the interface. Something like an interactive version of Charles and Ray Eames’ masterpiece Powers of Ten.

World Wide Telescope

World Wide Telescope

Usahidi, an interactive map-based information collection tool was born out of a need to capture and report post-election violence during Kenya’s 2008 presidential elections. Usahidi means testimony. Since then it has been used widely to crowdsource data through mobile devices and present them dynamically on a map: from neighborhood snow removal updates to crime reporting. Most noteably it was deployed in the aftermath of the devastating earthquake in Haiti to crowdsource unsafe conditions and aid relief coordination.

How did you hear about Steve Jobs’ death? A lot of us heard through Twitter or from someone who heard it through Twitter, as a collective gasp went through the twitterverse at the news of his sooner-than-expected death. Tweets per second (TPS) is now a proxy for the velocity of the spread of news. When it comes to TPS, surprisingly Jobs’ death ranks #5. It’s the news of Beyonce’s pregnancy announced during the MTV Video Awards that takes the honor of #1. A newborn life wins over death.

Adding Our Life to Data

Jawbone, which produces high-performace mobile headsets, just came out with a very affordable health monitor bracelet called UP. Coupled with a smartphone, this bracelet tracks your eating, sleeping and exercise habits and “nudges” you to adopt better habits. You can imagine market-research groups like Nielsen paying people to don a device like this to track how people really react to what they are watching. Nike Plus gathers data about your run, but what would it be like if global events were tracked not just in the number of media reports but as bio-metric data? What kind of story would that tell? What would a collective “gasp” look like when people heard of Steve Job’s death or Beyonce’s pregnancy?

Jawbone UP

Jawbone UP

Interactive artist, Jonathan Harris is an amazing story teller. We Feel Fine is the project he is best known for. But his Whale Hunt is an incredible project in many ways. Here’s what he did:

I documented the entire experience with a plodding sequence of 3,214 photographs, beginning with the taxi ride to Newark airport, and ending with the butchering of the second whale, seven days later. The photographs were taken at five-minute intervals, even while sleeping (using a chronometer), establishing a constant “photographic heartbeat”. In moments of high adrenaline, this photographic heartbeat would quicken (to a maximum rate of 37 pictures in five minutes while the first whale was being cut up), mimicking the changing pace of my own heartbeat.

The Whale Hunt / A storytelling experiment / by Jonathan Harris

The Whale Hunt / A storytelling experiment / by Jonathan Harris

The result is very close to how our minds actually work – we capture more information and memories in relation to how intense our experience is. Time slows down because we are collecting more information (often for our survival).

This is exactly what happens in the way we collect data through our mobile devices. The more significant the event or location, the more photos, tweets, status updates, blog entries we create about it. You can see it on an individual level, but also on a greater collective level. If you were to represent this in a graphical way, you’ll see something analogous to World Wide Telescope’s universe, where you would have stories instead of stars. What would it mean to look at galaxies of stories across time and distance, zoom into individual shining stars of stories, or encounter black holes where a natural disaster abruptly muted thousands of voices in a single horrific event. You can almost imagine ripples of story supernova spreading at the speed of light as the news of the disaster spreads in its aftermath.

Scale of Stories = Scale of Identity

Recently, overcoming a freak October snowstorm in Washington DC, I went to the National Museum of the American Indian, and then to the National Museum of American History. There I witnessed two institutions telling stories. One of a frequently muted story of the American Indian, whose so many tribes are now forgotten because their stories did not survive the diseases, conflicts and forced migrations. In contrast I saw the victorious stories being told of a young nation who overcame colonial powers, native inhabitants and inner division, whose short story is still unfolding, and needs to be remembered and repeated because its identity and survival as a nation depends on it.

When I showed Google Earth for the first time to my dad on an iPad, the first thing he did was to look for the house he grew up in, deep in North Korea, having left it behind some 60 years ago during the Korean War. I saw the concentration and the emotion that poured over his face as he searched for his childhood home by scanning the geography but also his memory, desperately inferring its location through the landscape of streams, valleys and railroad tracks he remembered.

Zooming in, it’s my dad’s childhood story. Zooming out, it’s the tragic story of the Korean War and the subsequent division of Korea. Further out, it’s the historic story of the fear and ideological power struggle between the superpowers following World War II.

Our identity is the story we repeat to ourselves. If that is so, what is the story we repeat to ourselves as an individual, family, community, region, nation or as a humanity? For the first time in history, as we collect so much data about ourselves, we have the potential to simultaneously see our stories unfold dynamically at different scales. And maybe that can teach us something about ourselves.

Update (2011-11-09)

Microsoft Research has just posted the presentation online. It’s in 2 parts. See the second half.

Get Microsoft Silverlight

iPad as disruptive innovation in education

iPad in classroom

A recent meeting with a friend who is interested in technology in education, a NYTimes article More schools embracing iPad as a learning tool and recent flood of attention on the growing tablet PC market got me thinking about the potential of tablet PC’s (Apple iPad, Samsung Galaxy Tab etc) as a disruptive innovation for education.

Here’s are 5 attributes of tablet PC’s that I think may help to tip the current education system.

1. Data driven. For the first time in education history we have the opportunity to monitor students progress in minute detail through tablet PC’s. A good example of this is the TeacherMate learning systems which has already been relatively successful.

Teachers can see which students are falling behind and where they need help. It also shows areas where students excel. This opens the potential that given this data, education can be personalized to some degree to fit the needs of each individual student. If advances in biotech allows us to dream a future of personalized drug treatments, why can’t we dream an age of personalized education? There could be a core curriculum that every student must fulfill, however with data on each student, they could also have a tailored curriculum that meets their aptitude, interests and areas where they excel.

2. Open ended. Many mention the benefits of tablet PC as a replacement for heavy and expensive textbooks in the classroom. Yes, that’s an obvious solution, but I think they are missing the point.

I don’t like the notion of technology being relegated to eBooks in schools simply because this makes them just digitized versions of a the traditional closed knowledge system: books. There is nothing wrong with books. Books have worked fine for hundreds of years and I am sure they will continue to serve us for the foreseeable future. But there is something not quite 21st Century about text-“books”. Especially the kind that is government vetted, approved and issued, as we have in Korea.

Tablet PC’s are open-ended meaning apps can be developed that not only teach the core concepts but can be open to tap the infinite and dynamic knowledge that is embodied in the Web. This is one of the founding principles of OLPC (One Laptop Per Child initiative). If OLPC’s are doing this already in developing countries where they are deployed, why not in our classrooms?

3. Networked. Kids learn from each other. As Mitra Sugata mentions in his inspiring TED Talk: The child-driven education, kids are consistently teaching each other. If you look at how a teenager does her homework, you’ll see that she is consistently messaging her peers for information. In this always-online, socially networked world, knowledge-making and learning has become inherently collaborative.

A networked device allows for communication, collaboration and peer learning. Learning to collaborate is key to surviving in this ever increasingly networked society. As Steven Johnson points out in his book, Where good ideas come from (also see: TEDtalk, animation), innovations come less from lone geniuses in our midst but as a result of collaborations that build on the knowledge and ideas within fluid networks.

4. Portable. There are no cables attached to an iPad, and the battery lasts a whole day. This is more significant that it sound. This means kids can use them for a whole school day. This means they can work by themselves, in a classroom setting, in the library or huddled around a desk with their peers in a group project. It goes with them wherever they go. We still have “computer labs” in schools, where kids come to interact at fixed times in their curriculum. Being portable means they have a personal assistant with them at all times, with the all above mentioned attributes that this entails.

5. Interactive. The new tablet PC are inherently interactive because they are touch enabled. Being able to touch something is a giant leap from the moderated experience of typing a command, or click a mouse on a screen. Touching something evokes an emotional response, which allows for a far more satisfying user experience as anyone who has seen kids interact with an iPad would attest.

Tablet PC’s force developers of educational application to rethink the whole user experience (I would hope). It brings a whole new dimension of interactivity to applications that go far beyond the point-and-click variety. A storybook for example cannot be just a “flip the page” experience. Characters and objects need to be responsive. You may even be able to rearrange the story and it’s outcome by directly interacting with the story.

Touch-enabled interaction really opens up a whole new area that had been explored only in limited ways on a desktop computer environment. You can now have the constructivist learning environment that Lego afford. We have yet to see these types of applications come into full blossom, but I am sure it’s only around the corner.

Maybe I’ve painted an overly rosy picture of technology. Every technology has its perils. I can tell you that my 4 year-old is already addicted to my (now his) iPad. Technology makes things worse a lot of times, but that should not take away for the opportunities it does afford us. We have to be mindful and vigilant about its pitfalls, and make sure kids are interacting with technology within a guided, safe environment. No conscientious parent would let their kids wander by themselves in the streets, which is tantamount to what we are doing if we allow kids to access the open web, by themselves with no control or moderation.

As with many things, it is hard to innovate from within. Just ask Michelle Rhee. However, there are rare opportunities that we can leverage to make change happen. I certainly wish that this time technology, in the form of tablet PC, in the right hands and minds, is the push we need to upgrade our antiquated education systems.

Photo credit: macattck (flickr)

ChangeON conference presentation

On November 20, 2009 I made a presentation at ChangeON, a conference focusing on non-profits internet media, hosted by the Daum Foundation, the charitable arm of the Korean internet portal, Daum Communications. They just posted the video online.

My presentation (in Korean) was entitled “UX for Good”, focussing on how internet technologies and social media benefit non-profits, with 4 stories to illustrate how some non-profit organizations in the US are using the internet to their advantage.

The examples include:

  • CARMA.org, a site dedicated to monitoring carbon emissions from power plants and providing citizens with tools to take action.
  • Ask Your Lawmaker where users can post questions they want to ask lawmakers, visits vote on the question and reporters get the answers and post it back to the site.
  • DonorsChoose.org connecting classrooms in need of small funding for activities with donors across the US.
  • Ashoka’s Changemakers, global, open-sourced competition site which taps the community of social entrepreneurs to generate ideas for social change.

These are all work I was either directly involved in or made aware of when I was at Forum One Communications in Washington D.C.

Also check out all the other great presentations at the ChangeON conference (in Korean). Especially inspiring where the presentations by Jung Jin Ho of Yahoo! Korea, Park Woong Hyun of TBWA Korea, and Pyo Chul Min of WizardWorks.

How losing control isn’t that bad

Mr Splashy Pants / Greenpeace.org

Mr Splashy Pants / Greenpeace.org

Mister Splashy Pants, a whale named after Greenpeace held a naming competition in 2007 isn’t really news, but Alexis Ohanian, who is a founder of Reddit tells a great story at TED (in 3 minutes no less!) of how social media created a meme, took Greenpeace by surprise, won the competition, Greenpeace ceded control and in the end saved whales, literally.

The example shows one way for establish organizations to work with social media: Loosen up and go with the flow. Make the most of the situation and the attention. You need to give something up to gain people’s trust and participation. This is something that corporations and non-profits alike are mortally afraid to do.

Organizations are afraid of losing control over their message. But what is brand identity anyway? Isn’t it something that forms in the minds of the customers and participants? And it’s hard to control what people think of you. Individuals are constantly making adjustments to accommodate, influence or reject the way they are perceived by others. But it’s an ongoing relationship, not one-way. The more social we get in the use of internet technologies, the more relationship-oriented things will be.

So it’s not ok to find new ways to do old things, like one-way communication. Embrace participation. Lose some control. It’s ok. If a serious organization like Greenpeace can have some fun, other can too.

See also: Wikipedia entry

Co-posted on uxforgood.org

Sugar on Eee PC

Sugar on EeePC

Sugar running on Asus EeePC

Finally got Sugar installed on my Asus Eee PC.

My brother gave me a pink Asus Eee as a gift for my daughter about a year ago, but having used it for a few days I was convinced that the version Linux it was running and the lack of Korean support would do more to damage to my daughter’s computer literacy than help it.

Recently I realized that I could install Sugar Learning Platform, the OS running on the OLPC XO (Nicholas Negroponte‘s One Laptop Per Child initiative) on the Eee. Initial web search was very confusing. Do you need to install Ubuntu? Can you install it from a USB? Do you need a CD-ROM drive…

Mike Lee (@curiouslee) who has been using an OLPC XO and has Sugar installed on his Eee gave me the amazingly simple installation answer. It took basic 2 steps:

You need a Windows PC though.

Step 1: Create a standalone USB drive with Sugar from your Windows PC.

  • Plug in your USB drive (1 gig or more) to the PC.
  • Download and run Fedora LiveUSB Creator.
  • Select “Sugar on a Stick” under “Download Fedora”. Select your USB stick under “Target Device”.
  • Click “Create Live USB” button. This should take a while (It took about 2 hours to download and create for me).
  • When the process completes, you now have “Sugar on a Stick” (SoaS)!

Step 2: Boot up Eee from your USB drive

  • Plug the USB drive into your Eee, then hold down F2 as it is booting up to launch “BIOS Setup Utility”.
  • Select the 4th tab “Boot”.
  • Then select “Hard Disk Drives” from the Boot Settings. Set your USB stick as the 1st Drive.
  • Hit F10 to Save and Exit the BIOS setup.

You are done. The system should start up in Sugar.

Thx Mike for showing me the light. I’m going to test Sugar out and hopefully write more about it.