You Lookin’ at Me? Reflections on Google Glass.

frog640

There is but one remedy for the Glass wearer — a bucket of ice water in the face whenever you suspect he has taken you unawares

With the public beta launch of Google Glass, there has been a lot of discussion on why it will or won’t fail. The ultimate benchmark for success is high: After someone has tried Glass, can they imagine life without it?

It’s the wrong question.

Glass is Google’s unintentional public service announcement on the future of privacy. Our traditional bogeyman for privacy was Big Brother and its physical manifestation — closed-circuit TV — but the reality today is closer to what I call Little Sister, and she is socially active, curious, sufficiently tech-savvy, growing up in the land of “free,” getting on with life and creating a digital exhaust that is there for the taking. The sustained conversation around Glass will be sufficient to lead to a societal shift in how we think about the ownership of data, and to extrapolate a bit, the kind of cities we want to live in. For me, the argument that Glass is somehow inherently nefarious misses a more interesting point: It is a physical and obvious manifestation of things that already exist and are widely deployed today, whose lack of physical, obvious presence has limited a mainstream critical discourse.

As a product that is both on-your-face and in-your-face, Glass is set to become a lightning rod for a wider discussion around what constitutes acceptable behavior in public and private spaces. The Glass debate has already started, but these are early days; each new iteration of hardware and functionality will trigger fresh convulsions. In the short term, Glass will trigger anger, name-calling, ridicule and the occasional bucket of thrown water (whether it’s ice water, I don’t know). In the medium term, as societal interaction with the product broadens, signs will appear in public spaces guiding mis/use1 and lawsuits will fly, while over the longer term, legislation will create boundaries that reflect some form of im/balance between individual, corporate and societal wants, needs and concerns.

So Shoot Me

Of all of the companies and organisations that could bring Glass to market, I’m pleased that Google is the one making a significant investment: A company with a recent record of genuine innovation that stretches/defines social and behavioral norms2 with a strong revenue stream and deep enough pockets to have a fighting chance of medium to long-term success. It also helps that the project is considered of strategic importance, and has key executive sponsorship. Less obvious, but no less relevant in this equation, is that the company has a lot to lose, is no longer the media darling, has fucked up enough times in public to know it can do so again (and again), has been humbled by more nimble competitors, has experienced talent drain and understands the impact of this on its culture and its bottom line. Of course, Google can financially afford to fail again: Experimentation and failure is a critical part of its DNA, but while privacy-snafu fines are low, the internal and external cultural costs of Glass failing are high.

All technology challenges the status quo, and if a technology is noticed by consumers/users/constituents at all, it presents for some an opportunity and for others a threat. The perceived and actual threat from Glass comes not from crimes against taste. (Many have commented on the perceived inelegance of the design.) Google’s design team appears to have done a sterling job, if you assume that particular design direction and constraints. Our sense of what is tasteful succeeds or fails as part of a far broader narrative, which they, too, are exploring. Yes, you can find a hundred and one designs of “wearable computing” from the past decade that look similar, but very few are packing the same experience into the same form factor. However, as a connected, sensing object, it is capable of recording and transmitting photos, video and sound directly through content analysis or indirectly through proximate connected devices, other data such as location, temperature, trajectory and so on. In other words, in a worst/best case scenario it could record and measure “everything,” and associate that data to a person. How will this play out?

I want you to try a little experiment. Find somewhere where you can sit and observe people interact with one another. Pick somewhere just out of the throng — the edge of a cafe looking in, a park bench, a doorway close to a market. It’s easier if you choose somewhere you don’t know so well, you’ll have less to unlearn.

Give yourself 30 minutes to view and reflect upon the scene in front of you: Who visits that space, and why; the differences in ritual greetings, and indeed whether or not a person is greeted; how people project who they are; things that signify status and social hierarchy; where objects are placed; the level of interaction with those objects when not in use. What can you see being documented online or off? What can you imagine being documented? Pay particular attention to things that fit your definition of “technology” and reflect upon the things in front of you that once fit this definition but no longer do (my list of were-once-technologies includes the pencil, the wristwatch and the smartphone).

If you’re close enough to other people, you’ll overhear conversations plus bits of conversations that the speakers will allow you to hear, raised, projected, sotto voce and in whispers, combined with body language all serving to emphasize what is said, and the intent of what is communicated. How much of that conversation is directed at the “listener” and how much of it is directed at others in proximity, including you? This rich social choreography is playing out hundreds of billions of times a day across our planet, and is as subtle and delicate as anything appearing in a BBC2 nature documentary.

Of course, people and systems are already capturing (and channeling) content and data in this space in the form of photos, video, background noise on phone or video calls, who is connected to what, and what they are doing. It is likely that Google, Microsoft and Nokia’s Navteq (to name but three) have already systematically mapped this space and are serving up street views online. The difference with Glass is that it threatens surreptitious, unexpected or continuous recording from the perspective of the human-eye/ear view. At this point, it doesn’t matter whether it can support sustained recording for long periods or not; what matters is that the form factor supports this, that it could at some point, and that we all know Google is in the business of selling ads against insight drawn from large volume of data. Continuous, indiscriminate recording in this space is the dragnet fishing of data collection — it’s a destructive technology, a conversation- and privacy-killer.3

Back to our experiment. Take in the scene in front of you. Who owns this space, both legally and figuratively? Who has the rights to do what? By what authority? Who enforces that authority? How do these rights differ for regulars or a first-time visitor? What are the ways people signal the beginning or the end of an activity? And how does that signalling make something more or less acceptable? The obvious clue to activities people have deemed socially unacceptable are often found on hand-scribbled “do not” signs, as in “staff will refuse to serve customers who are on their mobile phone,” or “do not ask for credit.” The more sustained the infringement, the more official-looking the sign.

Today, we falsely assume that our conversations and our images are not by default recorded by other people in proximity.4 Not having a persistent record allows us to present a nuanced identity to different people, or groups of people; it provides the space to experiment with what we could be. The risk that what we say will be broadcast, or narrowcasted, to people we don’t know, or may bubble up at some point in the future in the hands of someone serving up ads, fundamentally changes what we want to talk about. The challenge for Glass is that the costs of ownership fall on people in proximity of the wearer, and that its benefits have yet to be proven.

Social Interaction

A number of years ago, while I was working at Nokia, I was asked to explore use cases using an appearance model (a non-working prototype) of a form factor similar to Glass, but clunkier and definitely less refined.5 In the first phase of this make-it-up-as-you-go-along-and-see-what-works study, we hired students in Tokyo to act out various scenarios, including content browsing, viewing and game-play using gestures and voice commands, in a range of contexts: At home, on a commuter train, on a long-distance train, in a hotel lobby, in a park, a cafe, and while walking along. The research team then noted interaction issues with the glasses, carefully observing social reactions from people in proximity before finally interviewing the actors/actresses for their own experience.6

Fans of Milgram’s New York subway experiment will be happy to note that our actors and actresses felt extremely self-conscious about wearing nonstandard glasses, and awkward about acting out the scenarios, particularly in contexts where there were others in close proximity. A number of the things we learned from this study surprised us:

  • Most of what we “see” at any time is out of focus in the periphery where as long as the things going on in peripheral vision don’t trigger a threat response will probably pass the glance test. It will be interesting to see whether Glass is perceived as a threatening object and thus may force others in proximity of a wearer to maintain a hyperawareness of the wearer and their own actions — whereas today they are currently able to relax. This would be, in effect, like a blanket tax on the collective attention of society.7
  • Spoken interaction is awkward for almost everyone in confined spaces on systems with less than 100 percent accuracy. An interface built around short responses to contextually understood events will be the dominant form of interaction.
  • Gesture interaction is just as awkward in close spaces, and in many instances will restrict regular use and/or in a vocabulary of “quiet gestures.” To get a sense of how this plays out, the next time you are on the subway and have people sitting on either side, raise your hands in front of your face or look down and move your hands in your field of vision. Even simple gestures require upper-arm/shoulder movements, which, when you are sitting shoulder to shoulder, impact fellow passengers. A Glass wearer who wants to maintain the social cohesion in that context (and not all will be that self-aware or considerate) can mitigate this by pausing interactions for the moment when they are appropriate, or more likely by avoiding interactions in that context.
  • In contexts where social interaction is required — sitting with friends around a table in a cafe, say — Glass will create a situation where people are not sure whether they or the contents of the display are engaging the wearer.
  • In-ear or close-to-ear (inductive) audio changes the wearer’s enjoyment of food and drink — a problem for an otherwise prime use case: Watching movies at home, where snacks and beverages might naturally be consumed.
  • Humans tend to fall asleep in contexts where they are seated, safe, and there is minimal physical movement — providing opportunities to design for disengagement.
  • Humans have a vested interest in tracking changing emotional states of the people around them. This will introduce “Are you lookin’ at me?” moments where others in proximity assume that a smile, tear or frown is triggered by their own presence, and will spur people to send inappropriate content to their Glass-wearing peers, with a weary inevitability that will include this but is far less likely to include this (or is it the other way around?). In some contexts, these moments will lead to confrontation. Read the footnote in this article in the Atlantic, by Ta-Nehisi Coates, and imagine introducing erratic behavior into the equation. Amplify to billions of social interactions a day.

What starts out as a fairly broad set of use cases rapidly starts to narrow.

Tooling Up

I’ve got a confession to make. Frog, the design and innovation consultancy where I work, has recorded thousands of conversations around the world, videotaped many more, tailed people around town and nosed around people’s homes — opening cupboards and drawers, asking personal questions where there were none. All with their permission, and all in the name of research. There are a few things we’ve learned that relate to the broader discussion of what is collected by whom, how and why, and how it is used; you’ll see why these are relevant in a moment.

Any idiot can collect data. The real issue is how to collect data in such a way that meets both moral and legal obligations and still delivers some form of value.

  • Ownership. People are naturally suspicious of what they don’t know. The simple act of giving them control over the process or the objects/technologies we carry defuses initial suspicion. A few simple field-research techniques can rapidly build trust. These include handing someone you’ve just met on the street a $5,000 camera and then ignoring them to concentrate on a conversation with their friends. This shows we trust them. And then they trust us.
  • Clear On/Off States. Most people have (at least initial) concerns about being recorded. There are numerous effective ways that we in Frog’s design research team emphasize the transition between on and off: From how a camera or other recording device is held when not in use. It is useful to think of a camera as a gun: Understand the impact that bringing it out can have on any given context; only take it out if you’re prepared to use it and be careful where you point it.
  • Reciprocity. Today it is easy to maintain a persistent connection between the researcher and the participant — often in the form of a social media account or email address. You’ve asked something of them, and they have the right and now have a channel through which to ask something of you.
  • Full circle: We give participants the opportunity to review, delete or own any of the data collected on them by the research team. This is normally carried out at the end of the session, after any reward is handed over (so they are not pressured into letting us keep data) and before any data consent form is signed (so they better understand the implications of what they are signing). A team that knows the data will be reviewed by the participant changes what they collect in the first place; it becomes self-policing. More than any training, this simple principle helps keep teams honest and operating within social norms.
  • A few simple steps lower the more obviously anti-social aspects of Glass. The evolution of body language that helps communicate Glass’s current state, e.g. pushed above the head to show that it is not in use; a literacy around the spoken commands that communicate the current task that the user is engaged in “take panorama” or “grindr lookup”; and showing whether the camera and other recording mechanisms are in use or disabled.

    Glass has four design principles for developers that focus on the Glass wearer’s user experience: “design for Glass,” “don’t get in the way,” “keep it timely,” and “avoid the unexpected.”8 As challenging as it is to find a compelling use-case (beyond porn), these principles are aimed at the wrong people — Glass wearers, rather than those in proximity.

    Two complementary principles will go some way toward accommodating the concerns of people in proximity and lower social barriers to adoption:

  • Proximate Transparency: Allow anyone in proximity to access the same feed that the wearer is recording or seeing and view it through a device of their choosing. Make it easy to identify the Glasses themselves and to trace them back to the wearer. This simple act can help demystify the technology, create a broader sense of ownership of its inclusion in any given space. The reality is that very few people would be interested in jacking in and the act of having an open stream will change the behavior of what is watched. For many this won’t be enough of a step; it is after all an opt-out measure for people who have the technological know how and literacy to — forcing people in proximity to do something for dubious gain.
  • Remote Control: allow identifiable people in proximity to control Glass’s recording functionality and have access to the output of what was recorded. Allowing others to demonstrably benefit from the utility of Glass will make it part of the social landscape.

Pedestal or a Pauper’s Grave?

One could argue that the form taken by Glass offers up a lazy futurist’s vision of what might be — take the trajectory of one product (displays becoming smaller/cheaper/more efficient over time) and integrate it with another (eyeglasses), sprinkle in connectivity and real-time access to content and big-data-analytics. Our expectations of what it could be are raised in part because this join-the-dots vision of the future fits neatly into Western un/popular young-male culture, from “The Terminator” through to Halo. Glass has a certain inevitability about it, like the weight of expectation on of child born to a great composer or, if you will, to a middle-aged suicide. As any visitor to Yodobashi camera over the past decade will tell you, the hardware technologies that make Glass hardly feel novel (and for recent competitors, see Sony, Golden-i, or this Telepathy device prototype) but neither do they need to be, because this is all about how they are brought together into a holistic experience.

There are of course alternative visions of this connected future that are far more discrete, taking connected, sensing things and embedding them in the world around us to inform, guide, direct, cajole, tax, enrich us and the things around us. It’s an area worthy of an essay in its own right, but for now, here are a few pointers to people, places and things that have helped inform my sense of this space: Dan Hill at City of Sound; the MIT Senseable City Lab; Design Interactions at the Royal College of Art; Tisch ITP; BERG, Nicholas Nova and Julian Bleecker at the Near Future Laboratory help stretch our understanding of what could be; Curious Rituals in conjuction with students at the Arts Center College of Design in particular is a lovely piece of work; living for more than a decade in Tokyo, Shanghai and frequent trips to the cities that define this century’s urban experience — the Seoul/Nairobi/Mumbai/Rio/Chongqings of this world; products like Nike+, FitBit, Moves (to take one narrow category) through to less well known but arguably more impactful services that for me are at the very center of the internet of things — services like Kilimo Salama and Sarvajal;9 through to business units/activities in large corporations such as Cisco, IBM, Disney, and Ericsson with more of a how to make money/make a difference at scale.10

That Moment in Time

I started this essay by paraphrasing a quote — here is the original in full: “There is but one remedy for the amateur photographer. Put a brick through his camera whenever you suspect he has taken you unawares.” It could be written about Glass today, but is in fact taken from an 1885 edition of “Amateur Photographer”11 magazine, seven years after the introduction of dry plates, a technology that supported more surreptitious photography. (The essay by Bill Jay is worth reading in full.)

The same essay contains another quote from “Amateur Photographer,” twenty five years later, when cameras were becoming smaller, less noticeable: “Our moral character dwindles as our instruments get smaller.” In due course, the technologies to deliver Glass’s emerging functionality will truly disappear from view — this is a window of opportunity for discussion, debate and a reflection.

I’m thankful to Google for putting so much effort into Glass at this moment in time.

That passion? Channel it.

That anger? Channel it.

Jan Chipchase is Executive Creative Director of Global Insights at Frog, a design and innovation consultancy. He has not tried Google Glass, and has no idea whether he has been recorded through one. His first book, “Hidden in Plain Sight,” available from HarperCollins on April 16, explores issues around technology adoption, use and abuse.


1 This sign did the rounds but is closer to advertising for a pleasantly seedy bar than a warning sign. The suspicion can be real, but the true test comes from reactions to a wider deployment.
2 Eric Schmidt’s quote, “Google policy is to get right up to the creepy line and not cross it,” is an interesting reflection of company culture. It’s refreshing to have a CEO that is this frank about the business they are in and the way they operate, and it’s an interesting assumption that the best way to institutionalize an understanding of creepy is to measure it and place it on a line.
3 If you want to extrapolate the argument around wholesale recording through Glass, it’s actually highly inefficient, particularly once much of that space and context is known. There are other, emerging technologies with far more processing power and unlimited power supply that are in a better position to continuously record.
4 There are many examples of what we say and do being recorded: From the obvious conversations in an interrogation room through to corporations tracking employee emails and IM chats, all the way to state agencies. When conducting research in Iran and making a call to the U.S., I assume it is being recorded by both Iranian and U.S. agencies. The only question is who else is listening and what is their motivation, today and at some point in the future.
5 I’ve not done a full write up of the research, but it was shared publicly a few years back.
6 After the Tokyo study, my then colleague Raphael Grignani ran a comparable study in New York City, with broadly analogous findings.
7 The physical toll of having to maintain a state of hyper-awareness is touched on here and here, and while these are extreme examples it is an interesting topic to further explore.
8 As Bruce Sterling pointed out, take each of those design principles and flip them to understand the actual experience.
9 We are running a study around water consumption and Sarvajal and will be sharing more on the project in due course.
10 Full disclosure: This list includes both personal and Frog clients.
11 “The Amateur Photographer,” 18 September 1885, p. 871.

Must-Reads from other Websites

Panos Mourdoukoutas

Why Apple Should Buy China’s Xiaomi

Paul Graham

What I Didn’t Say

Benjamin Bratton

We Need to Talk About TED

Mat Honan

I, Glasshole: My Year With Google Glass

Chris Ware

All Together Now

Corey S. Powell and Laurie Gwen Shapiro

The Sculpture on the Moon

About Voices

Along with original content and posts from across the Dow Jones network, this section of AllThingsD includes Must-Reads From Other Websites — pieces we’ve read, discussions we’ve followed, stuff we like. Six posts from external sites are included here each weekday, but we only run the headlines. We link to the original sites for the rest. These posts are explicitly labeled, so it’s clear that the content comes from other websites, and for clarity’s sake, all outside posts run against a pink background.

We also solicit original full-length posts and accept some unsolicited submissions.

Read more »