via Complete Beginner’s Guide to Design Research – UX Booth | UX Booth.
Research actually begins the moment we learn about a project, whether we acknowledge it or not. As user experience designers we aren’t content simply designing to specification. Instead, we ask questions. We take notes. We learn everything we can about our client and their audience—and that’s before we even begin! In this article, we explore the (purported) method to this (seeming) madness, appropriately known as design research.
A NOTE ON USER-CENTERED DESIGN
Design research is an integral part of the oft–misunderstood user–centered design process. This process, employed by user experience designers, is both iterative and cyclical. Its outputs serve as its inputs. Initially, solutions are proposed based on embodied, observable phenomena related to the problem space. Next, a design solution is agreed upon and then prototyped. Eventually, it’s tested against its target audience. Finally, the process repeats itself.
Design research, as described in this article, assumes the reader follows a user–centered design process.
What is design research?
Design research describes any number of investigative techniques used to add context and insight to the design process. Although this article discusses research in the context of contemporary UX/Interaction Design for websites, Design Research has been practiced for decades (since the 1960s) in the architectural, industrial, and academic communities. For a deeper look into this industry, check out publications like Design Research Quarterly, or consider attending the Design Research Conference.
Design Research techniques can be incorporated before, during, or after the design solution is established. If done before or during the design phase, these techniques are collectively known as user research; if after, they’re known as user testing. User research attempts to answer questions like “whowill use this design?” and “how does this concept work in the context of our users’ workflow,” whereas user testing seeks to answer: “how effective is this design?”
The diagram below provides an overview of user–centered design techniques,highlighting research activities in red.
Young, Indi. 2008. Mental Models: Aligning Design Strategy with Human Behavior. New York: Rosenfeld Media.
PURPOSE
As previously mentioned, Design Research is conducted to add context to the design process.
It’s also used to combat the natural tendency to design for ourselves (or our stakeholders) rather than designing for our target audience. Don Norman, cognitive psychologist and author of The Design of Everyday Things, explains: “We tend to project our own rationalisations and beliefs onto the actions and beliefs of others.”
Without design research we tend towards a self–serving, uninformed design process.
ANALYSIS
The design team is ultimately responsible for analysis of user research. Analysis turns the data collected during research into actionable information. Prominent analysis techniques include (the creation of): personas, mental models, storyboards, nomenclature etc. Although the techniques described here will guide you in conducting research, the presentation and discussion of that data is more important.
MALLEABILITY
Design Research is littered with unanswered questions: How many usersshould we interview (before we can decisively conclude what’s wrong)? What kind of research should I conduct? Should I conduct qualitative or quantitative research? etc. No one technique or approach is correct. It all depends on the fidelity of the technique and the context in which it is applied.
How is user research done?
User Research has the potential to be a sizable undertaking, depending on whether or not the client is iterating on an existing website or commissioning a new one. Regardless, it’s the researcher’s job to explain to their clients what the project’s goals and budget imply for the forthcoming research initiative.
Fortunately, all signs point toward a more casual, habitual approach to user research. Many of today’s practitioners eschew expensive laboratory or field research for rapid behavioral observation.
The following tools and their “plain–English” descriptions are based heavily on the article Can You Say That in English? Explaining UX Research to Clients first run on A List Apart in November, 2009. Although this list is far from comprehensive, it’s enough to get your team started conducting user research.
-
Non–directed Interviews
Non–directed interviews are the best way to develop a design strategy without asking users or stakeholders to spell it out. Simply set up some rough guidelines and converse with your audience—but be sure to focus more on listening.
More information: Nondirected Interviews: How to Get More Out of Your Research Questions and The Secrets of Consulting
-
Contextual inquiry
Contextual inquiry involves observing what people do as they go about their day—not what they say they do. It’s useful for creating a website that supports users’ actual (and not supposed) activities.
More information: Inside Your Users’ Minds: The Cultural Probe, See for Yourself: About the Power of Observing, wikipedia.org.
-
Questionnaires
Questionnaires invite people to say who they are, what they do, and where they go. Creating one is supremely simple with tools such as Wufoo or Google Docs.
-
Card sorting
Card sorting asks people to explore relationships between content and/or hierarchies in an effort to find commonalities. Card sorting is a super simple way to help people find information more quickly and easily on your website.
More information: Card Sorting: a definitive guide.
On a final note, if you need more comprehensive user research, I highly recommend following Indi Young’s Mental Models.
How is user testing done?
As previously mentioned, user testing involves asking potential users of your product or service to complete a (set of) task(s) using a version—ideally a prototype—of your product or service in order to determine its utility and its usability.
Thanks to the Internet, the practice of user testing has seen a dramatic shift over the past few years; despite the fact that it’s less than 50 years old. Nate Bolt and Tony Tulathimutte describe the prevalence of user testing in large organizations in their book Remote Research:
In-person lab research procedures were developed, refined, and standardized, and then became entrenched in the corporate R&D product development cycle. Practically everything gets tested in a lab nowadays: commercial Web sites, professional and consumer software, even video games.
Fortunately, user testing is becoming increasingly prevalent in smaller organizations.
TESTING PROTOCOL
Regardless of where it’s conducted, user testing always follows a similartesting protocol:
- Identify potential users (ideally done during user research, see above)
- Recruit potential users
- Create test guidelines
- Schedule test sessions with potential users
- Administer the test
- Analyze the results
A super–simple method for doing just this is explained in Steve Krug’s new book Rocket Surgery Made Easy: The Do-It-Yourself Guide to Finding and Fixing Usability Problems.
The names of the various methods in which user testing is done depend largely on the relationship of the proctor to the participant:
-
Lab research
Lab research describes usability tests conducted in a highly–produced, simulated environment. Researchers typically observe the test behind a one–way mirror and employ screen–capturing software, video cameras, etc. to document the test.
-
Guerrilla research
Guerrilla research is a modern, lightweight take on lab research. Instead of renting a lab, guerrilla research is typically done on the spot; users are simply asked to complete basic tasks with a website or service, and the entire operation is recorded for later use.
More information: Watch Steve Krug administer a simple test.
-
Remote research
On Bolt|Peters‘ website Remote Usability, they define remote research as
“any kind of research where the user and research moderator aren’t interacting face–to–face.”
Remote research is the answer to the increasing cost and hassle of earlier research endeavors juxtaposed with iterative, agile development. Ideally, users are both recruited online and tested online, so that the entire feedback loop is handled at both parties’ convenience.More information: remoteusability.com.
Design research luminaries
The following people have contributed greatly to the field of experience design research. Follow the related links to see what they’re currently up to.
NATE BOLT
After pioneering and directing the User Experience department at Clear Ink in 1999, which included the construction of Natural Environment and Remote Observation laboratories, Nate co-founded Bolt | Peters. He now serves as el presidente, where he has overseen hundreds of user research studies for Sony, Oracle, HP, Greenpeace, Electronic Arts, and others. Beginning in 2003, he led the creation of the first moderated remote user research software, Ethnio.
MIKE KUNIAVSKY
Mike Kuniavsky is a user experience design, process, and strategy consultant. He’s created successful and innovative user-centered digital technology for more than twenty years and for dozens of the world’s biggest companies. His typical work involves partnerships with senior level executives who want to create more successful products and a more compelling user experience.
STEVE PORTIGAL
Steve is fascinated by the stuff of a culture—its products, companies, consumers, media, and advertising. All these artifacts and the relationships between them are the rules that define a culture—the stuff makes the culture, but it is the culture that makes the stuff.
DAN SAFFER
Dan is a founder and principal of Kicker Studio, a design consultancy for consumer electronics, appliances, devices, and interactive environments, specializing in touchscreens and interactive gestures. When he’s not researching the latest and greatest in interface design, he works as an interaction designer.
JARED SPOOL
Jared founded User Interface Engineering in 1988. He has more than 15 years of experience conducting usability evaluations on a variety of products, and is an expert in low-fidelity prototyping techniques. Jared is on the faculty of the Tufts University Gordon Institute and teaches seminars on product usability. He is a recognized authority on user interface design and human factors in computing.
INDI YOUNG
Indi is an applications and navigation guru who began her work in Web applications in 1995. Her clients range from technology start-ups to large financial institutions. Projects include global corporate intranets, consumer finance and investment tools, enterprise software lead generation sites, knowledge management tools, workflow applications, and business-to-business e-commerce.
ON TWITTER
Tools of the trade
Much of design research is actually done in a question-and-answer sense; researchers ask questions, record responses, and analyze the results. As a consequence, the tools they use are mostly communicative or illustrative:
Sticky Notes
While you’re researching users, illustrating ideas, or performing a card sort, consider separating and physically playing with your ideas using sticky notes.
Notecards
When you don’t want your notes to be sticky, but still want to allow people the flexibility to move them around and play with them, use these. They’re a cheap, worthwhile addition to any research meeting.
Moleskine
Like the other “analog” tools listed here, Moleskines are great for jotting down and exploring ideas with users and stakeholders alike. Invest in a few of these notebooks and then bring them along to any collaborative session.
Flip Video Camera
Although any video camera will do, the Flip is great because its small, lightweight, and convenient. Researchers conducting interviews or contextual observations will quickly put them through their paces. Consider buying a couple (and sometripods) for your team.
Ethnio
Need to get in touch with potential users? If you’ve already tried Twitter or bugged enough of your Facebook friends, consider sourcing users from your existing website usingEthnio. Ethnio works well because it gets users actually in the act of doing something with your website before you ask them questions about their experience.
Skype
Combined with an application such as Audio Hijack Pro, researchers can conduct audio (and video) chats with users and record their responses. Grab a copy.
Silverback
Spontaneous, unobtrusive usability testing software for designers and developers. Nothing like bringing users to your laptop and asking them for feedback on the spot. Learn more about Silverback.
Related Resources
Introductory Letter to the Participant
This letter helps prepare research participants for the questions that you might ask of them.
Printing Template for 3M Printable Post-It Notes
Use this Microsoft Word template to print anything on 3×4 Post-It Notes. For example, copy quotes to the template and print them out for sorting on the wall. Or, during analysis of one transcript, assign one team member the job of typing up the verb+noun phrases you shout out, to print every 10 minutes or so.
EightShapes Unify
EightShapes Unify is a collection of templates, libraries, and other assets that enable user experience designers to create more consistent, effective deliverables faster.
Useful for generating documentation after you’ve conducted your research.
Sample Usability Test Script
A six–page script that walks proctors through administering a hypothetical user test. This is a direct excerpt from Steve Krug’s Rocket Surgery Made Easy.
Usability Testing Checklist
Another excerpt from Steve Krug’s book, this guide explains what to do in the weeks, days, and hours leading up to guerilla usability tests.