Pat’s Point of View

Lately, I’ve been thinking about recruiting users (or I could don a lab coat and call them subjects) for usability testing.

I’ve spent the last year focused on intranets, which when it comes to this, are a breeze. You have a captive audience which can be defined quite well—in terms of job roles and information needs—through a bit of ethnographic research, they are usually close by and are usually quite happy to participate (if it comes to it you can always get their boss to make them do it…<evil laugh>).

Now, working on a website is a whole different ball game. There’s a lot of talk about usability testing—who to test, how many subjects, how to run the sessions—but not a lot on how to find a good source of representative subjects.

In the past, I’ve used two techniques when working on public projects: guerrilla style and external testing. By guerrilla (I just love that word) I mean low-cost, in-house testing where you make use of carefully selected colleagues/friends/family. At the other extreme we almost totally outsourced the recruitment and provision of test labs. Each is a valid technique, if applied appropriately, but both have obvious drawbacks.

Your client might already be in contact with key customers (such as in the case of B2B) and allow you access to their staff, but this is not that common for most projects, and more importantly, are these going to be representative users?

Probably the most popular method of recruitment is to use an external recruiter, normally a market research firm, who can get you subjects. Sometimes they even get you subjects you specify! But this is pretty bloody expensive.

A recent addition to the proverbial toolkit is Usability Exchange which makes it a bit easier by facilitating remote online sessions (specifically for accessibility). But remote testing of this nature has major drawbacks. It’s not surprising that it’s focus is on the more mechanical aspects of accessibility; so much of what you might learn from a one-on-one session is lost with this arrangement.

AGIMO have an interesting bit in their tookit on recruiting participants, although it doesn’t go into specifics. Some of their suggestions are interesting, and the list of pros and cons seems very sensible. Having never used some of these methods (such as cold calling or advertising in the newspaper) I’m not sure how practical they would would be, or how enthusiastic most clients would be to use them.

So it’s looking like the best approach is still to try a combination of methods that are suitable for the specific situation you find yourself in. No silver bullet here…or is there? Do you have a favoured technique for getting hold of usability testing subjects? C’mon let’s hear it.

(And this is just for your usual usability testing, what about cultural probes and other more ‘intrusive’ techniques? How do you find subjects for those?)

Popularity: 7% [?]