How not to run a survey
Published September 12th, 2008 in UsabilityHere’s a Friday afternoon thought regarding a classic mistake in trying to get people to participate in a survey. When you tell people about your survey, make sure they can complete it!
Sounds simple, right? Well that’s because it is.
Some background perhaps. A common sight within organisations is the satisfaction survey, your HR department might call it something else but essentially they’re all the same. And like all satisfaction surveys—think of a motel or car rental company—it’s really a poor attempt at communicating with your audience, or giving the perception that you are communicating with them (but I digress). People know this, that you’re not really listening to them (the vague, clichéd questions are a dead giveaway) so you’re already off to a bad start if you choose to run such a survey. But you’re really going to struggle when you ask staff to complete a survey that doesn’t exist…yet.
I saw an example of this today, where an email—and a rather long winded email full of ‘management speak’—was sent to all staff in a large organisation, telling them about the flagship staff engagement activity for the year, an all-encompassing survey (!!). At the end there was a link to the online survey. At this point I was simply surprised it was an online survey and out of sheer excitment decided to click on the link. Error. Not a nice “survey not open please come back later” message, an HTTP 404 error.
Apparently I was meant to wait until the survey opened in a few days time and then go back to the email, click the link and complete the survey. Hmmm. Delete!
Survey completion rates are typically quite low. Without a tangible incentive they’re even lower. If it has anything to do with work, waaaay low. So you’ve got very little chance of getting a decent set of responses, but when the link doesn’t work at the point when people are the most likely to click on it, you’ve lost before you’re even begun.
Let’s not even discuss whether a survey is a good method for engaging with staff, the moral of the story is if you create a call to action make sure the people who you want to act are able to take action. This goes for surveys but also competitions, sales promotions and website launches.
(You may be thinking this post is rather ironic given my own recent attempts at surveying, but this is one mistake I definitely didn’t make :)
Popularity: 6% [?]
One Response to “How not to run a survey”
Leave a Reply
Search
Latest posts
Old favourites
Categories
- Accessibility (13)
- Automotive (11)
- Books (2)
- Conferences (39)
- Consulting (23)
- Design (6)
- Design research (28)
- Family (18)
- Humour (27)
- IA (43)
- Interactive marketing (3)
- Intranets (14)
- Music (14)
- Photos (7)
- Quotes (11)
- Ramblings (126)
- Speaking (21)
- Travel (23)
- Usability (28)
- User experience (41)
- Web 2.0 (7)
- Web design (46)
Archives
- November 2008
- October 2008
- September 2008
- August 2008
- July 2008
- June 2008
- May 2008
- April 2008
- March 2008
- February 2008
- January 2008
- December 2007
- November 2007
- October 2007
- September 2007
- August 2007
- July 2007
- June 2007
- May 2007
- April 2007
- March 2007
- February 2007
- January 2007
- December 2006
- November 2006
- October 2006
- September 2006
- August 2006
- July 2006
- June 2006
- May 2006
- April 2006
- March 2006
- February 2006
- January 2006
- December 2005
- November 2005
- October 2005
- September 2005
- July 2005
- June 2005
- May 2005
- April 2005
- March 2005
Where I do what you’re doing now
Code and technology
Creative and multimedia
Design research
KM, IM and strategy
Misc
UX, IA and IxD
- 37 signals signal vs noise
- Adaptive Path entries
- Andy Rutledge : Design View
- Austin Govella : Thinking and Making
- Boxes and Arrows
- Chris Khalil’s Musing
- Christina Wodtke : Eleganthack
- Christopher Fahey : Graphpaper
- Donna Maurer : DonnaM
- findability.org
- Good Experience
- Iain Barker : Simpler is Better
- InfoDesign
- Jared Spool : Brainsparks
- Jeff Veen
- Jesse James Garrett
- Joshua Ledwell : Compete on Usability
- Leisa Reichelt : Disambiguity
- Lou Rosenfeld : blougList
- Lyle Kantrovich
- Martin Hardee : Sun.com Design
- OK/Cancel
- Peter Merholz
- Peter Van Dijck’s Guide to Ease
- Shane Morris : UXB
- Steve Baty : Doc Holds Forth
- Todd Warfel
- UsableWorld
- UX Matters
- Zef Fugaz : zef[a]media


Good post! How true.
Seems like a crazy double whammy: give us your time and effort even though we aren’t *really* interested in what you have to say!