Fraud Alert! (Part One)

As a design researcher, I find few things more difficult or frustrating than recruiting qualified and honest research participants. The recruiting process is arguably the most important part of a project, but often the most overlooked.

Over the past 25 years, I’ve personally observed and interviewed thousands upon thousands of people and families throughout the world. I can smell a “focus groupie” (as we call them) a mile away. In recent years I have seen more and more of them in every market, in every corner of the world: people who earn a secondary income by frequently attending focus groups and contextual interviews. Fraudulent recruiting agencies and participants have become an epidemic, which is poisoning the research industry.

Many recruiters fail to fully understand or accept the consequences of their poor recruiting. Besides the impact it has on data quality, one bad participant, specifically an in-context observation/interview, can cost thousands of dollars in time (fees), travel, and support services.

But if one bad recruit were all we had to worry about, things would be different. Without vigilant monitoring, you can end up with an entire market of unusable respondents. The worst conversation any researcher can have with their client is telling them a market must be redone because of bad recruiting.

Not all recruiters are bad, nor are all participants liars; however, finding a good recruiting agency has become the exception and not the rule. As recruiting agencies face more pressure from clients to decrease costs and time associated with recruiting, diligence throughout the process and quality of recruiters are compromised. Many recruiting firms pay their recruiting staff slightly above minimum wage, with little or no experience or training.

In a human-centric business, if you can’t trust the honesty of your participants, how can you trust your analysis, your conclusions or your design recommendations? The old saying holds true, “garbage in, garbage out”.

 (Come back next week to read about how SonicRim has tackled this problem.)

This entry was posted in Feature, Thinking. Bookmark the permalink. Both comments and trackbacks are currently closed.

Doing

Future of Autonomous Driving in India: A Co-Creation Workshop

Uday will conduct a co-creation workshop at the 10th Pune Design Festival on February 26th and 27th. The workshop will offer an opportunity to learn how to introduce  a disruptive technology into community imagination with sensitivity to cultural, psychological and social factors. For the workshop we have chosen a topic that is already drivers’ mental models and challenging the imagination... learn more »

Whiteboard @ SonicRim: Designing Design Education

Where should we draw the boundaries of design education? Design has been considered to encompass all kinds of things — from a safety pin to a highway.  It involves the development of hardware and software. Its scope involves tangible and intangible domains of human life. The practice of design has come a long way since... learn more »

October 16, 2015: A workshop on “Innovation Through Co-creation” at Wayne State University, Detroit.

A workshop on “Innovation Through Co-creation” at Wayne State University, Detroit. SonicRim Uday Dandavate and Kevin Schmidt facilitated a workshop on “Innovation through Cocreaton” at the Wayne State University in Detroit. 25 participants from both for profit and non-profit sector participated in this hands on workshop. A key point made was the need to introduce... learn more »