Using HCI methods to evaluate the effectiveness of LinkedIn as a job search tool for creative graduates.

The challenge

We are introduced to a range of HCI methods for research and evaluation including: surveys, focus group, user testing, heuristic evaluation, card sorting, contextual inquiry, and asked to apply appropriate methods to: “Create an evaluation of LinkedIn that can be used towards improving service for new creative graduates.”

Project story

We (a team of 3) designed 3 studies, each informing the problem statement of the next, to gather findings from high-level perceptions to those centered around accomplishing a specific task. Referring to Jacob Nielsens 10 heuristics, a heuristic evaluation was initially conducted to familiarize ourselves with LinkedIn’s web and mobile sites.

STUDY 1

We started out with a survey questionnaire to get an overview of students’ use of LinkedIn. Results led us to focus on job search, a high priority activity for soon-to-be graduates, and informed the problem statement for our next phase.

STUDY 2

“How effective is LinkedIn as a job search tool for new creative graduates?”

For this study, a semi-structured, contextual interview protocol was designed for use in an atypical setting (our makeshift usability lab).  Participants searched for a job and talked aloud through their experience, citing problems with  advance search, finding entry-level jobs and saved jobs.

STUDY 3

“How usable advanced search?”
“How effective is entry-level job search?’ 
“How usable is the save job-post function?”

We designed a detailed task analysis which addressed the three problem statements. On completion of the tasks, user paths were created for each participant, highlighting problem areas. 

Reporting findings

Common issues were collated and reported as findings, described in an easy-to-scan format. Recommendations include usability improvements such as making the advance search link more visible, to creating a new experience: "Provide a special job search section for recent graduates to help them maximize their profile and job search efforts".