HRM 548 Week 3 Selection Methods Example

Structured Interviews, Work Samples and a Fraud Analysis Exercise: Redesigning Selection at Saguaro Valley Credit Union

[Student Name]

University of Phoenix

HRM/548: Recruitment and Retention Practices

Week 3 Assignment

[Instructor Name]

[Date]

Saguaro Valley Credit Union and all selection data are composites written for a model paper.

Saguaro Valley Credit Union, the composite Arizona cooperative, hires about 230 member service representatives a year through branch and contact center managers who conduct their own informal interviews. Forty percent of new representatives leave within six months, and supervisors rate one in four as weak after their first year. The credit union is also building an 18-person fraud team with no defined selection process. An organization that hires hundreds of people a year through unstructured conversations is making the same bet hundreds of times, and the odds can be measurably improved. This paper evaluates current practice and recommends a selection system for both jobs.

Current Practice

Branch managers screen resumes, hold 20- to 40-minute conversations and decide based on impressions. Questions vary by manager. No scores are recorded. Reference checks confirm dates of employment. The process is quick but inconsistent, and managers often favor candidates who resemble current staff.

Job Analysis

Job analysis for member service representatives, using observation, interviews with top performers and supervisor ratings, identified critical competencies: listening and explaining financial products clearly, accuracy with cash and transactions, resolving complaints calmly, following procedures and learning new systems. For fraud analysts, it identified analytical reasoning with data, attention to detail, knowledge of payment systems and fraud patterns, written communication for case notes and judgment about when to escalate.

Updated Validity Research

Schmidt and Hunter (1998) summarized decades of research and placed general cognitive ability among the strongest predictors of job performance. Sackett et al. (2022) revisited those estimates, correcting an overcorrection for range restriction, and found lower validity for many tools. In their revised estimates, structured interviews were among the highest, around .42, while cognitive ability fell to about .31, work samples were about .33 and unstructured interviews about .19.

What the Revision Means

The revision changes practice. Cognitive ability tests remain useful but are not clearly the best predictor, and they tend to produce larger group differences, which raises adverse impact concerns. Structured interviews offer high validity with smaller group differences and are accepted by candidates. For Saguaro Valley, structured interviews are the backbone of the system.

Designing the Structured Interview

Levashina et al. (2014) reviewed research on interview structure and identified features that improve validity: job-related questions, the same questions for all candidates, anchored rating scales, multiple interviewers and note-taking. The member service interview has six questions linked to competencies. One asks candidates to describe the last time they explained something complicated to an upset customer, what they said and how it ended. Each answer is rated on a five-point scale with examples of poor, acceptable and excellent responses.

The Member Service Work Sample

Candidates complete a 15-minute role-play with a trained evaluator acting as a member who disputes an overdraft fee. Evaluators score listening, accuracy in explaining the policy and calm resolution. A brief accuracy exercise asks candidates to count a cash drawer and record transactions. Work samples measure the job directly, and candidates view them as fair.

Selection for Fraud Analysts

Fraud analysts complete a 60-minute exercise reviewing a dataset of 200 transactions to identify suspicious patterns and write a short case note recommending action. A technical structured interview asks about payment systems, fraud typologies and how they handled ambiguous cases. A panel including the fraud manager and a senior analyst scores each step.

Personality and Situational Judgment

A short conscientiousness measure was considered for member service roles, since attention to procedures matters. Its validity is modest, and its added value over a structured interview is small, so it will not be used at first. A situational judgment test may be added for the contact center if volume justifies development costs.

Why Unstructured Interviews Persist

Managers like unstructured interviews because they feel informative and allow rapport. Yet the impressions formed in the first minutes often reflect similarity, appearance or confidence rather than the competencies the job needs. Structure does not forbid rapport; interviewers can still greet candidates warmly and explain the job before asking the standard questions. Explaining this to managers, with examples from their own past hires who struggled, will reduce resistance to the new process.

Combining the Scores

Each tool produces a score, and the decision rule matters. For member service roles, candidates must reach a minimum on the cash accuracy exercise, since errors are costly, and the remaining candidates are ordered by the sum of their interview and role-play ratings. This approach avoids letting a strong interview mask poor accuracy. For fraud analysts, the panel weighs the data exercise most heavily and uses the interview to confirm judgment and communication.

Reference Checks

Reference checks add little predictive value when they confirm only dates. The credit union will continue them for verification and add structured questions for fraud analysts about specific behaviors, while recognizing their limits.

Adverse Impact Checks

Selection rates will be monitored by race, ethnicity, sex and age at each stage using the four-fifths screen. Structured interviews and work samples are expected to produce smaller differences than cognitive tests. If impact appears, the credit union will review content and scoring before continuing.

Candidate Reactions

Candidates respond better to tools that look job related and to processes that are timely and respectful. The member service process is designed to finish in one visit of about an hour, with a decision within three days.

Estimating the Value

If better selection reduces six-month turnover among new representatives from 40 percent to 30 percent, about 23 fewer early departures a year would save about $265,000 at $11,500 each. Fewer weak performers would reduce transaction errors and complaint escalations. Development and training costs of about $60,000 would be recovered in the first year.

Legal Defensibility

The system is easier to defend than current practice. Each tool links to competencies identified in job analysis, all candidates for a job receive the same process and scores are recorded. If a rejected candidate challenges a decision, the credit union can show what was measured and why. Interview questions will be reviewed by counsel to remove any that touch on protected characteristics, and accommodations will be offered for the role-play and the data exercise.

Training Hiring Managers

All hiring managers will complete a half-day training on conducting structured interviews, using rating scales, avoiding illegal questions and documenting decisions. Each quarter, HR will pull 20 interview files at random and check that questions were asked as written and ratings were recorded.

Implementation and Evaluation

The system will launch in the contact center and ten branches, then expand. After a year, HR will correlate each candidate's interview and role-play results with supervisor ratings and with whether the person stayed, which tests whether the tools predict success at this credit union.

Conclusion

Saguaro Valley's unstructured hiring produces early turnover and uneven performance. A selection system built on job analysis, with structured interviews and work samples for member service and a data exercise for fraud analysts, uses the strongest current evidence, limits adverse impact and pays for itself through lower turnover. Local validation will confirm the results.

References

Levashina, J., Hartwell, C. J., Morgeson, F. P., & Campion, M. A. (2014). The structured employment interview: Narrative and quantitative review of the research literature. Personnel Psychology, 67(1), 241-293. https://doi.org/10.1111/peps.12052

Sackett, P. R., Zhang, C., Berry, C. M., & Lievens, F. (2022). Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range. Journal of Applied Psychology, 107(11), 2040-2068. https://doi.org/10.1037/apl0000994

Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124(2), 262-274. https://doi.org/10.1037/0033-2909.124.2.262