IOP 480 Week 2 Talent and Selection Assessment Example

Building a Front Desk Hiring Battery: Interviews, Judgment Scenarios and Integrity Measures at a Resort

[Student Name]

University of Phoenix

IOP/480: Assessment Tools for Organizations

Week 2 Assignment

[Instructor Name]

[Date]

The resort company, staff, tools and data are composites written for a model paper; research findings come from the sources listed.

After setting aside an unproven vendor test in Week 1, Saguaro Springs Resorts still needs a better way to hire front desk agents. This paper builds a selection battery, choosing each tool for what it adds and combining them into a process that is valid, fair and fast enough for high-volume hiring.

The Job

Front desk agents at the company's four Phoenix-area resorts check in and out several hundred guests on busy days, resolve complaints about rooms and billing, process payments and deposits and coordinate with housekeeping and maintenance. Turnover is high, and managers report that the worst hires either lose their composure with difficult guests or make repeated cash-handling errors. A job analysis using observation, interviews with top agents and critical incidents identified four priorities: service orientation, composure under pressure, accuracy with money and data and dependability.

The Structured Interview

Levashina et al. (2014) reviewed decades of research on the structured employment interview. They found that structure, through practices such as basing questions on job analysis, asking every applicant the same questions, using behavioral or situational questions, limiting follow-up probing, using anchored rating scales, training interviewers and using multiple interviewers, increased reliability and validity and reduced the influence of irrelevant factors. Structured interviews generally showed smaller group differences than cognitive ability tests and were viewed favorably by applicants.

Jonah's interview asks six questions drawn from critical incidents, for example, "Tell me about a time a customer was angry about something that was not your fault. What did you do?" Two trained interviewers score each answer independently on a five-point scale anchored with examples from the job analysis, then compare ratings.

Situational Judgment

McDaniel et al. (2007) combined studies of situational judgment tests, which present realistic work scenarios and ask applicants to evaluate possible responses. The tests predicted job performance and added prediction beyond cognitive ability and personality. Validity was similar whether applicants were asked what they should do or what they would do, but the two instruction types related differently to other traits: "should do" tests related more to cognitive ability, and "would do" tests more to personality.

Jonah's twelve-item video scenario test shows situations such as a guest arriving after a canceled reservation during a full house, a coworker voiding a charge without authorization and a line of twenty guests when the system goes down. Applicants choose the most and least effective responses, which were keyed by experienced front desk managers. The test targets service orientation and composure and takes about fifteen minutes on a phone.

A guest whose reservation vanished during a sold-out weekend tells you more about an applicant's composure than any question about strengths and weaknesses.

Integrity

Ones et al. (1993) conducted a large meta-analysis of integrity tests, which assess honesty and dependability either through direct questions about attitudes and past behavior or through personality-based items. Integrity tests predicted both overall job performance and counterproductive behaviors such as theft, absenteeism and disciplinary problems, and they added prediction beyond cognitive ability. Validity was found across a range of jobs.

Because agents handle cash and guest payment information, Jonah includes a short personality-based integrity inventory focused on dependability and rule following. He notes common concerns: some applicants may try to present themselves favorably, and a few items can seem intrusive. He chooses a measure without questions about past crimes and explains its purpose to applicants.

Accuracy With Money and Data

None of the three tools directly measures accuracy. Jonah adds a five-minute work sample in which applicants process three mock check-ins with deposits and correct a billing error. Scoring is objective: the number of entries completed correctly.

Combining Scores

The tools are combined mechanically rather than by impression. Applicants first complete the scenario test and work sample online; those above a minimum score on each are invited to the structured interview and integrity inventory. Final scores are a weighted sum, with the interview and scenario test weighted most heavily, as decided before any data are seen. Hiring managers choose among top-scoring applicants but cannot override scores without documenting a job-related reason.

Why Not a Cognitive Ability Test?

General ability tests predict performance across many jobs, and Jonah considered one. He left it out for three reasons. The front desk role relies more on composure, service and accuracy than on complex reasoning; ability tests typically show larger group differences than the tools he chose, which would raise adverse impact in a diverse applicant pool; and the scenario test already captures some reasoning about work situations. If local validation later shows that the battery misses something ability would add, the decision can be revisited.

Faking and Coaching

Any self-report measure can be faked to some degree, and hospitality applicants may share tips online. Jonah reduces the risk by using a scenario test scored by expert keys rather than obvious right answers, keeping the integrity inventory's items indirect and relying most heavily on the interview and work sample, which are hard to fake because applicants must perform rather than describe.

Fairness and Applicant Experience

Structured interviews, situational judgment tests and work samples typically show smaller subgroup differences than cognitive ability tests. The scenario test is available in English and Spanish, since many guests and applicants speak Spanish, and reading demands are kept low. The total process takes under an hour, and applicants receive a short realistic preview of front desk work.

Validating the Battery

After six months, Jonah will compare battery scores with supervisor ratings on a structured form, cash discrepancy records, guest survey remarks and whether each hire is still employed at day ninety, then examine selection rates by group. Weights and cutoffs will be revised based on the results.

Conclusion

A battery built from a job analysis combines a structured interview, a situational judgment test, an integrity inventory and a brief work sample, each chosen for what it measures and supported by research. Mechanical combination, attention to fairness and a plan for local validation complete a selection system far stronger than the unproven test Saguaro Springs first considered.

References

Levashina, J., Hartwell, C. J., Morgeson, F. P., & Campion, M. A. (2014). The structured employment interview: Narrative and quantitative review of the research literature. Personnel Psychology, 67(1), 241-293. https://doi.org/10.1111/peps.12052

McDaniel, M. A., Hartman, N. S., Whetzel, D. L., & Grubb, W. L., III. (2007). Situational judgment tests, response instructions, and validity: A meta-analysis. Personnel Psychology, 60(1), 63-91. https://doi.org/10.1111/j.1744-6570.2007.00065.x

Ones, D. S., Viswesvaran, C., & Schmidt, F. L. (1993). Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance. Journal of Applied Psychology, 78(4), 679-703. https://doi.org/10.1037/0021-9010.78.4.679