PSYCH 642 Week 3 Interviews and Assessment Centers Example

Choosing Crew Chiefs Without Picking Favorites: A Structured Interview and a One-Day Assessment Center for an Aircraft Maintenance Shop

[Student Name]

University of Phoenix

PSYCH/642: Personnel Psychology

Week 3 Assignment

[Instructor Name]

[Date]

The maintenance company, candidates and exercises are composites written for a model paper; research findings come from the sources listed.

Promotion decisions shape careers and signal to everyone what an organization values. When they rest on one manager's judgment, they invite suspicion even when the manager means well. This paper designs a structured process for promoting crew chiefs at my company.

The Situation

Six crew chief slots are opening at Copperline Aero Services. A crew chief runs a shift team of six to eight, sequences each aircraft's work package, signs off finished tasks and brings newer mechanics along. Twenty-three mechanics applied. In the past, the general manager chose crew chiefs after informal conversations, and an employee survey last year showed that most mechanics believed promotions depended on who the manager liked. Two respected mechanics who were passed over left for an airline.

What the Job Requires

Our job analysis, based on interviews with current crew chiefs, observation of shift handoffs and a review of quality incidents, identified four competencies. Technical judgment means diagnosing problems and deciding when a task needs engineering input. Planning under deadline means sequencing work packages so aircraft return to service on time without skipping steps. Coaching means helping mechanics build skill and confidence. Holding others to procedure means correcting colleagues who cut corners, even friends, a difficult task for someone promoted from within a crew.

The Structured Interview

Huffcutt et al. (2014) reanalyzed the validity of employment interviews using methods that correct for indirect range restriction, which occurs when applicants are selected on variables related to the interview. Their corrected estimates showed higher validity than earlier analyses for structured interviews, and structured interviews continued to outperform unstructured ones substantially. Structure, in their framework, includes standardized, job-related questions and systematic scoring.

Our panel interview has six questions, two per competency except technical judgment, which the exercises cover. Behavioral questions ask about past experience, such as "Tell us about the last time you had to stop a coworker from signing off on work you thought was incomplete." Situational questions present a scenario, such as an airline representative pressing to release an aircraft before a required inspection. Panelists score every answer from one to five, guided by sample answers that current crew chiefs wrote to show what weak, typical and excellent replies sound like. A panel of three, a crew chief from another shift, a quality inspector and an HR representative, scores independently before discussing.

The Assessment Center

The one-day assessment center includes three exercises. In the planning in-basket, candidates receive a work package for an aircraft due back in thirty hours, along with a staffing list, two parts delays and an email from the airline, and must produce a shift plan. In the coaching role play, a trained actor plays a mechanic who skipped a required torque check because he was rushing; candidates must address it. In the handoff briefing, candidates review a shift log and brief the incoming crew chief on open items and risks. Two trained assessors observe each exercise and rate behaviors related to the relevant competencies.

What Research Says About Assessment Centers

Arthur et al. (2003) took the dozens of labels that assessment centers use for what they rate, collapsed them into a handful of families such as solving problems, persuading others, planning and communicating, and then checked how well each family forecast later job performance. Several of these dimensions predicted job performance, and a regression combining them predicted performance better than the overall assessment rating used in many centers. Their findings support scoring by well-defined dimensions rather than relying only on an overall judgment.

Lance (2008) challenged the assumption that assessment centers measure dimensions consistently across exercises. Reviewing evidence on the internal structure of ratings, Lance argued that ratings reflect the exercise more than the dimension: a candidate's ratings on different dimensions within one exercise tend to be similar, while ratings on the same dimension across exercises differ. Lance proposed viewing assessment centers as measuring performance in situations, consistent with a view that behavior depends on context, and suggested designing and scoring them around exercises as work samples.

A candidate who coaches well in the torque-check role play may plan poorly in the in-basket; the center is measuring both the person and the situation.

How These Findings Shape Our Design

Rather than choose between the two views, we score in a way that respects both. Assessors rate each exercise on the competencies it is designed to show, using behavioral checklists, and also give an overall exercise score. Because each exercise mirrors a real crew chief task, exercise scores serve as work samples in their own right. We avoid asking assessors to rate every competency in every exercise, which research suggests produces ratings that mostly repeat the exercise impression.

Assessor Training

Assessor preparation takes a full day. The group studies the four competencies and the checklists, then scores videos of mock candidates, compares numbers and talks through every gap of two points or more until their scores line up. Training also covers common rating errors, such as halo and leniency, and the importance of recording observed behavior before rating.

Assessors will also rotate across exercises so that no single assessor's view of a candidate dominates.

Combining Scores

The final score weights the interview at 30 percent and the three exercises at 70 percent, with each exercise counting equally. Candidates must reach a minimum on the coaching role play, since holding others to procedure is essential to safety. The six highest-scoring candidates are offered promotion; others receive feedback and a development plan.

Cost and Practicality

The process costs more than a conversation. Actor fees, assessor time and a day away from the hangar for twenty-three candidates come to roughly $14,000, a small figure beside the cost of losing two good mechanics to an airline after a promotion seen as unfair, or the cost of a crew chief who lets procedural shortcuts spread. To control cost, the exercises will be reused for future promotions with minor changes, and two crew chiefs will be trained as permanent assessors.

Involving the General Manager

The general manager will not score candidates, but he reviewed the competencies and exercises and will meet each finalist after scores are set. His role shifts from choosing to confirming and welcoming, which preserves his relationship with new crew chiefs while removing the appearance of favoritism.

Fairness and Candidate Experience

Candidates will receive a written description of the process, the competencies and sample exercises a month in advance. Assessment centers generally show smaller group differences than cognitive tests, but we will review results by sex, age and ethnicity. Unsuccessful candidates will receive individual feedback, which research on candidate reactions suggests improves perceived fairness.

Conclusion

A structured interview and a job-based assessment center replace one manager's judgment with a transparent process tied to the crew chief job. Research supports structure in interviews and dimension-based scoring in assessment centers, while also showing that performance depends on the situation. Designing exercises as realistic work samples and scoring them carefully respects both findings.

References

Arthur, W., Jr., Day, E. A., McNelly, T. L., & Edens, P. S. (2003). A meta-analysis of the criterion-related validity of assessment center dimensions. Personnel Psychology, 56(1), 125-153. https://doi.org/10.1111/j.1744-6570.2003.tb00146.x

Huffcutt, A. I., Culbertson, S. S., & Weyhrauch, W. S. (2014). Moving forward indirectly: Reanalyzing the validity of employment interviews with indirect range restriction methodology. International Journal of Selection and Assessment, 22(3), 297-309. https://doi.org/10.1111/ijsa.12078

Lance, C. E. (2008). Why assessment centers do not work the way they are supposed to. Industrial and Organizational Psychology, 1(1), 84-97. https://doi.org/10.1111/j.1754-9434.2007.00017.x