PSYCH 629 Week 2 Job Analysis and Selection Example

Hiring Rooftop Installers Who Stay Safe and Do Good Work: A Job Analysis and an Evidence-Based Selection System

[Student Name]

University of Phoenix

PSYCH/629: Introduction to Industrial/Organizational Psychology

Week 2 Assignment

[Instructor Name]

[Date]

The solar company, its installer role and hiring figures are composites written for a model paper; research findings come from the sources listed.

Selecting employees is one of I-O psychology's oldest and most developed areas. Its central principle is that hiring should rest on a careful analysis of the job and on tools with evidence that they predict performance. This paper applies that principle to hiring residential solar installers at my company.

The Current Process

Sunridge Solar hires about twenty installers a year near Henderson, Nevada, to keep its twelve crews staffed as people leave or move up. Currently, applicants meet the owner or a foreman for a ten-minute conversation, and those who "seem like hard workers" are hired. Last year, five of twenty-one new installers left or were let go within three months, two after safety violations on roofs, and customer callbacks for workmanship problems were concentrated among newer crews. The owner asked me to improve hiring without slowing it down.

Analyzing the Job

I used several methods. I observed two crews for a full day each, interviewed six experienced installers and two foremen about critical incidents, meaning examples of especially good or poor performance, and surveyed all sixty installers on how often they performed each of forty tasks and how important each was. The analysis identified five clusters of tasks: reading layout plans and measuring roof surfaces; mounting rails and panels to manufacturer specifications; basic electrical work under a licensed electrician's supervision; working safely at height, including harness use and ladder setup; and communicating with homeowners. Important attributes included mechanical aptitude, careful attention to detail, physical stamina in heat, conscientiousness about safety rules and teamwork.

Checking the Analysis for Bias

Morgeson and Campion (1997) described social and cognitive sources of inaccuracy in job analysis. Social sources include conformity pressures in group meetings and self-presentation, as when incumbents inflate the importance of their tasks. Cognitive sources include limited information, carelessness and the tendency to rely on general impressions rather than specific tasks. They recommended using multiple sources and methods, asking about specific behaviors and checking for inconsistencies.

Following their advice, I compared survey ratings with observation and interviews. Installers rated "communicating with homeowners" as highly important, but observation showed that foremen handled most homeowner contact; I gave that cluster lower weight for entry-level installers. Conversely, installers underrated harness checks, perhaps because they had become routine, while foremen's critical incidents showed they were central to safety.

Choosing Predictors

Sackett et al. (2022) revisited the meta-analytic estimates of predictor validity that had guided the field for decades, arguing that earlier work had overcorrected for range restriction. After the correction, cognitive ability tests dropped noticeably in the rankings, while structured interviews, tests of job knowledge, scored background questionnaires and hands-on work samples sat near the top; personality and integrity measures still predicted performance, only less strongly. The revision matters because tests with higher group differences, such as cognitive ability tests, lose some of their advantage, which shifts the balance toward tools with less adverse impact.

The Proposed System

The proposed system has three steps, each linked to the job analysis. First, a forty-minute work sample at our warehouse yard, conducted on a low practice roof frame, in which applicants measure and mark a layout from a simple plan, mount a section of rail to specification and demonstrate harness setup after a short instruction. Trained foremen will rate performance using a checklist for accuracy, safety steps and time.

Second, a structured interview. Levashina et al. (2014) sorted the interview research by which design choices make interviews more consistent and more predictive. The helpful choices included giving every candidate the same questions drawn from the job, asking about past behavior and hypothetical situations, scoring each answer against written examples, preparing the interviewers and keeping small talk out of the scoring. Our interview will include six questions, for example, "Describe the last unsafe setup you spotted at a job site and what you did about it," with rating anchors developed from the critical incidents.

Third, a structured reference check focused on reliability and safety, asking former supervisors standard questions about attendance and following rules.

Ten minutes of conversation measured how much the owner liked an applicant; forty minutes on a practice roof measures whether the applicant can do the job.

Fairness and Legal Considerations

The work sample and structured interview are directly job-related, which supports legal defensibility, and work samples typically show smaller group differences than cognitive ability tests. Each quarter we will compare pass rates across sex, race, ethnicity and age groups and flag any group whose rate falls below four-fifths of the highest. Physical demands will be tested only as they appear in the job, and reasonable accommodations will be considered. The practice roof is a few feet off the ground, with fall protection, so the test does not expose applicants to serious risk.

Why Managers Resist Structure

The owner's first reaction was that he can "tell a good worker in five minutes." Highhouse (2008) reviewed why employers continue to rely on intuition and unstructured interviews despite evidence that structured methods predict better. Explanations include the belief that people are too complex to be captured by tests, overconfidence in personal judgment, the appeal of individual stories and the feeling that experience brings expertise. Highhouse suggested that presenting evidence alone rarely changes these beliefs and that involving managers in designing tools can help.

I applied that advice by having the two foremen help design the work sample and rating checklist, and by keeping a short informal conversation at the end of the interview so the owner can still meet each finalist.

How the Scores Will Be Combined

A system is only as good as the way its parts are combined. Applicants must pass the safety portion of the work sample, since an installer who will not clip in a harness cannot be trained around that risk in the first weeks. Applicants who pass then receive a combined score in which the work sample counts for half, the structured interview for forty percent and the reference check for ten percent, weights the foremen agreed reflect the job analysis. Ties go to applicants who scored higher on the safety items. Setting these rules in advance prevents the familiar pattern in which a manager's favorite candidate is rescued by a reweighting after the fact, and it gives us a consistent record to defend if a hiring decision is ever challenged.

Training the Raters

Foremen who rate the work sample and interviewers who score answers will complete a two-hour practice session using recorded examples, comparing their ratings and discussing differences until they agree within one point on most items. Raters will be reminded to score each answer against its anchors before forming an overall impression.

Evaluation

After a year, we will compare the new hires' ninety-day retention, safety violations, foreman performance ratings and callback rates with last year's hires, and examine whether work sample scores relate to later performance.

Conclusion

A careful job analysis identifies what solar installers actually do, including the safety behaviors the current process missed. Updated research on predictor validity and interview structure points to a work sample and a structured interview that are job-related, fair and practical. Involving foremen in the design addresses the intuition that makes unstructured hiring so persistent.

References

Highhouse, S. (2008). Stubborn reliance on intuition and subjectivity in employee selection. Industrial and Organizational Psychology, 1(3), 333-342. https://doi.org/10.1111/j.1754-9434.2008.00058.x

Levashina, J., Hartwell, C. J., Morgeson, F. P., & Campion, M. A. (2014). The structured employment interview: Narrative and quantitative review of the research literature. Personnel Psychology, 67(1), 241-293. https://doi.org/10.1111/peps.12052

Morgeson, F. P., & Campion, M. A. (1997). Social and cognitive sources of potential inaccuracy in job analysis. Journal of Applied Psychology, 82(5), 627-655. https://doi.org/10.1037/0021-9010.82.5.627

Sackett, P. R., Zhang, C., Berry, C. M., & Lievens, F. (2022). Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range. Journal of Applied Psychology, 107(11), 2040-2068. https://doi.org/10.1037/apl0000994