Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

Week 2. Recruiting, Screening, and Entry into Organizations

Learning Objectives

By the end of this week, students should be able to distinguish attracting applicants, evaluating candidates, choosing offers, and securing starts; construct an application–vacancy–event panel with defensible denominators; explain the economic value and cost of another screening step; evaluate tests, discretion, referrals, and interview order using actual research designs; and explain why performance observed only for hired workers cannot automatically validate a hiring policy. The research deliverable is a recruiting-funnel design that states the initial risk set, intervention, counterfactual, outcomes, and missing-performance problem.

Opening Orientation

Central question: How do firms choose whom to evaluate and hire when attention, time, information, and interview capacity are costly?

Two firms can receive the same number of applications for the same job and end with very different workforces. One may review every application immediately, another may stop reviewing after its first acceptable candidate. One may interview mainly referrals, another may use a test to broaden the shortlist. One may make attractive offers that are frequently rejected, while another deliberately targets candidates who are more likely to accept. A comparison of vacancy counts or the characteristics of eventual hires cannot distinguish these processes.

The organizational question is therefore not simply whether the firm hires good workers. It is how the firm builds and evaluates its opportunity set, and what information is lost at each decision. Recruiting combines employer choices with applicant choices. Speed, attention, tests, discretion, and offer conditions may change who enters the process as well as who survives it.

This week is an extended applied field lecture, suitable for two shorter meetings. The first meeting follows the recruiting funnel and the main papers; the second examines selective performance data and designs a study. The chapter contains a broad reading menu, not a requirement to assign every paper. Hoffman, Kahn, and Li provide the central tests-versus-discretion case; the wider personnel-economics review supplies context rather than replacing the individual applications Hoffman et al., 2018Hoffman & Stanton, 2025.

Core Points

Bridge

Week 1 treated the firm as a system for selecting, allocating, motivating, and developing workers. Week 2 opens the entry stage of that system. The focus is on choices within recruiting organizations, not a repeat of centralized matching, exploding offers, or market unraveling from the labor-design special topic. Week 3 will examine measurement and learning after entry; this week introduces probation only as the point where selected candidates begin generating new information.

Start with a hypothetical vacancy receiving 100 applications. Sixty are reviewed, 20 interviewed, 10 offered a job, eight accept, and seven start. The firm chooses whom to review and offer; applicants choose whether to apply, attend, and accept. Seven starts describe the outcome of both sides’ decisions. A hire rate alone cannot locate the bottleneck.

Now give the recruiter one more hour. Reviewing unseen applications expands the considered set; interviewing a shortlisted candidate improves information; contacting an offer recipient may secure a start. The same resource can change different stages. The economic problem is to compare these uses of scarce attention, while recognizing that candidates have outside options and that workers bear participation costs.

The Field Core turns this intuition into an event ledger, a small stopping model, and evidence on actual recruiting interventions. Treat “better hiring” as a question to define: more filled positions, different hires, longer tenure, more output, and improved worker outcomes need separate measures.

Field Core

1. The recruiting funnel is an economic object

Start with an application attached to a specific vacancy. Track screening, interview or contact, offer, acceptance, start, and subsequent retention. A person can submit multiple applications; a vacancy can contain multiple positions; one interview can assess several positions. These are reasons to retain separate applicant, application, vacancy, position, and event identifiers, not reasons to count them interchangeably.

For a genuinely nested cohort with a positive initial count and positive denominators at each reported transition, let N0N_0 be the number of applications and N1,…,NKN_1,\ldots,N_K the counts reaching successive stages within explicitly defined horizons. Then

NKN0=∏s=1KNsNs−1.\frac{N_K}{N_0}=\prod_{s=1}^{K}\frac{N_s}{N_{s-1}}.

This is an accounting identity: adjacent counts cancel. If a stage has no survivors, the overall final yield is zero, but subsequent conditional transition rates are undefined; report them as unavailable rather than evaluate a zero denominator. The product works only when the stages refer to the same cohort and nested events. Do not multiply this month’s screening rate, last month’s offer acceptance, and an annual retention rate and call the result a hiring probability. An alternative process with direct offers or multiple interview routes needs branching states rather than a forced linear funnel.

What the identity does not identify. A reform can raise interview-to-offer conversion because interviews become more informative, because the shortlist becomes stronger, or because the interview threshold falls. Conditioning on reaching the interview stage selects a potentially different population under the reform. The causal effect of the reform on eventual starts from the original applicant cohort is not the same object as a change in a conditional transition rate.

Vacancy yields in aggregate data need equal care. Davis, Faberman, and Haltiwanger show that establishment-level vacancy and hiring patterns require attention to employer recruiting behavior beyond vacancy counts. Their framework infers aspects of recruiting intensity; it does not observe every interview inside a vacancy Davis et al., 2013. BLS definitions further distinguish job openings measured at a point in time from hires measured over a month. Their ratio is not an application-level conversion probability U.S. Bureau of Labor Statistics, 2026.

Implementation rule. Build a stage ledger before estimating a regression: unit, entry time, exit time, eligible population, event, competing exit, follow-up horizon, and missingness code. Keep rejected, withdrawn, position-cancelled, pending, and administratively censored cases distinct. Table Table 1 provides a template.

This is a construction template, not a claim that every employer follows a linear process. Retain branching paths, cancelled positions, and cross-vacancy applications when they exist.

Table 1:Recruiting funnel and risk-set ledger

Stage / empirical objectObservation and denominatorWhat to recordMain interpretation trap
Recruiting outreachAssigned advertisement/site/channel; eligible or exposed audience if actually observedMessage version, wage disclosure, date, eligibility, views if reliableTreating applicants as the entire population exposed to recruitment
Submitted applicationApplication × vacancy, not unique person aloneStable person/application/vacancy IDs, source, timestampCounting a multi-position requisition as one worker slot
Review opportunityApplications eligible for review at that timeQueue state, reviewer availability, posted deadline, archived rule versionTreating never reviewed as formally rejected
ScreeningReviewed application × assessment eventTest version, raw score, recommendation shown, override and reasonUsing later score revisions as if they were available ex ante
Interview invitationInvited / baseline applications and invited / reviewed, reported separatelyInvitation, response, schedule, no-show, cancellationConditioning on post-policy review without saying so
Interview assessmentCandidate × evaluator × session × slotStart/end times, independent score, ratings, breaksCreating a lag across different interview sessions
OfferOffers / baseline applications; offer terms and timingWage, amenities, expiration, competing offer if measuredTreating employer choice as an accepted match
Acceptance and startAccepted / offers; starts / accepted; starts / baseline applicationsWithdrawals, acceptance time, start date, vacancy cancellationOmitting acceptances that never become starts
Probation / retentionEntrants with adequate follow-up, plus censoring accountingHorizon, survival time, exit reason, missing follow-upCoding administratively censored entrants as failures
Post-hire outputHires in defined jobs/tasks/time windowsQuantity, quality, task opportunity, supervisor, measurement systemClaiming this reveals rejected candidates’ counterfactual performance

Three non-negotiable flags: unknown is not zero; a pending case is not a rejection; a successful match is not synonymous with high worker welfare.

Use a baseline-cohort intention-to-treat outcome alongside conditional transition descriptions. A stage-transition product is a valid accounting identity only for nested events from the same cohort and compatible horizons. Do not replace the applicant funnel with a stock/flow ratio from JOLTS U.S. Bureau of Labor Statistics, 2026.

2. A small model: when is another evaluation worthwhile?

Consider a teaching benchmark with one opening, recall of previously evaluated candidates, a finite evaluation horizon, and known candidate-value distributions. Let bb be the best known match surplus, including the option to leave the position unfilled. Evaluating another candidate costs ctc_t; the candidate reveals a net match value Qt+1Q_{t+1}. Index evaluation opportunities by t=0,…,T−1t=0,\ldots,T-1, with discount factor δ∈(0,1]\delta\in(0,1]. The next-draw distributions are known and exogenous; past observations contain no additional information beyond bb about future draws. Thus bb and remaining time suffice as the state. A simple recursion is

Vt(b)=max⁡{b,  −ct+δ E[Vt+1{max⁡(b,Qt+1)}]},VT(b)=b.V_t(b)=\max\left\{b,\;-c_t+\delta\,\mathbb E\left[V_{t+1}\{\max(b,Q_{t+1})\}\right]\right\}, \qquad V_T(b)=b.

Values and costs are measured in the same cardinal employer-surplus units, with a fixed outside option; they are not ordinal test ranks. The first option is to act on current information; the second is to pay for another evaluation. This is an instructor-created benchmark, not an estimated hiring model. It abstracts from competing employers, strategic acceptance, multiple slots, uncertain arrival, and candidate withdrawal. The optimal-search literature provides the conceptual ancestry, but its specific index results require their own assumptions Weitzman, 1979.

Numerical intuition. Suppose one evaluation remains, δ=1\delta=1, b=8b=8, and the new candidate’s value is 6 or 12 with equal probability. Expected best value after evaluation is 10. With cost 1, evaluation yields 9 and is worthwhile; with cost 3, it yields 7 and stopping is preferable. All numbers are hypothetical. The optimized values are 9 and 8, respectively: 7 is the rejected continuation option when evaluating costs 3.

The example separates a high evaluation standard from a long search. A firm with a good current candidate may stop early; another may continue because its shortlist is weak. Early closure alone does not reveal low standards, irrational impatience, or employer power. Those are competing interpretations requiring additional variation.

A test is a noisy signal, not the candidate’s payoff. Its value depends on how it changes the chosen action. Managerial information can complement a test, duplicate it, or distort its use. Likewise, a ranking is not automatically a cardinal surplus measure: welfare calculations need a scale and assumptions linking the recorded signal to production, costs, and worker outcomes.

A one-step offer calculation adds applicant behavior:

Si(w,d)=ai(w,d) vˉi(w,d)−ki(w,d),S_i(w,d)=a_i(w,d)\,\bar v_i(w,d)-k_i(w,d),

where ai(w,d)a_i(w,d) is acceptance probability at compensation ww and delay dd, vˉi\bar v_i is expected employer surplus conditional on acceptance, and kik_i is the relevant offer or delay cost. Here surplus is relative to a fixed fallback normalized to zero if the offer is declined, and the cost is paid for making or delaying the offer. No acceptance elasticity is identified by this notation. It simply explains why the highest test score need not generate the largest expected realized hiring surplus. Worker welfare must be evaluated separately, including pay, conditions, and the cost of participating in recruitment.

3. Recruiting first changes who applies

A policy starts affecting the workforce before anyone is screened. Advertising channels, campus visits, pay information, and descriptions of the job change application costs and beliefs. An evaluation using only submitted applications may therefore miss the policy’s extensive margin.

Where firms recruit. Weinstein studies on-campus recruiting through an equilibrium framework with employer screening costs. The setting illustrates why firms need not consider all potentially suitable workers: recruiting channels and institutions change the cost of reaching and evaluating them Weinstein, 2018. For a related study, collect invited schools or channels, eligible populations where known, employer visits, applications, interview costs, and hires. A regression among visited campuses alone conditions on the organizational choice being explained.

Pay as attraction and information. Dal Bó, Finan, and Rossi use recruitment experiments in Mexican public service to study financial incentives, applicant characteristics, and subsequent recruitment outcomes. Deserranno’s experiment with village-promoter recruitment in Uganda shows why earnings information can also signal the nature of an unfamiliar job and change applicant selection Dal Bó et al., 2013Deserranno, 2019. These are different institutional environments, not a contradiction to be resolved by declaring that high pay always improves or worsens motivation.

Design translation. A randomized advertisement identifies the effect of offering that advertisement to its assigned audience. To study applicant selection, record an independently defined exposure or eligibility denominator when feasible, not just the eventual applicant file. To study acceptance separately, record the offer and who was eligible to receive it. Avoid controlling for applicant attributes that the advertisement itself changes or selects without explaining the new conditional estimand.

4. Recruiting effort, capacity, and sequence

More effort per vacancy is different from more vacancies

Carrillo-Tudela, Gartner, and Kaas combine employer recruitment information and linked records with a model of hiring. Their paper makes recruitment effort, standards, and wage policies explicit rather than collapsing every difference into a vacancy count Carrillo-Tudela et al., 2023. Forsythe and Weinstein use a survey of employers recruiting recent graduates to observe planned effort and compensation, linking greater effort to more hires per vacancy Forsythe & Weinstein, 2025.

Read these alongside the inferred-intensity approach above. A recruiting residual, a reported effort measure, and an exogenous change in interviewer capacity are three different evidence objects. None should be described as the other. More difficult vacancies can induce more effort, creating reverse causality in effort–duration regressions.

A prospective design could randomize additional screening support across comparable requisitions, or exploit a documented capacity shock with a defensible comparison. Record hours, applications reviewed, completed interviews, offers, and vacancy outcomes. Also monitor spillovers: moving one recruiter to treated vacancies can reduce attention to controls. A within-firm treatment can redistribute hiring resources rather than expand them.

The order in which information arrives can change evaluations

Radbruch and Schiprowski study high-stakes admissions and hiring interviews using quasi-random candidate allocation and timing, along with independent assessments of candidate quality. They document sequential contrast effects: evaluations depend on the quality of the preceding candidate. The paper distinguishes this channel from broader sequence composition and examines possible responses; candidate reordering is evaluated through simulation, not reported as a demonstrated field-policy success Radbruch & Schiprowski, 2025.

In the grant setting, allocation is randomized within workshops conditional on gender. In consulting hiring, the relevant allocation pools are position × year × location conditional on gender; quality is informed by the other independent assessments. The hiring records recover interview order without timestamps. Advice below about recording precise timestamps is a prospective data requirement, not a claim about the released source data Radbruch & Schiprowski, 2025.

The methodological contribution for this course is precise: retain the actual sequence, define the evaluator’s comparison pool, and measure candidate quality independently of the focal evaluation. Do not infer a contrast effect merely because yes/no decisions alternate. That pattern could also reflect quotas, changing applicant composition, or common evaluation shocks.

A useful teaching specification, not a transcription of every specification in the paper, is

Rips=αp+λs+βQiind+γQprev⁡(i)ind+uips,R_{ips}=\alpha_p+\lambda_s+\beta Q_i^{\mathrm{ind}} +\gamma Q_{\operatorname{prev}(i)}^{\mathrm{ind}}+u_{ips},

where pp is the design-relevant interview pool, ss is slot, and QindQ^{\mathrm{ind}} is a pre-existing or independently constructed quality signal. Interpreting γ\gamma causally requires justified sequence assignment and a signal not mechanically built from the focal rating. Random assignment must be assessed within the actual scheduling blocks; cancellations and substitutions can undo it.

Implementation rule. Sort by evaluator, session, and timestamp. Reset lags at the correct boundaries. A first interview has no preceding interview within that session: it is not a zero-quality predecessor. Freeze how breaks, cancellations, missing evaluations, and tie timestamps are handled. Cluster or randomize inference according to the assignment/dependence structure, not simply the number of candidate rows.

5. Tests and managerial discretion: what should the firm trust?

Hoffman, Kahn, and Li study job-test introduction and managerial decisions across service-sector firms. Managers who deviate from test recommendations do not, on average in their setting, appear to compensate with superior private information as reflected in subsequent hire outcomes. The central outcome lens includes tenure; this is not a universal demonstration that algorithms maximize productivity or that every override is a mistake Hoffman et al., 2018.

The competing hypotheses are productive private information versus inconsistent or biased discretion. A credible design needs the choice set: test scores for candidates who were available, recommendations shown, manager choices, timing, and eventual outcomes. A regression of tenure on hired workers’ test scores cannot by itself say which rejected candidate should have received an offer.

Autor and Scarborough provide a complementary retail application of job-test rollout, examining tenure and minority hiring. It is useful for evaluating multiple consequences of a screening technology instead of assuming a necessary quality–diversity trade-off Autor & Scarborough, 2008. Neither setting justifies treating any proprietary score as unbiased ground truth.

Evaluation plan. Compare a score-only rule, discretion with documented reasons, and a hybrid rule only when the data support each comparison. Distinguish an organizational rollout from random assignment of overrides. Pre-specify protected baseline controls and the outcome horizon. Report hiring composition, fill rates, offer acceptance, subsequent retention, and available output/quality measures separately. Explain any change in job conditions that could affect tenure independently of screening quality.

6. Referrals: information, screening, and participation in hiring

A referral may transmit information about a candidate, change who learns about the opening, help a new hire succeed, or involve incumbents in the organization. These mechanisms imply different data and interventions.

Burks and coauthors compare referred and nonreferred workers across firms, showing why turnover and recruiting costs can matter even when average measured productivity differences are limited. This is valuable personnel evidence, but referral status is not randomly assigned Burks et al., 2015.

Beaman and Magruder experimentally vary referral incentives to examine who refers whom and the information revealed by referrals. Pallais and Sands use field experiments to distinguish informational and other channels of referral value. Together they demonstrate how experimental changes can interrogate mechanisms hidden in a simple referred-worker wage or retention premium Beaman & Magruder, 2012Pallais & Sands, 2016.

Friebel and coauthors randomize an employee referral program across stores. Their analysis separates direct referral outcomes from overall organizational effects, including retention changes among nonreferred employees. The firm-level value of a program is therefore not exhausted by comparing referred hires with other hires Friebel et al., 2023.

Design translation. Keep a referrer–candidate link table separate from the applicant and employment tables. Record when the link was supplied, the reward offered, eligibility, and whether the referrer remains a coworker. Record untreated and nonreferred incumbents for program-level evaluation. For store-level randomization, report store-level assignment effects and dependence-aware inference. Do not absorb spillovers into a generic claim about individual referral productivity.

7. Offers, acceptance, starts, and probation

Employer choice does not complete the match. A candidate can decline, delay, fail to start, or leave quickly. An intervention improving the shortlist may appear ineffective if it increases competition for candidates whom the employer cannot attract. Conversely, easier hiring can reflect targeting people with fewer alternatives, not better work matches.

The public-service recruitment experiment is a useful applied anchor for separating recruitment offers from acceptance Dal Bó et al., 2013. Horton provides a platform field experiment on employer recommendations, showing how an intermediary can change the set of workers an employer considers. Its labor-design lesson here is about directed recruiting, not a reason to recapitulate the entire platform-design literature Horton, 2017.

For a new offer-timing study, distinguish the time since posting, time since application, time since interview, and time since offer. A “one-day delay” in each clock changes a different information set. Hiring before another applicant arrives, delayed evaluation of an already-arrived application, and a short acceptance deadline should not share an unnamed timing coefficient.

Probation can produce valuable new information, but it is experienced only by entrants. A probation outcome combines selection into hiring, job conditions, training, and evaluation. Week 3 studies that learning process in detail. Here, the immediate implementation requirement is to retain starts and exits, define the probation horizon, and avoid coding incomplete follow-up as failure.

8. The missing-performance problem is central, not an appendix

Let ZZ denote a recruiting policy and Hi(z)H_i(z) whether candidate ii would be hired under that policy. Let Yih(z)Y_i^h(z) denote performance if employed in the specified job under its associated regime. Observed performance is available only when Hi(Z)=1H_i(Z)=1. Therefore

E[Yih(1)∣Hi(1)=1]−E[Yih(0)∣Hi(0)=1] ≠ E[Yih(1)−Yih(0)]in general.\mathbb E[Y_i^h(1)\mid H_i(1)=1] -\mathbb E[Y_i^h(0)\mid H_i(0)=1] \ \neq\ \mathbb E[Y_i^h(1)-Y_i^h(0)] \quad\text{in general}.

The left side compares different selected workforces. It may be a meaningful policy outcome when labeled that way; it is not the individual causal effect of the screening policy on productivity.

A six-candidate example. Six applicants have fixed hypothetical job outputs 10, 9, 8, 7, 6, and 5. A two-slot rule hires candidates with outputs 10 and 9; another hires 10 and 8. Mean output changes from 9.5 to 9, although no candidate’s potential performance changes. This is a composition change. With variable hiring capacity, a lower mean can coexist with greater total production; evaluating that policy additionally requires headcount costs and the value of filling more positions.

Two hypothetical examples. Screening with costs 1 and 3 gives continuation payoffs 9 and 7 against stopping at 8. Two fixed-slot rules select mean outputs 9.5 and 9, with totals 19 and 18 and unchanged individual outputs.

Figure 1:Constructed teaching examples, not empirical estimates. Left: pay for the last evaluation only when its expected value exceeds the stopping payoff. Right: changing the two selected workers changes their average output without changing anyone’s potential productivity. The full six-candidate population has outputs 10, 9, 8, 7, 6, and 5.

A useful firm outcome is production attributable to a fixed set of requisitions over a fixed horizon. Giving unfilled positions zero production in that accounting outcome is legitimate when it matches the question. Coding every rejected candidate’s latent productivity as zero is not. For worker welfare, a rejected applicant’s outside earnings or employment may matter; those are distinct outcomes requiring follow-up or linkage.

Why algorithmic prediction does not solve missingness. Historical labels reflect the previous hiring rule. A model trained only on hires cannot empirically validate its predictions for groups never hired merely by producing scores for them. Li, Raymond, and Bergman’s Hiring as Exploration makes exploration an explicit recruiting objective. Its empirical evaluation is retrospective and a principal quality proxy is eventual hiring among candidates considered for interviews, not universal observed on-the-job productivity Li et al., 2026. Kleinberg and coauthors’ bail application is a methodological comparison for selective labels, not a hiring study Kleinberg et al., 2018.

What additional designs buy. Randomizing a marginal invitation or trial task can generate outcomes on a broader candidate set, but only for the task actually measured. Pallais’s entry-level online labor experiment illustrates how giving workers a job and an evaluation can generate information and affect later opportunities Pallais, 2014. A short paid task is not automatically a complete measure of long-run job performance.

Lee’s bounds offer another route under random assignment and monotone selection. For fixed-slot recruiting, monotonicity is especially questionable: a new rule can hire some previously rejected candidates while rejecting some previously selected candidates. Both directions occur even when the total hiring rate is unchanged. The lab makes this failure visible rather than applying a trimming command by default Lee, 2009.

9. From firm process to a credible empirical design

First, define the treatment. A randomized invitation, interviewer order, test rollout, referral bonus, and algorithmic recommendation are different interventions. A vacancy-level treatment should have vacancy-level outcomes and a record of applicant pathways; an applicant-level intervention must account for competition for shared slots.

Second, choose outcomes that survive selection. From a baseline application cohort, contact, offer, and hire indicators can be measured for everyone if logging is complete. Hire-only output requires a separate interpretation. Applicant welfare can include participation costs, transparency, outside outcomes, and access, not only the firm’s retention rate.

Third, name the comparison and its failure. Randomized scheduling is powerful only within its valid blocks. A staggered test rollout needs a reason untreated sites provide credible counterfactual trends; modern group-time DID addresses particular comparison problems, not endogenous adoption by itself Callaway & Sant'Anna, 2021. A test cutoff supports local RD only when the threshold actually governs treatment and other determinants are appropriately smooth. Manager “leniency” is not automatically a valid IV: managers can alter more than hiring, and assignment need not be random.

Fourth, separate statistical correction from identifying information. Weighting for randomized invitations uses known probabilities and adequate support. Weighting hire-only outcomes using a model does not resolve unobserved selection without extra assumptions. Leave-out scores and cross-fitting can reduce mechanical dependence or leakage; they do not create overlap or make evaluator assignment random. More application rows do not create more independent policy assignments.

Fifth, defend what crosses the firm’s boundary. Kline, Rose, and Walters randomize application characteristics in a large employer correspondence study. It anchors a clean entry-stage outcome: employer contact. It does not reveal rejected applicants’ job performance or identify the causal effect of centralization merely because centralization correlates with contact disparities Kline et al., 2022. A useful broader claim concerns the mechanism and stage actually measured, not every downstream labor outcome.

10. Data resources and research opportunities

A minimum applicant-tracking-system extract should contain stable application and vacancy identifiers; position count; application and evaluation timestamps; recruiter/evaluator identifiers; original and revised scores; the recommendation actually displayed; stage changes with reasons; referral links; compensation and offer dates; acceptance and start dates; and follow-up status. Ask whether edits overwrite history. A final status table can erase the sequence needed for the research design.

For administrative staffing data, distinguish employees from applicants. For survey data, distinguish intended effort from realized effort. The IAB Job Vacancy Survey and linked IABSE-ADIAB resource offer relevant employer information, but the microdata require an access route rather than an unrestricted download. BLS JOLTS public data supply contextual aggregates, not applicant-level screening histories Research Data Centre of the Federal Employment Agency at the Institute for Employment Research, 2026U.S. Bureau of Labor Statistics, 2026.

The interview-sequence article states that its microdata are proprietary; its public archive supplies code, construction information, and empirical moments. Public code is not public microdata. The lab below does not claim access to the original candidate records Radbruch & Schiprowski, 2025Radbruch & Schiprowski, 2024.

Access descriptions checked 21 September 2026. Public documentation or code does not imply public applicant microdata.

Table 2:Recruiting data, access, and minimum usable objects

Resource / data environmentWhat it can supplyAccess statusMinimum caution / practical request
Applicant-tracking and scheduling logsApplications, status histories, scores, evaluators, timestamps, offersTypically employer collaboration; not provided hereAsk for event history rather than overwritten final status; link IDs across applications and vacancies
Test-provider records linked to personnel filesRecommendation, test version, manager choice, later tenure/outputProprietary in the central discretion study Hoffman et al., 2018Obtain scores for evaluated applicants, not only hired employees; document score recalibration
Referral-program recordsReferrer, nominee, timing, eligibility, bonus, employmentFirm-specific agreement; study designs differIdentify coworkers and nonreferred incumbents; do not retain only successful referrals
IAB Job Vacancy Survey / linked IABSE-ADIAB Research Data Centre of the Federal Employment Agency at the Institute for Employment Research, 2026Employer recruitment and administrative contextPublic documentation; controlled microdata accessCheck wave/variable coverage and access application before committing a project
BLS JOLTS U.S. Bureau of Labor Statistics, 2026Public aggregate openings, hires, separationsPublic aggregates, not all establishment microdataPoint-in-time openings and period-flow hires do not measure application transitions
Radbruch–Schiprowski interview study Radbruch & Schiprowski, 2024Public-code pointer, construction documentation, empirical moments stated in paperCandidate microdata proprietary; archive files not downloaded hereDo not fabricate a candidate-level replication; use synthetic design reconstruction by default
Pallais online-hiring archive Pallais, 2019Publicly listed readmes and Stata programsArchive listing checked; no original worker microdata established by this checkRead terms and dependency notes; archive title is not proof every required file is downloadable
Platform postings/applications/responsesEntry restrictions, application choice, employer responseStudy-specific; access not assumedPlatform visibility and employer coverage can change over time
Included teaching starterSynthetic interview sessions, funnel, fixed-slot selectionFully offline Python standard library; no personal dataParameters are instructor choices; successful recovery verifies the exercise, not the empirical papers

Suggested extract contract: applicant ID, application ID, vacancy/requisition ID, slot count, site, recruiter/evaluator, timestamps and time zone, original score and version, displayed recommendation, override reason, referral timestamp, offer terms, acceptance, start, exit, and follow-up end. Keep direct identifiers out of the analysis release; use stable pseudonymous keys. Do not upload confidential application text to an external model without authorization and appropriate controls.

Three research proposals connect the evidence to new work without claiming that the questions are wholly unstudied:

Screening capacity versus candidate loss. Randomize reviewer capacity or batch timing at a level that limits resource displacement. Link queue state to withdrawals, offers, starts, and vacancy costs. The key test distinguishes more information from reduced loss of candidates while waiting.

Exploration with meaningful outcomes. Prospectively vary marginal trial invitations among qualified candidates, retain known selection probabilities, and collect standardized output plus worker follow-up. Evaluate the information gained and which applicants benefit, rather than using interview conversion as a synonym for productivity.

Portable, stage-specific barriers. Separate whom job rules discourage from applying, whom screening excludes, and whom employers contact. A September 2026 working paper on posted age limits and employer responses illustrates the value of linked platform stages, while remaining working-paper evidence rather than a settled causal template Feng et al., 2026. Cross-country comparisons should state which rule and stage travel, not equate an identical observed age profile with an identical mechanism.

The data and methods tables turn these proposals into data requests, comparisons, and failure checks. The boundary with Week 9 remains clear: this week studies the recruiting decision; a full analysis of AI adoption and organizational change comes later.

Evidence map for paper discussions

Use this handout map to compare settings, variation, and outcome limits after reading the individual cases.

Use the table as a reading guide. Rows are not claims that every paper identifies the same parameter.

Table 3:Paper → decision → evidence → limitation

PaperOrganizational decision / dataResearch design or objectWhat students should extract — and not overclaim
Hoffman–Kahn–Li (2018) Hoffman et al., 2018Tests and managerial hiring choicesTest introduction and discretion in applicant poolsReconstruct the manager’s choice set; tenure is one hire outcome, not universal productivity
Autor–Scarborough (2008) Autor & Scarborough, 2008Retail job testingTechnology rollout; tenure and minority hiringEvaluate several margins; this is not proof that every hiring score is fair
Davis–Faberman–Haltiwanger (2013) Davis et al., 2013Establishment vacancies and hiresMeasurement plus recruiting-intensity frameworkSeparate inferred effort from direct observations of screening time
Carrillo-Tudela–Gartner–Kaas (2023) Carrillo-Tudela et al., 2023Effort, standards, wages, fillingEmployer surveys/admin linkage plus modelExplain which statements come from data and which from modeled counterfactuals
Forsythe–Weinstein (2025) Forsythe & Weinstein, 2025Recruiting recent graduatesFirm survey effort and hire/vacancy patternsA measured association is not an experimentally induced capacity effect
Weinstein (2018) Weinstein, 2018Campus recruiting destinationsScreening-cost equilibrium modelThe recruited-campus sample is itself selected
Dal Bó–Finan–Rossi (2013) Dal Bó et al., 2013Public-service recruitment payRecruitment/offer experimentationSeparate applicant composition from willingness to accept an offer
Deserranno (2019) Deserranno, 2019Earnings information about a new jobRecruitment experimentA pay message can also signal job characteristics
Radbruch–Schiprowski (2025) Radbruch & Schiprowski, 2025Interview order and subjective ratingsQuasi-random sequence; independent assessmentsDefine scheduling blocks; lagged decisions alone do not identify contrast effects
Burks et al. (2015) Burks et al., 2015Referred hires in firm panelsObservational comparisonReferral differences combine selection, information, and other mechanisms
Beaman–Magruder (2012) Beaman & Magruder, 2012Who receives a referralExperiment varying referral incentivesUse the intervention to interrogate information and selection
Pallais–Sands (2016) Pallais & Sands, 2016Why referrals matterField experiments distinguishing channelsMap each experimental comparison to its mechanism
Friebel et al. (2023) Friebel et al., 2023Employee referral programStore-level randomized introductionProgram-wide effects are not just a referred-versus-nonreferred premium
Horton (2017) Horton, 2017Employer recommendationsPlatform field experimentDirected outreach can alter consideration; do not infer full market welfare automatically
Pallais (2014) Pallais, 2014Initial job and evaluationOnline-market experimentGenerating information can change future access; a short task is not every future job
Li–Raymond–Bergman (2026) Li et al., 2026Resume-screening explorationRetrospective algorithmic evaluationDistinguish eventual hiring yield from observed long-run productivity and from a prospective trial
Kline–Rose–Walters (2022) Kline et al., 2022Employer contactRandomized correspondence attributesContact is an entry-stage outcome; organizational correlations are not organizational experiments
Kleinberg et al. (2018) Kleinberg et al., 2018Bail decisions, not hiringPrediction with selectively observed labelsUse as a methodological comparison; do not transfer substantive estimates to employment
Feng et al. (2026), working paper Feng et al., 2026Posted age restrictions and linked platform stagesPlatform evidence and economic modelOptional emerging illustration; inspect the actual cutoff design before calling it an RD

Methods companions: costly search Weitzman, 1979, monotone-selection bounds Lee, 2009, staggered-rollout comparisons Callaway & Sant'Anna, 2021. These methods do not substitute for the institution-specific assignment argument.

Research Lab

Reproduce

The primary design anchor is Radbruch and Schiprowski (2025). The paper’s proprietary interviews are not included. Use the verified article and archive statement to identify the assignment pools, independent-quality logic, and relevant outcome. An authorized official-data path may be added locally after inspecting the actual release; it is not assumed.

The guaranteed offline path is explicitly synthetic design reconstruction, not replication of published estimates. The included lab generates hypothetical interview sessions with randomized order, a pre-interview score, an evaluator/session effect, and a known sequential-contrast coefficient. Students construct the within-session lag, estimate its simplified session-fixed-effect version, and compute session-clustered uncertainty. The synthetic DGP sets slot effects λs=0\lambda_s=0; its estimator includes own and previous scores plus session effects, not separate slot indicators. Code and output mark every generated observation as synthetic.

Diagnose

Compare the valid lag with an erroneous lag that crosses sessions. Explain why the first slot cannot be assigned a zero-quality predecessor. Recover the known parameter in the controlled simulation, then explain why successful recovery does not establish the paper’s empirical identifying assumptions.

Next, apply two fixed-capacity hiring rules to the same six-candidate example. Record entry and exit from the selected set, the difference between selected mean and total output, and why Lee-style monotone selection does not follow from an unchanged hiring rate. Keep latent job-output truth in a separate instructor-only synthetic file; the analyst dataset must not accidentally expose outcomes for rejected candidates.

Transfer

Use Hoffman–Kahn–Li and Li–Raymond–Bergman to design a test-versus-discretion or marginal-exploration study. The student memo must specify one rule change, the original applicant risk set, the observed outcome for each stage, the missing performance outcomes, the assignment/inference unit, and the limited claim the design can support. A model-based extrapolation must be labeled separately from the experimental or quasi-experimental estimate.

The lab deliverables are a provenance ledger, interview-event data dictionary, lag-boundary diagnostics, synthetic estimates with clustered standard errors, a selective-label demonstration, a funnel check, and a two-page transfer memo. The lab handout supplies the event schema, execution steps, and transfer memo template.

Methods Box

Table 4:Practical design choices and failure checks

Question / settingUsable design or measurement stepWhat it can identify or describeWhat must be checked
Does a test improve hiring?Randomized rollout when feasible; otherwise documented rollout comparison with pretrends and appropriate group-time effects Callaway & Sant'Anna, 2021Effect of introducing the test regime on baseline-cohort or vacancy outcomesAdoption responds to performance; simultaneous pay/manager changes; newly selected hires
Does interview order distort ratings?Quasi-random order within actual pools + independent candidate-quality measure Radbruch & Schiprowski, 2025Sequence-related evaluation response under the assignment assumptionsCancellations/rescheduling; cross-session lags; contamination of quality with focal ratings
Does discretion add information?Applicant choice sets, displayed recommendation, override reasons, outcome linkage Hoffman et al., 2018Evidence comparing recommendation and discretionary choicesUnseen candidate attributes, endogenous override, selective performance
Does a referral program work?Randomize program at site/store; track all incumbents and applicants Friebel et al., 2023Assigned program’s overall effect and carefully defined suboutcomesReferral status is post-treatment; spillovers; few independent sites
Does the ad alter the workforce?Randomized messages/wage information with audience denominator Dal Bó et al., 2013Deserranno, 2019Recruitment-offer effect including pool compositionUnknown exposure; application-conditioned selection; messages convey multiple attributes
What would rejected candidates do?Randomized marginal task/interview with known probabilities; task-specific outcome Pallais, 2014Outcomes on the newly sampled, supported marginLimited task validity; noncompliance; no support for never-observed groups
Can selection bounds help?Lee-style bounds only with justified randomization and monotone selection Lee, 2009Bounds for the appropriate always-selected groupFixed-capacity swaps can generate both selection directions; unchanged rate proves nothing
Do delayed contacts reduce starts?Predefined capacity/timing intervention, baseline application risk set, competing-risk ledgerTiming-policy effect, not automatically cost of delay or match surplusApplicant withdrawals; recruiter resource displacement; age of vacancy versus age of application
Is an algorithm better?Separate training/evaluation, label definition, prospective/offline status, supported policy comparison Li et al., 2026Performance against the declared target under evaluation assumptionsHiring labels inherit previous rules; no universal ground truth; offline evaluation is not an RCT
Does the process discriminate?Randomized correspondence attributes and measured contact outcome Kline et al., 2022Causal effect on contact under the audit designContact is not hiring; organizational practices are not randomized by the audit

Inference rule: the dependency and treatment-assignment structure determines independent information. Applications within a vacancy, interviews within a scheduling pool, and workers within a store can share shocks or treatment. Standard-error corrections cannot turn nonrandom assignment into random assignment. Pre-specify what is clustered and why; report cluster counts and interference boundaries.

Reading Ladder And References

Required before class: Hoffman, Kahn, and Li on tests and discretion; Radbruch and Schiprowski on interview sequence; Friebel and coauthors on direct versus overall referral-program effects. These are three different ways to interrogate an organizational process Hoffman et al., 2018Radbruch & Schiprowski, 2025Friebel et al., 2023.

Rotating frontier presentation: Li, Raymond, and Bergman on exploration, or Forsythe and Weinstein on directly measured recruiting effort. Present the outcome and identifying assumptions before presenting the result Li et al., 2026Forsythe & Weinstein, 2025.

Background/research pathways: Hoffman–Stanton for the field map; Weitzman for costly search; Davis–Faberman–Haltiwanger and Carrillo-Tudela–Gartner–Kaas for recruiting intensity; Weinstein for channels; Autor–Scarborough for testing; Dal Bó–Finan–Rossi and Deserranno for applicant selection; the referral experiments and observational studies for mechanism comparison; Pallais, Kleinberg and coauthors, and Lee for selective information; Kline–Rose–Walters for a clean contact-stage experiment; Callaway–Sant’Anna for rollout methods. The reading table assigns a task to each rather than making the whole bibliography compulsory.

Resources: BLS JOLTS definitions; IAB survey/access documentation; the interview paper’s archive statement; and the entry-level online-hiring replication archive. Read each access label before planning a student project U.S. Bureau of Labor Statistics, 2026Research Data Centre of the Federal Employment Agency at the Institute for Employment Research, 2026Radbruch & Schiprowski, 2024Pallais, 2019.

Table 5:Reading ladder and laboratory route

RoleReadingStudent task
Required: tests versus judgmentHoffman–Kahn–Li (2018) Hoffman et al., 2018Draw the available applicant choice set and define the later outcome
Required: information sequenceRadbruch–Schiprowski (2025) Radbruch & Schiprowski, 2025Identify scheduling blocks, quality measurement, and the order-related comparison
Required: organizational treatmentFriebel et al. (2023) Friebel et al., 2023Separate program ITT from conditional referred-worker differences
Rotating frontierLi–Raymond–Bergman (2026) Li et al., 2026Identify selective labels and distinguish offline policy comparison from prospective evaluation
Rotating frontierForsythe–Weinstein (2025) Forsythe & Weinstein, 2025Compare directly reported effort with inferred recruiting intensity
Field backgroundHoffman–Stanton (2025) Hoffman & Stanton, 2025Place the week inside personnel economics, not only algorithmic hiring
Theory supplementWeitzman (1979) Weitzman, 1979State the extra assumptions needed for an optimal-search result
Recruiting-intensity pathwayDavis et al. (2013); Carrillo-Tudela et al. (2023); Weinstein (2018) Davis et al., 2013Carrillo-Tudela et al., 2023Weinstein, 2018Separate vacancies, effort, channels, standards, and model-implied counterfactuals
Applicant-selection pathwayDal Bó et al. (2013); Deserranno (2019) Dal Bó et al., 2013Deserranno, 2019Explain why applicant composition is an outcome, not a control to add mechanically
Referral pathwayBurks et al.; Beaman–Magruder; Pallais–Sands Burks et al., 2015Beaman & Magruder, 2012Pallais & Sands, 2016Compare observational differences with channel-specific experiments
Measurement/equity pathwayAutor–Scarborough; Kline–Rose–Walters; Horton Autor & Scarborough, 2008Kline et al., 2022Horton, 2017List what each outcome actually measures at the entry stage
Selective-information pathwayPallais; Kleinberg et al.; Lee Pallais, 2014Kleinberg et al., 2018Lee, 2009Identify what new observation or assumption is needed for missing performance
Optional emerging exampleFeng et al. (2026), working paper Feng et al., 2026Assess the stage-specific age-barrier evidence without assuming an RD

Lab modes and deliverables

Table 6:Lab modes and deliverables

StageGuaranteed offline pathOptional official path
ReproduceSynthetic design reconstruction of interview sequencing with known DGP parametersInspect stated archive materials; use authorized original data only if genuinely available
DiagnoseWithin-session lags versus cross-session errors; session-clustered uncertainty; fixed-slot selection swapReconcile actual comparison pools, documented preprocessing, labels, and reported specifications
TransferTwo-page test/discretion/exploration design using the original applicant risk setPropose a future data request or experiment, not a claim of available rejected-worker outcomes

The offline exercise is not an empirical replication of published coefficients. It does not require the optional archive to be reachable and must never fabricate original variable names. Its purpose is to make the paper’s design issues executable in a bounded setting.

Exercises And Discussion Prompts

  1. Derive the nested funnel identity and construct a counterexample where multiplying rates from different cohorts has no hiring-probability interpretation.

  2. Solve the one-step screening example at costs 1 and 3. Which additional observation would you need to distinguish high delay costs from low screening standards in a real firm?

  3. A screening reform raises interview-to-offer conversion but lowers starts per application. Give two mechanisms and one data request that separates them.

  4. Why does a previous evaluator’s yes/no decision require a different identification argument from an independently measured previous candidate quality under quasi-random scheduling?

  5. A new test increases tenure but does not change measured output. Write a defensible conclusion without declaring either result the uniquely correct measure of hire quality.

  6. Use the six-candidate example to show that constant headcount does not imply monotone selection. State the population for which a hire-only outcome comparison is meaningful.

  7. Compare evaluating a referral bonus among referred hires with evaluating the program across all assigned stores. Which effects disappear in the first analysis?

  8. Submit the two-page recruiting-funnel memo: intervention, baseline risk set, stage ledger, counterfactual, selection problem, inference, data access, and one economically meaningful limitation.

Reproducibility And Code Lab Note

Download the teaching repository (ZIP), or clone the repository. Keep its folder structure and open books/special-topic8-organizational/labs/02-recruiting-screening-and-entry-into-organizations/; the lab README supplies the run instructions. Weeks 1–3 use the shared plotting module supplied with the repository.

The Week 2 lab handout guides Reproduce, Diagnose, and Transfer. From labs/02-recruiting-screening-and-entry-into-organizations/, run:

ENV_NAME=research bash smoke.sh

The core src/offline_lab.py uses Python’s standard library; the teaching chart uses the repository’s existing Matplotlib environment. The smoke generates 96 synthetic interview sessions, estimates the teaching equation, checks valid and invalid lag constructions, masks rejected-candidate outcomes in the analyst data, rejects a non-nested funnel, verifies a fixed-slot selection swap, and checks a deterministic rerun. No internet, API, private microdata, or credential is needed. Outputs state synthetic design reconstruction, with empirical_replication: false; coefficient recovery verifies this exercise rather than the article’s empirical findings.

The separately stored instructor truth is for the explicitly synthetic diagnosis. It is not information available to a real hiring analyst. The optional empirical archive route is not implemented; the published paper’s proprietary interviews are not included.

Rebuild the chapter’s hypothetical figure from this book directory:

conda run -n research python assets/scripts/build-week2-screening.py

Slide Companion Note

The Week 2 slide deck (PDF) develops the funnel, costly evaluation, paper designs, selective labels, and research lab. Its companion Beamer source follows the Week 1 style. The full deck supports an extended session or two meetings; the chapter’s paper and reading maps provide the longer handout material.

Bridge Forward

Entry determines which workers begin producing information inside the organization. Week 3 asks how employers learn from their output, quality, ratings, tasks, and supervisors once they arrive. Carry forward the distinction between changing worker performance and changing who is observed: it remains central when studying monitoring and employer learning.

References
  1. Hoffman, M., Kahn, L. B., & Li, D. (2018). Discretion in Hiring. The Quarterly Journal of Economics, 133(2), 765–800. 10.1093/qje/qjx042
  2. Hoffman, M., & Stanton, C. T. (2025). People, Practices, and Productivity: A Review of New Advances in Personnel Economics. In Handbook of Labor Economics (Vol. 6, pp. 729–818). Elsevier. 10.1016/bs.heslab.2025.07.005
  3. Davis, S. J., Faberman, R. J., & Haltiwanger, J. C. (2013). The Establishment-Level Behavior of Vacancies and Hiring. The Quarterly Journal of Economics, 128(2), 581–622. 10.1093/qje/qjt002
  4. U.S. Bureau of Labor Statistics. (2026). Job Openings and Labor Turnover Survey: Definitions. https://www.bls.gov/jlt/jltdef.htm
  5. Weitzman, M. L. (1979). Optimal Search for the Best Alternative. Econometrica, 47(3), 641–654. 10.2307/1910412
  6. Weinstein, R. (2018). Employer Screening Costs, Recruiting Strategies, and Labor Market Outcomes: An Equilibrium Analysis of On-Campus Recruiting. Labour Economics, 55, 282–299. 10.1016/j.labeco.2018.10.007
  7. Dal Bó, E., Finan, F., & Rossi, M. A. (2013). Strengthening State Capabilities: The Role of Financial Incentives in the Call to Public Service. The Quarterly Journal of Economics, 128(3), 1169–1218. 10.1093/qje/qjt008
  8. Deserranno, E. (2019). Financial Incentives as Signals: Experimental Evidence from the Recruitment of Village Promoters in Uganda. American Economic Journal: Applied Economics, 11(1), 277–317. 10.1257/app.20170670
  9. Carrillo-Tudela, C., Gartner, H., & Kaas, L. (2023). Recruitment Policies, Job-Filling Rates, and Matching Efficiency. Journal of the European Economic Association, 21(6), 2413–2459. 10.1093/jeea/jvad034
  10. Forsythe, E., & Weinstein, R. (2025). Recruiting Intensity, Hires and Vacancies: Evidence from Firm-Level Data. The Economic Journal, 135(669), 1734–1748. 10.1093/ej/ueaf002
  11. Radbruch, J., & Schiprowski, A. (2025). Interview Sequences and the Formation of Subjective Assessments. The Review of Economic Studies, 92(2), 1226–1256. 10.1093/restud/rdae039
  12. Autor, D. H., & Scarborough, D. (2008). Does Job Testing Harm Minority Workers? Evidence from Retail Establishments. The Quarterly Journal of Economics, 123(1), 219–277. 10.1162/qjec.2008.123.1.219
  13. Burks, S. V., Cowgill, B., Hoffman, M., & Housman, M. (2015). The Value of Hiring through Employee Referrals. The Quarterly Journal of Economics, 130(2), 805–839. 10.1093/qje/qjv010
  14. Beaman, L., & Magruder, J. (2012). Who Gets the Job Referral? Evidence from a Social Networks Experiment. American Economic Review, 102(7), 3574–3593. 10.1257/aer.102.7.3574
  15. Pallais, A., & Sands, E. G. (2016). Why the Referential Treatment? Evidence from Field Experiments on Referrals. Journal of Political Economy, 124(6), 1793–1828. 10.1086/688850