Screened Out

Maya, I've spent two weeks coordinating these interviews. The hiring panel has blocked their entire Monday. Three candidates are travelling from other cities. You're asking me to blow up the schedule because of a 'data anomaly'? This had better be serious.

It is. I wouldn't ask if it weren't. 8am Monday — I'll have the data ready.

Fine. But I'm not cancelling the interviews. We'll meet at 8, and they'd better still go ahead at 9.

Maya, I see you added a candidate manually to the shortlist? Raymond Clarke — score 72? That's below threshold. What happened?

His CV is exceptionally strong for this role. I felt the score didn't reflect his qualifications.

OK, but if we're going to override the AI, what's the point of using it? Derek isn't going to like this.

It's one candidate, Aisha. Let's just make sure he gets a fair interview.

Fine. But if anyone asks why we're cherry-picking candidates outside the AI's recommendations, that's on you.

Derek, I hear what you're saying about career trajectory. But let me show you something. Here's the rejection data. I've highlighted age, score, and the two metrics that drove the low scores: 'adaptability potential' and 'cultural alignment.' These metrics aren't defined anywhere in the platform documentation. I've checked.

So?

So we're using an automated employment decision tool — recruitment AI is explicitly classified under § 20-870 — and we can't explain how it makes decisions. If Raymond Clarke files a complaint, we have no transparency documentation to show them.

The vendor assured us the tool was compliant.

The vendor's compliance is their problem. Our compliance — as deployers — is ours. § 20-871 is clear: we have to ensure the bias audit is current, the summary is posted, and candidates received notice. The question isn't whether I'm right or wrong about the cause. The question is what we do now that the pattern exists.

What are you proposing?

I want to bring Legal in. Today. And request the vendor's transparency documentation on how those metrics are calculated. If they can explain it, great. If they can't, we have a bigger conversation.

Fine. But I want to be in the room when Legal reviews this. And I want it on record that I'm cooperating, not being investigated.

Of course. This isn't about blame, Derek. It's about getting ahead of a problem before it gets ahead of us.

You make a fair point, Derek. The career trajectory explanation could account for some of the pattern. I'll dig into the data more before raising anything formally.

Good. Let's not create a crisis out of a coincidence. The interviews are at 10 — are we good?

We're good.

You're probably right. Career trajectory is a legitimate signal. I'll make sure Raymond gets an interview and we'll keep an eye on the metrics going forward.

That's sensible. Look, I appreciate that you're thorough — that's why you're good at your job. But sometimes a pattern is just a coincidence.

Marcus, we need to understand how 'adaptability potential' and 'cultural alignment' are calculated. What data inputs drive those scores?

Those are part of our proprietary Talent Compatibility Engine. The specific weighting and feature interactions are commercially sensitive.

Under § 20-873 of NYC LL144, candidates must be told what job qualifications and characteristics the tool evaluates. If we can't explain those metrics, we can't provide compliant notice.

We provide a compliance summary document. I can send that over.

We've read it. 'Scores are generated using a multi-factor model incorporating role-relevant competency indicators.' That doesn't tell us how 'cultural alignment' is calculated.

What I can offer is our AI Compliance Audit Package — a comprehensive review by our internal compliance team. 6–8 weeks, $30,000.

Six to eight weeks?

They can't or won't explain how their own tool makes decisions. That's a § 20-873 problem — theirs and ours.

Derek, I'm recommending we suspend HireLogic AI effective immediately. I'll draft the formal recommendation for Priya and the CFO today.

Immediately? We process 200 applications a month through that tool. We'll be back to manual screening — that's the 200 hours per quarter I saved us.

I know. But § 20-875 allows fines up to $500 per first violation and $500–$1,500 for each subsequent violation on different days, with each affected candidate counting as a separate violation. With 850 employees and thousands of candidates processed annually, daily penalties plus class-action exposure under Title VII could run into the millions.

That's the worst case. The DCWP isn't going to come after us for a recruitment tool.

LL144 penalties are just the start. The real exposure is Title VII — a class-action age discrimination suit from rejected candidates. And that's before reputational damage. If the FT runs a story about Apex Capital's AI discriminating against older candidates, what happens to the Chicago office's client relationships?

How long?

Until we get an independent bias audit with proper impact ratios. If the vendor can provide one, we turn it back on. If they can't, we find a vendor who can.

The board is going to want to know why.

Better they hear it from us than from a regulator.

I'm recommending we keep the tool but add mandatory human review. Every rejected candidate gets manual review. Any candidate over 50 below threshold on 'adaptability' or 'cultural alignment' gets escalated to senior HR.

That's more work for your team.

Less work than a regulatory investigation. And we can keep using the tool's screening while we push the vendor for a proper independent audit.

Reasonable interim measure. But this doesn't fix the underlying § 20-871 issue. If the bias audit wasn't independent, we're still technically non-compliant regardless of human review.

Agreed. Reviewers won't see the AI score until after their own assessment. Blind review first, then comparison.

Better. But we still need a compliant independent audit. This is temporary, not permanent.

I think the audit is the right path. The vendor knows their system best. Six to eight weeks is manageable.

Maya, I have concerns. We're asking the vendor to audit themselves. That's a conflict of interest — and § 20-872 explicitly requires the auditor be independent of the employer and the vendor.

They have internal compliance people. It's standard practice.

Standard practice that LL144 doesn't accept. The law is explicit: the audit must be performed by an independent auditor. If the DCWP investigates, 'we paid the vendor to audit themselves' won't hold up.

If the vendor's audit comes back clean — which it almost certainly will — and a regulator later finds the same pattern you found, where does that leave us?

Let's just do the vendor audit and move on.