11 min readMarcus Thorne

Updated on

Open book interviews and the end of candidate surprise

Providing your exact rubric to candidates 48 hours before the interview limits bias and uncovers actual operational competence.

Open book interviews and the end of candidate surprise

The performance theater of blind interviews

Most recruitment teams operate under a false assumption. They believe a candidate answering questions on the spot proves competence. We hide our grading criteria. We keep specific interview questions locked inside private templates in systems like Greenhouse or Lever. We walk into a video call expecting the candidate to perform high stakes improvisation based on vague prompts. This approach does not find the best engineer or marketing manager. It finds the person best at thinking under pressure while being watched.

For companies with 50 to 2000 employees, the financial penalty for this theater is severe. The United States Department of Labor estimates the cost of a bad hire at 30 percent of their first year earnings. When your organization scales rapidly, you need people who can do the actual work. You do not need people who are merely good at taking meetings. The solution is removing the element of surprise entirely. You must send your exact questions to the candidate in advance.

Why hidden questions fail your hiring managers

Keeping your interview questions secret creates specific operational problems for your hiring managers. It heavily favors candidates with high social confidence. It rewards individuals who pay for expensive executive interview coaching. A brilliant software architect who is introverted might struggle to structure a complex answer in thirty seconds. A candidate speaking English as a third language faces an unnecessary cognitive load. Meanwhile, a mediocre candidate with strong narrative skills can charm their way through your hidden criteria without providing actual technical depth.

Hiding questions also forces interviewers to waste valuable time. Interviewers often spend 40 minutes of a standard 60 minute block just getting basic facts. The candidate spends ten minutes trying to remember a specific project from 2021 that matches your prompt. That is ten minutes you cannot spend on follow up questions. It is ten minutes lost for deep technical analysis. Providing the questions ahead of time eliminates this dead air.

Defining the grading criteria

Before you can send questions to a candidate, your team must agree on what a good answer looks like. This requires building a strict grading standard. Most organizations fail here because they rely on vague feelings about an applicant. You must define specific positive and negative signals for every single question. If you ask a software engineer about scaling a relational database, you must list the exact technical concepts you expect to hear in a passing response.

You might require the candidate to mention connection pooling, read replicas, or specific caching strategies. You must also define negative signals. A negative signal might be a candidate suggesting a complete database migration for a minor performance issue. You document these specific positive and negative requirements in your applicant tracking system. When the candidate receives the prompt on Tuesday for a Thursday interview, they know exactly what topic to prepare.

The interviewer knows exactly what technical terms to listen for during the call. This entirely eliminates the common problem where two interviewers grade the identical answer completely differently. A defined standard forces your hiring managers to measure competence objectively. It stops them from hiring candidates simply because they share a similar corporate background or casual communication style.

Structuring the open book protocol

Your recruiting team must build a reliable mechanism for this new process. You should send the exact interview questions to the candidate exactly 48 hours before the scheduled call. This is not a summary of broad topics. It is the literal list of three to five core questions the interviewer will ask. You can automate this delivery using standard communication triggers inside Workday or Lever. Your system administrator can configure a rule that fires an email template as soon as a calendar invite is accepted.

This automation ensures no candidate is accidentally left without preparation materials. It also provides a timestamped audit log proving the candidate received the document. This audit log is critical for compliance reviews. If an auditor asks to see your standard interview process, you can export the exact timeline of when materials were delivered. Relying on manual emails from recruiters introduces too much human error. A recruiter might forget to attach the document or send it too late. Automation guarantees a uniform candidate experience.

For a product manager role, you send a specific list via email once the candidate clears the initial recruiter phone screen. Question one asks the candidate to walk through a product feature they deprecated. You instruct them to explain the specific data driving the decision and how they handled internal pushback from the sales team. Question two asks how they prioritize a roadmap when two executive stakeholders submit conflicting requests. You tell them to prepare a real example from their last role.

Question three focuses on your current user onboarding flow. You ask them to review your public software trial and bring three specific observations regarding friction points. By providing these precise prompts, you change the nature of the conversation entirely. It shifts from a memory test to a professional consultation.

Training the interview panel

Moving to an open book interview model requires retraining your hiring managers. A manager used to catching candidates off guard will struggle with a prepared applicant. The biggest risk is that candidates will simply read a written script over the video call. Your interviewers must know how to interrupt politely and redirect the conversation. You must instruct your panel to set the rules of engagement at the very beginning of the meeting.

The interviewer should state clearly that they have read the candidate resume and expect a conversational dialogue. If a candidate starts reading from a second monitor, the interviewer must intervene. The interviewer can say they want to explore a specific detail the candidate just mentioned. This pulls the candidate off the script and back into an active discussion. Training your panel to handle this dynamic is critical for success.

You should run mock interviews with your hiring managers before they speak to external candidates. They need practice pivoting from the prepared answer into deep analytical probing.

Moving from recall to analysis

When a candidate arrives prepared, the interviewer can no longer just tick a box. The recruiter and the hiring manager must learn to move past the initial rehearsed answer. Since you provided the questions in advance, you should expect a highly structured response. The candidate has no excuse for a poor initial answer. This allows the interviewer to use the bulk of the hour for deeper probing. We call this Level 2 and Level 3 questioning.

The candidate gives their prepared answer about a product deprecation. The interviewer immediately follows up with a new constraint. The interviewer asks what the candidate would change if they had to execute that same deprecation today with a 50 percent budget reduction. This forces the applicant to apply their prepared thoughts to an unexpected variable.

You are still testing their ability to think analytically. You are simply doing it from a foundation of shared context rather than a cold start. The quality of the dialogue improves immediately.

Calibrating expectations across different seniority levels

The open book model requires you to adjust your expectations based on the seniority of the role. You cannot expect a junior developer to provide the same strategic depth as a staff engineer, even with 48 hours of preparation. For junior roles, providing the questions helps reduce baseline anxiety. It allows early career professionals to showcase their actual coding knowledge rather than their ability to manage interview stress. You should focus your follow up questions on execution details. You might ask a junior candidate how they would test the specific code they just described.

For senior leadership roles, the open book format becomes a rigorous test of strategic prioritization. A director level candidate should use the preparation time to analyze your market position. If you send a question about declining user retention, a senior candidate should arrive with a structured turnaround plan. They should anticipate your follow up questions about budget constraints and team restructuring. Providing the questions in advance removes their ability to use generic management jargon. They have the prompt, so you expect a highly specific operational strategy. If a senior candidate provides a superficial answer after two days of preparation, you have an immediate and clear signal to reject them.

Regulatory shifts in North America

The legal landscape in North America is rapidly changing how we structure interviews. Defensibility is becoming your primary operational requirement. The Equal Employment Opportunity Commission updated its guidance in May 2023 regarding algorithmic decision tools. The commission clearly stated that employers are responsible if their selection procedures cause a disparate impact on protected groups. Unstructured interviews are notoriously biased. They allow interviewers to drift into irrelevant topics that can introduce demographic bias. Sending the questions in advance anchors the conversation. It forces the interviewer to stick to the approved script.

New York City Local Law 144 mandates independent bias audits for automated employment decision tools. Enforcement for this law began on July 5, 2023. Other jurisdictions like California are drafting similar regulations under the Fair Employment and Housing Act. Creating a defensible and standardized interview input is the only way to survive these audits. Giving every candidate the exact same preparation materials 48 hours in advance proves your process is uniform.

It also provides a universal accommodation under Title I of the Americans with Disabilities Act. You avoid forcing neurodivergent candidates to request special accommodations because your baseline process is already accessible.

Compliance realities across the European Union

European jurisdictions approach interview data differently than North American regulators. The transition to open book interviewing aligns perfectly with the push for algorithmic transparency across the continent. The European Parliament passed the Artificial Intelligence Act on March 13, 2024. This law explicitly designates artificial intelligence systems used for recruitment as high risk. If your organization uses any automated system to summarize interview notes or rank candidates, you face strict compliance obligations.

The underlying logic of your assessment must be explainable to a regulator. By providing the exact questions to candidates in advance, you constrain the variables of the interview. You create a highly structured data set for your assessment tools to process. This makes it much easier to prove that your process is fair. The General Data Protection Regulation also limits automated profiling under Article 22.

You must demonstrate a legitimate business interest for the specific data you collect during an interview. Documenting and sharing your exact questions before the interview establishes this legitimate interest clearly. In countries like Germany, the General Equal Treatment Act restricts arbitrary variations in how you treat different candidates. A documented open book protocol proves you gave every candidate the exact same opportunity to prepare.

Overcoming internal resistance

Hiring managers will often resist this change. Sales directors and engineering leads might argue that real life does not give employees the questions in advance. This objection is rarely true in a modern professional setting. High value corporate work requires deep preparation. Board meetings, quarterly business reviews, and complex code deployments all allow for extensive review. The person who walks into a board meeting without studying the financial deck usually fails. You should not hire people based on their ability to perform well without preparation.

To roll this out effectively, start with a single department. Engineering and product teams are usually the most receptive to structured processes. Draft a candidate preparation guide for a specific mid level role. This document includes the names and LinkedIn profiles of the interviewers. It details the specific technical environment the team uses. It lists the exact questions the candidate must answer. Let the hiring manager see the difference in candidate quality for one quarter.

The impact on your employer brand

At the 50 to 2000 employee scale, your organization competes for talent against multinational giants. You cannot always win on base salary alone. You win by offering a more respectful and intelligent process. Candidates talk to their peers. Glassdoor reviews frequently mention the specific mechanics of an interview process. A candidate will tell their professional network that your company provided the questions in advance. They will describe how your process respects their time and their cognitive load.

They will mention that your team focused on deep technical discussion rather than attempting to trick them with trivia. Your inbound application pipeline will improve significantly. High performing professionals appreciate employers who treat them like adults. Preparation is never cheating. It is a fundamental prerequisite for professional excellence. By formalizing candidate preparedness, you stop hiring the best interviewees. You start hiring the most competent employees. Providing the questions ahead of time signals that your organization values deep work over quick reflexes. It proves you care about actual job performance.

Implementation steps for next quarter

You need a specific action plan to deploy this methodology in the upcoming quarter. First, audit your existing interview templates in your applicant tracking system. Identify roles with high turnover or historically low interview pass rates. Select one high priority open requisition to serve as your pilot program. Do not announce a global policy change until you have data from this pilot.

Next, gather the hiring panel for a mandatory working session. Force the team to write down the exact three questions they will ask every candidate. Require them to document the specific positive and negative signals for each answer. Update your automated email sequences to send this document to candidates exactly 48 hours before the interview.

Finally, schedule a mandatory 30 minute training session for the pilot interviewers. Teach them how to interrupt candidates who attempt to read from a prepared script. Review the pilot data after ten candidate interviews. Compare the depth of the technical feedback to your historical averages. You will see an immediate improvement in the quality of your hiring decisions.

Sources

  1. 01Inclusive Hiring: Why We Share Our Interview Questions in AdvanceBuffer
  2. 02Why You Should Give Candidates Interview Questions in AdvanceHarvard Business Review
  3. 03Alternative Hiring: Should you give interview questions to candidates before the interview?Workable
  4. 04Structure Your Interviews to Avoid BiasSociety for Human Resource Management (SHRM)
ShareLinkedInXEmail

Read next in candidate experience

The newsletter

One edition roughly every two weeks: new articles, and what changed in hiring that is worth your time.

Back to all articles