Configuring assessment-call settings on a job
Assessment calls add a live coding or case-study segment to a job's interview. Configure the questions, the time budget, and what gets scored — per job.
Key takeaways
- Assessment-call settings live on the job, at /jobs/[id]/assessment-call-config.
- You define a small set of structured problems the AI will walk the candidate through.
- The assessment-call segment runs inside the standard interview, after the conversational portion.
- Use it for roles where real-time problem-solving signal matters more than the conversational interview alone.
Before you start
Assessment calls let you add structured live problem-solving to an AI interview — useful for engineering, analytics, and case-study-style roles where you want to see a candidate think under time pressure, not just describe past experience.
When to use it
- Engineering roles — see the candidate write a small piece of code and explain their approach.
- Analytics / data science — give them a dataset description and ask how they would solve a problem.
- Product / strategy — case-study questions like "How would you prioritise these three features?"
- Operations — process-design problems with multiple right answers.
When not to use it: pure-conversational roles where past-experience storytelling is the primary signal (most sales, customer success, recruiting roles).
How to configure
What the candidate experiences
The interview begins conversationally — the AI asks behavioural and experience questions for 15–20 minutes. Then the AI transitions: "Now I'd like to walk through a specific problem with you." A code editor or whiteboard panel opens, and the candidate works through the problem out loud.
The AI listens to their reasoning, asks clarifying follow-ups, and probes for edge cases. It does not give the answer or steer too hard — the goal is to evaluate independent thinking.
How it gets scored
The assessment portion contributes to the Problem Solving and Technical Competence dimensions of the evaluation. The weight is set in your assessment-call config — typically 60% of those two dimensions come from the assessment if assessment is enabled, 40% from the conversational portion.
TIP
If you're using assessment calls for the first time, start with 2 problems of moderate difficulty rather than 4 of varying difficulty. You'll get cleaner cross-candidate comparisons that way.
Next: editing or closing the job after candidates have started.
Frequently asked questions
Does the assessment call cost extra credits?
No — it is included in the interview duration you already selected. If your interview is configured for 45 minutes, the assessment portion eats into that budget.
Can the candidate write code?
Yes — for engineering assessment calls, a shared code editor appears during the assessment segment. The candidate types code; the AI watches the screen and asks follow-up questions about their approach.
What if I don't set up assessment-call config?
The job defaults to a conversational-only interview. The assessment-call segment is opt-in per job.