Ivy can scan your question bank, compare each question against your organization's competency matrix, and return a list of suggested competency tags. You review every suggestion individually before anything is saved — Ivy never writes tags without your approval.
Prerequisites
Enabling the feature
- Open Organization Settings (your org menu → Settings).
- Find the AI competency classification card.
- Toggle Enable AI classification for this organization to on.
Once enabled, the classification tools appear on the Questions page and inside the Ivy chat panel for all members with questions:update.
Running a bulk classification from the Questions page
Step 1 — Open the classify dialog
When five or more questions in your bank have no competency tags, a banner appears at the top of the Questions page:
N questions in your bank aren't tagged with competencies yet. Let Ivy suggest tags for you.
Select Classify to open the dialog. You can also dismiss the banner and come back to it later.
Step 2 — Choose your scope and job roles
The Classify questions dialog opens in setup view.
Scope controls which questions Ivy analyzes:
| Option | What Ivy analyzes |
|---|---|
| Untagged questions | Only questions with no competency tags (default) |
| All questions | Every question in the bank, including already-tagged ones |
Toggle Include already-tagged questions to switch between these two options.
Select one or more job roles to scope the competency suggestions. Ivy maps each question against the competencies defined for the roles you pick. You must select at least one role before starting.
Step 3 — Start the classification
Select Start classification. Ivy processes your questions in the background. A progress indicator appears while it works. You can select Cancel without charge at any time during processing to abort with no credits deducted.
Step 4 — Review suggestions
Once Ivy finishes, the dialog switches to review mode. Each row shows:
- The question title
- The suggested competency tags and their confidence level (High, Medium, or Low)
- Any tags the question already has
You can:
- Accept or discard individual suggestions by toggling each competency chip.
- Keep all or Discard all for an entire question row at once.
- Toggle Replace existing tags if you want accepted suggestions to overwrite the question's current tags rather than being merged with them.
No changes are written until you confirm in the next step.
Step 5 — Save
Select Save N questions to apply the accepted suggestions. A confirmation toast appears, with an Undo option that reverts all tags to their previous state.
Running a classification via Ivy
You can also ask Ivy to classify questions directly from the chat panel. Ivy uses the same classify_questions tool and follows a two-step conversation:
- Ivy first asks which job roles you want to scope to.
- Once you confirm, Ivy runs the classification and opens a draft in the workspace tab for you to review.
As with the bulk dialog, no tags are applied until you save the draft.
Credit usage
Classifications consume credits proportional to the number of questions processed. Credits are charged only once Ivy returns results — cancelling during processing incurs no charge.
If your organization has configured its own API key (BYOK mode, enabled by an Org Admin in Organization Settings → AI), AI usage is billed directly to your API provider account and no credits are deducted from your Intervy balance.
Selecting specific questions via Ivy
When you ask Ivy to classify a specific set of questions (for example, "classify questions 12, 15, and 20"), Ivy passes only those question IDs to the classification engine. The results appear in the workspace draft for review in the same way as a bulk run.
Permissions reference
| Action | Permission | Default roles |
|---|---|---|
| Run AI classification | questions:update | AdminStaffing |
| Enable / disable AI classification for the organization | org:manage | Admin |
Troubleshooting
The classify banner or button does not appear — AI competency classification may be disabled for your organization. Ask an Org Admin to enable it in Organization Settings → AI competency classification. You also need questions:update for the feature to appear.
"AI classification is temporarily unavailable. Please try again later." — The classification service is not reachable. Wait a moment and try again.
"At least one job role must be selected" — Select one or more job roles in the setup step before starting the classification.