Core Concepts
Understand the building blocks of Datashift.
Queues
A queue defines a review workflow. Think of it as an inbox for a specific type of decision.
Example: "Refund Approvals", "Content Moderation", "Contract Reviews" — each with different reviewers and decision types.
Tasks
A task is a unit of work submitted for review. When your agent needs human input, it creates a task.
Tasks progress through states:
Reviewers
Reviewers make decisions on tasks. Datashift supports two types:
Human Reviewers
Team members who review tasks via the Console. Can also receive notifications via Slack, Discord, or Teams.
AI Reviewers
LLM-based reviewers that process tasks automatically. Configure with a model, prompt, and parameters.
Review Types
The review type determines what kind of decision reviewers make.
| Type | Description | Example |
|---|---|---|
| Approval | Yes/no decision | Approve or reject a refund |
| Classification | Single category selection | Bug, Feature, Support, Spam |
| Scoring | Numeric rating | Lead quality 1-5 |
| Labeling | Multiple labels | urgent, customer-facing, security |
| Augmentation | Edit the content | Fix AI-drafted copy before sending |
Assignment Strategies
Control how tasks are distributed to reviewers.
| Strategy | Description | Best For |
|---|---|---|
| Manual | Tasks sit in pool; reviewers self-assign | Small teams, variable workloads |
| Round Robin | Auto-assigns to next reviewer | Even workload distribution |
| AI First | AI reviews first, then human | High volume, AI pre-screening |
| AI Last | Human reviews first, AI audits afterward | Quality assurance, compliance checks |
Reviews
A review is a decision made on a task. Each review contains:
Tasks can have multiple reviews (e.g., in AI First mode, the AI reviews first, then a human reviews).
Reviewer Channels
Reviewers can make decisions from wherever they already work. Datashift supports multiple review channels so reviewers don't need to learn a new tool.
Console
Full-featured web dashboard with dedicated review UIs for each review type. Keyboard shortcuts for fast reviewing. Best for high-volume or complex reviews.
Slack
Review tasks directly from Slack using interactive modals. Receive notifications when tasks are assigned and submit decisions without leaving the conversation.
Discord
Button-based review interactions in Discord channels or DMs. Reviewers click to approve, reject, or open the full review in the Console.
Microsoft Teams
Adaptive Card-based reviews in Teams channels. Supports tenant-level security verification and threaded conversations.
Each reviewer can configure their preferred notification channels in their profile settings. Reviews from any channel are recorded identically — the task doesn't know or care where the decision came from.
AI Reviewers
AI reviewers are LLM-based agents that process tasks automatically using structured output. They can work alongside human reviewers or handle tasks independently.
AI reviewers are most powerful when combined with human reviewers using assignment strategies:
AI First
The AI reviews every task first. If it's confident, the result is used directly. If not, the task is escalated to a human reviewer. Reduces human workload by handling straightforward cases automatically.
AI Last
A human reviews first, then the AI audits the human's decision. Useful for compliance checks and quality assurance — the AI flags disagreements for further review.