Humanloop

artificial intelligence 4 tools available

Humanloop helps developers build and refine AI applications, offering user feedback loops, model training, and data annotation to iterate on language model performance

Connect Humanloop Visit Humanloop

About this integration

Connect Humanloop to Definable to route to the best model per task, mix providers in one workflow, fall back on rate-limits. Personas call Humanloop's 4 tools directly from chat or scheduled flows. Add it to your persona's available models and route requests to it where it fits best.

Connect Humanloop to Definable and it becomes a set of typed tools your agents plan with — triggered by events, run on schedules, or invoked mid-conversation. Every write is checked by the verifier before it lands.

Auth OAuth2 · 2 clicks

Tools 4 exposed

Plans All, incl. Free

Data Never trained on

Humanloop · in workflows

What teams actually run.

Three patterns teams run with Humanloop on day one. Each one is a plain-English prompt — no canvas, no glue code — and you can remix them into anything.

Multi-provider routing

│ Persona decides which model fits

│ Calls this provider when its strengths apply

└ Falls back to alternatives on rate-limits

Specialised pipeline

│ Use this provider for one stage

│ Pipe to a different model for the next

└ Combine outputs in the response

4 tools available

The Humanloop toolbox.

Every Humanloop capability your agents can call, each with a typed schema the planner reads. The router picks the right tool per step; the verifier checks the result.

Create Project

This tool creates a new project in Humanloop. It is an independent action that generates a project by accepting a project's name (required), an optional description, and an optional organization_id. Upon execution, it returns details of the created project, including the project's id, name, description, created_at timestamp, and organization_id.

Delete Project

This tool allows you to delete a specific project from your Humanloop organization. The deletion is permanent and cannot be undone. All associated data, including sessions, datapoints, and evaluations linked to the project, will be permanently removed.

List Experiments

This tool retrieves an array of experiments associated with a specific project in Humanloop. It requires a project_id (starting with 'pr_') and returns details including experiment_id, name, description, creation timestamp, status, configuration details, and metrics/results. It is useful for monitoring experiments, analyzing results, tracking model configurations, and comparing experimental setups.

List Sessions

This tool retrieves a paginated list of sessions for a specific project in Humanloop. It requires a project_id (and optionally, page and size for pagination) and returns session details such as id, reference_id, project information, datapoints_count, first_inputs, last_output, created_at, and updated_at. This enables users to monitor and analyze historical project interactions.

See it run

One prompt, start to finish.

A real prompt, the Humanloop tools it calls, and what comes back. This is the whole interface — describe the outcome, agents handle the rest.

❯

Run a real Humanloop task end-to-end — plan it, execute across the API, and hand back a verified result.

humanloop.create_project This tool creates a new project in Humanloop. It is an independent action that generates a

humanloop.delete_project This tool allows you to delete a specific project from your Humanloop organization. The de

humanloop.list_experiments This tool retrieves an array of experiments associated with a specific project in Humanloo · verified

done

Done. Humanloop responded across 3 calls, the verifier signed off, and the result is logged with every payload.

FAQ · Humanloop

Questions, answered.

What teams ask before connecting Humanloop.

01 What can I automate with Humanloop on Definable?

Anything Humanloop exposes through its API. Common artificial intelligence workflows on Definable include route to the best model per task, mix providers in one workflow, fall back on rate-limits. Personas can call any of the 4 Humanloop tools directly, then chain the result into another integration without you writing code.

02 How does Humanloop authentication work?

Humanloop uses API_KEY on Definable. You connect once from the integrations page, scoped to the permissions you choose, and from then on any persona that has the integration enabled can act on your behalf. Tokens are encrypted at rest and rotated automatically.

03 Is the Humanloop integration included in my Definable plan?

Yes — every Definable plan, including Starter, includes access to all 4 Humanloop tools. You only need a separate Humanloop subscription if Humanloop itself charges per seat or per API call.

04 Is using Humanloop through Definable secure?

Every call from a persona to Humanloop is logged with the user, persona, prompt, and response. Tokens never leave Definable's secrets vault, scopes are configurable per persona, and you can revoke access at any time from the integration page.

05 How do I get started with Humanloop on Definable?

Sign up for Definable, open the integrations page, find Humanloop, and connect via OAuth or API key. You can immediately attach Humanloop to any persona and start running workflows. The free Starter plan includes 5,000 credits/month.

06 What Humanloop actions does Definable expose?

Definable exposes all 4 Humanloop actions as callable tools — including `Create Project`, `Delete Project`, `List Experiments`, plus 1 more. Each tool gets a typed parameter schema so personas know exactly how to call it.