Humanloop

4 tools available

Humanloop helps developers build and refine AI applications, offering user feedback loops, model training, and data annotation to iterate on language model performance

Connect Humanloop to Definable to route to the best model per task, mix providers in one workflow, fall back on rate-limits. Personas call Humanloop's 4 tools directly from chat or scheduled flows. Add it to your persona's available models and route requests to it where it fits best.

Common workflows with Humanloop

01

Multi-provider routing

  1. Persona decides which model fits
  2. Calls this provider when its strengths apply
  3. Falls back to alternatives on rate-limits
02

Specialised pipeline

  1. Use this provider for one stage
  2. Pipe to a different model for the next
  3. Combine outputs in the response

Humanloop actions 4

Every Humanloop action below is a callable tool any Definable persona can invoke.

Create Project

This tool creates a new project in Humanloop. It is an independent action that generates a project by accepting a project's name (required), an optional description, and an optional organization_id. Upon execution, it returns details of the created project, including the project's id, name, description, created_at timestamp, and organization_id.

Delete Project

This tool allows you to delete a specific project from your Humanloop organization. The deletion is permanent and cannot be undone. All associated data, including sessions, datapoints, and evaluations linked to the project, will be permanently removed.

List Experiments

This tool retrieves an array of experiments associated with a specific project in Humanloop. It requires a project_id (starting with 'pr_') and returns details including experiment_id, name, description, creation timestamp, status, configuration details, and metrics/results. It is useful for monitoring experiments, analyzing results, tracking model configurations, and comparing experimental setups.

List Sessions

This tool retrieves a paginated list of sessions for a specific project in Humanloop. It requires a project_id (and optionally, page and size for pagination) and returns session details such as id, reference_id, project information, datapoints_count, first_inputs, last_output, created_at, and updated_at. This enables users to monitor and analyze historical project interactions.

Frequently asked questions

What can I automate with Humanloop on Definable?

Anything Humanloop exposes through its API. Common artificial intelligence workflows on Definable include route to the best model per task, mix providers in one workflow, fall back on rate-limits. Personas can call any of the 4 Humanloop tools directly, then chain the result into another integration without you writing code.

How does Humanloop authentication work?

Humanloop uses API_KEY on Definable. You connect once from the integrations page, scoped to the permissions you choose, and from then on any persona that has the integration enabled can act on your behalf. Tokens are encrypted at rest and rotated automatically.

Is the Humanloop integration included in my Definable plan?

Yes — every Definable plan, including Starter, includes access to all 4 Humanloop tools. You only need a separate Humanloop subscription if Humanloop itself charges per seat or per API call.

Is using Humanloop through Definable secure?

Every call from a persona to Humanloop is logged with the user, persona, prompt, and response. Tokens never leave Definable's secrets vault, scopes are configurable per persona, and you can revoke access at any time from the integration page.

How do I get started with Humanloop on Definable?

Sign up for Definable, open the integrations page, find Humanloop, and connect via OAuth or API key. You can immediately attach Humanloop to any persona and start running workflows. The free Starter plan includes 5,000 credits/month.

What Humanloop actions does Definable expose?

Definable exposes all 4 Humanloop actions as callable tools — including `Create Project`, `Delete Project`, `List Experiments`, plus 1 more. Each tool gets a typed parameter schema so personas know exactly how to call it.

Ready to automate with Humanloop?

Wire it up in minutes. No coding required.

← All integrations