Bench

developer tools 1 tool available

Benchmarking tool

About this integration

Connect Bench to Definable to triage issues, review pull requests, monitor builds. Personas call Bench's 1 tools directly from chat or scheduled flows. Wire it into a triage, review, or release-management persona — every action runs scoped, reviewable, and logged.

Connect Bench to Definable and it becomes a set of typed tools your agents plan with — triggered by events, run on schedules, or invoked mid-conversation. Every write is checked by the verifier before it lands.

Auth None required

Tools 1 exposed

Plans All, incl. Free

Data Never trained on

Bench · in workflows

What teams actually run.

Three patterns teams run with Bench on day one. Each one is a plain-English prompt — no canvas, no glue code — and you can remix them into anything.

Triage incoming issues

│ Webhook fires on every new issue

│ Persona summarises and labels it

└ Assigns the right engineer

Auto-review PRs

│ Pull the diff

│ Run a code-review persona

└ Post structured feedback as PR comment

Failing-build alerts

│ CI sends a failure event

│ Agent inspects logs and stack trace

└ Drops a debug summary in Slack

1 tools available

The Bench toolbox.

Every Bench capability your agents can call, each with a typed schema the planner reads. The router picks the right tool per step; the verifier checks the result.

Sleep

Sleep

See it run

One prompt, start to finish.

A real prompt, the Bench tools it calls, and what comes back. This is the whole interface — describe the outcome, agents handle the rest.

❯

Run a real Bench task end-to-end — plan it, execute across the API, and hand back a verified result.

bench.sleep Sleep · verified

done

Done. Bench responded across 1 call, the verifier signed off, and the result is logged with every payload.

FAQ · Bench

Questions, answered.

What teams ask before connecting Bench.

01 What can I automate with Bench on Definable?

Anything Bench exposes through its API. Common developer tools workflows on Definable include triage issues, review pull requests, monitor builds. Personas can call any of the 1 Bench tool directly, then chain the result into another integration without you writing code.

02 How does Bench authentication work?

Bench doesn't require authentication on Definable — it's a public-data integration, so personas can call it immediately without an account hand-off.

03 Is the Bench integration included in my Definable plan?

Yes — every Definable plan, including Starter, includes access to all 1 Bench tool. You only need a separate Bench subscription if Bench itself charges per seat or per API call.

04 Is using Bench through Definable secure?

Every call from a persona to Bench is logged with the user, persona, prompt, and response. Tokens never leave Definable's secrets vault, scopes are configurable per persona, and you can revoke access at any time from the integration page.

05 How do I get started with Bench on Definable?

Sign up for Definable, open the integrations page, find Bench, and connect in one click — no auth required. You can immediately attach Bench to any persona and start running workflows. The free Starter plan includes 5,000 credits/month.

06 What Bench actions does Definable expose?

Definable exposes all 1 Bench action as callable tools — including `Sleep`. Each tool gets a typed parameter schema so personas know exactly how to call it.