Skip to content

Every run has a budget ​

Time, money and output tokens. The first limit reached stops the run.

  • Graceful by default. The turn under way ends and answers. Not graceful cuts it off where it stands. Each limit is graceful or not on its own.
  • Nested. Cost and tokens roll up through every flow a run calls. Duration is a deadline, not a sum.
  • Humanize holds it. No flow and no hook can talk a spent budget into another turn.
  • One per run. A picked-up run brings its own. Only chat runs without one.
  • Unpriced is free. A model with no listed price costs $0, so pair cost with a time or token limit.

Released under the Apache-2.0 licence.