ToolBench
Open-source agent research, data, and evaluation for tool learning, agent evaluation, dataset.
What does this agent do, and when should you use it?
The repository describes ToolBench as: [ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning. This profile is a source-based catalog entry; an independent FARS review is still pending.
[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.
- Run a documented research, analysis, or evaluation workflow.
- Compare agent behavior with reproducible evidence.
- Adapt its datasets, environments, or analysis components.
What are this agent's strengths and limitations?
- Public source and README are available for inspection.
- Focused on tool learning, agent evaluation, dataset.
- Setup, model-provider support, and maturity must be confirmed against the current release.
- No independent FARS score has been assigned yet.
How do you install or deploy this agent?
Follow the current installation instructions in the [repository README](https://github.com/OpenBMB/ToolBench#readme). Requirements and provider setup vary by release.
How do you use this agent?
Start with the examples and quickstart in the [repository documentation](https://github.com/OpenBMB/ToolBench#readme), then test the workflow with limited permissions and non-sensitive data.