A terminal-based tool for local runs and debugging of eva-run.

It uses eva-parser to convert Promptfoo config into eva-run tasks.

Quick Start​

npm i -g @eva-llm/eva-cli
export DATABASE_URL="postgresql://..." # required for results monitoring
eva-llm run /path/to/promptfooconfig.yaml

Settings​

By default it searches eva-run instance in localhost:3000, but could be customised with enviroment variable EVA_RUN_HOST.

Tests Format​

It supports restricted Promptfoo format and extends it with own features.

Full details in eva-parser specification.

License​

MIT