YI EVAL DOCS

Bring testing into your workflow.

The Yi Eval docs live with the product: from connecting your first agent to datasets, scorers and experiments, fault and attack tests in a sandbox, the release gate, production logs and the API. Start from any section below; links open the docs in your current language.

Quickstart

Pick a way to connect; you can switch later, or use several in one project, with results in the same experiments, logs and release gate. With a GitHub repository, your first report takes about 30 minutes. The SDK, the AI Gateway, your own image and a chat AI by its API address are in development.

Guides

Reference

Security & legal

Common questions

Do I need an activation code?

No. Sign in to Yi Eval with your Yi Labs account and your personal workspace is created on first use. GitHub and Google sign-in are available. Contact admin@nice2.io if an existing account doesn't link up.

Where is my data?

Everything the platform stores is in London. Cloud runs happen in London by default, each on a fresh virtual machine deleted afterwards; a project set to run in the EU runs in Sweden (EU), and its run bundle is still stored in London. The platform's models (global deployments, which may process it in any region) receive the text they grade or answer; the security overview has the detail. Code that can't leave your company can use a local test runner.

What does “passed” mean?

Within that test's scope, every pass criterion you set was met. Nothing outside the scope was checked, so a pass doesn't mean the system is completely safe; anything that didn't finish or couldn't be decided is called out in the report and doesn't count as passed.

Next step

AI that understands how code runs.

Contact