SimulEval documentation

SimulEval is a general evaluation framework for simultaneous translation.

Get started

• Installation
  • From pip
  • From source
• Quick Start

User's guide

• Introduction
• Agent
  • Source-Target Types
  • Policy
  • States
  • Pipeline
  • Customized Arguments
• Evaluator
  • SentenceLevelEvaluator
  • Quality Scorers
  • Latency Scorers
  • Customized Scorers
• Dataloader
  • GenericDataloader

Tutorials

• Remote Evaluation
  • Stand Alone Agent
  • Docker
  • Remote Evaluation
• Speech-to-Text
• Speech-to-Speech