EASSE: Easier Automatic Sentence Simplification Evaluation

We introduce EASSE, a Python package aiming to facilitate and standardise evaluation and comparison of Sentence Simplification (SS) systems. provides a single access point to a broad range of evaluation resources: automatic metrics for assessing SS outputs (e.g. SARI), word-level scores for certain simplification transformations,-independent quality estimation features (e.g. compression ratio), and test data for SS evaluation (e.g. TurkCorpus). Finally, EASSE easy-to-visualise reports on the various metrics and features above on how a particular SS output fares against reference simplifications. experiments, we show that these functionalities allow for better and understanding of the performance of SS systems.