ROUGE-2.0 | ROUGE automatic summarization evaluation toolkit | Natural Language Processing library

Ensure you have Java 1.8 and above installed. You only need the JRE.
Download latest version of ROUGE 2.0 distribution zip file
Unpack the zip file
Move into the ROUGE 2.0 directory cd <rouge2-1.x-runnable>
Do a test run: java -jar rouge2-1.x.jar. You should see results in the console and in rouge2-1.x-runnable/results.csv
The above step uses the sample summarization tasks under rouge2-1.x-runnable/projects/test-summarization and the default settings in rouge2-1.x-runnable/rouge.properties file.
Use the full documentation for summary formatting guidelines and making changes to the settings, etc.
To make changes to the ROUGE 2.0 code base, follow the installation steps below.
To build on the source code of ROUGE 2.0, clone the repository and import the project as a Maven project by selecting the pom.xml file in the root directory from Eclipse, IntelliJ or other IDE's. Next, add the jars under the lib directory to your build path for the code to compile. Note that you can also install the jars in the lib directory by creating a local maven repository for those jar files. All you would need to do after that is to add the local dependencies to your pom.xml.