Authors: A Zolanvari, S Haghighi, S Sabouri Venue: pycm.io technical report, 2022

Summary

Survey of rater agreement metrics, written to give PyCM users a clearer basis for choosing among them — part of the effort to make open-source evaluation tooling self-documenting.

PyCM — Multi-Class Confusion Matrix Library — the library this report supports. Open Source Philosophy — reproducible-practice reports as a deliberate output.