Rethinking Creativity Evaluation: A Critical Analysis of Existing Creativity Evaluations
Li-Chun Lu, Miri Liu, Pin-Chun Lu, Yufei Tian, Shao-Hua Sun, and Nanyun Peng, in Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2026.
Download the full text
Abstract
The paper systematically examines, analyzes, and compares representative creativity measures such as creativity index, perplexity, syntactic templates, and LLM-as-a-Judge across various creative domains. The analysis reveals that these metrics exhibit limited consistency and capture different dimensions of creativity, highlighting the need for more robust and generalizable evaluation frameworks.
Bib Entry
@inproceedings{lu2026rethinking,
title = {Rethinking Creativity Evaluation: A Critical Analysis of Existing Creativity Evaluations},
author = {Lu, Li-Chun and Liu, Miri and Lu, Pin-Chun and Tian, Yufei and Sun, Shao-Hua and Peng, Nanyun},
booktitle = {Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (EACL)},
year = {2026}
}