General video game evaluation using relative algorithm performance profiles

Thorbjørn S. Nielsen, Gabriella A. B. Barros, Julian Togelius, Mark J. Nelson (2015). General video game evaluation using relative algorithm performance profiles. In Proceedings of the Conference on Applications of Evolutionary Computation, pp. 369–380.

Abstract

In order to generate complete games through evolution we need generic and reliable evaluation functions for games. It has been suggested that game quality could be characterised through playing a game with different controllers and comparing their performance. This paper explores that idea through investigating the relative performance of different general game-playing algorithms. Seven game-playing algorithms was used to play several hand-designed, mutated and randomly generated VGDL game descriptions. Results discussed appear to support the conjecture that well-designed games have, on average a higher performance difference between better and worse game-playing algorithms.


Back to publications.