What is it about?

Through the analysis of 152 source codes of 374 publications accepted to previous editions of the lead conference SIGGRAPH, in 2014, 2016 and 2018, we have analyzed the state of computer graphics research replicability. We tried to compile, execute and reproduce the results of these publications while keeping note of the procedure needed to make these codes work (including debug, code updates, etc...).

Featured Image

Why is it important?

The outcome of this vast analysis is a website gathering these observations, open to the research community to allow adding new contributions: https://replicability.graphics. We also observed a general trend towards improvement: researchers tend to share their code more over time. Researchers from Academia also tend to share more their source codes than researchers from Industry. Furthermore, publications with available codes are often more cited, with an increase of 56% in citations for 2014 publications.

Perspectives

We hope that this analysis will reinforce code sharing among the Computer Graphics community, but will also improve code sharing practices, to make released codes more usable. I also hope that the strong efforts we deployed will help to convince the Computer Graphics community to take ownership and contribute to our collaborative tool replicability.graphics.

Nicolas Mellado
Centre National de la Recherche Scientifique

Read the Original

This page is a summary of: Code replicability in computer graphics, ACM Transactions on Graphics, August 2020, ACM (Association for Computing Machinery),
DOI: 10.1145/3386569.3392413.
You can read the full text:

Read

Resources

Contributors

The following have contributed to this page