NEW The 15th GI workshop (event page) will take place at ICSE 2026.
Submission deadline: 27 October 2025 (Mon)
NEW Invitation to submit to the special issue on Genetic Improvement in the Automated Software Engineering Journal
Can you suggest good GI Benchmarks?
GI-improved test subjects with test cases:
- http://www0.cs.ucl.ac.uk/staff/ucacbbl/gismo/ (see Free Code heading)
- http://www.cs.ucl.ac.uk/staff/W.Langdon/gggp/#code (see Free Code heading)
- http://crest.cs.ucl.ac.uk/autotransplantation/downloads/artifact.html
(several frameworks also come with benchmarks, please see GI frameworks above)
Automated program repair, bug repositories:
- http://repairbenchmarks.cs.umass.edu/
- http://program-repair.org/benchmarks.html
- http://groups.csail.mit.edu/pac/patchgen/
Benchmarks identified at the Dagstuhl Seminar on Genetic Improvement of Software:
- Parsec: http://parsec.cs.princeton.edu/
- SPEC INT: https://www.spec.org/benchmarks.html
Additional benchmarks identified from the survey by Blot et al. on benchmarks for GI of non-functional properties. A more detailed overview is available at: benchmarks.
Search by benchmark name.
Query:
Showing 68 of 68 entries.
| Name | Link |
|---|---|
| ACLib | URL |
| AMD SDK | |
| Angha | URL |
| benchFFTW | URL |
| blas | |
| cBench | URL |
| CHAOS | |
| Chisel | URL |
| Coreutils | URL |
| CUDA SDK | |
| DaCapo | URL |
| DENBench | URL |
| Dhrystone | URL |
| DSPstone | |
| eispack | |
| F-Droid | |
| FDTD | URL |
| FMM | |
| Fontana | |
| GPGPU-Sim | URL |
| Grinder | |
| Habanero-Java | |
| hompack | URL |
| Honeywell | |
| Jade | |
| JavaBenchmarkEmbedded | |
| Java Grande | URL |
| JetStream | |
| JSTAMP | |
| Livermore Loops | |
| LoneStar | |
| Malardalen | |
| MediaBench | |
| MGMRES | URL |
| MiBench | URL |
| MPEG-1 | |
| MySQL | |
| NAS | |
| NERSC | |
| Nginx | |
| Nvidia SDK | |
| nwchem | |
| Octane | URL |
| Olden | URL |
| Parboil | URL |
| PARMS | |
| PeleC | |
| Perfect Club | |
| Perl Oasis | |
| PhysicsBench | |
| PolyBench | URL |
| Polyhedron | |
| RAJAPerf | URL |
| RawBench | |
| RiCeps | |
| Rodinia | |
| Scala DaCapo | |
| SHOC | URL |
| SIR | URL |
| SNU-RT | |
| SparseBench | URL |
| SPECjbb | |
| SPECjvm | URL |
| Spike | URL |
| SPLASH | URL |
| SunSpider | |
| UTDSP | URL |
| Wetstone |