The dataset of a paper under review by ESEM'20

This is the experiment result of the paper under review by ESEM'20. The file ExecutionLogs.zip includes all execution logs based on different fault localization strategies that we take into consideration in the study. The file Exception_Statistics.xlsx includes the distributions of unique types of exceptions in our study. All logs are located in directories that are named with fault localization setting and the related automated program repair system name. Specifically, in the directories of ExecutionLogs there are four sub-directories: GZ-0.1,GZ-1.7,No_FL_Required, and Perfect_FL. GZ-0.1 means the normal fault localization setting with GZoltar-v0.1.1. From FSE'19 paper. GZ-1.7 means the normal fault localization setting with GZoltar-v1.7.2. From ICSE'20 paper. No_FL_Required means that the tool does not require fault localization. From FSE'19 paper Perfect_FL means that the fault localization setting is provided with the ground-truth bug positions. From ICSE'20 paper For example, the bug Chart-1's log generated by Cardumen with Gzoltar-0.1 are stored in the directory GZ-0.1/Chart/1/Cardumen/. In the file Exception_Statistics.xlsx, we show the detailed distribution of each exception in sheets. Format of the content: Fault_localization_strategy-project_id-version_id-tool_name Take Gz0.1-Chart-1-Cardumen as an example, this log generated by Cardumen on bug Chart-1 with fault localization by GZoltar-v0.1.1. About compliance level Take Gz0.1-Mockito-1-Cardumen's log as an example as follow. We can get the compliance level from parameter -javacompliancelevel. 4 corresponds to java 1.4, 5 corresponds to java 1.5 and so on. Hence, we can know what compliance level authors were used. time java -Xmx4048m -cp /home/tdurieux/RepairThemAll/script/../libs/jtestex7.jar:/home/tdurieux/RepairThemAll/script/../repair_tools/astor.jar fr.inria.main.evolution.AstorMain \ -mode cardumen \ -location . \ -id Chart-1 \ -failing org.jfree.chart.renderer.category.junit.AbstractCategoryItemRendererTests \ -jvm4testexecution /home/tdurieux/openjdk-1.7.0/bin/ \ -jvm4evosuitetestexecution /home/tdurieux/openjdk-1.7.0/bin/ \ -maxgen 1000000 \ -maxtime 120 \ -stopfirst true \ -seed 0 \ -scope local \ -population 1 \ -javacompliancelevel 4 \ ...... Regarding the serves In the end of log, it illustrates the brief information about the node. Hence, we can know which results are from the same node. ...... Node: suno-2.sophia.grid5000.fr Date: Fri Dec 28 21:21:00 EST 201