Experimental Results: Enhancing Fault Localization in Programs by Integrating Constraint-Based and Model Checking Techniques with Spectrum-Based Methods

About the Author

Author: Mohammed BEKKOUCHE

Affiliation: Maître de conférence classe A à l'École Nationale Supérieure en Informatique de Sidi Bel Abbès, Algérie

Summary of Experiments

This page provides the source of the experimental results obtained by combining LocFaults with spectrum-based techniques to support our journal paper titled: 'Enhancing Fault Localization in Programs by Integrating Constraint-Based and Model Checking Techniques with Spectrum-Based Methods'.

Benchmark: Tritype

Program: Tritypev1

Faulty Program Source Code: Tritypev1.java

View Tritypev1 Source Code

Java Programs Used by LocFaults for Tritypev1

LocFaults Output for Tritypev1

Spectrum-Based Fault Localization for Tritypev1

Combined LocFaults with Spectrum-Based Fault Localization for Tritypev1

Program: Tritypev2

Faulty Program Source Code: Tritypev2.java

View Tritypev2 Source Code

Java Programs Used by LocFaults for Tritypev2

LocFaults Output for Tritypev2

Spectrum-Based Fault Localization for Tritypev2

Combined LocFaults with Spectrum-Based Fault Localization for Tritypev2

Program: Tritypev3

Faulty Program Source Code: Tritypev3.java

View Tritypev3 Source Code

Java Programs Used by LocFaults for Tritypev3

LocFaults Output for Tritypev3

Spectrum-Based Fault Localization for Tritypev3

Combined LocFaults with Spectrum-Based Fault Localization for Tritypev3

Program: Tritypev4

Faulty Program Source Code: Tritypev4.java

View Tritypev4 Source Code

Java Programs Used by LocFaults for Tritypev4

LocFaults Output for Tritypev4

Spectrum-Based Fault Localization for Tritypev4

Combined LocFaults with Spectrum-Based Fault Localization for Tritypev4

Program: TriPerimetrev1

Faulty Program Source Code: TriPerimetrev1.java

View TriPerimetrev1 Source Code

Java Programs Used by LocFaults for TriPerimetrev1

LocFaults Output for TriPerimetrev1

Spectrum-Based Fault Localization for TriPerimetrev1

Combined LocFaults with Spectrum-Based Fault Localization for TriPerimetrev1

Program: TriPerimetrev2

Faulty Program Source Code: TriPerimetrev2.java

View TriPerimetrev2 Source Code

Java Programs Used by LocFaults for TriPerimetrev2

LocFaults Output for TriPerimetrev2

Spectrum-Based Fault Localization for TriPerimetrev2

Combined LocFaults with Spectrum-Based Fault Localization for TriPerimetrev2

Program: TriPerimetrev3

Faulty Program Source Code: TriPerimetrev3.java

View TriPerimetrev3 Source Code

Java Programs Used by LocFaults for TriPerimetrev3

LocFaults Output for TriPerimetrev3

Spectrum-Based Fault Localization for TriPerimetrev3

Combined LocFaults with Spectrum-Based Fault Localization for TriPerimetrev3

Program: TriPerimetrev4

Faulty Program Source Code: TriPerimetrev4.java

View TriPerimetrev4 Source Code

Java Programs Used by LocFaults for TriPerimetrev4

LocFaults Output for TriPerimetrev4

Spectrum-Based Fault Localization for TriPerimetrev4

Combined LocFaults with Spectrum-Based Fault Localization for TriPerimetrev4

Program: TriMultPerimetrev1

Faulty Program Source Code: TriMultPerimetrev1.java

View TriMultPerimetrev1 Source Code

Java Programs Used by LocFaults for TriMultPerimetrev1

LocFaults Output for TriMultPerimetrev1

Spectrum-Based Fault Localization for TriMultPerimetrev1

Combined LocFaults with Spectrum-Based Fault Localization for TriMultPerimetrev1

Program: TriMultPerimetrev2

Faulty Program Source Code: TriMultPerimetrev2.java

View TriMultPerimetrev2 Source Code

Java Programs Used by LocFaults for TriMultPerimetrev2

LocFaults Output for TriMultPerimetrev2

Spectrum-Based Fault Localization for TriMultPerimetrev2

Combined LocFaults with Spectrum-Based Fault Localization for TriMultPerimetrev2

Program: Heronv1

Faulty Program Source Code: Heronv1.java

View Heronv1 Source Code

Java Programs Used by LocFaults for Heronv1

LocFaults Output for Heronv1

Spectrum-Based Fault Localization for Heronv1

Combined LocFaults with Spectrum-Based Fault Localization for Heronv1

Program: Heronv2

Faulty Program Source Code: Heronv2.java

View Heronv2 Source Code

Java Programs Used by LocFaults for Heronv2

LocFaults Output for Heronv2

Spectrum-Based Fault Localization for Heronv2

Combined LocFaults with Spectrum-Based Fault Localization for Heronv2

Program: Heronv3

Faulty Program Source Code: Heronv3.java

View Heronv3 Source Code

Java Programs Used by LocFaults for Heronv3

LocFaults Output for Heronv3

Spectrum-Based Fault Localization for Heronv3

Combined LocFaults with Spectrum-Based Fault Localization for Heronv3

Program: Heronv4

Faulty Program Source Code: Heronv4.java

View Heronv4 Source Code

Java Programs Used by LocFaults for Heronv4

LocFaults Output for Heronv4

Spectrum-Based Fault Localization for Heronv4

Combined LocFaults with Spectrum-Based Fault Localization for Heronv4

Program: Heronv5

Faulty Program Source Code: Heronv5.java

View Heronv5 Source Code

Java Programs Used by LocFaults for Heronv5

LocFaults Output for Heronv5

Spectrum-Based Fault Localization for Heronv5

Combined LocFaults with Spectrum-Based Fault Localization for Heronv5

Program: Heronv6

Faulty Program Source Code: Heronv6.java

View Heronv6 Source Code

Java Programs Used by LocFaults for Heronv6

LocFaults Output for Heronv6

Spectrum-Based Fault Localization for Heronv6

Combined LocFaults with Spectrum-Based Fault Localization for Heronv6

Benchmark: Tcas

Program: Tcasv1

Faulty Program Source Code: Tcasv1.java

View Tcasv1 Source Code

Java Programs Used by LocFaults for Tcasv1

LocFaults Output for Tcasv1

Spectrum-Based Fault Localization for Tcasv1

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv1

Program: Tcasv2

Faulty Program Source Code: Tcasv2.java

View Tcasv2 Source Code

Java Programs Used by LocFaults for Tcasv2

LocFaults Output for Tcasv2

Spectrum-Based Fault Localization for Tcasv2

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv2

Program: Tcasv3

Faulty Program Source Code: Tcasv3.java

View Tcasv3 Source Code

Java Programs Used by LocFaults for Tcasv3

LocFaults Output for Tcasv3

Spectrum-Based Fault Localization for Tcasv3

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv3

Program: Tcasv4

Faulty Program Source Code: Tcasv4.java

View Tcasv4 Source Code

Java Programs Used by LocFaults for Tcasv4

LocFaults Output for Tcasv4

Spectrum-Based Fault Localization for Tcasv4

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv4

Program: Tcasv5

Faulty Program Source Code: Tcasv5.java

View Tcasv5 Source Code

Java Programs Used by LocFaults for Tcasv5

LocFaults Output for Tcasv5

Spectrum-Based Fault Localization for Tcasv5

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv5

Program: Tcasv6

Faulty Program Source Code: Tcasv6.java

View Tcasv6 Source Code

Java Programs Used by LocFaults for Tcasv6

LocFaults Output for Tcasv6

Spectrum-Based Fault Localization for Tcasv6

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv6

Program: Tcasv7

Faulty Program Source Code: Tcasv7.java

View Tcasv7 Source Code

Java Programs Used by LocFaults for Tcasv7

LocFaults Output for Tcasv7

Spectrum-Based Fault Localization for Tcasv7

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv7

Program: Tcasv8

Faulty Program Source Code: Tcasv8.java

View Tcasv8 Source Code

Java Programs Used by LocFaults for Tcasv8

LocFaults Output for Tcasv8

Spectrum-Based Fault Localization for Tcasv8

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv8

Program: Tcasv9

Faulty Program Source Code: Tcasv9.java

View Tcasv9 Source Code

Java Programs Used by LocFaults for Tcasv9

LocFaults Output for Tcasv9

Spectrum-Based Fault Localization for Tcasv9

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv9

Program: Tcasv10

Faulty Program Source Code: Tcasv10.java

View Tcasv10 Source Code

Java Programs Used by LocFaults for Tcasv10

LocFaults Output for Tcasv10

Spectrum-Based Fault Localization for Tcasv10

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv10

Program: Tcasv11

Faulty Program Source Code: Tcasv11.java

View Tcasv11 Source Code

Java Programs Used by LocFaults for Tcasv11

LocFaults Output for Tcasv11

Spectrum-Based Fault Localization for Tcasv11

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv11

Program: Tcasv12

Faulty Program Source Code: Tcasv12.java

View Tcasv12 Source Code

Java Programs Used by LocFaults for Tcasv12

LocFaults Output for Tcasv12

Spectrum-Based Fault Localization for Tcasv12

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv12

Program: Tcasv13

Faulty Program Source Code: Tcasv13.java

View Tcasv13 Source Code

Java Programs Used by LocFaults for Tcasv13

LocFaults Output for Tcasv13

Spectrum-Based Fault Localization for Tcasv13

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv13

Program: Tcasv14

Faulty Program Source Code: Tcasv14.java

View Tcasv14 Source Code

Java Programs Used by LocFaults for Tcasv14

LocFaults Output for Tcasv14

Spectrum-Based Fault Localization for Tcasv14

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv14

Program: Tcasv15

Faulty Program Source Code: Tcasv15.java

View Tcasv15 Source Code

Java Programs Used by LocFaults for Tcasv15

LocFaults Output for Tcasv15

Spectrum-Based Fault Localization for Tcasv15

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv15

Program: Tcasv16

Faulty Program Source Code: Tcasv16.java

View Tcasv16 Source Code

Java Programs Used by LocFaults for Tcasv16

LocFaults Output for Tcasv16

Spectrum-Based Fault Localization for Tcasv16

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv16

Program: Tcasv17

Faulty Program Source Code: Tcasv17.java

View Tcasv17 Source Code

Java Programs Used by LocFaults for Tcasv17

LocFaults Output for Tcasv17

Spectrum-Based Fault Localization for Tcasv17

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv17

Program: Tcasv18

Faulty Program Source Code: Tcasv18.java

View Tcasv18 Source Code

Java Programs Used by LocFaults for Tcasv18

LocFaults Output for Tcasv18

Spectrum-Based Fault Localization for Tcasv18

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv18

Program: Tcasv19

Faulty Program Source Code: Tcasv19.java

View Tcasv19 Source Code

Java Programs Used by LocFaults for Tcasv19

LocFaults Output for Tcasv19

Spectrum-Based Fault Localization for Tcasv19

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv19

Program: Tcasv20

Faulty Program Source Code: Tcasv20.java

View Tcasv20 Source Code

Java Programs Used by LocFaults for Tcasv20

LocFaults Output for Tcasv20

Spectrum-Based Fault Localization for Tcasv20

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv20

Program: Tcasv21

Faulty Program Source Code: Tcasv21.java

View Tcasv21 Source Code

Java Programs Used by LocFaults for Tcasv21

LocFaults Output for Tcasv21

Spectrum-Based Fault Localization for Tcasv21

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv21

Program: Tcasv22

Faulty Program Source Code: Tcasv22.java

View Tcasv22 Source Code

Java Programs Used by LocFaults for Tcasv22

LocFaults Output for Tcasv22

Spectrum-Based Fault Localization for Tcasv22

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv22

Program: Tcasv23

Faulty Program Source Code: Tcasv23.java

View Tcasv23 Source Code

Java Programs Used by LocFaults for Tcasv23

LocFaults Output for Tcasv23

Spectrum-Based Fault Localization for Tcasv23

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv23

Program: Tcasv24

Faulty Program Source Code: Tcasv24.java

View Tcasv24 Source Code

Java Programs Used by LocFaults for Tcasv24

LocFaults Output for Tcasv24

Spectrum-Based Fault Localization for Tcasv24

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv24

Program: Tcasv25

Faulty Program Source Code: Tcasv25.java

View Tcasv25 Source Code

Java Programs Used by LocFaults for Tcasv25

LocFaults Output for Tcasv25

Spectrum-Based Fault Localization for Tcasv25

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv25

Program: Tcasv26

Faulty Program Source Code: Tcasv26.java

View Tcasv26 Source Code

Java Programs Used by LocFaults for Tcasv26

LocFaults Output for Tcasv26

Spectrum-Based Fault Localization for Tcasv26

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv26

Program: Tcasv27

Faulty Program Source Code: Tcasv27.java

View Tcasv27 Source Code

Java Programs Used by LocFaults for Tcasv27

LocFaults Output for Tcasv27

Spectrum-Based Fault Localization for Tcasv27

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv27

Program: Tcasv28

Faulty Program Source Code: Tcasv28.java

View Tcasv28 Source Code

Java Programs Used by LocFaults for Tcasv28

LocFaults Output for Tcasv28

Spectrum-Based Fault Localization for Tcasv28

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv28

Program: Tcasv29

Faulty Program Source Code: Tcasv29.java

View Tcasv29 Source Code

Java Programs Used by LocFaults for Tcasv29

LocFaults Output for Tcasv29

Spectrum-Based Fault Localization for Tcasv29

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv29

Program: Tcasv30

Faulty Program Source Code: Tcasv30.java

View Tcasv30 Source Code

Java Programs Used by LocFaults for Tcasv30

LocFaults Output for Tcasv30

Spectrum-Based Fault Localization for Tcasv30

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv30

Program: Tcasv31

Faulty Program Source Code: Tcasv31.java

View Tcasv31 Source Code

Java Programs Used by LocFaults for Tcasv31

LocFaults Output for Tcasv31

Spectrum-Based Fault Localization for Tcasv31

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv31

Program: Tcasv32

Faulty Program Source Code: Tcasv32.java

View Tcasv32 Source Code

Java Programs Used by LocFaults for Tcasv32

LocFaults Output for Tcasv32

Spectrum-Based Fault Localization for Tcasv32

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv32

Program: Tcasv34

Faulty Program Source Code: Tcasv34.java

View Tcasv34 Source Code

Java Programs Used by LocFaults for Tcasv34

LocFaults Output for Tcasv34

Spectrum-Based Fault Localization for Tcasv34

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv34

Program: Tcasv35

Faulty Program Source Code: Tcasv35.java

View Tcasv35 Source Code

Java Programs Used by LocFaults for Tcasv35

LocFaults Output for Tcasv35

Spectrum-Based Fault Localization for Tcasv35

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv35

Program: Tcasv36

Faulty Program Source Code: Tcasv36.java

View Tcasv36 Source Code

Java Programs Used by LocFaults for Tcasv36

LocFaults Output for Tcasv36

Spectrum-Based Fault Localization for Tcasv36

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv36

Program: Tcasv37

Faulty Program Source Code: Tcasv37.java

View Tcasv37 Source Code

Java Programs Used by LocFaults for Tcasv37

LocFaults Output for Tcasv37

Spectrum-Based Fault Localization for Tcasv37

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv37

Program: Tcasv39

Faulty Program Source Code: Tcasv39.java

View Tcasv39 Source Code

Java Programs Used by LocFaults for Tcasv39

LocFaults Output for Tcasv39

Spectrum-Based Fault Localization for Tcasv39

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv39

Program: Tcasv40

Faulty Program Source Code: Tcasv40.java

View Tcasv40 Source Code

Java Programs Used by LocFaults for Tcasv40

LocFaults Output for Tcasv40

Spectrum-Based Fault Localization for Tcasv40

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv40

Program: Tcasv41

Faulty Program Source Code: Tcasv41.java

View Tcasv41 Source Code

Java Programs Used by LocFaults for Tcasv41

LocFaults Output for Tcasv41

Spectrum-Based Fault Localization for Tcasv41

Combined LocFaults with Spectrum-Based Fault Localization for Tcasv41

Benchmark: BubbleSort

Program: BubbleSort

Faulty Program Source Code: BubbleSort.java

View BubbleSort Source Code

Java Programs Used by LocFaults for BubbleSort

LocFaults Output for BubbleSort

Some Detailed Results

This section presents detailed experimental results through selected tables and a graph.

Results Table

Average percentage improvement of our approach LocFaults+SBFL over pure SBFL techniques on the Tritype benchmark.

Technique Metric Performance
LocFaults+Ochiai over Ochiai Average Percentage Improvement 22.50%
LocFaults+Tarantula over Tarantula Average Percentage Improvement 8.83%
LocFaults+Jaccard over Jaccard Average Percentage Improvement 10.22%
LocFaults+Zoltar over Zoltar Average Percentage Improvement 34.73%

Average percentage improvement of our approach LocFaults+SBFL over pure SBFL techniques on the TCAS benchmark.

Technique Metric Performance
LocFaults+Ochiai over Ochiai Average Percentage Improvement 47.25%
LocFaults+Tarantula over Tarantula Average Percentage Improvement 56.47%
LocFaults+Jaccard over Jaccard Average Percentage Improvement 53.10%
LocFaults+Zoltar over Zoltar Average Percentage Improvement 36.36%

Exploration of the Scalability in Computation Time of MCSs and IISs in LocFaults for BubbleSort Benchmark.