QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family CounterFactual solved by
sKizzo-0.9-std
QBFEVAL'06
Instance
Result
Time
ncf_4_16_4_edau.8
SAT
0
ncf_4_16_2_d.2
SAT
0
ncf_4_8_8_d.9
UNSAT
0
ncf_4_16_2_edau.6
SAT
0
ncf_4_8_4_euad.9
SAT
0
ncf_8_16_4_d.4
SAT
0
ncf_4_16_4_d.5
SAT
0
ncf_8_16_4_edau.10
SAT
0
ncf_8_16_4_euad.1
SAT
0
ncf_4_16_4_d.1
SAT
0
ncf_4_16_2_edau.2
SAT
0
ncf_8_16_4_u.1
SAT
0
ncf_4_8_4_u.9
SAT
0
ncf_8_16_4_edau.1
SAT
0
ncf_4_16_4_edau.5
SAT
0.01
ncf_8_16_4_edau.5
UNSAT
0.01
ncf_16_32_4_edau.8
SAT
0.01
ncf_4_16_2_d.6
SAT
0.01
ncf_4_8_8_euad.9
UNSAT
0.01
ncf_4_8_8_d.1
SAT
0.01
ncf_8_16_4_euad.5
UNSAT
0.01
ncf_4_8_8_edau.8
SAT
0.01
ncf_4_8_8_edau.9
UNSAT
0.01
ncf_4_8_8_edau.1
SAT
0.01
ncf_8_16_4_edau.4
SAT
0.01
ncf_4_16_4_d.8
SAT
0.01
ncf_8_16_4_d.1
SAT
0.01
ncf_8_16_4_d.10
SAT
0.01
ncf_4_8_8_edau.3
SAT
0.01
ncf_16_32_4_edau.9
SAT
0.01
ncf_16_32_4_d.9
SAT
0.01
ncf_16_32_4_edau.3
SAT
0.01
ncf_16_32_2_edau.6
SAT
0.01
ncf_4_16_2_d.4
SAT
0.01
ncf_4_8_8_u.9
UNSAT
0.01
ncf_4_8_8_d.8
SAT
0.02
ncf_4_16_8_d.7
SAT
0.02
ncf_4_8_8_d.3
SAT
0.02
ncf_4_8_2_u.4
UNSAT
0.02
ncf_4_8_2_u.10
SAT
0.02
ncf_16_32_4_d.2
SAT
0.02
ncf_4_16_2_edau.4
SAT
0.02
ncf_16_32_4_d.8
SAT
0.02
ncf_16_32_2_d.6
SAT
0.02
ncf_16_32_4_edau.2
SAT
0.02
ncf_4_16_4_edau.1
SAT
0.02
ncf_16_32_2_edau.7
UNSAT
0.03
ncf_16_32_4_d.3
SAT
0.03
ncf_4_8_2_euad.4
UNSAT
0.03
ncf_8_16_4_euad.2
UNSAT
0.03
ncf_4_8_2_euad.10
SAT
0.03
ncf_8_16_4_u.5
UNSAT
0.03
ncf_16_32_2_d.7
UNSAT
0.03
ncf_8_16_4_d.5
UNSAT
0.04
ncf_4_8_2_u.7
UNSAT
0.04
ncf_16_32_8_edau.3
SAT
0.04
ncf_4_8_8_d.5
UNSAT
0.04
ncf_16_32_8_d.3
SAT
0.04
ncf_8_16_4_d.2
UNSAT
0.04
ncf_4_8_8_edau.5
UNSAT
0.04
ncf_4_8_2_euad.5
SAT
0.04
ncf_8_16_4_edau.8
UNSAT
0.04
ncf_4_8_2_euad.7
UNSAT
0.05
ncf_4_8_2_euad.8
SAT
0.05
ncf_8_16_4_d.8
UNSAT
0.05
ncf_8_16_4_u.2
UNSAT
0.05
ncf_4_8_2_u.9
SAT
0.05
ncf_4_8_2_u.1
UNSAT
0.05
ncf_4_8_2_u.5
SAT
0.05
ncf_4_8_2_euad.1
UNSAT
0.05
ncf_4_16_2_euad.6
SAT
0.06
ncf_4_8_2_u.6
SAT
0.06
ncf_4_16_2_u.6
SAT
0.06
ncf_4_8_2_euad.6
SAT
0.06
ncf_8_16_4_edau.2
UNSAT
0.06
ncf_4_8_2_u.8
SAT
0.07
ncf_4_8_2_u.2
SAT
0.07
ncf_4_8_2_euad.2
SAT
0.07
ncf_4_8_2_euad.9
SAT
0.08
ncf_4_16_2_edau.7
SAT
0.08
ncf_4_16_2_u.9
SAT
0.09
ncf_4_16_2_d.7
SAT
0.09
ncf_4_16_2_euad.9
SAT
0.11
ncf_4_16_2_d.9
SAT
0.12
ncf_4_16_2_edau.9
SAT
0.12
ncf_4_16_2_u.2
SAT
0.13
ncf_4_16_2_u.4
SAT
0.15
ncf_4_16_2_euad.2
SAT
0.15
ncf_16_32_4_edau.5
UNSAT
0.15
ncf_16_32_4_d.5
UNSAT
0.16
ncf_4_16_2_euad.4
SAT
0.16
ncf_4_8_4_u.2
UNSAT
0.17
ncf_8_16_4_d.6
UNSAT
0.18
ncf_4_16_4_u.5
SAT
0.19
ncf_8_16_4_edau.6
UNSAT
0.19
ncf_4_8_4_euad.5
SAT
0.23
ncf_4_8_2_u.3
UNSAT
0.23
ncf_4_16_4_euad.5
SAT
0.23
ncf_4_8_4_euad.2
UNSAT
0.23
ncf_4_8_2_euad.3
UNSAT
0.23
ncf_4_8_4_u.5
SAT
0.25
ncf_16_32_4_edau.10
UNSAT
0.26
ncf_16_32_4_d.10
UNSAT
0.27
ncf_4_16_2_d.5
UNSAT
0.28
ncf_16_32_2_u.9
UNSAT
0.28
ncf_16_32_2_edau.9
UNSAT
0.29
ncf_4_16_2_edau.5
UNSAT
0.29
ncf_4_8_4_u.6
SAT
0.32
ncf_4_8_8_d.4
SAT
0.32
ncf_4_8_4_euad.6
SAT
0.32
ncf_4_16_4_edau.9
SAT
0.34
ncf_4_16_4_euad.9
SAT
0.36
ncf_4_8_8_edau.4
SAT
0.37
ncf_4_16_2_edau.1
UNSAT
0.38
ncf_4_16_4_d.9
SAT
0.39
ncf_16_32_2_euad.9
UNSAT
0.39
ncf_16_32_2_d.9
UNSAT
0.39
ncf_16_32_2_d.8
UNSAT
0.39
ncf_4_16_2_u.7
SAT
0.44
ncf_4_16_4_u.9
SAT
0.44
ncf_4_8_4_euad.7
UNSAT
0.44
ncf_4_8_8_euad.1
SAT
0.46
ncf_4_8_8_u.1
SAT
0.46
ncf_4_16_4_u.1
SAT
0.46
ncf_4_16_4_euad.1
SAT
0.47
ncf_4_8_4_euad.10
SAT
0.47
ncf_4_16_2_d.1
UNSAT
0.47
ncf_4_16_2_euad.7
SAT
0.48
ncf_4_8_4_u.7
UNSAT
0.48
ncf_4_16_2_d.8
SAT
0.5
ncf_4_16_2_edau.8
SAT
0.5
ncf_16_32_2_edau.8
UNSAT
0.51
ncf_4_8_4_u.10
SAT
0.53
ncf_4_8_8_u.3
SAT
0.54
ncf_4_8_4_euad.3
UNSAT
0.57
ncf_4_8_4_u.3
UNSAT
0.61
ncf_4_8_4_u.8
UNSAT
0.66
ncf_4_8_8_euad.3
SAT
0.67
ncf_4_8_4_euad.8
UNSAT
0.7
ncf_4_16_4_euad.8
SAT
0.76
ncf_4_8_4_euad.4
UNSAT
0.83
ncf_4_16_4_u.8
SAT
0.84
ncf_16_32_2_u.7
UNSAT
0.88
ncf_4_16_2_d.10
UNSAT
0.89
ncf_4_16_2_edau.10
UNSAT
0.97
ncf_4_8_4_u.4
UNSAT
1.02
ncf_16_32_4_d.7
UNSAT
1.09
ncf_16_32_8_edau.8
UNSAT
1.09
ncf_8_16_4_u.6
UNSAT
1.12
ncf_16_32_8_d.8
UNSAT
1.18
ncf_16_32_4_edau.7
UNSAT
1.22
ncf_16_32_2_euad.7
UNSAT
1.28
ncf_8_16_4_euad.6
UNSAT
1.42
ncf_4_16_2_euad.10
UNSAT
1.87
ncf_4_16_2_u.10
UNSAT
1.93
ncf_4_8_8_u.5
UNSAT
2.24
ncf_4_16_2_u.8
SAT
2.33
ncf_4_8_4_euad.1
SAT
2.37
ncf_4_8_4_u.1
SAT
2.45
ncf_4_8_8_euad.5
UNSAT
2.47
ncf_4_32_2_edau.1
UNSAT
2.6
ncf_4_16_2_euad.8
SAT
2.69
ncf_8_16_4_d.3
SAT
4.24
ncf_4_16_2_u.5
UNSAT
5.48
ncf_8_16_4_edau.3
SAT
5.67
ncf_4_16_2_euad.5
UNSAT
6.48
ncf_4_32_2_edau.2
SAT
6.6
ncf_4_8_8_euad.4
SAT
7.11
ncf_4_16_4_edau.4
UNSAT
10.91
ncf_4_16_4_d.4
UNSAT
11.71
ncf_8_16_4_u.8
UNSAT
12.81
ncf_4_8_8_u.4
SAT
14.89
ncf_4_32_2_u.1
UNSAT
15.92
ncf_8_16_8_euad.1
SAT
16.61
ncf_8_16_8_d.1
SAT
16.63
ncf_4_16_4_d.7
SAT
16.65
ncf_8_16_8_d.7
UNSAT
18.2
ncf_4_16_4_edau.7
SAT
24.6
ncf_8_16_8_edau.7
UNSAT
25.58
ncf_8_16_4_euad.8
UNSAT
29.12
ncf_16_32_2_d.5
UNSAT
36.79
ncf_16_32_2_d.2
UNSAT
39.03
ncf_4_16_4_u.7
SAT
50.79
ncf_4_16_4_d.10
UNSAT
52.91
ncf_16_32_2_edau.5
UNSAT
62.95
ncf_4_32_2_u.2
SAT
63.12
ncf_4_16_2_u.1
UNSAT
67.44
ncf_4_8_8_d.2
UNSAT
69.83
ncf_4_16_4_euad.7
SAT
79.06
ncf_4_16_2_euad.1
UNSAT
80
ncf_4_16_4_edau.2
SAT
80.25
ncf_16_32_2_edau.2
UNSAT
102.35
ncf_4_16_4_u.10
UNSAT
124.72
ncf_4_8_8_u.8
FAIL
140.03
ncf_4_8_8_edau.2
UNSAT
151.45
ncf_4_8_8_euad.8
FAIL
152.75
ncf_4_16_4_euad.10
UNSAT
170.75
ncf_4_16_4_edau.10
UNSAT
173.71
ncf_4_16_2_edau.3
UNSAT
197.85
ncf_8_16_8_edau.1
SAT
200.17
ncf_4_16_4_euad.6
UNSAT
236.54
ncf_4_16_4_d.3
SAT
278.29
ncf_4_16_4_edau.3
FAIL
293.09
ncf_4_32_2_u.8
FAIL
379.21
ncf_4_32_2_edau.3
UNSAT
407.11
ncf_8_16_8_d.9
UNSAT
435.64
ncf_4_8_8_euad.2
UNSAT
440.52
ncf_4_32_2_edau.8
FAIL
451.49
ncf_4_16_4_d.2
SAT
470.48
ncf_4_16_2_d.3
UNSAT
485.01
ncf_4_16_4_u.2
FAIL
492.87
ncf_4_16_8_d.8
UNSAT
521.86
ncf_8_16_8_edau.6
UNSAT
532.26
ncf_4_16_8_u.7
FAIL
541.35
ncf_4_16_4_u.6
UNSAT
545.05
ncf_4_16_2_u.3
UNSAT
551.04
ncf_4_16_2_euad.3
FAIL
581.4
ncf_16_32_4_euad.5
FAIL
600.89
ncf_8_16_8_euad.7
UNSAT
610.01
ncf_4_16_4_euad.3
FAIL
619.43
ncf_4_8_8_d.7
SAT
659.66
ncf_4_16_4_edau.6
UNSAT
732.46
ncf_4_16_8_euad.7
FAIL
734.87
ncf_4_8_8_edau.7
SAT
770.6
ncf_8_16_4_u.10
FAIL
806.54
ncf_4_8_8_euad.10
FAIL
812.7
ncf_4_8_8_edau.10
FAIL
837.34
ncf_8_16_4_euad.10
FAIL
1049.45
ncf_4_32_2_edau.9
UNSAT
1049.45
ncf_4_32_2_u.3
UNSAT
1171.36
ncf_4_32_2_edau.7
SAT
1187.52
ncf_4_8_8_edau.6
FAIL
1216.79
ncf_4_8_8_d.10
SAT
1234.65
ncf_8_16_4_d.7
FAIL
1276.17
ncf_4_32_2_u.4
UNSAT
1277.56
ncf_4_8_8_d.6
FAIL
1278.93
ncf_4_16_4_euad.2
FAIL
1427
ncf_4_16_4_u.4
FAIL
1427.86
ncf_4_16_4_u.3
FAIL
1463.09
ncf_16_32_4_euad.8
FAIL
1489.66
ncf_4_8_8_u.2
UNSAT
1510.77
ncf_8_16_8_edau.9
UNSAT
1520.58
ncf_4_32_2_u.7
FAIL
1557.29
ncf_4_16_4_euad.4
FAIL
1727.93
ncf_16_32_4_euad.1
FAIL
1817.53
ncf_4_8_8_u.7
FAIL
1829.92
ncf_16_32_4_u.8
FAIL
1961.25
ncf_4_32_2_edau.4
UNSAT
1997.28
ncf_8_16_4_u.3
FAIL
2091.71
ncf_8_16_4_edau.9
UNSAT
2146.97
ncf_16_32_4_u.9
FAIL
2206.14
ncf_4_8_8_u.10
FAIL
2299.93
ncf_8_16_4_u.7
FAIL
2451.44
ncf_16_32_4_euad.7
FAIL
2478.68
ncf_4_8_8_euad.7
FAIL
2569.23
ncf_16_32_2_d.10
FAIL
2645.93
ncf_16_32_4_edau.4
FAIL
2663.89
ncf_4_16_8_u.10
FAIL
2776.79
ncf_16_32_4_u.2
FAIL
2918.12
ncf_8_16_8_euad.8
FAIL
2944.45
ncf_16_32_4_u.1
FAIL
2946.84
ncf_4_16_4_d.6
UNSAT
3033.52
ncf_8_16_8_euad.4
FAIL
3182.25
ncf_4_8_8_euad.6
FAIL
3198.14
ncf_8_16_8_edau.10
FAIL
3288.51
ncf_16_32_4_euad.6
FAIL
3438.88
ncf_4_16_8_euad.9
FAIL
3511.04
ncf_4_32_2_u.6
FAIL
3511.4
ncf_4_8_8_u.6
FAIL
3551.49
ncf_8_16_4_euad.7
FAIL
3698.43
ncf_4_16_8_euad.4
FAIL
3847.8
ncf_8_16_8_edau.3
FAIL
3856.02
ncf_16_32_8_d.7
FAIL
3862.48
ncf_8_16_4_d.9
UNSAT
4130.61
ncf_16_32_2_u.10
FAIL
4205.56
ncf_16_32_8_u.1
FAIL
4391.83
ncf_4_16_8_d.9
FAIL
4567.16
ncf_8_16_4_euad.3
FAIL
4642.17
ncf_16_32_2_euad.2
FAIL
4779.81
ncf_4_32_2_u.9
FAIL
4863.6
ncf_8_16_8_edau.2
FAIL
5038.18
ncf_4_32_2_edau.6
FAIL
5207.68
ncf_8_16_8_d.3
FAIL
5232.71
ncf_8_16_8_d.6
UNSAT
5313.89
ncf_16_32_8_edau.9
FAIL
5465.66
ncf_4_16_8_u.3
FAIL
5575.53
ncf_16_32_8_edau.1
FAIL
5662.07
ncf_16_32_8_d.4
FAIL
5686.21
ncf_16_32_8_euad.1
FAIL
5739.71
ncf_4_16_8_u.9
FAIL
5923.88
ncf_16_32_8_euad.2
FAIL
5937.88
ncf_16_32_8_u.4
FAIL
5952.85
ncf_4_16_8_u.4
FAIL
5997.03
ncf_16_32_2_euad.6
FAIL
5998.1
ncf_4_32_2_u.5
FAIL
5999.53
ncf_16_32_8_euad.5
FAIL
5999.86
ncf_16_32_2_u.6
FAIL
5999.88
ncf_16_32_4_euad.3
FAIL
6000.03
ncf_16_32_2_euad.4
FAIL
6000.04
ncf_16_32_8_u.5
FAIL
6000.05
ncf_16_32_4_euad.9
FAIL
6000.05
ncf_16_32_8_d.1
FAIL
6000.15
ncf_8_16_8_d.10
FAIL
6000.18
ncf_16_32_8_d.2
FAIL
6000.2
ncf_8_16_8_euad.10
FAIL
6000.21
ncf_16_32_8_euad.8
FAIL
6000.21
ncf_16_32_2_d.4
FAIL
6000.21
ncf_16_32_2_u.4
FAIL
6000.24
ncf_16_32_8_u.7
FAIL
6000.24
ncf_16_32_8_euad.7
FAIL
6000.25
ncf_16_32_8_u.10
FAIL
6000.28
ncf_16_32_4_edau.1
FAIL
6000.28
ncf_16_32_2_euad.10
FAIL
6000.28
ncf_8_16_4_edau.7
FAIL
6000.28
ncf_4_16_8_euad.3
FAIL
6000.32
ncf_8_16_8_euad.5
FAIL
6000.32
ncf_4_16_8_euad.10
FAIL
6000.34
ncf_4_16_8_u.5
FAIL
6000.34
ncf_4_16_8_euad.6
FAIL
6000.35
ncf_4_16_8_u.6
FAIL
6000.36
ncf_16_32_8_euad.4
FAIL
6000.37
ncf_8_16_8_edau.4
FAIL
6000.37
ncf_16_32_2_edau.10
FAIL
6000.37
ncf_16_32_8_u.2
FAIL
6000.38
ncf_8_16_8_d.4
FAIL
6000.39
ncf_16_32_8_u.6
FAIL
6000.4
ncf_16_32_2_edau.4
FAIL
6000.42
ncf_4_16_8_d.4
FAIL
6000.42
ncf_8_16_4_u.4
FAIL
6000.43
ncf_4_16_8_euad.5
FAIL
6000.44
ncf_16_32_8_d.10
FAIL
6000.46
ncf_16_32_8_edau.2
FAIL
6000.48
ncf_16_32_8_d.5
FAIL
6000.48
ncf_8_16_8_edau.5
FAIL
6000.51
ncf_4_16_8_d.5
FAIL
6000.51
ncf_16_32_8_edau.6
FAIL
6000.52
ncf_16_32_8_euad.6
FAIL
6000.52
ncf_16_32_4_u.5
FAIL
6000.52
ncf_16_32_8_edau.4
FAIL
6000.53
ncf_16_32_2_d.1
FAIL
6000.53
ncf_4_16_8_euad.2
FAIL
6000.54
ncf_16_32_4_euad.4
FAIL
6000.54
ncf_16_32_2_euad.5
FAIL
6000.55
ncf_16_32_8_euad.9
FAIL
6000.55
ncf_16_32_4_edau.6
FAIL
6000.56
ncf_16_32_4_d.4
FAIL
6000.56
ncf_16_32_2_u.3
FAIL
6000.56
ncf_16_32_4_u.7
FAIL
6000.56
ncf_16_32_4_u.3
FAIL
6000.56
ncf_16_32_4_u.4
FAIL
6000.57
ncf_8_16_8_euad.3
FAIL
6000.58
ncf_16_32_8_edau.7
FAIL
6000.58
ncf_16_32_8_d.9
FAIL
6000.58
ncf_16_32_8_edau.5
FAIL
6000.59
ncf_4_32_2_edau.5
FAIL
6000.59
ncf_16_32_8_d.6
FAIL
6000.59
ncf_8_16_8_d.5
FAIL
6000.6
ncf_16_32_8_euad.10
FAIL
6000.6
ncf_4_16_8_d.6
FAIL
6000.63
ncf_16_32_2_u.2
FAIL
6000.64
ncf_16_32_4_u.6
FAIL
6000.65
ncf_16_32_8_u.8
FAIL
6000.67
ncf_8_16_8_d.8
FAIL
6000.67
ncf_16_32_8_euad.3
FAIL
6000.67
ncf_4_16_8_euad.1
FAIL
6000.67
ncf_4_16_8_d.2
FAIL
6000.68
ncf_4_16_8_d.10
FAIL
6000.68
ncf_8_16_8_euad.2
FAIL
6000.68
ncf_16_32_2_euad.1
FAIL
6000.68
ncf_16_32_4_euad.2
FAIL
6000.69
ncf_16_32_2_d.3
FAIL
6000.69
ncf_16_32_2_u.5
FAIL
6000.69
ncf_16_32_4_d.1
FAIL
6000.69
ncf_16_32_2_edau.3
FAIL
6000.69
ncf_8_16_4_euad.4
FAIL
6000.7
ncf_4_16_8_d.3
FAIL
6000.71
ncf_16_32_4_euad.10
FAIL
6000.72
ncf_16_32_2_u.1
FAIL
6000.72
ncf_4_16_8_u.1
FAIL
6000.72
ncf_8_16_8_d.2
FAIL
6000.73
ncf_8_16_8_euad.9
FAIL
6000.73
ncf_4_16_8_euad.8
FAIL
6000.73
ncf_4_16_8_d.1
FAIL
6000.73
ncf_8_16_4_u.9
FAIL
6000.74
ncf_16_32_8_u.9
FAIL
6000.74
ncf_16_32_2_euad.8
FAIL
6000.74
ncf_4_32_2_edau.10
FAIL
6000.75
ncf_4_16_8_u.8
FAIL
6000.76
ncf_4_16_8_u.2
FAIL
6000.76
ncf_16_32_2_u.8
FAIL
6000.77
ncf_8_16_8_edau.8
FAIL
6000.77
ncf_16_32_2_edau.1
FAIL
6000.78
ncf_16_32_8_u.3
FAIL
6000.78
ncf_4_32_2_u.10
FAIL
6000.79
ncf_16_32_4_u.10
FAIL
6000.8
ncf_16_32_8_edau.10
FAIL
6000.81
ncf_8_16_8_euad.6
FAIL
6000.81
ncf_16_32_2_euad.3
FAIL
6000.84
ncf_8_16_4_euad.9
FAIL
6000.85
ncf_16_32_4_d.6
FAIL
6000.88
Contact
|
Organization
|
Links
|
Citing QBFLIB