QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family CounterFactual solved by
sKizzo-0.9-grn
QBFEVAL'06
Instance
Result
Time
ncf_4_16_2_edau.4
SAT
0
ncf_4_8_8_edau.1
SAT
0
ncf_4_16_2_edau.2
SAT
0
ncf_8_16_4_d.1
SAT
0
ncf_8_16_4_d.10
SAT
0
ncf_16_32_2_d.6
SAT
0
ncf_16_32_2_edau.6
SAT
0
ncf_4_16_2_edau.6
SAT
0
ncf_8_16_4_d.5
UNSAT
0
ncf_4_8_8_d.3
SAT
0
ncf_4_16_2_d.6
SAT
0
ncf_4_16_4_d.1
SAT
0.01
ncf_8_16_4_euad.1
SAT
0.01
ncf_4_8_8_d.5
UNSAT
0.01
ncf_8_16_4_edau.4
SAT
0.01
ncf_16_32_4_d.9
SAT
0.01
ncf_4_8_8_edau.3
SAT
0.01
ncf_4_16_2_d.4
SAT
0.01
ncf_4_8_4_u.9
SAT
0.01
ncf_4_16_4_edau.1
SAT
0.01
ncf_8_16_4_edau.1
SAT
0.01
ncf_8_16_4_u.1
SAT
0.01
ncf_4_8_8_u.9
UNSAT
0.01
ncf_16_32_4_edau.2
SAT
0.01
ncf_4_16_8_d.7
SAT
0.01
ncf_16_32_2_edau.7
UNSAT
0.01
ncf_4_8_8_d.9
UNSAT
0.01
ncf_4_16_4_edau.5
SAT
0.01
ncf_4_16_4_edau.8
SAT
0.01
ncf_4_16_2_d.2
SAT
0.01
ncf_4_8_8_d.8
SAT
0.01
ncf_8_16_4_edau.5
UNSAT
0.01
ncf_8_16_4_edau.10
SAT
0.01
ncf_4_8_8_edau.8
SAT
0.01
ncf_4_16_4_d.5
SAT
0.01
ncf_4_8_8_euad.9
UNSAT
0.01
ncf_4_8_8_d.1
SAT
0.01
ncf_4_8_8_edau.9
UNSAT
0.02
ncf_4_16_4_d.8
SAT
0.02
ncf_4_8_2_euad.10
SAT
0.02
ncf_16_32_4_d.8
SAT
0.02
ncf_16_32_4_edau.3
SAT
0.02
ncf_16_32_8_d.3
SAT
0.02
ncf_8_16_4_u.5
UNSAT
0.02
ncf_16_32_4_d.3
SAT
0.02
ncf_16_32_4_edau.8
SAT
0.02
ncf_4_8_2_u.4
UNSAT
0.02
ncf_4_8_2_u.10
SAT
0.02
ncf_4_8_4_euad.9
SAT
0.02
ncf_8_16_4_euad.5
UNSAT
0.02
ncf_16_32_4_d.2
SAT
0.02
ncf_8_16_4_d.4
SAT
0.02
ncf_16_32_4_edau.9
SAT
0.03
ncf_16_32_2_d.7
UNSAT
0.03
ncf_4_8_8_edau.5
UNSAT
0.03
ncf_16_32_8_edau.3
SAT
0.03
ncf_4_8_2_euad.4
UNSAT
0.04
ncf_8_16_4_euad.2
UNSAT
0.04
ncf_4_8_2_euad.6
SAT
0.04
ncf_8_16_4_d.2
UNSAT
0.04
ncf_4_8_2_u.1
UNSAT
0.04
ncf_4_8_2_euad.5
SAT
0.04
ncf_4_8_2_euad.1
UNSAT
0.04
ncf_8_16_4_d.8
UNSAT
0.04
ncf_4_8_2_euad.8
SAT
0.04
ncf_4_8_2_u.7
UNSAT
0.04
ncf_4_8_2_u.8
SAT
0.05
ncf_4_16_2_u.6
SAT
0.05
ncf_8_16_4_u.2
UNSAT
0.05
ncf_8_16_4_edau.8
UNSAT
0.05
ncf_8_16_4_edau.6
UNSAT
0.05
ncf_4_8_2_euad.7
UNSAT
0.05
ncf_4_16_2_euad.6
SAT
0.05
ncf_4_8_2_u.6
SAT
0.05
ncf_4_8_2_u.5
SAT
0.06
ncf_8_16_4_edau.2
UNSAT
0.06
ncf_8_16_4_d.6
UNSAT
0.07
ncf_4_16_2_u.2
SAT
0.1
ncf_4_16_2_euad.2
SAT
0.11
ncf_4_16_2_edau.9
SAT
0.11
ncf_4_16_2_d.9
SAT
0.12
ncf_16_32_4_edau.5
UNSAT
0.13
ncf_16_32_4_d.5
UNSAT
0.14
ncf_4_16_4_u.5
SAT
0.17
ncf_4_8_4_u.2
UNSAT
0.17
ncf_4_16_4_euad.5
SAT
0.2
ncf_4_8_4_euad.2
UNSAT
0.2
ncf_4_8_2_euad.3
UNSAT
0.22
ncf_4_8_4_euad.5
SAT
0.22
ncf_16_32_2_edau.9
UNSAT
0.23
ncf_16_32_4_edau.10
UNSAT
0.23
ncf_4_8_2_u.3
UNSAT
0.23
ncf_16_32_4_d.10
UNSAT
0.24
ncf_4_8_4_u.5
SAT
0.24
ncf_16_32_2_u.9
UNSAT
0.25
ncf_4_16_2_edau.5
UNSAT
0.26
ncf_4_16_2_euad.4
SAT
0.29
ncf_4_16_2_d.5
UNSAT
0.32
ncf_16_32_2_d.8
UNSAT
0.34
ncf_4_16_2_edau.1
UNSAT
0.34
ncf_16_32_2_euad.9
UNSAT
0.35
ncf_16_32_2_d.9
UNSAT
0.36
ncf_4_16_4_edau.9
SAT
0.36
ncf_4_16_2_u.4
SAT
0.39
ncf_4_16_4_d.9
SAT
0.39
ncf_4_8_4_euad.6
SAT
0.42
ncf_4_8_4_euad.7
UNSAT
0.43
ncf_4_8_4_u.6
SAT
0.43
ncf_4_16_4_euad.1
SAT
0.43
ncf_4_16_2_d.1
UNSAT
0.44
ncf_4_16_4_u.1
SAT
0.44
ncf_4_8_4_u.7
UNSAT
0.44
ncf_4_8_8_euad.1
SAT
0.44
ncf_4_8_8_u.1
SAT
0.44
ncf_16_32_2_edau.8
UNSAT
0.47
ncf_4_8_8_u.3
SAT
0.52
ncf_4_8_4_euad.3
UNSAT
0.53
ncf_4_16_4_u.9
SAT
0.55
ncf_4_16_4_euad.9
SAT
0.56
ncf_4_8_4_u.3
UNSAT
0.58
ncf_4_8_8_euad.3
SAT
0.6
ncf_4_8_4_u.8
UNSAT
0.63
ncf_4_8_4_euad.8
UNSAT
0.68
ncf_4_16_4_euad.8
SAT
0.7
ncf_4_16_4_u.8
SAT
0.77
ncf_4_8_4_euad.4
UNSAT
0.8
ncf_16_32_2_u.7
UNSAT
0.84
ncf_4_8_4_u.4
UNSAT
0.97
ncf_16_32_4_d.7
UNSAT
1
ncf_16_32_8_edau.8
UNSAT
1.03
ncf_8_16_4_u.6
UNSAT
1.06
ncf_16_32_8_d.8
UNSAT
1.07
ncf_16_32_4_edau.7
UNSAT
1.11
ncf_16_32_2_euad.7
UNSAT
1.23
ncf_8_16_4_euad.6
UNSAT
1.36
ncf_4_8_2_u.9
SAT
1.56
ncf_4_16_2_d.7
SAT
1.61
ncf_4_8_8_u.5
UNSAT
2.11
ncf_4_8_8_euad.5
UNSAT
2.29
ncf_4_16_2_u.5
UNSAT
2.33
ncf_4_16_2_euad.5
UNSAT
2.44
ncf_4_32_2_edau.1
UNSAT
2.52
ncf_4_16_2_edau.7
SAT
2.81
ncf_4_16_2_u.9
SAT
3.69
ncf_4_16_2_euad.9
SAT
4.93
ncf_4_16_2_euad.7
SAT
6.14
ncf_4_8_4_euad.10
SAT
6.2
ncf_4_8_4_u.10
SAT
9.4
ncf_8_16_4_u.8
UNSAT
12.18
ncf_4_32_2_u.1
UNSAT
15.48
ncf_8_16_4_euad.8
UNSAT
18.58
ncf_8_16_8_d.7
UNSAT
18.83
ncf_4_8_2_euad.9
SAT
23.08
ncf_8_16_8_edau.7
UNSAT
27.29
ncf_4_8_2_euad.2
SAT
29.51
ncf_4_8_2_u.2
SAT
31.45
ncf_4_16_2_euad.1
UNSAT
34.19
ncf_4_8_4_euad.1
FAIL
72.64
ncf_4_16_2_u.1
UNSAT
78.42
ncf_4_16_4_euad.10
UNSAT
84.67
ncf_4_8_8_euad.8
FAIL
87.24
ncf_4_8_4_u.1
FAIL
89.34
ncf_4_16_4_d.10
UNSAT
92.67
ncf_4_16_4_edau.10
UNSAT
96.15
ncf_4_16_2_u.8
FAIL
100.04
ncf_4_32_2_edau.2
FAIL
101.95
ncf_4_16_4_u.7
FAIL
101.97
ncf_4_8_8_d.2
UNSAT
105.84
ncf_4_8_8_u.4
FAIL
108.15
ncf_16_32_2_edau.5
UNSAT
114.16
ncf_4_16_2_euad.8
FAIL
116.21
ncf_4_8_8_u.8
FAIL
117.11
ncf_4_16_4_u.10
UNSAT
117.51
ncf_4_16_4_euad.7
FAIL
123.6
ncf_4_32_2_u.2
FAIL
125.77
ncf_8_16_4_edau.3
FAIL
126.61
ncf_4_16_2_euad.10
FAIL
127.67
ncf_4_16_4_d.7
FAIL
129.08
ncf_4_16_4_edau.7
FAIL
129.92
ncf_8_16_4_d.3
FAIL
131.71
ncf_4_16_2_u.10
FAIL
132.3
ncf_4_8_8_euad.4
FAIL
139.62
ncf_4_8_8_edau.2
UNSAT
140.08
ncf_16_32_2_d.5
UNSAT
147.48
ncf_4_8_8_d.4
FAIL
167.55
ncf_4_16_4_euad.4
FAIL
175.52
ncf_4_8_8_edau.4
FAIL
184.07
ncf_4_16_4_u.4
FAIL
197.66
ncf_4_16_4_euad.6
UNSAT
205.43
ncf_4_16_4_edau.4
FAIL
233.23
ncf_4_16_8_euad.7
FAIL
286.79
ncf_4_16_8_u.7
FAIL
342.23
ncf_4_16_4_d.4
FAIL
371.63
ncf_4_16_2_u.7
SAT
374.23
ncf_4_32_2_u.8
FAIL
450.38
ncf_4_16_8_d.8
UNSAT
455.03
ncf_8_16_4_u.10
FAIL
484.35
ncf_4_16_4_edau.3
FAIL
485.89
ncf_4_16_2_edau.8
FAIL
495.16
ncf_4_32_2_edau.8
FAIL
515.43
ncf_8_16_4_edau.7
FAIL
517.92
ncf_4_16_2_d.3
FAIL
522.78
ncf_4_16_2_d.8
FAIL
539.2
ncf_4_16_2_d.10
FAIL
557.49
ncf_4_16_2_euad.3
FAIL
559.76
ncf_4_16_2_edau.3
FAIL
559.98
ncf_4_16_2_edau.10
FAIL
562.15
ncf_4_16_2_u.3
FAIL
589.01
ncf_4_16_4_euad.2
FAIL
599.15
ncf_4_16_4_d.3
FAIL
599.95
ncf_16_32_8_d.9
FAIL
600.96
ncf_4_8_8_d.7
FAIL
660.42
ncf_8_16_4_euad.10
FAIL
662.96
ncf_8_16_8_d.9
FAIL
711.77
ncf_4_8_8_edau.10
FAIL
713.29
ncf_8_16_8_euad.1
SAT
723.79
ncf_8_16_8_d.1
SAT
724.81
ncf_4_16_4_edau.6
UNSAT
730.25
ncf_4_8_8_edau.7
FAIL
877.31
ncf_4_16_4_d.2
FAIL
890.61
ncf_4_16_4_edau.2
FAIL
938.49
ncf_8_16_8_euad.7
UNSAT
958.23
ncf_4_32_2_edau.4
UNSAT
979.71
ncf_4_8_8_d.10
FAIL
1027.82
ncf_4_8_8_u.10
FAIL
1057.97
ncf_4_32_2_u.3
UNSAT
1092.82
ncf_8_16_8_edau.1
SAT
1135.61
ncf_4_8_8_euad.10
FAIL
1194.08
ncf_4_32_2_u.7
FAIL
1196.89
ncf_4_16_4_euad.3
FAIL
1236.09
ncf_4_8_8_euad.2
UNSAT
1353.01
ncf_4_16_4_u.3
FAIL
1437.97
ncf_4_32_2_edau.7
FAIL
1573.84
ncf_8_16_8_edau.9
FAIL
1582
ncf_4_16_4_u.2
FAIL
1688.14
ncf_4_8_8_u.7
FAIL
1722.86
ncf_4_32_2_u.4
UNSAT
1734.96
ncf_8_16_4_d.9
FAIL
1952.3
ncf_4_32_2_edau.3
UNSAT
2051.55
ncf_8_16_4_euad.3
FAIL
2137.77
ncf_4_8_8_euad.7
FAIL
2488.93
ncf_4_16_4_u.6
UNSAT
2502.2
ncf_8_16_8_d.6
UNSAT
2540.4
ncf_4_16_4_d.6
UNSAT
2597.12
ncf_4_8_8_u.6
FAIL
2921.22
ncf_8_16_4_edau.9
FAIL
3011.7
ncf_4_32_2_u.9
FAIL
3204.28
ncf_4_8_8_d.6
FAIL
3332.36
ncf_4_8_8_euad.6
FAIL
3350.92
ncf_4_8_8_u.2
UNSAT
3513.04
ncf_4_16_8_d.9
FAIL
3667.82
ncf_16_32_2_edau.10
FAIL
4041.07
ncf_16_32_4_u.1
FAIL
4048.01
ncf_8_16_8_edau.6
UNSAT
4105.96
ncf_16_32_4_u.3
FAIL
4173.8
ncf_4_16_8_u.2
FAIL
4460.57
ncf_4_8_8_edau.6
FAIL
4491.12
ncf_8_16_4_u.3
FAIL
4494.1
ncf_8_16_8_euad.8
FAIL
4552.55
ncf_16_32_2_u.10
FAIL
4653.21
ncf_16_32_2_u.2
FAIL
4777.64
ncf_4_16_8_euad.4
FAIL
4799.22
ncf_16_32_4_u.9
FAIL
5009.31
ncf_4_32_2_u.6
FAIL
5045.37
ncf_4_16_8_euad.9
FAIL
5066.54
ncf_4_32_2_edau.9
FAIL
5116.72
ncf_4_16_8_d.4
FAIL
5116.77
ncf_8_16_4_u.9
FAIL
5307.93
ncf_4_16_8_euad.5
FAIL
5470.62
ncf_16_32_4_euad.9
FAIL
5563.62
ncf_4_16_8_d.2
FAIL
5584.38
ncf_16_32_4_d.1
FAIL
5746.45
ncf_16_32_4_d.6
FAIL
5856.5
ncf_16_32_2_u.6
FAIL
5992.23
ncf_16_32_2_euad.4
FAIL
5999.83
ncf_16_32_4_u.6
FAIL
5999.94
ncf_16_32_8_u.6
FAIL
6000.05
ncf_16_32_4_u.5
FAIL
6000.05
ncf_16_32_2_u.4
FAIL
6000.06
ncf_8_16_4_euad.7
FAIL
6000.09
ncf_16_32_4_edau.6
FAIL
6000.11
ncf_16_32_8_u.7
FAIL
6000.15
ncf_16_32_8_d.6
FAIL
6000.17
ncf_4_16_8_u.5
FAIL
6000.2
ncf_4_16_8_euad.3
FAIL
6000.2
ncf_16_32_4_euad.6
FAIL
6000.2
ncf_16_32_2_d.1
FAIL
6000.21
ncf_4_16_8_u.6
FAIL
6000.23
ncf_16_32_8_euad.5
FAIL
6000.24
ncf_16_32_4_euad.2
FAIL
6000.24
ncf_16_32_2_edau.4
FAIL
6000.27
ncf_16_32_2_d.4
FAIL
6000.29
ncf_16_32_8_u.5
FAIL
6000.29
ncf_8_16_8_euad.3
FAIL
6000.3
ncf_8_16_8_d.4
FAIL
6000.31
ncf_16_32_8_euad.4
FAIL
6000.31
ncf_16_32_2_d.10
FAIL
6000.33
ncf_16_32_8_u.1
FAIL
6000.33
ncf_16_32_2_edau.2
FAIL
6000.33
ncf_16_32_2_euad.2
FAIL
6000.33
ncf_16_32_2_euad.10
FAIL
6000.35
ncf_8_16_8_edau.4
FAIL
6000.39
ncf_16_32_8_u.8
FAIL
6000.39
ncf_8_16_8_euad.5
FAIL
6000.41
ncf_8_16_4_u.4
FAIL
6000.41
ncf_8_16_8_edau.10
FAIL
6000.42
ncf_8_16_8_euad.4
FAIL
6000.42
ncf_16_32_2_euad.6
FAIL
6000.43
ncf_16_32_8_edau.4
FAIL
6000.44
ncf_16_32_8_edau.5
FAIL
6000.44
ncf_16_32_4_edau.1
FAIL
6000.44
ncf_4_16_8_u.9
FAIL
6000.45
ncf_4_32_2_u.10
FAIL
6000.45
ncf_16_32_4_euad.1
FAIL
6000.46
ncf_4_32_2_edau.10
FAIL
6000.46
ncf_16_32_8_edau.6
FAIL
6000.47
ncf_16_32_8_u.4
FAIL
6000.48
ncf_8_16_8_d.10
FAIL
6000.49
ncf_16_32_4_euad.4
FAIL
6000.49
ncf_16_32_8_euad.7
FAIL
6000.5
ncf_16_32_8_d.5
FAIL
6000.5
ncf_8_16_8_edau.5
FAIL
6000.5
ncf_16_32_8_d.1
FAIL
6000.54
ncf_8_16_8_euad.10
FAIL
6000.54
ncf_16_32_4_euad.8
FAIL
6000.55
ncf_16_32_8_d.2
FAIL
6000.56
ncf_16_32_8_edau.9
FAIL
6000.57
ncf_16_32_8_euad.2
FAIL
6000.58
ncf_16_32_8_euad.1
FAIL
6000.58
ncf_16_32_4_euad.3
FAIL
6000.58
ncf_8_16_4_euad.4
FAIL
6000.59
ncf_16_32_8_edau.10
FAIL
6000.59
ncf_16_32_4_u.8
FAIL
6000.61
ncf_16_32_8_euad.10
FAIL
6000.61
ncf_4_16_8_u.3
FAIL
6000.61
ncf_8_16_8_d.5
FAIL
6000.61
ncf_16_32_4_euad.5
FAIL
6000.61
ncf_16_32_2_euad.3
FAIL
6000.62
ncf_4_16_8_u.4
FAIL
6000.62
ncf_4_16_8_d.1
FAIL
6000.62
ncf_16_32_8_d.4
FAIL
6000.62
ncf_4_32_2_u.5
FAIL
6000.62
ncf_16_32_8_euad.3
FAIL
6000.63
ncf_16_32_8_u.2
FAIL
6000.63
ncf_8_16_8_euad.6
FAIL
6000.64
ncf_4_16_8_euad.1
FAIL
6000.64
ncf_16_32_4_u.4
FAIL
6000.64
ncf_16_32_8_euad.6
FAIL
6000.64
ncf_16_32_8_u.9
FAIL
6000.65
ncf_8_16_4_u.7
FAIL
6000.65
ncf_16_32_4_u.7
FAIL
6000.65
ncf_16_32_2_edau.1
FAIL
6000.65
ncf_16_32_8_edau.2
FAIL
6000.65
ncf_16_32_4_euad.7
FAIL
6000.66
ncf_4_16_8_euad.8
FAIL
6000.66
ncf_16_32_4_u.2
FAIL
6000.68
ncf_16_32_4_euad.10
FAIL
6000.68
ncf_4_16_8_euad.2
FAIL
6000.68
ncf_16_32_2_u.5
FAIL
6000.7
ncf_8_16_8_euad.9
FAIL
6000.7
ncf_16_32_8_edau.1
FAIL
6000.7
ncf_16_32_8_u.10
FAIL
6000.7
ncf_4_32_2_edau.6
FAIL
6000.7
ncf_16_32_2_d.3
FAIL
6000.7
ncf_16_32_2_u.8
FAIL
6000.71
ncf_16_32_8_d.10
FAIL
6000.71
ncf_16_32_8_euad.8
FAIL
6000.71
ncf_4_32_2_edau.5
FAIL
6000.71
ncf_16_32_8_edau.7
FAIL
6000.72
ncf_16_32_2_u.1
FAIL
6000.72
ncf_4_16_8_euad.6
FAIL
6000.72
ncf_4_16_8_u.10
FAIL
6000.72
ncf_16_32_2_euad.5
FAIL
6000.72
ncf_4_16_8_d.6
FAIL
6000.73
ncf_8_16_8_d.2
FAIL
6000.74
ncf_16_32_2_euad.1
FAIL
6000.74
ncf_8_16_8_edau.3
FAIL
6000.74
ncf_4_16_8_u.8
FAIL
6000.74
ncf_8_16_4_d.7
FAIL
6000.74
ncf_16_32_2_edau.3
FAIL
6000.75
ncf_8_16_8_edau.8
FAIL
6000.75
ncf_8_16_4_euad.9
FAIL
6000.75
ncf_16_32_8_euad.9
FAIL
6000.76
ncf_16_32_2_u.3
FAIL
6000.77
ncf_16_32_2_euad.8
FAIL
6000.77
ncf_8_16_8_d.8
FAIL
6000.77
ncf_16_32_2_d.2
FAIL
6000.77
ncf_8_16_8_euad.2
FAIL
6000.78
ncf_16_32_8_u.3
FAIL
6000.79
ncf_16_32_4_edau.4
FAIL
6000.79
ncf_4_16_8_d.5
FAIL
6000.79
ncf_16_32_4_u.10
FAIL
6000.8
ncf_4_16_8_d.10
FAIL
6000.8
ncf_4_16_8_d.3
FAIL
6000.8
ncf_4_16_8_u.1
FAIL
6000.82
ncf_4_16_8_euad.10
FAIL
6000.83
ncf_8_16_8_d.3
FAIL
6000.83
ncf_16_32_4_d.4
FAIL
6000.83
ncf_16_32_8_d.7
FAIL
6000.84
ncf_8_16_8_edau.2
FAIL
6000.86
Contact
|
Organization
|
Links
|
Citing QBFLIB