QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family CounterFactual solved by
qube3.0
QBFEVAL'06
Instance
Result
Time
ncf_4_8_2_euad.4
UNSAT
0
ncf_4_16_2_edau.6
SAT
0.01
ncf_4_16_4_edau.5
SAT
0.01
ncf_4_8_2_u.4
UNSAT
0.01
ncf_4_8_2_u.10
SAT
0.01
ncf_4_16_2_euad.6
SAT
0.01
ncf_4_8_2_u.8
SAT
0.01
ncf_4_8_4_euad.2
UNSAT
0.01
ncf_4_8_2_euad.10
SAT
0.01
ncf_4_8_2_u.1
UNSAT
0.01
ncf_4_8_2_euad.2
SAT
0.01
ncf_4_8_2_u.5
SAT
0.01
ncf_4_8_2_euad.9
SAT
0.01
ncf_4_8_4_u.9
SAT
0.01
ncf_4_16_2_edau.9
SAT
0.01
ncf_4_8_2_euad.7
UNSAT
0.02
ncf_8_16_4_d.5
UNSAT
0.02
ncf_8_16_4_edau.5
UNSAT
0.02
ncf_4_8_2_u.7
UNSAT
0.02
ncf_4_8_4_euad.9
SAT
0.02
ncf_4_8_2_u.3
UNSAT
0.02
ncf_4_16_4_euad.5
SAT
0.02
ncf_16_32_4_euad.9
SAT
0.02
ncf_4_8_2_u.2
SAT
0.02
ncf_4_16_4_u.5
SAT
0.02
ncf_8_16_4_u.2
UNSAT
0.02
ncf_8_16_4_euad.2
UNSAT
0.02
ncf_4_8_2_u.9
SAT
0.02
ncf_16_32_4_u.9
SAT
0.02
ncf_4_8_4_euad.6
SAT
0.02
ncf_8_16_4_d.2
UNSAT
0.02
ncf_4_8_2_euad.5
SAT
0.02
ncf_8_16_4_u.5
UNSAT
0.02
ncf_4_16_2_d.9
SAT
0.02
ncf_4_8_2_euad.1
UNSAT
0.02
ncf_4_8_2_euad.3
UNSAT
0.02
ncf_8_16_4_u.1
SAT
0.02
ncf_16_32_2_u.7
UNSAT
0.03
ncf_4_8_2_euad.8
SAT
0.03
ncf_4_8_8_d.1
SAT
0.03
ncf_8_16_4_euad.5
UNSAT
0.03
ncf_4_16_2_euad.9
SAT
0.03
ncf_4_8_8_edau.8
SAT
0.03
ncf_16_32_2_euad.9
UNSAT
0.03
ncf_4_16_4_d.5
SAT
0.03
ncf_4_16_2_d.6
SAT
0.03
ncf_16_32_2_d.9
UNSAT
0.03
ncf_4_8_4_u.6
SAT
0.03
ncf_4_8_8_edau.9
UNSAT
0.03
ncf_4_16_2_u.6
SAT
0.03
ncf_4_8_8_edau.4
SAT
0.03
ncf_8_16_4_edau.2
UNSAT
0.03
ncf_4_8_4_u.3
UNSAT
0.03
ncf_4_16_2_edau.7
SAT
0.03
ncf_4_8_4_u.2
UNSAT
0.03
ncf_8_16_4_edau.1
SAT
0.03
ncf_4_8_8_d.8
SAT
0.04
ncf_4_8_8_d.9
UNSAT
0.04
ncf_4_16_2_u.9
SAT
0.04
ncf_16_32_4_d.3
SAT
0.04
ncf_4_8_8_d.3
SAT
0.04
ncf_4_8_8_euad.9
UNSAT
0.04
ncf_4_8_4_euad.3
UNSAT
0.04
ncf_4_8_8_edau.1
SAT
0.04
ncf_16_32_4_edau.9
SAT
0.04
ncf_8_16_4_d.1
SAT
0.04
ncf_4_8_8_u.4
SAT
0.04
ncf_4_8_8_u.9
UNSAT
0.04
ncf_16_32_2_edau.7
UNSAT
0.05
ncf_8_16_4_euad.8
UNSAT
0.05
ncf_4_8_8_euad.4
SAT
0.05
ncf_4_8_8_d.4
SAT
0.05
ncf_8_16_4_euad.1
SAT
0.05
ncf_4_8_4_u.10
SAT
0.05
ncf_16_32_2_euad.7
UNSAT
0.05
ncf_16_32_4_d.9
SAT
0.05
ncf_16_32_2_d.7
UNSAT
0.05
ncf_16_32_2_u.9
UNSAT
0.05
ncf_4_8_4_u.5
SAT
0.06
ncf_8_16_4_euad.6
UNSAT
0.06
ncf_4_8_2_u.6
SAT
0.06
ncf_4_16_2_d.7
SAT
0.06
ncf_16_32_2_edau.9
UNSAT
0.06
ncf_16_32_4_edau.3
SAT
0.06
ncf_4_16_2_u.2
SAT
0.06
ncf_4_8_4_euad.5
SAT
0.07
ncf_8_16_4_u.8
UNSAT
0.07
ncf_4_8_4_euad.10
SAT
0.07
ncf_4_8_8_edau.3
SAT
0.07
ncf_4_8_2_euad.6
SAT
0.07
ncf_4_8_8_euad.1
SAT
0.08
ncf_4_8_8_u.1
SAT
0.08
ncf_4_8_8_euad.3
SAT
0.08
ncf_8_16_8_edau.1
SAT
0.08
ncf_4_16_2_d.1
UNSAT
0.08
ncf_4_16_2_euad.2
SAT
0.08
ncf_4_16_2_edau.1
UNSAT
0.09
ncf_4_8_8_u.3
SAT
0.09
ncf_8_16_8_euad.1
SAT
0.09
ncf_8_16_8_d.1
SAT
0.1
ncf_8_16_4_u.6
UNSAT
0.1
ncf_4_16_2_u.7
SAT
0.1
ncf_4_16_2_edau.10
UNSAT
0.1
ncf_8_16_4_euad.10
SAT
0.1
ncf_4_16_2_u.4
SAT
0.11
ncf_4_16_2_euad.4
SAT
0.12
ncf_4_16_4_edau.1
SAT
0.12
ncf_8_16_4_d.10
SAT
0.14
ncf_4_16_2_edau.2
SAT
0.15
ncf_4_16_4_u.1
SAT
0.15
ncf_4_16_2_d.10
UNSAT
0.15
ncf_16_32_2_u.6
SAT
0.16
ncf_16_32_2_euad.6
SAT
0.17
ncf_8_16_4_edau.8
UNSAT
0.17
ncf_4_16_2_d.2
SAT
0.18
ncf_8_16_4_d.8
UNSAT
0.19
ncf_4_16_4_u.9
SAT
0.19
ncf_4_16_4_euad.1
SAT
0.19
ncf_16_32_2_d.6
SAT
0.19
ncf_16_32_2_edau.6
SAT
0.19
ncf_4_16_2_d.4
SAT
0.21
ncf_8_16_4_u.10
SAT
0.23
ncf_4_8_4_u.1
SAT
0.23
ncf_4_8_4_u.8
UNSAT
0.24
ncf_4_16_4_edau.9
SAT
0.25
ncf_4_16_4_d.1
SAT
0.25
ncf_4_16_2_edau.4
SAT
0.25
ncf_4_16_2_u.1
UNSAT
0.26
ncf_4_8_4_euad.8
UNSAT
0.28
ncf_4_8_4_euad.4
UNSAT
0.29
ncf_4_8_4_u.4
UNSAT
0.29
ncf_4_16_2_euad.7
SAT
0.31
ncf_8_16_8_euad.6
UNSAT
0.33
ncf_8_16_8_euad.7
UNSAT
0.33
ncf_8_16_4_edau.6
UNSAT
0.34
ncf_4_8_4_u.7
UNSAT
0.36
ncf_4_8_4_euad.7
UNSAT
0.39
ncf_4_16_4_d.9
SAT
0.4
ncf_4_8_8_edau.6
UNSAT
0.41
ncf_4_16_4_edau.8
SAT
0.46
ncf_4_8_8_euad.6
UNSAT
0.47
ncf_4_8_4_euad.1
SAT
0.48
ncf_4_8_8_u.6
UNSAT
0.51
ncf_4_16_4_d.8
SAT
0.53
ncf_8_16_8_edau.7
UNSAT
0.53
ncf_4_8_8_u.8
SAT
0.55
ncf_4_8_8_euad.5
UNSAT
0.61
ncf_8_16_4_d.6
UNSAT
0.62
ncf_8_16_8_d.7
UNSAT
0.74
ncf_4_16_4_euad.9
SAT
0.75
ncf_4_16_2_edau.3
UNSAT
0.78
ncf_4_8_8_euad.8
SAT
0.81
ncf_4_16_2_u.10
UNSAT
0.82
ncf_4_8_8_u.2
UNSAT
0.83
ncf_4_16_2_edau.8
SAT
1.03
ncf_4_8_8_edau.5
UNSAT
1.13
ncf_4_8_8_d.5
UNSAT
1.23
ncf_4_16_2_edau.5
UNSAT
1.37
ncf_4_32_2_u.4
UNSAT
1.74
ncf_4_16_2_d.5
UNSAT
1.78
ncf_4_16_2_u.5
UNSAT
1.94
ncf_8_16_4_edau.7
SAT
2.17
ncf_4_8_8_u.5
UNSAT
2.66
ncf_16_32_4_euad.1
SAT
2.66
ncf_4_16_4_edau.4
UNSAT
2.94
ncf_4_16_4_euad.8
SAT
3.19
ncf_4_16_2_u.3
UNSAT
3.24
ncf_8_16_4_d.7
SAT
3.47
ncf_4_8_8_edau.2
UNSAT
3.51
ncf_8_16_4_edau.10
SAT
3.68
ncf_4_16_4_edau.7
SAT
4.15
ncf_4_16_2_d.8
SAT
4.43
ncf_4_8_8_edau.7
SAT
4.62
ncf_4_16_2_u.8
SAT
5.2
ncf_8_16_8_d.6
UNSAT
5.25
ncf_4_8_8_d.6
UNSAT
5.73
ncf_4_8_8_edau.10
SAT
5.78
ncf_4_8_8_d.2
UNSAT
6.72
ncf_8_16_8_edau.6
UNSAT
6.77
ncf_4_32_2_edau.2
SAT
7
ncf_4_16_2_euad.10
UNSAT
7.87
ncf_8_16_8_edau.8
UNSAT
8.2
ncf_4_32_2_u.2
SAT
8.87
ncf_4_16_2_euad.1
UNSAT
11.65
ncf_8_16_8_edau.9
UNSAT
11.91
ncf_4_16_2_euad.5
UNSAT
12.69
ncf_4_16_2_d.3
UNSAT
13.66
ncf_4_16_4_d.4
UNSAT
14.31
ncf_8_16_8_d.9
UNSAT
15
ncf_4_16_4_u.7
SAT
18.57
ncf_4_16_2_euad.8
SAT
21.66
ncf_4_32_2_u.9
UNSAT
23.75
ncf_4_16_4_edau.10
UNSAT
23.98
ncf_4_16_4_d.10
UNSAT
31.67
ncf_8_16_4_u.4
SAT
32.67
ncf_4_32_2_u.6
UNSAT
33.12
ncf_8_16_4_euad.4
SAT
34.45
ncf_4_16_4_edau.3
SAT
35.42
ncf_4_32_2_edau.8
SAT
42.38
ncf_16_32_4_u.1
SAT
47.85
ncf_4_8_8_d.7
SAT
48.81
ncf_4_8_8_euad.2
UNSAT
49.47
ncf_8_16_4_u.7
SAT
49.87
ncf_4_32_2_edau.6
UNSAT
66.64
ncf_4_16_4_u.6
UNSAT
75.66
ncf_8_16_8_d.8
UNSAT
79.48
ncf_8_16_8_euad.9
UNSAT
81.87
ncf_4_16_4_edau.2
SAT
82.27
ncf_16_32_4_euad.5
UNSAT
93.13
ncf_4_16_4_d.2
SAT
101.82
ncf_4_8_8_d.10
SAT
108.5
ncf_16_32_4_u.5
UNSAT
113.26
ncf_16_32_4_edau.7
UNSAT
119.99
ncf_4_16_4_u.8
SAT
140.49
ncf_4_16_4_u.10
UNSAT
159.13
ncf_4_32_2_edau.7
SAT
169.3
ncf_4_16_4_d.7
SAT
181.82
ncf_8_16_4_d.9
UNSAT
203.75
ncf_8_16_4_d.4
SAT
212.85
ncf_8_16_4_euad.9
UNSAT
224.93
ncf_8_16_4_u.9
UNSAT
226.97
ncf_8_16_8_euad.8
UNSAT
242.44
ncf_4_8_8_u.7
SAT
243.18
ncf_4_16_8_u.7
SAT
255.99
ncf_4_16_4_u.4
UNSAT
263.47
ncf_16_32_8_u.3
SAT
285.06
ncf_16_32_8_euad.3
SAT
311.63
ncf_16_32_4_d.7
UNSAT
322.02
ncf_4_16_8_euad.7
SAT
323.74
ncf_16_32_4_u.10
UNSAT
334.56
ncf_4_8_8_euad.7
SAT
356.03
ncf_4_16_8_u.9
SAT
375.56
ncf_16_32_4_edau.5
UNSAT
383.47
ncf_4_16_4_u.2
SAT
419.76
ncf_4_16_4_edau.6
UNSAT
458.84
ncf_4_16_4_d.3
SAT
460.63
ncf_8_16_4_edau.4
SAT
467.74
ncf_16_32_8_u.4
FAIL
599.79
ncf_16_32_8_u.8
FAIL
599.81
ncf_16_32_8_euad.4
FAIL
599.97
ncf_16_32_4_d.5
UNSAT
605.16
ncf_8_16_4_u.3
SAT
686.5
ncf_4_16_2_euad.3
UNSAT
707.63
ncf_4_16_4_euad.7
SAT
708.25
ncf_8_16_4_euad.3
SAT
729.88
ncf_16_32_8_u.1
FAIL
747.22
ncf_16_32_8_euad.1
FAIL
783.29
ncf_4_16_4_d.6
UNSAT
835.68
ncf_16_32_8_u.2
FAIL
843.09
ncf_8_16_4_edau.9
UNSAT
854.11
ncf_16_32_8_euad.8
FAIL
865.62
ncf_16_32_8_u.5
FAIL
955.28
ncf_8_16_8_euad.5
FAIL
1073.53
ncf_16_32_8_euad.5
FAIL
1130.65
ncf_8_16_8_euad.4
FAIL
1190.92
ncf_4_16_8_d.8
UNSAT
1192.98
ncf_4_16_8_euad.2
FAIL
1277.31
ncf_8_16_8_euad.2
FAIL
1280.99
ncf_16_32_2_edau.2
UNSAT
1304.15
ncf_8_16_4_euad.7
SAT
1328.76
ncf_16_32_4_d.4
UNSAT
1374.69
ncf_4_16_8_u.8
FAIL
1392.59
ncf_4_8_8_u.10
SAT
1463.45
ncf_4_16_8_euad.10
FAIL
1506.29
ncf_16_32_2_d.2
UNSAT
1603.65
ncf_4_16_8_euad.5
FAIL
1616.24
ncf_4_16_8_u.2
FAIL
1628.44
ncf_4_16_8_euad.3
FAIL
1658.02
ncf_16_32_8_euad.2
FAIL
1725.29
ncf_16_32_4_euad.2
FAIL
1772.8
ncf_16_32_4_euad.8
FAIL
1823.84
ncf_16_32_2_u.2
UNSAT
1859.61
ncf_4_16_8_euad.6
FAIL
1880.05
ncf_4_16_8_u.5
FAIL
1890.58
ncf_16_32_4_edau.10
UNSAT
1927.05
ncf_16_32_4_euad.10
FAIL
1952.33
ncf_4_16_8_euad.1
FAIL
2016.27
ncf_16_32_2_euad.2
UNSAT
2107.49
ncf_16_32_4_u.2
FAIL
2167.06
ncf_4_16_8_euad.4
FAIL
2189.33
ncf_4_16_8_u.4
FAIL
2200.24
ncf_16_32_4_euad.6
FAIL
2247.34
ncf_16_32_4_euad.4
FAIL
2258.41
ncf_16_32_4_u.4
FAIL
2272.41
ncf_4_16_4_euad.2
SAT
2275.03
ncf_16_32_4_u.6
FAIL
2287.9
ncf_16_32_8_edau.2
FAIL
2348.09
ncf_16_32_8_d.5
FAIL
2378.43
ncf_16_32_8_edau.4
FAIL
2417.52
ncf_4_16_8_u.6
FAIL
2428.38
ncf_4_16_8_u.10
FAIL
2466.66
ncf_16_32_8_d.4
FAIL
2470.88
ncf_16_32_8_edau.5
FAIL
2535.19
ncf_4_16_8_euad.8
FAIL
2623.08
ncf_4_16_8_u.1
FAIL
3184.64
ncf_4_16_8_u.3
FAIL
3236.57
ncf_4_8_8_euad.10
FAIL
3316.62
ncf_16_32_8_d.3
FAIL
3406.66
ncf_16_32_2_u.5
FAIL
3431.93
ncf_16_32_2_euad.5
FAIL
3545.66
ncf_16_32_8_edau.3
FAIL
3575.85
ncf_8_16_8_euad.3
FAIL
3715.07
ncf_16_32_8_d.8
FAIL
3763.93
ncf_16_32_8_edau.8
FAIL
3777.68
ncf_8_16_8_euad.10
FAIL
3781.23
ncf_16_32_8_u.10
FAIL
3797.99
ncf_4_16_4_euad.6
UNSAT
3828.07
ncf_16_32_4_u.8
FAIL
3856.28
ncf_16_32_8_d.1
FAIL
4023.11
ncf_16_32_2_euad.1
FAIL
4046.96
ncf_16_32_8_d.2
FAIL
4050.54
ncf_16_32_8_euad.10
FAIL
4161.95
ncf_16_32_2_u.10
UNSAT
4611.82
ncf_16_32_2_u.4
FAIL
4631.96
ncf_16_32_8_d.9
FAIL
4666.82
ncf_16_32_2_euad.4
FAIL
5124.88
ncf_4_16_8_euad.9
FAIL
5128.82
ncf_16_32_2_u.8
FAIL
5360.5
ncf_4_16_4_euad.10
FAIL
5373.44
ncf_4_16_4_euad.4
FAIL
5501.73
ncf_16_32_8_edau.7
FAIL
5556.42
ncf_16_32_4_edau.4
FAIL
5724.68
ncf_16_32_8_edau.9
FAIL
5779.27
ncf_8_16_8_edau.10
FAIL
5990.86
ncf_4_16_8_d.3
FAIL
5999.8
ncf_16_32_2_euad.10
FAIL
5999.86
ncf_16_32_2_euad.8
FAIL
5999.87
ncf_4_16_4_euad.3
FAIL
5999.92
ncf_16_32_8_d.6
FAIL
5999.94
ncf_8_16_8_d.10
FAIL
5999.94
ncf_4_32_2_u.3
FAIL
5999.95
ncf_16_32_8_edau.6
FAIL
5999.97
ncf_4_32_2_u.5
FAIL
6000.02
ncf_8_16_8_d.3
FAIL
6000.05
ncf_16_32_8_edau.10
FAIL
6000.06
ncf_16_32_8_d.7
FAIL
6000.08
ncf_16_32_2_edau.8
FAIL
6000.12
ncf_16_32_8_edau.1
FAIL
6000.13
ncf_8_16_8_edau.4
FAIL
6000.15
ncf_8_16_8_d.5
FAIL
6000.15
ncf_4_32_2_u.7
FAIL
6000.15
ncf_16_32_4_d.10
FAIL
6000.17
ncf_16_32_4_d.2
FAIL
6000.17
ncf_16_32_2_u.1
FAIL
6000.18
ncf_16_32_4_edau.2
FAIL
6000.19
ncf_8_16_8_edau.5
FAIL
6000.2
ncf_4_16_4_u.3
FAIL
6000.21
ncf_16_32_8_d.10
FAIL
6000.21
ncf_16_32_2_d.8
FAIL
6000.22
ncf_4_16_8_d.10
FAIL
6000.23
ncf_8_16_8_edau.3
FAIL
6000.25
ncf_16_32_2_edau.10
FAIL
6000.25
ncf_4_16_8_d.6
FAIL
6000.25
ncf_16_32_4_euad.7
FAIL
6000.26
ncf_8_16_8_d.4
FAIL
6000.27
ncf_8_16_8_d.2
FAIL
6000.27
ncf_4_16_8_d.4
FAIL
6000.27
ncf_8_16_8_edau.2
FAIL
6000.28
ncf_16_32_2_edau.5
FAIL
6000.3
ncf_4_16_8_d.9
FAIL
6000.3
ncf_4_16_8_d.2
FAIL
6000.31
ncf_16_32_2_d.5
FAIL
6000.31
ncf_16_32_2_d.4
FAIL
6000.33
ncf_4_32_2_u.8
FAIL
6000.33
ncf_16_32_4_edau.6
FAIL
6000.34
ncf_4_16_8_d.5
FAIL
6000.35
ncf_4_16_8_d.1
FAIL
6000.39
ncf_4_16_8_d.7
FAIL
6000.44
ncf_16_32_4_edau.8
FAIL
6000.44
ncf_4_32_2_edau.9
FAIL
6000.45
ncf_16_32_4_d.6
FAIL
6000.46
ncf_16_32_4_edau.1
FAIL
6000.48
ncf_4_32_2_u.10
FAIL
6000.48
ncf_16_32_2_d.10
FAIL
6000.48
ncf_4_32_2_edau.3
FAIL
6000.49
ncf_4_32_2_edau.4
FAIL
6000.51
ncf_4_32_2_edau.5
FAIL
6000.54
ncf_16_32_2_u.3
FAIL
6000.54
ncf_16_32_4_d.1
FAIL
6000.54
ncf_16_32_4_u.3
FAIL
6000.56
ncf_16_32_4_u.7
FAIL
6000.56
ncf_16_32_2_d.3
FAIL
6000.57
ncf_16_32_8_u.7
FAIL
6000.6
ncf_8_16_4_edau.3
FAIL
6000.61
ncf_4_32_2_edau.10
FAIL
6000.61
ncf_16_32_8_euad.7
FAIL
6000.61
ncf_4_32_2_u.1
FAIL
6000.62
ncf_16_32_2_d.1
FAIL
6000.64
ncf_16_32_2_edau.3
FAIL
6000.64
ncf_16_32_4_euad.3
FAIL
6000.65
ncf_16_32_2_euad.3
FAIL
6000.65
ncf_16_32_2_edau.1
FAIL
6000.67
ncf_16_32_2_edau.4
FAIL
6000.67
ncf_16_32_8_euad.9
FAIL
6000.67
ncf_8_16_4_d.3
FAIL
6000.67
ncf_16_32_8_u.6
FAIL
6000.7
ncf_16_32_8_euad.6
FAIL
6000.7
ncf_16_32_4_d.8
FAIL
6000.72
ncf_4_32_2_edau.1
FAIL
6000.8
ncf_16_32_8_u.9
FAIL
6000.81
Contact
|
Organization
|
Links
|
Citing QBFLIB