QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family CounterFactual solved by
openQbf
QBFEVAL'06
Instance
Result
Time
ncf_4_8_4_u.9
SAT
0.2
ncf_4_8_4_euad.7
UNSAT
0.2
ncf_4_8_2_u.1
UNSAT
0.2
ncf_4_8_2_euad.1
UNSAT
0.21
ncf_4_8_2_euad.3
UNSAT
0.21
ncf_4_8_2_u.4
UNSAT
0.21
ncf_4_8_4_euad.9
SAT
0.22
ncf_4_8_2_euad.4
UNSAT
0.23
ncf_8_16_4_euad.2
UNSAT
0.23
ncf_8_16_4_d.2
UNSAT
0.23
ncf_4_8_2_euad.10
SAT
0.23
ncf_4_8_2_u.5
SAT
0.24
ncf_16_32_2_u.9
UNSAT
0.25
ncf_4_8_8_edau.9
UNSAT
0.25
ncf_16_32_2_edau.9
UNSAT
0.25
ncf_8_16_4_edau.2
UNSAT
0.26
ncf_4_8_2_euad.5
SAT
0.26
ncf_8_16_4_u.5
UNSAT
0.26
ncf_16_32_2_edau.7
UNSAT
0.26
ncf_8_16_4_d.5
UNSAT
0.27
ncf_4_8_2_euad.7
UNSAT
0.27
ncf_16_32_2_d.2
UNSAT
0.27
ncf_16_32_2_euad.7
UNSAT
0.27
ncf_4_8_8_u.9
UNSAT
0.28
ncf_4_8_8_d.9
UNSAT
0.28
ncf_4_8_2_u.10
SAT
0.28
ncf_4_8_2_u.3
UNSAT
0.28
ncf_8_16_4_d.8
UNSAT
0.29
ncf_8_16_4_euad.8
UNSAT
0.29
ncf_8_16_4_euad.5
UNSAT
0.29
ncf_8_16_4_u.2
UNSAT
0.29
ncf_16_32_2_d.7
UNSAT
0.3
ncf_4_8_4_u.7
UNSAT
0.3
ncf_16_32_2_edau.2
UNSAT
0.3
ncf_8_16_4_edau.5
UNSAT
0.3
ncf_4_8_8_euad.9
UNSAT
0.3
ncf_4_8_2_u.8
SAT
0.3
ncf_8_16_4_edau.8
UNSAT
0.31
ncf_8_16_4_euad.6
UNSAT
0.31
ncf_16_32_2_euad.9
UNSAT
0.31
ncf_16_32_2_d.9
UNSAT
0.31
ncf_4_8_2_u.9
SAT
0.31
ncf_4_8_8_d.5
UNSAT
0.32
ncf_4_8_2_euad.9
SAT
0.33
ncf_4_8_2_euad.8
SAT
0.33
ncf_4_8_2_u.7
UNSAT
0.33
ncf_4_8_8_euad.5
UNSAT
0.33
ncf_4_8_4_euad.2
UNSAT
0.34
ncf_16_32_2_u.7
UNSAT
0.35
ncf_8_16_4_edau.6
UNSAT
0.37
ncf_16_32_2_euad.2
UNSAT
0.39
ncf_4_8_4_u.3
UNSAT
0.4
ncf_8_16_4_u.6
UNSAT
0.4
ncf_8_16_4_u.8
UNSAT
0.4
ncf_4_8_2_euad.2
SAT
0.41
ncf_4_8_8_edau.5
UNSAT
0.43
ncf_8_16_8_d.6
UNSAT
0.43
ncf_16_32_2_edau.4
UNSAT
0.43
ncf_16_32_2_d.4
UNSAT
0.44
ncf_8_16_8_euad.6
UNSAT
0.44
ncf_16_32_4_euad.7
UNSAT
0.45
ncf_16_32_4_euad.4
UNSAT
0.45
ncf_4_8_4_u.2
UNSAT
0.46
ncf_8_16_4_d.6
UNSAT
0.47
ncf_4_8_4_u.8
UNSAT
0.47
ncf_4_8_2_euad.6
SAT
0.47
ncf_4_8_8_u.5
UNSAT
0.48
ncf_4_8_2_u.6
SAT
0.49
ncf_4_8_4_euad.3
UNSAT
0.5
ncf_4_8_4_euad.8
UNSAT
0.5
ncf_4_8_8_u.4
SAT
0.51
ncf_16_32_4_edau.4
UNSAT
0.51
ncf_16_32_4_d.4
UNSAT
0.54
ncf_4_8_2_u.2
SAT
0.54
ncf_8_16_8_edau.6
UNSAT
0.54
ncf_4_8_8_euad.4
SAT
0.55
ncf_4_16_2_u.9
SAT
0.58
ncf_16_32_4_edau.7
UNSAT
0.59
ncf_16_32_2_euad.4
UNSAT
0.65
ncf_16_32_4_u.7
UNSAT
0.66
ncf_4_16_2_d.9
SAT
0.69
ncf_4_8_4_euad.6
SAT
0.79
ncf_4_8_4_u.4
UNSAT
0.81
ncf_16_32_4_d.7
UNSAT
0.87
ncf_4_16_2_euad.9
SAT
0.88
ncf_4_8_4_u.6
SAT
0.93
ncf_4_16_2_edau.9
SAT
0.98
ncf_4_16_2_euad.6
SAT
1.04
ncf_4_8_4_euad.4
UNSAT
1.14
ncf_4_8_8_edau.4
SAT
1.19
ncf_4_16_2_u.6
SAT
1.31
ncf_4_8_4_euad.5
SAT
1.39
ncf_4_16_2_d.6
SAT
1.44
ncf_4_16_2_d.10
UNSAT
1.54
ncf_4_16_2_edau.6
SAT
1.61
ncf_4_16_2_euad.10
UNSAT
1.61
ncf_4_16_2_edau.10
UNSAT
1.73
ncf_4_16_4_u.9
SAT
2.02
ncf_4_8_4_u.5
SAT
2.33
ncf_4_8_4_euad.10
SAT
2.38
ncf_4_8_8_u.1
SAT
2.61
ncf_4_8_8_euad.1
SAT
2.79
ncf_4_16_2_u.10
UNSAT
2.86
ncf_4_8_4_u.1
SAT
2.9
ncf_16_32_8_edau.8
UNSAT
2.92
ncf_8_16_4_u.1
SAT
3
ncf_8_16_4_edau.1
SAT
3.03
ncf_4_8_4_u.10
SAT
3.25
ncf_16_32_8_d.8
UNSAT
3.53
ncf_8_16_8_edau.1
SAT
3.83
ncf_4_16_2_euad.5
UNSAT
4.36
ncf_4_16_2_edau.7
SAT
4.66
ncf_4_16_4_euad.9
SAT
4.81
ncf_4_16_2_euad.2
SAT
5.24
ncf_8_16_8_euad.1
SAT
5.31
ncf_8_16_8_d.1
SAT
5.42
ncf_8_16_4_euad.10
SAT
5.71
ncf_4_16_2_d.5
UNSAT
6.09
ncf_4_16_2_u.7
SAT
6.1
ncf_16_32_8_euad.8
UNSAT
6.31
ncf_4_8_4_euad.1
SAT
7.16
ncf_16_32_4_euad.5
UNSAT
7.2
ncf_8_16_4_euad.1
SAT
7.32
ncf_8_16_4_d.1
SAT
7.32
ncf_4_16_2_d.7
SAT
8.15
ncf_4_8_8_euad.3
SAT
8.28
ncf_16_32_2_edau.8
UNSAT
9.28
ncf_4_16_2_u.2
SAT
9.98
ncf_4_8_8_euad.8
SAT
9.99
ncf_4_8_8_d.4
SAT
10.1
ncf_16_32_2_u.2
UNSAT
12.54
ncf_16_32_2_euad.8
UNSAT
12.7
ncf_4_16_2_euad.3
UNSAT
13.43
ncf_4_16_2_euad.7
SAT
14.18
ncf_8_16_4_u.10
SAT
15.96
ncf_16_32_4_d.5
UNSAT
16.06
ncf_4_16_2_euad.4
SAT
18.61
ncf_4_16_4_euad.5
SAT
18.84
ncf_4_16_4_euad.1
SAT
19.01
ncf_16_32_2_d.8
UNSAT
19.6
ncf_4_8_8_u.8
SAT
21.64
ncf_4_16_2_euad.1
UNSAT
22.84
ncf_8_16_4_edau.9
UNSAT
26.63
ncf_4_16_2_u.8
SAT
26.99
ncf_4_16_2_u.4
SAT
27.47
ncf_4_16_2_euad.8
SAT
31.45
ncf_4_16_2_u.3
UNSAT
32.22
ncf_4_16_2_d.2
SAT
32.96
ncf_4_16_2_edau.2
SAT
33.02
ncf_4_16_2_u.5
UNSAT
34.47
ncf_4_8_8_d.2
UNSAT
39.02
ncf_4_16_4_euad.6
UNSAT
44.44
ncf_4_16_2_d.1
UNSAT
50.19
ncf_4_16_4_edau.9
SAT
53.86
ncf_16_32_4_euad.10
UNSAT
59.88
ncf_4_8_8_u.7
SAT
63.49
ncf_4_16_2_u.1
UNSAT
68.02
ncf_4_8_8_u.3
SAT
68.7
ncf_4_16_4_u.7
SAT
77.93
ncf_4_8_8_euad.7
SAT
81.45
ncf_4_16_2_d.4
SAT
91.94
ncf_16_32_4_u.4
UNSAT
95.29
ncf_4_16_2_edau.4
SAT
96.13
ncf_4_16_4_u.5
SAT
96.57
ncf_16_32_2_u.4
UNSAT
99.62
ncf_4_16_4_u.1
SAT
99.73
ncf_4_16_4_d.9
SAT
100.74
ncf_4_16_4_euad.7
SAT
104.82
ncf_4_8_8_euad.2
UNSAT
123.94
ncf_16_32_8_u.8
UNSAT
169.82
ncf_8_16_4_euad.4
SAT
170.94
ncf_4_16_2_edau.3
UNSAT
171.96
ncf_4_8_8_u.10
SAT
173
ncf_4_16_2_d.3
UNSAT
184.01
ncf_4_16_2_edau.8
SAT
187.05
ncf_4_16_4_edau.10
UNSAT
189.52
ncf_4_8_8_euad.10
SAT
195.25
ncf_4_16_2_edau.5
UNSAT
232.74
ncf_4_8_8_u.2
UNSAT
239.33
ncf_4_16_2_edau.1
UNSAT
256.9
ncf_4_16_4_euad.4
UNSAT
262.06
ncf_8_16_4_d.10
SAT
310.46
ncf_4_16_4_u.6
UNSAT
323.43
ncf_4_16_2_d.8
SAT
325.31
ncf_4_8_8_edau.2
UNSAT
363.29
ncf_8_16_4_edau.10
SAT
391.96
ncf_8_16_8_euad.7
UNSAT
414.5
ncf_4_8_8_edau.1
SAT
511.62
ncf_4_16_4_u.10
UNSAT
738.74
ncf_16_32_8_edau.2
UNSAT
835.8
ncf_4_16_8_euad.7
SAT
892.58
ncf_4_32_2_u.2
SAT
1028.9
ncf_4_8_8_d.1
SAT
1031.97
ncf_4_32_2_edau.2
SAT
1142.17
ncf_8_16_8_edau.7
UNSAT
1230.04
ncf_8_16_4_u.9
UNSAT
1315.86
ncf_4_16_4_euad.10
UNSAT
1611.08
ncf_8_16_8_edau.9
UNSAT
2138.37
ncf_4_16_8_euad.9
SAT
2171.87
ncf_8_16_4_u.4
SAT
2262.55
ncf_8_16_8_d.7
UNSAT
2836.53
ncf_8_16_4_euad.3
SAT
3092.77
ncf_8_16_8_edau.8
UNSAT
3349.29
ncf_4_16_8_u.7
SAT
3830.08
ncf_4_8_8_edau.10
SAT
3839.51
ncf_4_16_4_edau.5
SAT
3854.03
ncf_4_16_4_d.5
SAT
4538.17
ncf_16_32_4_edau.5
UNSAT
4540.15
ncf_4_16_4_u.8
SAT
5179.45
ncf_4_16_4_euad.8
SAT
5219.03
ncf_16_32_8_euad.3
SAT
5516.44
ncf_8_16_4_u.3
SAT
5779.4
ncf_8_16_4_d.9
UNSAT
5927.51
ncf_16_32_4_euad.9
FAIL
5999.81
ncf_8_16_4_edau.7
FAIL
5999.82
ncf_4_32_2_edau.3
FAIL
5999.85
ncf_4_16_8_d.9
FAIL
5999.97
ncf_16_32_2_euad.3
FAIL
6000.01
ncf_4_8_8_d.3
FAIL
6000.03
ncf_16_32_2_u.8
FAIL
6000.14
ncf_4_32_2_u.3
FAIL
6000.33
ncf_4_16_4_edau.8
FAIL
6000.4
ncf_16_32_4_edau.8
FAIL
6000.41
ncf_16_32_8_u.3
FAIL
6000.44
ncf_4_16_4_d.2
FAIL
6000.49
ncf_4_8_8_d.8
FAIL
6000.5
ncf_4_8_8_edau.3
FAIL
6000.51
ncf_8_16_8_euad.2
FAIL
6000.52
ncf_4_32_2_u.7
FAIL
6000.58
ncf_8_16_8_d.4
FAIL
6000.67
ncf_8_16_4_d.3
FAIL
6000.69
ncf_4_8_8_d.10
FAIL
6000.69
ncf_8_16_8_d.3
FAIL
6000.71
ncf_16_32_2_u.5
FAIL
6000.71
ncf_16_32_8_u.9
FAIL
6000.71
ncf_8_16_4_edau.4
FAIL
6000.72
ncf_16_32_2_edau.3
FAIL
6000.73
ncf_8_16_8_euad.5
FAIL
6000.73
ncf_4_16_8_d.10
FAIL
6000.73
ncf_16_32_2_edau.5
FAIL
6000.73
ncf_16_32_2_d.6
FAIL
6000.74
ncf_16_32_2_euad.1
FAIL
6000.74
ncf_4_32_2_edau.8
FAIL
6000.74
ncf_16_32_4_euad.1
FAIL
6000.74
ncf_16_32_2_d.3
FAIL
6000.74
ncf_16_32_8_edau.7
FAIL
6000.74
ncf_16_32_2_u.6
FAIL
6000.74
ncf_4_16_8_euad.4
FAIL
6000.74
ncf_4_16_4_d.3
FAIL
6000.75
ncf_16_32_8_euad.1
FAIL
6000.75
ncf_8_16_4_d.4
FAIL
6000.75
ncf_4_16_4_edau.4
FAIL
6000.76
ncf_16_32_2_edau.10
FAIL
6000.76
ncf_8_16_8_d.8
FAIL
6000.77
ncf_4_32_2_edau.5
FAIL
6000.77
ncf_4_16_4_edau.2
FAIL
6000.77
ncf_16_32_4_edau.1
FAIL
6000.77
ncf_16_32_4_edau.6
FAIL
6000.77
ncf_16_32_8_u.1
FAIL
6000.78
ncf_16_32_4_d.3
FAIL
6000.78
ncf_4_8_8_edau.8
FAIL
6000.78
ncf_8_16_8_d.10
FAIL
6000.78
ncf_16_32_8_d.7
FAIL
6000.78
ncf_8_16_8_euad.9
FAIL
6000.78
ncf_8_16_4_edau.3
FAIL
6000.79
ncf_16_32_4_euad.3
FAIL
6000.79
ncf_16_32_4_euad.2
FAIL
6000.79
ncf_8_16_8_euad.3
FAIL
6000.79
ncf_16_32_4_edau.9
FAIL
6000.79
ncf_4_16_8_d.1
FAIL
6000.8
ncf_16_32_8_d.1
FAIL
6000.8
ncf_8_16_8_edau.10
FAIL
6000.8
ncf_16_32_4_edau.2
FAIL
6000.8
ncf_4_32_2_u.4
FAIL
6000.8
ncf_4_16_8_u.3
FAIL
6000.8
ncf_8_16_8_d.5
FAIL
6000.8
ncf_8_16_4_d.7
FAIL
6000.8
ncf_16_32_4_edau.3
FAIL
6000.8
ncf_4_16_4_u.3
FAIL
6000.81
ncf_4_16_8_u.2
FAIL
6000.81
ncf_4_8_8_d.6
FAIL
6000.81
ncf_8_16_8_edau.2
FAIL
6000.81
ncf_8_16_8_edau.3
FAIL
6000.81
ncf_16_32_8_edau.9
FAIL
6000.81
ncf_16_32_2_euad.5
FAIL
6000.81
ncf_4_16_4_d.6
FAIL
6000.81
ncf_16_32_8_u.7
FAIL
6000.81
ncf_4_16_8_euad.6
FAIL
6000.81
ncf_4_16_8_u.1
FAIL
6000.81
ncf_16_32_2_u.3
FAIL
6000.81
ncf_16_32_4_d.1
FAIL
6000.82
ncf_16_32_8_edau.1
FAIL
6000.82
ncf_4_16_4_edau.1
FAIL
6000.82
ncf_4_16_8_u.8
FAIL
6000.82
ncf_8_16_8_edau.5
FAIL
6000.82
ncf_4_16_4_u.2
FAIL
6000.82
ncf_16_32_8_d.6
FAIL
6000.82
ncf_4_16_4_edau.7
FAIL
6000.82
ncf_4_8_8_euad.6
FAIL
6000.82
ncf_16_32_4_u.8
FAIL
6000.82
ncf_16_32_2_u.1
FAIL
6000.82
ncf_4_16_4_u.4
FAIL
6000.82
ncf_16_32_2_d.10
FAIL
6000.82
ncf_4_16_4_edau.6
FAIL
6000.82
ncf_4_16_8_d.6
FAIL
6000.82
ncf_4_32_2_u.10
FAIL
6000.82
ncf_4_16_4_d.7
FAIL
6000.83
ncf_16_32_8_euad.7
FAIL
6000.83
ncf_4_16_4_d.10
FAIL
6000.83
ncf_4_8_8_edau.7
FAIL
6000.83
ncf_16_32_8_euad.4
FAIL
6000.83
ncf_16_32_8_euad.6
FAIL
6000.83
ncf_16_32_2_edau.1
FAIL
6000.83
ncf_16_32_2_d.1
FAIL
6000.83
ncf_4_16_8_euad.2
FAIL
6000.83
ncf_16_32_2_euad.6
FAIL
6000.83
ncf_4_32_2_edau.1
FAIL
6000.83
ncf_8_16_8_d.2
FAIL
6000.83
ncf_16_32_4_u.2
FAIL
6000.84
ncf_4_16_4_euad.2
FAIL
6000.84
ncf_4_32_2_u.5
FAIL
6000.84
ncf_16_32_4_d.10
FAIL
6000.84
ncf_4_32_2_edau.6
FAIL
6000.84
ncf_16_32_8_edau.10
FAIL
6000.84
ncf_16_32_4_d.6
FAIL
6000.84
ncf_16_32_8_euad.5
FAIL
6000.84
ncf_8_16_4_euad.9
FAIL
6000.84
ncf_4_32_2_u.1
FAIL
6000.84
ncf_4_16_4_d.1
FAIL
6000.84
ncf_16_32_4_u.1
FAIL
6000.84
ncf_4_16_8_u.5
FAIL
6000.84
ncf_8_16_8_d.9
FAIL
6000.84
ncf_16_32_4_d.9
FAIL
6000.84
ncf_8_16_4_euad.7
FAIL
6000.84
ncf_4_16_8_euad.8
FAIL
6000.85
ncf_4_32_2_u.8
FAIL
6000.85
ncf_4_16_8_euad.3
FAIL
6000.85
ncf_16_32_2_euad.10
FAIL
6000.85
ncf_16_32_4_u.3
FAIL
6000.85
ncf_8_16_8_euad.4
FAIL
6000.85
ncf_4_8_8_edau.6
FAIL
6000.85
ncf_16_32_8_euad.9
FAIL
6000.85
ncf_16_32_4_u.9
FAIL
6000.85
ncf_16_32_2_d.5
FAIL
6000.85
ncf_16_32_8_d.3
FAIL
6000.85
ncf_4_16_8_u.4
FAIL
6000.85
ncf_8_16_4_u.7
FAIL
6000.85
ncf_16_32_2_edau.6
FAIL
6000.86
ncf_16_32_8_u.2
FAIL
6000.86
ncf_4_16_8_euad.1
FAIL
6000.86
ncf_4_16_4_euad.3
FAIL
6000.86
ncf_16_32_8_d.10
FAIL
6000.86
ncf_16_32_8_edau.5
FAIL
6000.86
ncf_4_16_8_d.7
FAIL
6000.86
ncf_16_32_4_u.5
FAIL
6000.86
ncf_16_32_4_euad.6
FAIL
6000.86
ncf_4_32_2_edau.7
FAIL
6000.86
ncf_4_32_2_u.6
FAIL
6000.86
ncf_4_16_4_d.8
FAIL
6000.86
ncf_4_32_2_edau.4
FAIL
6000.86
ncf_16_32_8_u.4
FAIL
6000.87
ncf_4_16_4_d.4
FAIL
6000.87
ncf_16_32_8_edau.4
FAIL
6000.87
ncf_8_16_8_edau.4
FAIL
6000.87
ncf_8_16_8_euad.8
FAIL
6000.87
ncf_16_32_4_edau.10
FAIL
6000.87
ncf_16_32_4_d.2
FAIL
6000.87
ncf_16_32_8_u.5
FAIL
6000.87
ncf_4_16_4_edau.3
FAIL
6000.87
ncf_4_16_8_euad.5
FAIL
6000.88
ncf_4_32_2_edau.9
FAIL
6000.88
ncf_4_16_8_d.5
FAIL
6000.88
ncf_16_32_8_d.5
FAIL
6000.88
ncf_16_32_4_euad.8
FAIL
6000.88
ncf_8_16_8_euad.10
FAIL
6000.88
ncf_4_32_2_edau.10
FAIL
6000.88
ncf_16_32_8_euad.2
FAIL
6000.88
ncf_4_8_8_u.6
FAIL
6000.88
ncf_16_32_2_u.10
FAIL
6000.88
ncf_16_32_8_d.4
FAIL
6000.89
ncf_16_32_8_u.6
FAIL
6000.89
ncf_16_32_8_edau.6
FAIL
6000.89
ncf_16_32_4_u.6
FAIL
6000.89
ncf_4_16_8_euad.10
FAIL
6000.89
ncf_4_16_8_u.9
FAIL
6000.89
ncf_16_32_4_d.8
FAIL
6000.89
ncf_16_32_8_d.2
FAIL
6000.9
ncf_4_16_8_d.2
FAIL
6000.9
ncf_4_8_8_d.7
FAIL
6000.9
ncf_4_16_8_d.3
FAIL
6000.9
ncf_4_16_8_u.6
FAIL
6000.9
ncf_16_32_8_euad.10
FAIL
6000.9
ncf_16_32_8_u.10
FAIL
6000.91
ncf_4_16_8_d.4
FAIL
6000.91
ncf_4_16_8_d.8
FAIL
6000.91
ncf_4_16_8_u.10
FAIL
6000.92
ncf_4_32_2_u.9
FAIL
6000.92
ncf_16_32_4_u.10
FAIL
6000.93
ncf_16_32_8_d.9
FAIL
6000.93
ncf_16_32_8_edau.3
FAIL
6000.95
Contact
|
Organization
|
Links
|
Citing QBFLIB