QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family CounterFactual solved by
qube4.0
QBFEVAL'06
Instance
Result
Time
ncf_4_8_2_euad.2
SAT
0
ncf_4_8_2_euad.1
UNSAT
0
ncf_4_8_2_euad.8
SAT
0
ncf_4_8_4_euad.9
SAT
0
ncf_4_8_4_euad.6
SAT
0.01
ncf_4_8_2_euad.5
SAT
0.01
ncf_4_8_4_u.9
SAT
0.01
ncf_4_8_2_euad.9
SAT
0.01
ncf_4_16_2_edau.6
SAT
0.01
ncf_4_8_2_u.10
SAT
0.01
ncf_4_16_2_euad.6
SAT
0.01
ncf_4_8_2_u.7
UNSAT
0.01
ncf_8_16_4_euad.5
UNSAT
0.01
ncf_4_8_2_u.6
SAT
0.01
ncf_4_16_2_d.6
SAT
0.01
ncf_4_8_2_u.2
SAT
0.01
ncf_8_16_4_euad.2
UNSAT
0.02
ncf_4_8_2_u.9
SAT
0.02
ncf_4_8_2_euad.6
SAT
0.02
ncf_4_8_2_euad.10
SAT
0.02
ncf_8_16_4_d.1
SAT
0.02
ncf_4_8_2_u.1
UNSAT
0.02
ncf_8_16_4_d.10
SAT
0.02
ncf_8_16_4_euad.10
SAT
0.02
ncf_8_16_4_u.5
UNSAT
0.02
ncf_8_16_4_edau.1
SAT
0.02
ncf_4_16_2_u.9
SAT
0.02
ncf_4_16_2_d.2
SAT
0.02
ncf_8_16_4_edau.5
UNSAT
0.02
ncf_4_8_2_u.4
UNSAT
0.02
ncf_4_16_4_d.5
SAT
0.02
ncf_4_8_4_u.6
SAT
0.02
ncf_8_16_4_euad.1
SAT
0.02
ncf_4_16_4_euad.5
SAT
0.02
ncf_4_8_2_euad.4
UNSAT
0.02
ncf_4_16_2_u.6
SAT
0.03
ncf_16_32_2_euad.7
UNSAT
0.03
ncf_8_16_4_u.2
UNSAT
0.03
ncf_4_16_2_edau.4
SAT
0.03
ncf_4_16_2_euad.7
SAT
0.03
ncf_16_32_4_d.9
SAT
0.03
ncf_8_16_4_d.2
UNSAT
0.03
ncf_4_16_2_edau.2
SAT
0.03
ncf_16_32_4_d.1
SAT
0.03
ncf_16_32_2_d.6
SAT
0.03
ncf_4_8_2_u.5
SAT
0.03
ncf_4_16_2_d.4
SAT
0.03
ncf_8_16_4_edau.2
UNSAT
0.03
ncf_16_32_2_d.7
UNSAT
0.03
ncf_16_32_2_u.9
UNSAT
0.03
ncf_4_16_2_edau.7
SAT
0.03
ncf_4_8_4_u.2
UNSAT
0.03
ncf_8_16_4_u.1
SAT
0.03
ncf_4_8_8_d.9
UNSAT
0.03
ncf_8_16_4_u.10
SAT
0.03
ncf_16_32_2_euad.6
SAT
0.03
ncf_8_16_4_edau.10
SAT
0.03
ncf_16_32_2_euad.9
UNSAT
0.03
ncf_4_8_8_edau.9
UNSAT
0.03
ncf_4_8_2_u.8
SAT
0.03
ncf_16_32_2_d.9
UNSAT
0.03
ncf_16_32_4_u.9
SAT
0.04
ncf_16_32_2_edau.9
UNSAT
0.04
ncf_4_8_4_euad.2
UNSAT
0.04
ncf_16_32_4_edau.9
SAT
0.04
ncf_16_32_2_edau.6
SAT
0.04
ncf_4_16_4_edau.1
SAT
0.04
ncf_4_16_2_edau.9
SAT
0.04
ncf_4_32_2_edau.2
SAT
0.04
ncf_4_8_2_euad.7
UNSAT
0.04
ncf_16_32_2_edau.7
UNSAT
0.04
ncf_4_16_4_edau.5
SAT
0.04
ncf_8_16_4_d.5
UNSAT
0.04
ncf_4_8_8_d.8
SAT
0.04
ncf_16_32_4_d.3
SAT
0.04
ncf_4_16_4_edau.9
SAT
0.04
ncf_4_8_2_u.3
UNSAT
0.04
ncf_16_32_4_edau.1
SAT
0.04
ncf_16_32_4_euad.9
SAT
0.04
ncf_4_8_8_d.4
SAT
0.04
ncf_16_32_2_u.6
SAT
0.05
ncf_4_16_2_edau.10
UNSAT
0.05
ncf_4_8_8_edau.1
SAT
0.05
ncf_8_16_4_edau.4
SAT
0.05
ncf_16_32_4_u.1
SAT
0.05
ncf_4_8_8_edau.4
SAT
0.05
ncf_4_8_8_u.9
UNSAT
0.05
ncf_4_16_2_edau.1
UNSAT
0.05
ncf_4_16_2_u.7
SAT
0.05
ncf_8_16_4_d.8
UNSAT
0.05
ncf_4_16_2_euad.9
SAT
0.05
ncf_4_8_8_edau.8
SAT
0.05
ncf_4_8_8_euad.4
SAT
0.05
ncf_8_16_4_d.6
UNSAT
0.05
ncf_4_8_8_euad.9
UNSAT
0.05
ncf_4_16_2_d.7
SAT
0.05
ncf_4_16_4_d.1
SAT
0.05
ncf_4_16_4_u.9
SAT
0.05
ncf_8_16_4_edau.8
UNSAT
0.06
ncf_4_8_8_u.4
SAT
0.06
ncf_4_8_4_u.7
UNSAT
0.06
ncf_4_16_4_euad.9
SAT
0.06
ncf_16_32_2_u.7
UNSAT
0.06
ncf_8_16_4_d.4
SAT
0.06
ncf_4_8_8_d.1
SAT
0.06
ncf_4_8_4_euad.7
UNSAT
0.06
ncf_4_16_4_u.5
SAT
0.06
ncf_4_16_2_d.1
UNSAT
0.07
ncf_16_32_4_edau.3
SAT
0.07
ncf_4_8_8_edau.3
SAT
0.07
ncf_4_16_2_d.10
UNSAT
0.07
ncf_4_16_2_d.9
SAT
0.07
ncf_4_8_8_edau.5
UNSAT
0.07
ncf_4_8_2_euad.3
UNSAT
0.07
ncf_8_16_4_edau.6
UNSAT
0.07
ncf_4_16_2_d.8
SAT
0.07
ncf_4_16_2_d.5
UNSAT
0.07
ncf_4_32_2_edau.4
UNSAT
0.08
ncf_4_8_4_u.3
UNSAT
0.08
ncf_4_8_4_u.4
UNSAT
0.08
ncf_8_16_4_u.6
UNSAT
0.08
ncf_4_16_4_d.9
SAT
0.08
ncf_4_16_4_edau.8
SAT
0.08
ncf_4_32_2_edau.1
UNSAT
0.08
ncf_4_8_4_u.10
SAT
0.09
ncf_4_8_4_u.1
SAT
0.09
ncf_4_16_4_d.8
SAT
0.09
ncf_4_8_4_euad.3
UNSAT
0.09
ncf_4_8_4_u.8
UNSAT
0.09
ncf_8_16_4_u.8
UNSAT
0.1
ncf_4_8_8_d.5
UNSAT
0.1
ncf_8_16_8_edau.1
SAT
0.1
ncf_4_8_4_euad.10
SAT
0.1
ncf_4_16_2_edau.5
UNSAT
0.1
ncf_4_8_4_euad.1
SAT
0.1
ncf_4_16_4_d.4
UNSAT
0.1
ncf_16_32_2_d.2
UNSAT
0.1
ncf_4_8_8_d.3
SAT
0.1
ncf_4_16_4_edau.4
UNSAT
0.1
ncf_8_16_8_d.7
UNSAT
0.11
ncf_4_8_4_euad.8
UNSAT
0.11
ncf_8_16_8_d.1
SAT
0.11
ncf_8_16_4_euad.6
UNSAT
0.11
ncf_4_16_2_edau.8
SAT
0.11
ncf_8_16_8_euad.1
SAT
0.12
ncf_16_32_8_edau.4
SAT
0.12
ncf_8_16_4_euad.8
UNSAT
0.12
ncf_4_8_8_edau.2
UNSAT
0.13
ncf_16_32_8_d.4
SAT
0.13
ncf_16_32_4_edau.8
SAT
0.13
ncf_4_16_4_d.7
SAT
0.14
ncf_16_32_4_d.8
SAT
0.15
ncf_8_16_8_edau.7
UNSAT
0.15
ncf_16_32_2_edau.2
UNSAT
0.15
ncf_4_8_4_u.5
SAT
0.15
ncf_16_32_2_d.8
UNSAT
0.16
ncf_4_16_4_edau.7
SAT
0.16
ncf_8_16_8_d.6
UNSAT
0.16
ncf_8_16_8_edau.6
UNSAT
0.17
ncf_4_8_4_euad.4
UNSAT
0.17
ncf_4_8_8_d.2
UNSAT
0.17
ncf_4_32_2_u.2
SAT
0.18
ncf_4_16_4_edau.6
UNSAT
0.18
ncf_4_8_4_euad.5
SAT
0.18
ncf_4_16_2_edau.3
UNSAT
0.18
ncf_4_8_8_edau.7
SAT
0.2
ncf_4_16_2_d.3
UNSAT
0.2
ncf_16_32_2_edau.5
UNSAT
0.2
ncf_4_16_8_d.7
SAT
0.21
ncf_4_16_4_d.2
SAT
0.23
ncf_4_16_8_d.6
SAT
0.23
ncf_4_16_4_edau.2
SAT
0.23
ncf_4_16_4_edau.3
SAT
0.24
ncf_4_16_2_euad.8
SAT
0.24
ncf_16_32_4_d.7
UNSAT
0.24
ncf_4_8_8_u.1
SAT
0.25
ncf_4_16_2_u.8
SAT
0.26
ncf_4_32_2_edau.9
UNSAT
0.27
ncf_16_32_4_edau.7
UNSAT
0.27
ncf_4_8_8_euad.1
SAT
0.28
ncf_16_32_4_d.4
UNSAT
0.31
ncf_8_16_8_edau.9
UNSAT
0.31
ncf_4_8_8_d.7
SAT
0.32
ncf_4_16_2_u.5
UNSAT
0.33
ncf_4_16_2_euad.5
UNSAT
0.34
ncf_4_8_8_edau.6
UNSAT
0.35
ncf_8_16_8_d.9
UNSAT
0.36
ncf_16_32_4_edau.4
UNSAT
0.37
ncf_16_32_2_edau.8
UNSAT
0.37
ncf_16_32_4_edau.10
UNSAT
0.37
ncf_4_8_8_edau.10
SAT
0.38
ncf_4_16_2_u.10
UNSAT
0.4
ncf_4_16_4_d.6
UNSAT
0.42
ncf_8_16_4_d.9
UNSAT
0.46
ncf_16_32_4_edau.2
SAT
0.47
ncf_16_32_4_d.10
UNSAT
0.47
ncf_8_16_8_euad.7
UNSAT
0.48
ncf_16_32_4_d.2
SAT
0.49
ncf_16_32_4_edau.5
UNSAT
0.51
ncf_8_16_4_edau.9
UNSAT
0.51
ncf_4_16_4_u.4
UNSAT
0.53
ncf_8_16_4_edau.7
SAT
0.53
ncf_4_32_2_edau.6
UNSAT
0.54
ncf_16_32_2_d.5
UNSAT
0.57
ncf_16_32_2_d.10
UNSAT
0.58
ncf_4_8_8_u.8
SAT
0.59
ncf_8_16_8_edau.10
SAT
0.59
ncf_16_32_4_d.5
UNSAT
0.62
ncf_4_16_4_u.3
SAT
0.64
ncf_4_16_4_edau.10
UNSAT
0.64
ncf_8_16_8_edau.3
SAT
0.65
ncf_4_32_2_edau.8
SAT
0.66
ncf_4_16_8_euad.10
SAT
0.68
ncf_4_16_2_u.2
SAT
0.69
ncf_16_32_8_edau.3
SAT
0.69
ncf_4_16_2_u.4
SAT
0.7
ncf_4_16_2_euad.2
SAT
0.71
ncf_4_8_8_u.2
UNSAT
0.72
ncf_8_16_8_edau.8
UNSAT
0.74
ncf_8_16_4_d.3
SAT
0.75
ncf_4_16_2_euad.4
SAT
0.76
ncf_4_8_8_euad.8
SAT
0.77
ncf_4_16_2_u.3
UNSAT
0.79
ncf_4_16_4_u.7
SAT
0.82
ncf_4_16_4_euad.7
SAT
0.89
ncf_4_16_8_u.10
SAT
0.9
ncf_16_32_4_euad.1
SAT
0.92
ncf_4_8_8_u.3
SAT
0.93
ncf_16_32_2_edau.10
UNSAT
1
ncf_8_16_8_euad.9
UNSAT
1.05
ncf_8_16_4_edau.3
SAT
1.05
ncf_4_16_2_u.1
UNSAT
1.11
ncf_4_16_4_u.10
UNSAT
1.14
ncf_4_8_8_d.6
UNSAT
1.18
ncf_4_8_8_euad.3
SAT
1.19
ncf_4_16_4_d.10
UNSAT
1.2
ncf_8_16_4_d.7
SAT
1.24
ncf_4_8_8_u.10
SAT
1.32
ncf_4_16_2_euad.3
UNSAT
1.34
ncf_4_16_2_euad.1
UNSAT
1.36
ncf_4_8_8_euad.2
UNSAT
1.47
ncf_8_16_4_euad.7
SAT
1.49
ncf_4_16_2_euad.10
UNSAT
1.51
ncf_4_16_4_euad.8
SAT
1.7
ncf_4_8_8_d.10
SAT
1.72
ncf_16_32_8_u.4
SAT
1.78
ncf_4_32_2_edau.10
SAT
1.83
ncf_4_16_4_u.8
SAT
1.85
ncf_4_8_8_euad.10
SAT
1.96
ncf_8_16_8_d.10
SAT
1.99
ncf_4_16_4_euad.4
UNSAT
2.06
ncf_4_16_8_d.8
UNSAT
2.14
ncf_4_16_4_u.1
SAT
2.34
ncf_16_32_8_edau.10
SAT
2.42
ncf_16_32_8_d.3
SAT
2.44
ncf_16_32_8_d.5
UNSAT
2.59
ncf_4_16_8_euad.8
UNSAT
2.62
ncf_4_16_4_euad.1
SAT
2.76
ncf_4_32_2_edau.3
UNSAT
2.84
ncf_4_8_8_euad.6
UNSAT
3.25
ncf_4_8_8_u.7
SAT
3.33
ncf_8_16_4_u.7
SAT
3.34
ncf_16_32_8_edau.8
UNSAT
3.45
ncf_16_32_8_d.10
SAT
3.47
ncf_16_32_8_d.8
UNSAT
3.61
ncf_16_32_8_euad.4
SAT
3.65
ncf_4_8_8_euad.7
SAT
3.67
ncf_8_16_8_d.5
SAT
4
ncf_8_16_8_d.3
SAT
4.06
ncf_4_8_8_u.5
UNSAT
4.18
ncf_4_16_4_euad.2
SAT
4.2
ncf_4_16_4_euad.6
UNSAT
4.31
ncf_4_32_2_u.8
SAT
4.51
ncf_4_8_8_euad.5
UNSAT
5.13
ncf_4_16_4_d.3
SAT
5.27
ncf_16_32_2_edau.3
SAT
5.41
ncf_4_16_8_u.9
SAT
5.56
ncf_4_16_8_d.2
SAT
6.24
ncf_4_16_8_euad.9
SAT
6.27
ncf_4_16_4_u.6
UNSAT
6.57
ncf_4_16_8_d.4
SAT
7.52
ncf_4_16_8_u.2
SAT
8.24
ncf_4_16_4_euad.3
SAT
9.14
ncf_8_16_4_u.9
UNSAT
10.2
ncf_4_32_2_edau.5
UNSAT
10.55
ncf_8_16_8_edau.2
SAT
10.99
ncf_8_16_8_edau.5
SAT
11.42
ncf_16_32_2_d.4
UNSAT
11.98
ncf_16_32_2_d.3
SAT
12.31
ncf_8_16_4_euad.9
UNSAT
13.85
ncf_4_16_4_u.2
SAT
13.92
ncf_16_32_8_edau.5
UNSAT
14.78
ncf_8_16_8_d.8
UNSAT
15.46
ncf_4_32_2_u.4
UNSAT
16.72
ncf_4_32_2_edau.7
SAT
17.37
ncf_4_16_4_euad.10
UNSAT
20.56
ncf_8_16_4_u.4
SAT
22.83
ncf_4_16_8_euad.5
UNSAT
23.05
ncf_16_32_2_edau.4
UNSAT
23.06
ncf_8_16_4_euad.4
SAT
25.95
ncf_16_32_8_d.6
SAT
27.73
ncf_4_16_8_u.1
SAT
28.14
ncf_4_32_2_u.3
UNSAT
31.79
ncf_4_16_8_euad.2
SAT
36.68
ncf_8_16_8_d.2
SAT
37
ncf_4_8_8_u.6
UNSAT
40.91
ncf_4_16_8_u.5
UNSAT
47.98
ncf_4_16_8_d.5
UNSAT
52.27
ncf_8_16_8_edau.4
UNSAT
62.81
ncf_16_32_4_u.5
UNSAT
66.17
ncf_16_32_4_u.10
UNSAT
69.2
ncf_8_16_8_euad.6
UNSAT
73.08
ncf_8_16_4_euad.3
SAT
85.72
ncf_16_32_4_euad.5
UNSAT
88.3
ncf_4_32_2_u.9
UNSAT
116.74
ncf_8_16_4_u.3
SAT
139.76
ncf_4_32_2_u.7
SAT
181.41
ncf_8_16_8_euad.8
UNSAT
183.11
ncf_16_32_8_u.3
SAT
188.35
ncf_4_16_8_u.7
SAT
196.55
ncf_16_32_4_euad.10
UNSAT
200
ncf_4_16_8_d.9
SAT
212.28
ncf_8_16_8_euad.2
SAT
230.47
ncf_16_32_8_euad.3
SAT
234.38
ncf_4_16_8_euad.7
SAT
239.73
ncf_8_16_8_euad.3
SAT
243.74
ncf_4_16_8_d.3
SAT
280.85
ncf_8_16_8_d.4
UNSAT
355.57
ncf_16_32_4_euad.8
SAT
399.98
ncf_16_32_4_euad.6
FAIL
594.99
ncf_16_32_4_u.6
FAIL
598.06
ncf_4_16_8_u.6
SAT
600.6
ncf_16_32_2_euad.2
UNSAT
617.59
ncf_16_32_4_u.8
SAT
723.85
ncf_16_32_2_d.1
UNSAT
857.81
ncf_16_32_2_u.2
UNSAT
879.04
ncf_4_16_8_euad.1
SAT
911.38
ncf_4_32_2_u.6
UNSAT
1046.15
ncf_4_16_8_d.1
SAT
1469.25
ncf_16_32_4_u.2
SAT
1761.57
ncf_16_32_8_u.1
FAIL
2327.25
ncf_16_32_8_edau.2
FAIL
3179.09
ncf_8_16_8_euad.10
FAIL
3192.94
ncf_16_32_8_d.2
FAIL
3235.65
ncf_16_32_8_u.5
FAIL
3334.82
ncf_16_32_8_d.1
FAIL
3458.04
ncf_16_32_8_edau.9
FAIL
4113.69
ncf_16_32_8_euad.5
FAIL
4227.76
ncf_16_32_8_euad.8
FAIL
4485.25
ncf_16_32_8_d.9
FAIL
4593.79
ncf_16_32_8_edau.1
FAIL
4732.71
ncf_16_32_2_edau.1
UNSAT
4952.41
ncf_4_16_8_euad.4
SAT
5030.53
ncf_16_32_8_d.7
FAIL
5332.65
ncf_16_32_8_u.8
FAIL
5994.9
ncf_8_16_8_euad.4
FAIL
5999.69
ncf_8_16_8_euad.5
FAIL
5999.83
ncf_16_32_4_euad.4
FAIL
5999.87
ncf_16_32_8_edau.7
FAIL
5999.92
ncf_16_32_4_euad.2
FAIL
5999.94
ncf_16_32_8_edau.6
FAIL
6000.01
ncf_4_16_8_euad.6
FAIL
6000.11
ncf_4_16_8_u.3
FAIL
6000.12
ncf_16_32_8_u.10
FAIL
6000.17
ncf_16_32_8_euad.10
FAIL
6000.22
ncf_4_16_8_u.8
FAIL
6000.25
ncf_4_16_8_u.4
FAIL
6000.28
ncf_16_32_4_edau.6
FAIL
6000.28
ncf_4_16_8_euad.3
FAIL
6000.3
ncf_16_32_4_u.4
FAIL
6000.33
ncf_16_32_4_d.6
FAIL
6000.39
ncf_4_16_8_d.10
FAIL
6000.46
ncf_16_32_2_euad.5
FAIL
6000.48
ncf_16_32_2_u.5
FAIL
6000.49
ncf_16_32_4_euad.7
FAIL
6000.53
ncf_16_32_8_u.7
FAIL
6000.55
ncf_4_32_2_u.10
FAIL
6000.58
ncf_16_32_2_u.1
FAIL
6000.58
ncf_16_32_8_u.2
FAIL
6000.61
ncf_16_32_2_euad.3
FAIL
6000.62
ncf_16_32_2_u.3
FAIL
6000.63
ncf_16_32_4_u.7
FAIL
6000.64
ncf_16_32_8_euad.7
FAIL
6000.64
ncf_4_32_2_u.1
FAIL
6000.64
ncf_16_32_2_euad.8
FAIL
6000.65
ncf_16_32_2_u.8
FAIL
6000.66
ncf_16_32_8_euad.2
FAIL
6000.66
ncf_16_32_2_u.4
FAIL
6000.67
ncf_16_32_8_euad.6
FAIL
6000.67
ncf_16_32_4_euad.3
FAIL
6000.67
ncf_16_32_2_euad.1
FAIL
6000.68
ncf_16_32_2_u.10
FAIL
6000.69
ncf_16_32_4_u.3
FAIL
6000.69
ncf_16_32_2_euad.4
FAIL
6000.7
ncf_16_32_2_euad.10
FAIL
6000.73
ncf_4_32_2_u.5
FAIL
6000.73
ncf_16_32_8_euad.1
FAIL
6000.76
ncf_16_32_8_u.9
FAIL
6000.78
ncf_16_32_8_euad.9
FAIL
6000.81
ncf_16_32_8_u.6
FAIL
6000.84
Contact
|
Organization
|
Links
|
Citing QBFLIB