QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family CounterFactual solved by
qube5.0
QBFEVAL'06
Instance
Result
Time
ncf_4_8_2_u.9
SAT
0
ncf_4_16_2_euad.6
SAT
0
ncf_4_8_2_u.2
SAT
0.01
ncf_4_16_2_d.4
SAT
0.01
ncf_4_8_2_euad.9
SAT
0.01
ncf_4_8_8_d.9
UNSAT
0.01
ncf_4_16_2_edau.6
SAT
0.01
ncf_4_8_2_u.4
UNSAT
0.01
ncf_4_8_2_u.10
SAT
0.01
ncf_4_16_2_d.6
SAT
0.02
ncf_4_8_2_u.6
SAT
0.02
ncf_16_32_2_d.9
UNSAT
0.02
ncf_4_8_2_u.8
SAT
0.02
ncf_8_16_4_u.2
UNSAT
0.02
ncf_16_32_2_u.6
SAT
0.02
ncf_4_8_2_u.1
UNSAT
0.02
ncf_4_16_2_euad.7
SAT
0.02
ncf_4_8_2_u.5
SAT
0.02
ncf_4_8_2_euad.5
SAT
0.02
ncf_8_16_4_u.5
UNSAT
0.02
ncf_4_8_4_u.9
SAT
0.02
ncf_8_16_4_edau.1
SAT
0.02
ncf_4_8_2_euad.7
UNSAT
0.02
ncf_4_8_4_euad.9
SAT
0.02
ncf_4_8_8_euad.9
UNSAT
0.03
ncf_16_32_2_euad.9
UNSAT
0.03
ncf_4_16_4_euad.5
SAT
0.03
ncf_4_8_2_euad.4
UNSAT
0.03
ncf_4_8_4_u.6
SAT
0.03
ncf_4_16_2_u.6
SAT
0.03
ncf_8_16_4_d.10
SAT
0.03
ncf_4_8_4_euad.2
UNSAT
0.03
ncf_4_8_2_euad.6
SAT
0.03
ncf_8_16_4_d.2
UNSAT
0.03
ncf_4_8_2_euad.10
SAT
0.03
ncf_8_16_4_d.1
SAT
0.03
ncf_16_32_2_u.9
UNSAT
0.03
ncf_8_16_4_euad.10
SAT
0.03
ncf_4_8_2_euad.2
SAT
0.03
ncf_4_8_8_u.9
UNSAT
0.03
ncf_4_32_2_edau.2
SAT
0.03
ncf_4_8_4_u.2
UNSAT
0.03
ncf_8_16_4_u.1
SAT
0.03
ncf_4_16_4_edau.5
SAT
0.03
ncf_4_8_2_u.7
UNSAT
0.03
ncf_4_8_2_euad.8
SAT
0.03
ncf_8_16_4_euad.5
UNSAT
0.04
ncf_16_32_2_euad.6
SAT
0.04
ncf_8_16_4_edau.10
SAT
0.04
ncf_4_8_8_euad.4
SAT
0.04
ncf_16_32_4_euad.9
SAT
0.04
ncf_4_8_8_edau.9
UNSAT
0.04
ncf_4_16_2_edau.4
SAT
0.04
ncf_4_8_4_euad.6
SAT
0.04
ncf_4_16_2_edau.2
SAT
0.04
ncf_4_8_4_u.7
UNSAT
0.04
ncf_4_8_2_euad.1
UNSAT
0.04
ncf_4_16_2_d.2
SAT
0.04
ncf_8_16_4_d.5
UNSAT
0.04
ncf_8_16_4_edau.5
UNSAT
0.04
ncf_4_16_4_d.5
SAT
0.05
ncf_4_16_2_euad.9
SAT
0.05
ncf_4_8_8_edau.8
SAT
0.05
ncf_8_16_4_d.4
SAT
0.05
ncf_8_16_4_euad.1
SAT
0.05
ncf_4_16_2_d.7
SAT
0.05
ncf_4_16_4_d.1
SAT
0.05
ncf_4_8_8_d.4
SAT
0.05
ncf_4_16_4_u.5
SAT
0.05
ncf_4_8_8_edau.1
SAT
0.05
ncf_16_32_2_euad.7
UNSAT
0.05
ncf_8_16_4_euad.2
UNSAT
0.05
ncf_16_32_4_u.9
SAT
0.05
ncf_4_16_2_edau.10
UNSAT
0.05
ncf_4_16_2_d.1
UNSAT
0.05
ncf_8_16_4_edau.2
UNSAT
0.05
ncf_16_32_2_d.7
UNSAT
0.05
ncf_8_16_4_edau.8
UNSAT
0.05
ncf_16_32_2_d.6
SAT
0.05
ncf_16_32_2_edau.6
SAT
0.05
ncf_4_16_2_edau.7
SAT
0.05
ncf_4_8_2_euad.3
UNSAT
0.05
ncf_4_16_2_edau.9
SAT
0.05
ncf_4_16_2_u.7
SAT
0.05
ncf_8_16_4_u.10
SAT
0.05
ncf_4_8_8_d.8
SAT
0.05
ncf_4_16_2_u.9
SAT
0.05
ncf_8_16_4_d.8
UNSAT
0.05
ncf_16_32_2_u.7
UNSAT
0.05
ncf_8_16_4_d.6
UNSAT
0.06
ncf_4_8_8_d.1
SAT
0.06
ncf_4_8_2_u.3
UNSAT
0.06
ncf_16_32_4_edau.1
SAT
0.06
ncf_4_16_4_u.9
SAT
0.06
ncf_16_32_2_edau.9
UNSAT
0.06
ncf_4_8_8_edau.3
SAT
0.06
ncf_16_32_4_d.9
SAT
0.06
ncf_4_16_2_d.10
UNSAT
0.06
ncf_4_16_2_d.9
SAT
0.06
ncf_16_32_4_d.3
SAT
0.06
ncf_4_16_4_edau.9
SAT
0.06
ncf_4_8_4_euad.7
UNSAT
0.07
ncf_16_32_4_u.1
SAT
0.07
ncf_16_32_4_edau.9
SAT
0.07
ncf_4_8_8_edau.4
SAT
0.07
ncf_16_32_4_d.1
SAT
0.07
ncf_4_16_4_edau.1
SAT
0.07
ncf_16_32_2_edau.7
UNSAT
0.07
ncf_4_16_2_d.8
SAT
0.07
ncf_4_16_2_d.5
UNSAT
0.07
ncf_4_32_2_edau.4
UNSAT
0.08
ncf_16_32_4_edau.3
SAT
0.08
ncf_4_8_8_u.4
SAT
0.08
ncf_4_8_4_euad.1
SAT
0.08
ncf_4_16_2_edau.1
UNSAT
0.08
ncf_8_16_4_u.6
UNSAT
0.08
ncf_4_32_2_edau.1
UNSAT
0.09
ncf_4_8_4_u.8
UNSAT
0.09
ncf_4_8_4_euad.3
UNSAT
0.09
ncf_8_16_4_edau.4
SAT
0.09
ncf_4_16_4_d.8
SAT
0.09
ncf_4_8_4_u.10
SAT
0.09
ncf_4_8_4_u.1
SAT
0.09
ncf_8_16_4_edau.6
UNSAT
0.09
ncf_4_16_4_d.9
SAT
0.09
ncf_8_16_4_euad.6
UNSAT
0.1
ncf_8_16_4_u.8
UNSAT
0.1
ncf_4_8_8_d.5
UNSAT
0.1
ncf_8_16_8_edau.1
SAT
0.1
ncf_4_8_4_u.3
UNSAT
0.1
ncf_4_16_2_edau.5
UNSAT
0.1
ncf_4_16_4_edau.8
SAT
0.1
ncf_4_16_4_euad.9
SAT
0.1
ncf_4_8_4_u.4
UNSAT
0.1
ncf_4_8_8_d.3
SAT
0.1
ncf_4_16_4_edau.4
UNSAT
0.11
ncf_4_8_4_euad.10
SAT
0.11
ncf_4_8_4_euad.8
UNSAT
0.11
ncf_4_16_4_d.4
UNSAT
0.11
ncf_4_16_2_edau.8
SAT
0.12
ncf_8_16_8_d.1
SAT
0.12
ncf_16_32_2_d.2
UNSAT
0.12
ncf_8_16_4_euad.8
UNSAT
0.12
ncf_4_8_8_edau.5
UNSAT
0.13
ncf_8_16_8_edau.7
UNSAT
0.13
ncf_8_16_8_d.7
UNSAT
0.14
ncf_16_32_4_d.8
SAT
0.14
ncf_4_8_8_edau.2
UNSAT
0.15
ncf_16_32_8_d.4
SAT
0.15
ncf_16_32_4_edau.8
SAT
0.15
ncf_8_16_8_euad.1
SAT
0.16
ncf_4_16_4_d.7
SAT
0.16
ncf_16_32_2_edau.2
UNSAT
0.16
ncf_4_8_4_u.5
SAT
0.16
ncf_4_16_2_edau.3
UNSAT
0.16
ncf_4_16_4_edau.7
SAT
0.17
ncf_16_32_8_edau.4
SAT
0.17
ncf_16_32_2_d.8
UNSAT
0.18
ncf_4_8_4_euad.5
SAT
0.18
ncf_8_16_8_d.6
UNSAT
0.19
ncf_4_16_4_edau.6
UNSAT
0.19
ncf_4_8_4_euad.4
UNSAT
0.19
ncf_8_16_8_edau.6
UNSAT
0.2
ncf_4_16_2_d.3
UNSAT
0.2
ncf_16_32_2_edau.5
UNSAT
0.21
ncf_4_8_8_d.2
UNSAT
0.22
ncf_4_32_2_u.2
SAT
0.22
ncf_4_16_2_euad.8
SAT
0.22
ncf_4_16_8_d.7
SAT
0.22
ncf_4_16_8_d.6
SAT
0.24
ncf_4_8_8_edau.7
SAT
0.24
ncf_4_8_8_u.1
SAT
0.24
ncf_4_16_4_edau.3
SAT
0.25
ncf_4_16_4_d.2
SAT
0.25
ncf_4_16_4_edau.2
SAT
0.25
ncf_16_32_4_d.7
UNSAT
0.26
ncf_4_16_2_u.8
SAT
0.27
ncf_4_32_2_edau.9
UNSAT
0.28
ncf_4_8_8_d.7
SAT
0.29
ncf_16_32_4_d.4
UNSAT
0.3
ncf_16_32_4_edau.7
UNSAT
0.3
ncf_4_8_8_euad.1
SAT
0.3
ncf_4_16_2_u.5
UNSAT
0.34
ncf_16_32_2_edau.8
UNSAT
0.36
ncf_4_8_8_edau.6
UNSAT
0.36
ncf_8_16_8_edau.9
UNSAT
0.37
ncf_4_16_2_euad.5
UNSAT
0.37
ncf_16_32_4_edau.4
UNSAT
0.38
ncf_16_32_4_edau.10
UNSAT
0.38
ncf_8_16_8_d.9
UNSAT
0.39
ncf_4_8_8_edau.10
SAT
0.41
ncf_4_16_2_u.10
UNSAT
0.41
ncf_4_16_4_d.6
UNSAT
0.43
ncf_8_16_8_euad.7
UNSAT
0.46
ncf_8_16_4_d.9
UNSAT
0.46
ncf_16_32_4_edau.2
SAT
0.48
ncf_16_32_4_d.10
UNSAT
0.5
ncf_8_16_4_edau.9
UNSAT
0.5
ncf_16_32_4_d.2
SAT
0.51
ncf_16_32_4_edau.5
UNSAT
0.51
ncf_4_16_4_u.4
UNSAT
0.52
ncf_8_16_4_edau.7
SAT
0.55
ncf_4_32_2_edau.6
UNSAT
0.56
ncf_16_32_2_d.5
UNSAT
0.57
ncf_4_8_8_u.8
SAT
0.61
ncf_16_32_2_d.10
UNSAT
0.61
ncf_16_32_4_d.5
UNSAT
0.61
ncf_8_16_8_edau.10
SAT
0.62
ncf_4_16_4_u.3
SAT
0.63
ncf_4_16_2_u.2
SAT
0.66
ncf_8_16_8_edau.3
SAT
0.66
ncf_4_16_2_euad.2
SAT
0.67
ncf_4_16_4_edau.10
UNSAT
0.67
ncf_4_16_8_euad.10
SAT
0.7
ncf_4_32_2_edau.8
SAT
0.7
ncf_4_8_8_u.2
UNSAT
0.71
ncf_4_16_2_u.4
SAT
0.72
ncf_4_16_2_euad.4
SAT
0.74
ncf_8_16_8_edau.8
UNSAT
0.74
ncf_16_32_8_edau.3
SAT
0.75
ncf_4_8_8_euad.8
SAT
0.81
ncf_8_16_4_d.3
SAT
0.81
ncf_4_16_2_u.3
UNSAT
0.81
ncf_4_16_4_u.7
SAT
0.82
ncf_4_16_4_euad.7
SAT
0.9
ncf_4_8_8_u.3
SAT
0.93
ncf_4_16_8_u.10
SAT
0.93
ncf_16_32_4_euad.1
SAT
0.95
ncf_16_32_2_edau.10
UNSAT
1.01
ncf_8_16_8_euad.9
UNSAT
1.04
ncf_8_16_4_edau.3
SAT
1.06
ncf_4_16_2_u.1
UNSAT
1.14
ncf_4_16_4_u.10
UNSAT
1.16
ncf_4_8_8_euad.3
SAT
1.19
ncf_4_8_8_d.6
UNSAT
1.21
ncf_4_16_4_d.10
UNSAT
1.25
ncf_8_16_4_d.7
SAT
1.27
ncf_4_8_8_u.10
SAT
1.3
ncf_4_16_2_euad.3
UNSAT
1.34
ncf_4_16_2_euad.1
UNSAT
1.39
ncf_4_16_2_euad.10
UNSAT
1.49
ncf_4_8_8_euad.2
UNSAT
1.5
ncf_8_16_4_euad.7
SAT
1.51
ncf_4_8_8_d.10
SAT
1.7
ncf_4_16_4_euad.8
SAT
1.7
ncf_4_32_2_edau.10
SAT
1.83
ncf_16_32_8_u.4
SAT
1.86
ncf_4_16_4_u.8
SAT
1.88
ncf_8_16_8_d.10
SAT
1.95
ncf_4_8_8_euad.10
SAT
1.99
ncf_4_16_4_euad.4
UNSAT
2.1
ncf_4_16_8_d.8
UNSAT
2.18
ncf_4_16_4_u.1
SAT
2.35
ncf_16_32_8_d.3
SAT
2.48
ncf_16_32_8_edau.10
SAT
2.5
ncf_4_16_8_euad.8
UNSAT
2.68
ncf_16_32_8_d.5
UNSAT
2.7
ncf_4_16_4_euad.1
SAT
2.78
ncf_4_32_2_edau.3
UNSAT
2.86
ncf_4_8_8_u.7
SAT
3.29
ncf_4_8_8_euad.6
UNSAT
3.31
ncf_8_16_4_u.7
SAT
3.43
ncf_16_32_8_edau.8
UNSAT
3.52
ncf_16_32_8_d.10
SAT
3.59
ncf_16_32_8_d.8
UNSAT
3.71
ncf_4_8_8_euad.7
SAT
3.72
ncf_16_32_8_euad.4
SAT
3.74
ncf_8_16_8_d.5
SAT
4.09
ncf_8_16_8_d.3
SAT
4.16
ncf_4_16_4_euad.2
SAT
4.19
ncf_4_8_8_u.5
UNSAT
4.31
ncf_4_16_4_euad.6
UNSAT
4.32
ncf_4_32_2_u.8
SAT
4.59
ncf_4_8_8_euad.5
UNSAT
5.17
ncf_4_16_4_d.3
SAT
5.28
ncf_16_32_2_edau.3
SAT
5.45
ncf_4_16_8_u.9
SAT
5.67
ncf_4_16_8_d.2
SAT
6.39
ncf_4_16_8_euad.9
SAT
6.47
ncf_4_16_4_u.6
UNSAT
6.65
ncf_4_16_8_d.4
SAT
7.6
ncf_4_16_8_u.2
SAT
8.11
ncf_4_16_4_euad.3
SAT
9.06
ncf_8_16_4_u.9
UNSAT
10.14
ncf_4_32_2_edau.5
UNSAT
10.63
ncf_8_16_8_edau.2
SAT
11.02
ncf_8_16_8_edau.5
SAT
11.66
ncf_16_32_2_d.4
UNSAT
12.04
ncf_16_32_2_d.3
SAT
12.16
ncf_8_16_4_euad.9
UNSAT
14.02
ncf_4_16_4_u.2
SAT
14.08
ncf_16_32_8_edau.5
UNSAT
15.08
ncf_8_16_8_d.8
UNSAT
15.84
ncf_4_32_2_u.4
UNSAT
16.6
ncf_4_32_2_edau.7
SAT
17.43
ncf_4_16_4_euad.10
UNSAT
20.25
ncf_4_16_8_euad.5
UNSAT
23.1
ncf_8_16_4_u.4
SAT
23.14
ncf_16_32_2_edau.4
UNSAT
23.3
ncf_8_16_4_euad.4
SAT
25.59
ncf_16_32_8_d.6
SAT
28.07
ncf_4_16_8_u.1
SAT
28.52
ncf_4_32_2_u.3
UNSAT
31.77
ncf_4_16_8_euad.2
SAT
36.98
ncf_8_16_8_d.2
SAT
37.53
ncf_4_8_8_u.6
UNSAT
41.33
ncf_4_16_8_u.5
UNSAT
48.5
ncf_4_16_8_d.5
UNSAT
52.8
ncf_8_16_8_edau.4
UNSAT
63.29
ncf_16_32_4_u.5
UNSAT
66.1
ncf_16_32_4_u.10
UNSAT
69.88
ncf_8_16_8_euad.6
UNSAT
73.52
ncf_8_16_4_euad.3
SAT
83.1
ncf_16_32_4_euad.5
UNSAT
89.22
ncf_4_32_2_u.9
UNSAT
116.66
ncf_8_16_4_u.3
SAT
139.87
ncf_4_32_2_u.7
SAT
178.44
ncf_8_16_8_euad.8
UNSAT
183.5
ncf_16_32_8_u.3
SAT
191.03
ncf_4_16_8_u.7
SAT
196.55
ncf_16_32_4_euad.10
UNSAT
200.43
ncf_4_16_8_d.9
SAT
210.35
ncf_8_16_8_euad.2
SAT
232.02
ncf_16_32_8_euad.3
SAT
236.06
ncf_8_16_8_euad.3
SAT
239.11
ncf_4_16_8_euad.7
SAT
239.89
ncf_4_16_8_d.3
SAT
283.46
ncf_8_16_8_d.4
UNSAT
357.47
ncf_16_32_4_euad.8
SAT
400.15
ncf_16_32_4_euad.6
FAIL
594.88
ncf_16_32_4_u.6
FAIL
597.93
ncf_4_16_8_u.6
SAT
599.66
ncf_16_32_2_euad.2
UNSAT
621.29
ncf_16_32_4_u.8
SAT
722.47
ncf_16_32_2_d.1
UNSAT
855.81
ncf_16_32_2_u.2
UNSAT
882.91
ncf_4_16_8_euad.1
SAT
922.72
ncf_4_32_2_u.6
UNSAT
1042.87
ncf_4_16_8_d.1
SAT
1465.85
ncf_16_32_4_u.2
SAT
1755.41
ncf_16_32_8_u.1
FAIL
2321.38
ncf_8_16_8_euad.10
FAIL
3188.59
ncf_16_32_8_edau.2
FAIL
3189.19
ncf_16_32_8_d.2
FAIL
3230.03
ncf_16_32_8_u.5
FAIL
3360.99
ncf_16_32_8_d.1
FAIL
3451.47
ncf_16_32_8_edau.9
FAIL
4108.78
ncf_16_32_8_euad.5
FAIL
4188.09
ncf_16_32_8_euad.8
FAIL
4472.63
ncf_16_32_8_d.9
FAIL
4567.52
ncf_16_32_8_edau.1
FAIL
4715.3
ncf_16_32_2_edau.1
UNSAT
4939.78
ncf_4_16_8_euad.4
SAT
5003.34
ncf_16_32_8_d.7
FAIL
5332.85
ncf_16_32_8_u.8
FAIL
5994.74
ncf_8_16_8_euad.4
FAIL
5999.59
ncf_8_16_8_euad.5
FAIL
5999.76
ncf_16_32_4_euad.2
FAIL
5999.94
ncf_4_16_8_euad.6
FAIL
5999.96
ncf_16_32_8_edau.7
FAIL
5999.99
ncf_16_32_4_euad.4
FAIL
6000.01
ncf_16_32_8_edau.6
FAIL
6000.01
ncf_4_16_8_u.3
FAIL
6000.11
ncf_16_32_4_u.4
FAIL
6000.22
ncf_4_16_8_u.8
FAIL
6000.23
ncf_4_16_8_euad.3
FAIL
6000.26
ncf_16_32_2_euad.5
FAIL
6000.26
ncf_16_32_4_d.6
FAIL
6000.28
ncf_4_16_8_u.4
FAIL
6000.28
ncf_16_32_8_u.10
FAIL
6000.37
ncf_16_32_4_edau.6
FAIL
6000.4
ncf_16_32_8_euad.10
FAIL
6000.4
ncf_4_16_8_d.10
FAIL
6000.46
ncf_4_32_2_u.10
FAIL
6000.54
ncf_16_32_2_u.5
FAIL
6000.6
ncf_16_32_4_u.3
FAIL
6000.6
ncf_16_32_4_euad.7
FAIL
6000.61
ncf_16_32_2_euad.1
FAIL
6000.61
ncf_16_32_4_u.7
FAIL
6000.62
ncf_16_32_2_u.8
FAIL
6000.63
ncf_16_32_2_u.3
FAIL
6000.64
ncf_16_32_2_euad.8
FAIL
6000.65
ncf_16_32_2_u.4
FAIL
6000.67
ncf_16_32_8_euad.7
FAIL
6000.68
ncf_4_32_2_u.5
FAIL
6000.68
ncf_16_32_8_euad.9
FAIL
6000.69
ncf_16_32_8_u.2
FAIL
6000.69
ncf_16_32_2_euad.3
FAIL
6000.7
ncf_4_32_2_u.1
FAIL
6000.7
ncf_16_32_2_u.10
FAIL
6000.7
ncf_16_32_2_euad.10
FAIL
6000.7
ncf_16_32_8_u.7
FAIL
6000.71
ncf_16_32_2_euad.4
FAIL
6000.71
ncf_16_32_4_euad.3
FAIL
6000.72
ncf_16_32_2_u.1
FAIL
6000.74
ncf_16_32_8_u.6
FAIL
6000.77
ncf_16_32_8_euad.6
FAIL
6000.77
ncf_16_32_8_euad.2
FAIL
6000.8
ncf_16_32_8_euad.1
FAIL
6000.82
ncf_16_32_8_u.9
FAIL
6000.83
Contact
|
Organization
|
Links
|
Citing QBFLIB