QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family CounterFactual solved by
sSolve
QBFEVAL'06
Instance
Result
Time
ncf_4_16_4_euad.10
UNSAT
0.1
ncf_4_8_4_euad.6
SAT
0.11
ncf_4_16_4_d.6
UNSAT
0.12
ncf_4_32_2_edau.4
UNSAT
0.12
ncf_4_8_2_u.4
UNSAT
0.13
ncf_16_32_2_euad.9
UNSAT
0.13
ncf_4_8_2_euad.2
SAT
0.13
ncf_8_16_4_u.10
SAT
0.14
ncf_16_32_2_edau.2
UNSAT
0.14
ncf_16_32_2_euad.2
UNSAT
0.14
ncf_4_8_2_u.10
SAT
0.14
ncf_4_32_2_u.3
UNSAT
0.14
ncf_4_8_2_u.8
SAT
0.14
ncf_16_32_2_u.2
UNSAT
0.14
ncf_4_8_8_d.5
UNSAT
0.14
ncf_16_32_2_euad.8
UNSAT
0.14
ncf_16_32_2_edau.9
UNSAT
0.15
ncf_16_32_4_edau.9
SAT
0.15
ncf_4_16_2_u.10
UNSAT
0.15
ncf_8_16_4_edau.2
UNSAT
0.15
ncf_16_32_2_d.7
UNSAT
0.15
ncf_4_8_2_euad.5
SAT
0.15
ncf_16_32_2_d.6
SAT
0.15
ncf_16_32_2_edau.6
SAT
0.15
ncf_4_8_2_euad.3
UNSAT
0.15
ncf_8_16_4_d.5
UNSAT
0.16
ncf_4_8_2_euad.8
SAT
0.16
ncf_16_32_2_euad.5
UNSAT
0.16
ncf_4_8_8_euad.9
UNSAT
0.16
ncf_16_32_4_edau.1
SAT
0.16
ncf_16_32_4_edau.4
UNSAT
0.16
ncf_8_16_4_u.2
UNSAT
0.16
ncf_4_16_2_u.6
SAT
0.16
ncf_16_32_2_u.5
UNSAT
0.16
ncf_16_32_2_euad.7
UNSAT
0.16
ncf_16_32_4_euad.1
SAT
0.16
ncf_8_16_4_euad.10
SAT
0.16
ncf_4_16_2_edau.6
SAT
0.17
ncf_16_32_2_d.4
UNSAT
0.17
ncf_4_16_4_euad.6
UNSAT
0.17
ncf_8_16_4_euad.8
UNSAT
0.17
ncf_4_8_2_u.6
SAT
0.17
ncf_16_32_2_euad.6
SAT
0.17
ncf_4_16_4_euad.5
SAT
0.17
ncf_16_32_2_d.9
UNSAT
0.17
ncf_4_8_8_edau.9
UNSAT
0.17
ncf_8_16_4_u.8
UNSAT
0.17
ncf_8_16_8_euad.6
UNSAT
0.17
ncf_8_16_8_edau.6
UNSAT
0.17
ncf_16_32_2_d.5
UNSAT
0.17
ncf_4_16_4_d.10
UNSAT
0.17
ncf_4_8_2_euad.1
UNSAT
0.17
ncf_4_8_4_u.7
UNSAT
0.17
ncf_16_32_4_u.5
UNSAT
0.18
ncf_16_32_2_d.2
UNSAT
0.18
ncf_16_32_2_u.7
UNSAT
0.18
ncf_16_32_2_edau.4
UNSAT
0.18
ncf_16_32_4_d.4
UNSAT
0.18
ncf_4_8_4_u.6
SAT
0.18
ncf_16_32_4_u.1
SAT
0.18
ncf_8_16_4_euad.2
UNSAT
0.18
ncf_16_32_4_d.9
SAT
0.18
ncf_8_16_4_d.2
UNSAT
0.18
ncf_4_32_2_u.2
SAT
0.18
ncf_4_8_2_u.1
UNSAT
0.18
ncf_16_32_4_edau.5
UNSAT
0.18
ncf_4_16_2_d.10
UNSAT
0.18
ncf_8_16_4_edau.8
UNSAT
0.18
ncf_8_16_4_u.5
UNSAT
0.18
ncf_4_8_8_u.9
UNSAT
0.18
ncf_16_32_4_u.4
UNSAT
0.19
ncf_4_32_2_u.9
UNSAT
0.19
ncf_4_8_2_u.3
UNSAT
0.19
ncf_4_8_4_euad.7
UNSAT
0.19
ncf_4_8_4_euad.3
UNSAT
0.19
ncf_4_16_4_u.5
SAT
0.19
ncf_4_8_2_euad.6
SAT
0.19
ncf_16_32_2_edau.8
UNSAT
0.19
ncf_4_8_4_u.3
UNSAT
0.19
ncf_4_8_8_d.9
UNSAT
0.2
ncf_8_16_4_edau.5
UNSAT
0.2
ncf_4_32_2_edau.3
UNSAT
0.2
ncf_8_16_8_d.6
UNSAT
0.2
ncf_4_16_2_d.6
SAT
0.2
ncf_4_8_8_u.5
UNSAT
0.2
ncf_4_8_4_euad.2
UNSAT
0.2
ncf_4_8_2_u.5
SAT
0.2
ncf_4_32_2_edau.2
SAT
0.2
ncf_16_32_2_d.8
UNSAT
0.2
ncf_4_16_4_edau.5
SAT
0.21
ncf_16_32_4_d.5
UNSAT
0.21
ncf_4_16_4_d.5
SAT
0.21
ncf_4_8_2_euad.4
UNSAT
0.21
ncf_16_32_4_euad.9
SAT
0.21
ncf_16_32_4_u.9
SAT
0.21
ncf_4_16_4_edau.6
UNSAT
0.21
ncf_4_16_2_edau.7
SAT
0.21
ncf_16_32_2_euad.4
UNSAT
0.21
ncf_4_8_2_u.2
SAT
0.22
ncf_4_8_2_u.9
SAT
0.22
ncf_4_16_2_edau.10
UNSAT
0.22
ncf_4_16_2_euad.10
UNSAT
0.22
ncf_16_32_4_euad.4
UNSAT
0.22
ncf_16_32_2_u.9
UNSAT
0.22
ncf_16_32_4_d.1
SAT
0.22
ncf_4_32_2_edau.9
UNSAT
0.22
ncf_4_32_2_u.4
UNSAT
0.22
ncf_4_8_4_u.9
SAT
0.22
ncf_4_8_4_u.2
UNSAT
0.22
ncf_4_8_2_euad.7
UNSAT
0.23
ncf_16_32_2_u.4
UNSAT
0.23
ncf_4_8_2_u.7
UNSAT
0.23
ncf_4_8_4_euad.9
SAT
0.23
ncf_4_16_4_u.6
UNSAT
0.23
ncf_4_32_2_u.1
UNSAT
0.23
ncf_4_32_2_edau.1
UNSAT
0.23
ncf_16_32_2_u.8
UNSAT
0.23
ncf_4_8_2_euad.10
SAT
0.23
ncf_8_16_4_d.10
SAT
0.23
ncf_16_32_2_edau.7
UNSAT
0.24
ncf_4_16_4_edau.10
UNSAT
0.24
ncf_8_16_4_d.8
UNSAT
0.24
ncf_8_16_4_edau.10
SAT
0.24
ncf_4_8_2_euad.9
SAT
0.24
ncf_4_8_8_euad.5
UNSAT
0.25
ncf_16_32_2_d.1
UNSAT
0.25
ncf_4_8_4_u.8
UNSAT
0.25
ncf_4_8_4_euad.8
UNSAT
0.25
ncf_4_8_8_edau.5
UNSAT
0.25
ncf_4_16_2_euad.6
SAT
0.26
ncf_4_16_2_euad.9
SAT
0.26
ncf_16_32_2_edau.5
UNSAT
0.26
ncf_4_16_2_u.1
UNSAT
0.26
ncf_4_16_2_edau.1
UNSAT
0.27
ncf_16_32_4_euad.5
UNSAT
0.27
ncf_8_16_4_euad.5
UNSAT
0.27
ncf_4_16_4_u.10
UNSAT
0.27
ncf_8_16_8_d.7
UNSAT
0.27
ncf_16_32_2_euad.1
UNSAT
0.28
ncf_4_16_2_u.7
SAT
0.29
ncf_8_16_8_euad.7
UNSAT
0.29
ncf_16_32_2_u.6
SAT
0.3
ncf_4_16_2_euad.1
UNSAT
0.3
ncf_4_16_2_d.1
UNSAT
0.32
ncf_4_16_2_d.9
SAT
0.32
ncf_4_16_2_u.9
SAT
0.34
ncf_4_16_2_d.2
SAT
0.34
ncf_16_32_2_edau.1
UNSAT
0.35
ncf_4_16_2_euad.2
SAT
0.35
ncf_4_32_2_edau.5
UNSAT
0.36
ncf_8_16_8_edau.7
UNSAT
0.36
ncf_4_16_2_u.2
SAT
0.37
ncf_4_16_2_edau.2
SAT
0.38
ncf_4_16_2_edau.9
SAT
0.39
ncf_4_8_4_u.4
UNSAT
0.41
ncf_16_32_2_u.1
UNSAT
0.41
ncf_4_8_4_u.1
SAT
0.41
ncf_4_16_2_d.4
SAT
0.41
ncf_4_8_4_euad.4
UNSAT
0.43
ncf_4_32_2_u.5
UNSAT
0.43
ncf_4_8_4_euad.5
SAT
0.47
ncf_4_8_8_d.1
SAT
0.47
ncf_4_8_4_u.5
SAT
0.48
ncf_4_8_8_euad.1
SAT
0.49
ncf_4_16_2_u.4
SAT
0.49
ncf_8_16_4_u.6
UNSAT
0.5
ncf_4_16_2_edau.4
SAT
0.53
ncf_8_16_4_d.6
UNSAT
0.54
ncf_4_16_2_euad.4
SAT
0.56
ncf_8_16_4_euad.6
UNSAT
0.58
ncf_8_16_4_edau.6
UNSAT
0.61
ncf_4_8_8_edau.1
SAT
0.69
ncf_4_8_8_u.1
SAT
0.71
ncf_4_16_4_edau.9
SAT
0.75
ncf_4_8_4_euad.1
SAT
0.79
ncf_4_16_4_u.9
SAT
0.82
ncf_4_8_8_u.4
SAT
0.85
ncf_4_8_8_edau.4
SAT
0.92
ncf_4_16_2_edau.3
UNSAT
1.14
ncf_4_16_2_d.3
UNSAT
1.16
ncf_8_16_4_d.9
UNSAT
1.21
ncf_8_16_4_euad.9
UNSAT
1.22
ncf_8_16_4_u.9
UNSAT
1.23
ncf_8_16_4_edau.9
UNSAT
1.23
ncf_4_16_2_euad.3
UNSAT
1.23
ncf_4_8_8_euad.4
SAT
1.25
ncf_4_8_8_d.4
SAT
1.36
ncf_4_8_4_u.10
SAT
1.37
ncf_4_16_2_edau.8
SAT
1.68
ncf_4_8_4_euad.10
SAT
1.77
ncf_4_16_4_d.8
SAT
1.84
ncf_4_16_4_edau.8
SAT
1.85
ncf_4_16_4_u.8
SAT
1.86
ncf_4_16_2_d.7
SAT
1.86
ncf_4_16_2_u.8
SAT
1.9
ncf_4_16_2_euad.7
SAT
1.96
ncf_4_16_2_u.3
UNSAT
2.12
ncf_4_16_4_euad.8
SAT
2.19
ncf_4_16_2_edau.5
UNSAT
3.01
ncf_4_16_2_u.5
UNSAT
3.04
ncf_16_32_4_euad.7
UNSAT
3.12
ncf_4_16_4_d.9
SAT
3.23
ncf_16_32_4_d.7
UNSAT
3.25
ncf_4_16_4_euad.9
SAT
3.3
ncf_16_32_4_euad.8
SAT
5.01
ncf_16_32_4_d.8
SAT
5.1
ncf_8_16_4_u.1
SAT
5.97
ncf_8_16_4_edau.1
SAT
6.03
ncf_4_16_2_euad.5
UNSAT
6.23
ncf_4_16_2_d.5
UNSAT
6.53
ncf_4_32_2_edau.6
UNSAT
6.58
ncf_16_32_4_edau.8
SAT
6.58
ncf_4_32_2_u.6
UNSAT
6.66
ncf_16_32_4_u.8
SAT
6.71
ncf_8_16_4_d.1
SAT
7.14
ncf_8_16_4_euad.1
SAT
7.15
ncf_8_16_8_edau.1
SAT
7.24
ncf_8_16_8_d.1
SAT
7.3
ncf_8_16_8_euad.1
SAT
7.32
ncf_4_8_8_edau.8
SAT
7.4
ncf_4_8_8_u.3
SAT
7.51
ncf_4_8_8_u.8
SAT
7.51
ncf_4_8_8_edau.3
SAT
7.57
ncf_4_8_8_d.8
SAT
7.59
ncf_16_32_8_d.4
SAT
7.59
ncf_8_16_4_edau.4
SAT
7.62
ncf_4_8_8_d.3
SAT
7.63
ncf_8_16_4_euad.7
SAT
7.63
ncf_16_32_8_euad.4
SAT
7.69
ncf_4_8_8_euad.3
SAT
7.8
ncf_4_16_4_u.1
SAT
7.8
ncf_4_16_4_d.1
SAT
7.82
ncf_8_16_4_u.4
SAT
7.84
ncf_4_16_4_edau.1
SAT
7.87
ncf_8_16_4_d.4
SAT
7.88
ncf_16_32_2_edau.3
SAT
8
ncf_4_8_8_euad.8
SAT
8.02
ncf_4_16_4_euad.1
SAT
8.03
ncf_4_8_8_edau.10
SAT
8.12
ncf_4_8_8_u.10
SAT
8.23
ncf_8_16_8_edau.9
UNSAT
8.24
ncf_8_16_4_euad.4
SAT
8.26
ncf_8_16_4_edau.7
SAT
8.41
ncf_16_32_4_edau.2
SAT
8.43
ncf_16_32_4_d.3
SAT
8.47
ncf_16_32_2_u.3
SAT
8.5
ncf_4_8_8_u.7
SAT
8.56
ncf_8_16_4_u.7
SAT
8.58
ncf_4_16_8_d.7
SAT
8.72
ncf_4_16_8_u.7
SAT
8.76
ncf_16_32_8_edau.3
SAT
8.8
ncf_4_8_8_edau.7
SAT
8.9
ncf_8_16_8_edau.10
SAT
8.95
ncf_4_16_4_edau.7
SAT
9
ncf_16_32_8_u.3
SAT
9.09
ncf_16_32_8_edau.4
SAT
9.13
ncf_16_32_4_euad.3
SAT
9.28
ncf_16_32_8_u.4
SAT
9.3
ncf_8_16_4_d.7
SAT
9.33
ncf_16_32_2_d.3
SAT
9.34
ncf_16_32_4_edau.3
SAT
9.36
ncf_4_8_8_euad.10
SAT
9.48
ncf_4_16_4_u.7
SAT
9.51
ncf_16_32_2_euad.3
SAT
9.54
ncf_4_16_8_euad.7
SAT
9.75
ncf_16_32_4_u.2
SAT
9.78
ncf_4_8_8_edau.6
UNSAT
10.34
ncf_16_32_8_edau.10
SAT
10.35
ncf_16_32_8_u.10
SAT
10.42
ncf_16_32_4_d.2
SAT
11.07
ncf_16_32_4_u.3
SAT
11.12
ncf_4_16_8_u.10
SAT
11.46
ncf_16_32_4_euad.2
SAT
11.71
ncf_4_8_8_edau.2
UNSAT
12.45
ncf_4_8_8_u.6
UNSAT
12.47
ncf_16_32_8_edau.7
SAT
12.56
ncf_16_32_8_edau.6
SAT
13
ncf_8_16_8_edau.8
UNSAT
13.23
ncf_16_32_8_u.6
SAT
13.28
ncf_16_32_8_u.7
SAT
13.6
ncf_4_8_8_u.2
UNSAT
14.58
ncf_4_16_2_d.8
SAT
16.04
ncf_16_32_8_euad.3
SAT
17.62
ncf_4_16_2_euad.8
SAT
19.72
ncf_8_16_8_d.10
SAT
19.83
ncf_16_32_8_d.3
SAT
20.86
ncf_4_16_8_u.9
SAT
22.3
ncf_8_16_8_euad.9
UNSAT
22.55
ncf_8_16_8_euad.10
SAT
24.09
ncf_8_16_8_euad.8
UNSAT
24.76
ncf_16_32_8_euad.10
SAT
27.76
ncf_16_32_8_d.10
SAT
29.78
ncf_4_8_8_euad.7
SAT
32.61
ncf_4_8_8_euad.6
UNSAT
39.66
ncf_4_16_8_euad.10
SAT
46.77
ncf_4_8_8_d.2
UNSAT
48.87
ncf_8_16_8_d.9
UNSAT
50
ncf_4_8_8_euad.2
UNSAT
52.92
ncf_4_16_8_u.4
SAT
56.07
ncf_8_16_8_edau.4
UNSAT
79.39
ncf_4_16_8_euad.8
UNSAT
83.49
ncf_8_16_8_edau.5
SAT
90.12
ncf_8_16_4_edau.3
SAT
95.42
ncf_8_16_4_euad.3
SAT
101.08
ncf_4_16_4_u.4
UNSAT
110.51
ncf_4_16_4_edau.3
SAT
121.71
ncf_4_16_4_d.7
SAT
121.79
ncf_4_16_4_u.2
SAT
121.94
ncf_8_16_4_u.3
SAT
125.66
ncf_4_16_4_edau.2
SAT
132.6
ncf_4_32_2_edau.8
SAT
135.55
ncf_4_16_4_u.3
SAT
138.02
ncf_4_16_4_euad.7
SAT
139.48
ncf_4_16_4_euad.4
UNSAT
170.8
ncf_4_16_8_u.6
SAT
176.9
ncf_4_16_4_edau.4
UNSAT
204.17
ncf_4_16_4_euad.2
SAT
206.03
ncf_4_32_2_u.8
SAT
206.12
ncf_4_16_4_euad.3
SAT
238.01
ncf_8_16_8_euad.5
SAT
315.55
ncf_16_32_2_edau.10
UNSAT
321.3
ncf_4_16_8_u.2
SAT
343.3
ncf_4_16_4_d.3
SAT
381.55
ncf_4_16_8_u.1
SAT
393.7
ncf_16_32_4_edau.7
UNSAT
450.33
ncf_16_32_4_u.7
UNSAT
472.13
ncf_8_16_8_euad.4
UNSAT
475.56
ncf_16_32_2_u.10
UNSAT
532
ncf_4_16_8_euad.4
SAT
535.93
ncf_8_16_8_euad.2
SAT
559.2
ncf_4_16_8_euad.9
SAT
592.86
ncf_16_32_8_edau.1
FAIL
599.8
ncf_4_16_8_euad.5
UNSAT
640.04
ncf_8_16_8_edau.3
SAT
711.1
ncf_4_16_8_euad.2
SAT
755.65
ncf_4_16_8_u.5
UNSAT
788.26
ncf_8_16_4_d.3
SAT
845.85
ncf_8_16_8_edau.2
SAT
945.97
ncf_16_32_8_euad.6
SAT
990.84
ncf_4_32_2_edau.7
SAT
1085.62
ncf_4_16_8_u.3
SAT
1196.02
ncf_8_16_8_euad.3
SAT
1452.8
ncf_4_16_8_euad.6
SAT
1524.69
ncf_16_32_8_euad.7
SAT
1539.76
ncf_16_32_8_d.6
SAT
1622.53
ncf_4_32_2_u.7
SAT
1733.22
ncf_4_16_8_u.8
UNSAT
2124.96
ncf_4_8_8_d.7
SAT
2302.15
ncf_8_16_8_d.5
SAT
2304.2
ncf_16_32_8_d.7
SAT
2506.5
ncf_16_32_4_euad.10
UNSAT
2878.59
ncf_4_32_2_edau.10
SAT
3567.16
ncf_16_32_4_u.10
UNSAT
3685.58
ncf_16_32_4_d.10
UNSAT
3859.1
ncf_4_32_2_u.10
SAT
4158.13
ncf_4_16_8_euad.1
SAT
4696.35
ncf_16_32_2_d.10
FAIL
5999.28
ncf_8_16_8_d.8
FAIL
5999.43
ncf_16_32_2_euad.10
FAIL
5999.46
ncf_4_16_8_d.5
FAIL
5999.46
ncf_16_32_8_euad.8
FAIL
5999.51
ncf_16_32_4_edau.6
FAIL
5999.54
ncf_8_16_8_d.4
FAIL
5999.57
ncf_16_32_8_d.8
FAIL
5999.63
ncf_16_32_4_u.6
FAIL
5999.64
ncf_16_32_4_d.6
FAIL
5999.64
ncf_16_32_8_d.9
FAIL
5999.64
ncf_16_32_8_edau.8
FAIL
5999.64
ncf_16_32_8_u.8
FAIL
5999.65
ncf_16_32_4_euad.6
FAIL
5999.69
ncf_16_32_8_edau.2
FAIL
5999.76
ncf_16_32_8_euad.9
FAIL
5999.77
ncf_16_32_8_euad.5
FAIL
5999.83
ncf_16_32_8_u.2
FAIL
5999.87
ncf_16_32_8_euad.2
FAIL
5999.88
ncf_16_32_8_d.5
FAIL
5999.88
ncf_4_16_8_d.9
FAIL
5999.94
ncf_16_32_8_d.2
FAIL
5999.94
ncf_8_16_8_d.2
FAIL
5999.95
ncf_16_32_8_edau.5
FAIL
5999.98
ncf_4_16_4_d.2
FAIL
5999.98
ncf_16_32_8_u.9
FAIL
6000
ncf_4_16_8_d.4
FAIL
6000.02
ncf_4_16_8_d.2
FAIL
6000.03
ncf_4_16_4_d.4
FAIL
6000.04
ncf_4_16_8_d.3
FAIL
6000.05
ncf_4_16_8_d.10
FAIL
6000.1
ncf_4_8_8_d.6
FAIL
6000.11
ncf_16_32_8_edau.9
FAIL
6000.11
ncf_4_16_8_d.8
FAIL
6000.12
ncf_16_32_8_d.1
FAIL
6000.13
ncf_4_16_8_d.6
FAIL
6000.17
ncf_8_16_8_d.3
FAIL
6000.18
ncf_4_8_8_d.10
FAIL
6000.19
ncf_16_32_8_u.5
FAIL
6000.26
ncf_4_16_8_d.1
FAIL
6000.28
ncf_16_32_8_u.1
FAIL
6000.29
ncf_4_16_8_euad.3
FAIL
6000.32
ncf_16_32_8_euad.1
FAIL
6000.33
ncf_16_32_4_edau.10
FAIL
6000.37
Contact
|
Organization
|
Links
|
Citing QBFLIB