QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family CounterFactual solved by
ssolve+ut
QBFEVAL'06
Instance
Result
Time
ncf_8_16_4_d.10
SAT
0.09
ncf_4_8_4_u.3
UNSAT
0.12
ncf_4_8_4_u.2
UNSAT
0.12
ncf_8_16_4_u.10
SAT
0.12
ncf_4_8_2_u.7
UNSAT
0.12
ncf_8_16_8_d.6
UNSAT
0.12
ncf_4_8_4_u.6
SAT
0.13
ncf_16_32_4_edau.5
UNSAT
0.13
ncf_8_16_4_euad.5
UNSAT
0.13
ncf_16_32_2_euad.7
UNSAT
0.14
ncf_16_32_2_d.6
SAT
0.14
ncf_16_32_4_u.4
UNSAT
0.14
ncf_8_16_4_edau.5
UNSAT
0.14
ncf_4_16_2_euad.6
SAT
0.14
ncf_4_16_2_d.6
SAT
0.14
ncf_16_32_2_d.9
UNSAT
0.15
ncf_4_32_2_edau.1
UNSAT
0.15
ncf_8_16_4_u.2
UNSAT
0.15
ncf_4_16_2_u.10
UNSAT
0.15
ncf_16_32_2_d.8
UNSAT
0.15
ncf_4_32_2_u.4
UNSAT
0.15
ncf_8_16_8_edau.6
UNSAT
0.16
ncf_4_8_2_euad.10
SAT
0.16
ncf_8_16_4_edau.2
UNSAT
0.16
ncf_4_16_4_d.10
UNSAT
0.16
ncf_16_32_2_d.2
UNSAT
0.16
ncf_4_8_4_euad.9
SAT
0.16
ncf_4_16_4_u.5
SAT
0.17
ncf_16_32_2_u.2
UNSAT
0.17
ncf_16_32_4_u.9
SAT
0.17
ncf_16_32_2_edau.9
UNSAT
0.17
ncf_4_8_4_euad.6
SAT
0.17
ncf_4_8_4_euad.2
UNSAT
0.17
ncf_4_8_2_euad.6
SAT
0.17
ncf_4_16_4_edau.6
UNSAT
0.17
ncf_4_8_2_euad.9
SAT
0.17
ncf_4_8_2_euad.3
UNSAT
0.17
ncf_4_8_2_euad.8
SAT
0.17
ncf_8_16_4_edau.10
SAT
0.17
ncf_4_8_8_euad.9
UNSAT
0.17
ncf_8_16_4_euad.2
UNSAT
0.18
ncf_4_8_8_u.5
UNSAT
0.18
ncf_4_8_8_edau.5
UNSAT
0.18
ncf_4_16_2_d.10
UNSAT
0.18
ncf_4_8_2_euad.1
UNSAT
0.18
ncf_4_8_4_u.7
UNSAT
0.18
ncf_16_32_4_d.5
UNSAT
0.18
ncf_4_32_2_edau.3
UNSAT
0.18
ncf_4_8_2_u.4
UNSAT
0.18
ncf_8_16_4_euad.8
UNSAT
0.18
ncf_16_32_2_u.7
UNSAT
0.18
ncf_16_32_2_euad.5
UNSAT
0.18
ncf_16_32_4_edau.1
SAT
0.18
ncf_4_16_4_d.5
SAT
0.18
ncf_4_8_8_edau.9
UNSAT
0.19
ncf_4_8_2_u.8
SAT
0.19
ncf_4_16_4_euad.5
SAT
0.19
ncf_4_32_2_edau.4
UNSAT
0.19
ncf_16_32_2_u.8
UNSAT
0.19
ncf_16_32_4_edau.4
UNSAT
0.19
ncf_16_32_2_edau.8
UNSAT
0.19
ncf_8_16_4_d.2
UNSAT
0.19
ncf_16_32_2_u.9
UNSAT
0.19
ncf_8_16_4_edau.8
UNSAT
0.19
ncf_16_32_2_edau.6
SAT
0.19
ncf_16_32_2_euad.4
UNSAT
0.19
ncf_16_32_2_u.4
UNSAT
0.19
ncf_4_8_8_euad.5
UNSAT
0.19
ncf_16_32_2_euad.6
SAT
0.19
ncf_4_16_4_u.6
UNSAT
0.2
ncf_4_16_4_u.10
UNSAT
0.2
ncf_4_8_4_euad.3
UNSAT
0.2
ncf_16_32_2_u.5
UNSAT
0.2
ncf_4_16_2_euad.10
UNSAT
0.2
ncf_4_8_4_u.9
SAT
0.2
ncf_16_32_2_edau.7
UNSAT
0.2
ncf_16_32_2_edau.2
UNSAT
0.2
ncf_16_32_4_u.5
UNSAT
0.2
ncf_16_32_2_edau.5
UNSAT
0.21
ncf_4_32_2_u.3
UNSAT
0.21
ncf_4_16_2_edau.10
UNSAT
0.21
ncf_16_32_4_edau.9
SAT
0.21
ncf_4_8_8_u.9
UNSAT
0.21
ncf_4_8_8_d.9
UNSAT
0.21
ncf_4_16_2_edau.6
SAT
0.21
ncf_8_16_4_d.5
UNSAT
0.21
ncf_16_32_2_d.4
UNSAT
0.21
ncf_8_16_4_d.8
UNSAT
0.21
ncf_4_8_2_u.10
SAT
0.21
ncf_4_32_2_u.9
UNSAT
0.21
ncf_16_32_2_edau.4
UNSAT
0.21
ncf_4_8_2_u.3
UNSAT
0.21
ncf_4_8_2_u.2
SAT
0.22
ncf_16_32_4_d.4
UNSAT
0.22
ncf_16_32_4_u.1
SAT
0.22
ncf_16_32_2_u.6
SAT
0.22
ncf_8_16_8_euad.6
UNSAT
0.22
ncf_4_8_2_u.1
UNSAT
0.22
ncf_16_32_4_euad.1
SAT
0.22
ncf_8_16_4_euad.10
SAT
0.22
ncf_4_32_2_edau.2
SAT
0.22
ncf_4_16_4_euad.6
UNSAT
0.22
ncf_4_16_4_euad.10
UNSAT
0.22
ncf_16_32_4_euad.9
SAT
0.23
ncf_8_16_4_u.8
UNSAT
0.23
ncf_4_8_8_d.5
UNSAT
0.23
ncf_4_8_4_euad.8
UNSAT
0.23
ncf_16_32_4_euad.4
UNSAT
0.23
ncf_4_8_2_euad.2
SAT
0.23
ncf_4_8_2_euad.7
UNSAT
0.23
ncf_16_32_4_euad.5
UNSAT
0.23
ncf_4_16_2_euad.9
SAT
0.23
ncf_4_8_2_euad.4
UNSAT
0.24
ncf_4_32_2_u.1
UNSAT
0.24
ncf_4_16_2_u.6
SAT
0.24
ncf_16_32_2_euad.8
UNSAT
0.24
ncf_4_8_2_u.5
SAT
0.24
ncf_4_16_4_d.6
UNSAT
0.24
ncf_4_8_2_u.9
SAT
0.25
ncf_4_32_2_u.2
SAT
0.25
ncf_16_32_2_euad.1
UNSAT
0.25
ncf_4_16_2_edau.7
SAT
0.25
ncf_4_16_2_u.7
SAT
0.25
ncf_4_8_2_u.6
SAT
0.25
ncf_4_8_4_u.8
UNSAT
0.26
ncf_4_16_2_d.1
UNSAT
0.26
ncf_16_32_4_d.9
SAT
0.26
ncf_8_16_8_d.7
UNSAT
0.26
ncf_16_32_2_d.7
UNSAT
0.26
ncf_4_8_2_euad.5
SAT
0.26
ncf_16_32_4_d.1
SAT
0.26
ncf_8_16_8_euad.7
UNSAT
0.26
ncf_4_16_4_edau.5
SAT
0.26
ncf_16_32_2_euad.2
UNSAT
0.26
ncf_4_16_4_edau.10
UNSAT
0.26
ncf_8_16_4_u.5
UNSAT
0.27
ncf_16_32_2_d.1
UNSAT
0.27
ncf_4_32_2_edau.9
UNSAT
0.28
ncf_4_16_2_euad.1
UNSAT
0.28
ncf_8_16_8_edau.7
UNSAT
0.28
ncf_4_16_2_u.9
SAT
0.28
ncf_4_8_4_euad.7
UNSAT
0.29
ncf_16_32_2_d.5
UNSAT
0.29
ncf_16_32_2_euad.9
UNSAT
0.29
ncf_4_16_2_edau.9
SAT
0.3
ncf_4_16_2_u.2
SAT
0.31
ncf_4_16_2_d.9
SAT
0.33
ncf_4_16_2_edau.2
SAT
0.34
ncf_4_16_2_edau.1
UNSAT
0.34
ncf_16_32_2_edau.1
UNSAT
0.35
ncf_4_16_2_u.1
UNSAT
0.36
ncf_4_32_2_u.5
UNSAT
0.36
ncf_4_16_2_d.4
SAT
0.39
ncf_4_16_2_d.2
SAT
0.41
ncf_16_32_2_u.1
UNSAT
0.43
ncf_4_8_4_u.1
SAT
0.43
ncf_4_16_2_euad.2
SAT
0.43
ncf_4_8_4_u.4
UNSAT
0.43
ncf_4_32_2_edau.5
UNSAT
0.44
ncf_8_16_4_edau.6
UNSAT
0.45
ncf_4_8_8_d.1
SAT
0.45
ncf_4_16_2_edau.4
SAT
0.46
ncf_4_8_4_u.5
SAT
0.46
ncf_4_8_4_euad.4
UNSAT
0.47
ncf_4_8_4_euad.5
SAT
0.51
ncf_8_16_4_euad.6
UNSAT
0.51
ncf_4_16_2_euad.4
SAT
0.52
ncf_8_16_4_u.6
UNSAT
0.53
ncf_4_8_8_euad.1
SAT
0.53
ncf_8_16_4_d.6
UNSAT
0.54
ncf_4_16_2_u.4
SAT
0.58
ncf_4_8_8_edau.1
SAT
0.74
ncf_4_16_4_edau.9
SAT
0.77
ncf_4_8_8_u.1
SAT
0.79
ncf_4_16_4_u.9
SAT
0.83
ncf_4_8_8_u.4
SAT
0.9
ncf_4_8_8_edau.4
SAT
0.92
ncf_4_8_4_euad.1
SAT
1.1
ncf_4_16_2_edau.3
UNSAT
1.14
ncf_4_16_2_u.3
UNSAT
1.19
ncf_4_16_2_euad.3
UNSAT
1.21
ncf_4_16_2_d.3
UNSAT
1.21
ncf_4_8_4_u.10
SAT
1.33
ncf_4_16_2_edau.8
SAT
1.72
ncf_4_16_4_edau.8
SAT
1.78
ncf_4_16_2_u.8
SAT
1.83
ncf_8_16_4_edau.9
UNSAT
1.84
ncf_4_16_4_u.8
SAT
1.87
ncf_4_8_4_euad.10
SAT
1.89
ncf_8_16_4_d.9
UNSAT
1.9
ncf_8_16_4_euad.9
UNSAT
1.91
ncf_8_16_4_u.9
UNSAT
1.92
ncf_4_16_2_d.7
SAT
2.03
ncf_4_8_8_euad.4
SAT
2.03
ncf_4_16_4_d.8
SAT
2.07
ncf_4_16_2_euad.7
SAT
2.15
ncf_4_8_8_d.4
SAT
2.31
ncf_4_16_4_euad.8
SAT
2.42
ncf_4_32_2_edau.6
UNSAT
2.59
ncf_4_32_2_u.6
UNSAT
2.62
ncf_4_16_2_edau.5
UNSAT
2.92
ncf_4_16_2_u.5
UNSAT
2.95
ncf_4_16_4_euad.9
SAT
3.3
ncf_4_16_4_d.9
SAT
3.33
ncf_16_32_4_euad.7
UNSAT
4.1
ncf_16_32_4_d.7
UNSAT
4.13
ncf_16_32_4_euad.8
SAT
5.15
ncf_16_32_4_d.8
SAT
5.24
ncf_16_32_4_euad.10
UNSAT
5.26
ncf_16_32_4_d.10
UNSAT
5.34
ncf_16_32_4_edau.7
UNSAT
5.93
ncf_16_32_4_u.7
UNSAT
6.03
ncf_4_16_2_euad.5
UNSAT
6.25
ncf_8_16_4_edau.1
SAT
6.48
ncf_8_16_4_u.1
SAT
6.59
ncf_4_16_2_d.5
UNSAT
6.6
ncf_16_32_4_edau.8
SAT
6.84
ncf_16_32_4_u.8
SAT
6.94
ncf_8_16_4_d.1
SAT
7.64
ncf_8_16_4_euad.1
SAT
7.76
ncf_4_8_8_d.8
SAT
8.62
ncf_16_32_8_d.4
SAT
8.68
ncf_4_8_8_edau.8
SAT
8.69
ncf_16_32_8_euad.4
SAT
8.75
ncf_4_8_8_u.8
SAT
8.77
ncf_4_16_4_d.1
SAT
8.91
ncf_8_16_4_d.4
SAT
8.94
ncf_4_16_4_euad.1
SAT
9.04
ncf_8_16_4_euad.4
SAT
9.23
ncf_4_8_8_euad.8
SAT
9.24
ncf_8_16_8_edau.9
UNSAT
9.49
ncf_4_8_8_u.7
SAT
9.59
ncf_16_32_4_d.3
SAT
9.6
ncf_8_16_8_edau.10
SAT
9.9
ncf_4_8_8_edau.7
SAT
9.98
ncf_4_16_8_d.7
SAT
9.98
ncf_16_32_8_edau.3
SAT
9.98
ncf_8_16_8_edau.1
SAT
10.23
ncf_8_16_8_d.1
SAT
10.28
ncf_8_16_8_euad.1
SAT
10.33
ncf_16_32_4_euad.3
SAT
10.5
ncf_4_8_8_u.3
SAT
10.54
ncf_16_32_2_d.3
SAT
10.56
ncf_16_32_8_u.3
SAT
10.65
ncf_8_16_4_edau.4
SAT
10.67
ncf_4_8_8_edau.3
SAT
10.7
ncf_4_8_8_d.3
SAT
10.7
ncf_16_32_2_euad.3
SAT
10.76
ncf_4_16_4_u.1
SAT
10.86
ncf_8_16_4_u.4
SAT
10.87
ncf_4_16_4_edau.1
SAT
10.92
ncf_4_8_8_euad.3
SAT
10.98
ncf_4_16_8_euad.7
SAT
11.13
ncf_16_32_8_edau.10
SAT
11.21
ncf_16_32_2_edau.3
SAT
11.24
ncf_16_32_8_u.10
SAT
11.46
ncf_16_32_4_edau.2
SAT
11.56
ncf_8_16_4_euad.7
SAT
11.66
ncf_8_16_4_edau.7
SAT
11.67
ncf_16_32_2_u.3
SAT
11.74
ncf_8_16_4_u.7
SAT
11.75
ncf_4_16_8_u.7
SAT
11.82
ncf_16_32_4_d.2
SAT
11.98
ncf_4_16_4_edau.7
SAT
12.19
ncf_16_32_8_edau.4
SAT
12.21
ncf_4_16_4_u.7
SAT
12.4
ncf_16_32_4_edau.3
SAT
12.43
ncf_16_32_8_u.4
SAT
12.51
ncf_16_32_4_euad.2
SAT
12.71
ncf_16_32_4_u.2
SAT
12.8
ncf_8_16_4_d.7
SAT
13.31
ncf_4_8_8_edau.6
UNSAT
13.39
ncf_4_8_8_edau.2
UNSAT
13.58
ncf_16_32_4_u.3
SAT
14.36
ncf_4_8_8_edau.10
SAT
15.36
ncf_4_8_8_u.6
UNSAT
15.48
ncf_4_8_8_u.2
UNSAT
15.58
ncf_16_32_8_edau.7
SAT
15.68
ncf_16_32_8_edau.6
SAT
16.13
ncf_8_16_8_edau.8
UNSAT
16.22
ncf_16_32_8_u.6
SAT
16.42
ncf_16_32_8_u.7
SAT
16.51
ncf_4_16_8_u.10
SAT
17.06
ncf_4_8_8_u.10
SAT
17.2
ncf_16_32_8_euad.3
SAT
18.27
ncf_8_16_8_d.10
SAT
21.07
ncf_16_32_8_d.3
SAT
22.08
ncf_4_8_8_euad.10
SAT
22.89
ncf_8_16_8_euad.9
UNSAT
23.57
ncf_4_16_2_d.8
SAT
24.78
ncf_8_16_8_euad.10
SAT
25.32
ncf_4_16_2_euad.8
SAT
28.17
ncf_16_32_8_euad.10
SAT
29.09
ncf_8_16_8_euad.8
UNSAT
29.47
ncf_16_32_8_d.10
SAT
30.7
ncf_4_16_8_u.9
SAT
34.97
ncf_4_8_8_euad.7
SAT
35.29
ncf_4_8_8_euad.6
UNSAT
46.42
ncf_8_16_8_d.9
UNSAT
51.53
ncf_4_8_8_d.2
UNSAT
53.92
ncf_4_8_8_euad.2
UNSAT
58.08
ncf_4_16_8_u.4
SAT
59.11
ncf_4_16_8_euad.10
SAT
74.92
ncf_8_16_8_edau.4
UNSAT
85.79
ncf_4_16_8_euad.8
UNSAT
86.93
ncf_8_16_8_edau.5
SAT
91.43
ncf_8_16_4_edau.3
SAT
98.31
ncf_4_16_4_edau.3
SAT
122.73
ncf_4_16_4_u.4
UNSAT
124.23
ncf_8_16_4_u.3
SAT
128.6
ncf_8_16_4_euad.3
SAT
132.71
ncf_4_16_4_u.2
SAT
133.3
ncf_4_32_2_edau.8
SAT
134.79
ncf_4_16_4_u.3
SAT
139.32
ncf_4_16_4_edau.2
SAT
143.82
ncf_4_16_4_d.7
SAT
153.39
ncf_4_16_4_euad.7
SAT
170.3
ncf_4_16_8_u.6
SAT
180.21
ncf_4_32_2_u.8
SAT
205.42
ncf_4_16_4_edau.4
UNSAT
218
ncf_16_32_2_edau.10
UNSAT
323.19
ncf_4_16_4_euad.2
SAT
327.16
ncf_4_16_4_euad.3
SAT
331.57
ncf_8_16_8_euad.5
SAT
332.13
ncf_4_16_8_u.2
SAT
351.49
ncf_4_16_8_u.1
SAT
373.73
ncf_4_16_4_euad.4
UNSAT
446.02
ncf_8_16_8_euad.4
UNSAT
473.63
ncf_4_16_4_d.3
SAT
474.71
ncf_16_32_2_u.10
UNSAT
535.25
ncf_4_16_8_euad.4
SAT
599.68
ncf_16_32_4_d.6
FAIL
600.07
ncf_16_32_8_u.9
FAIL
600.24
ncf_4_16_8_d.6
FAIL
600.25
ncf_4_16_8_d.8
FAIL
600.27
ncf_16_32_8_u.1
FAIL
600.27
ncf_16_32_8_d.6
FAIL
600.29
ncf_8_16_8_edau.3
FAIL
600.3
ncf_16_32_8_euad.7
FAIL
600.32
ncf_4_16_8_u.5
FAIL
600.37
ncf_8_16_8_euad.2
SAT
605.29
ncf_4_16_8_euad.5
UNSAT
831.65
ncf_8_16_4_d.3
SAT
871.11
ncf_4_16_8_euad.2
SAT
933.13
ncf_8_16_8_edau.2
SAT
949.89
ncf_4_16_8_euad.9
SAT
958.67
ncf_16_32_8_euad.6
SAT
989.15
ncf_4_32_2_edau.7
SAT
1116.83
ncf_4_16_8_u.3
SAT
1155.68
ncf_4_16_8_euad.6
SAT
1653.74
ncf_8_16_8_euad.3
SAT
1673.94
ncf_4_32_2_u.7
SAT
1748.65
ncf_4_16_8_u.8
UNSAT
2137.8
ncf_8_16_8_d.5
SAT
2305.83
ncf_16_32_8_d.7
SAT
2509.26
ncf_4_8_8_d.7
SAT
2726.45
ncf_4_32_2_edau.10
SAT
3572.55
ncf_16_32_4_u.10
UNSAT
3654.26
ncf_4_32_2_u.10
SAT
4182.18
ncf_4_16_8_euad.1
SAT
5048.1
ncf_4_16_8_d.9
FAIL
5997.97
ncf_4_16_8_d.5
FAIL
5999.11
ncf_16_32_2_d.10
FAIL
5999.43
ncf_16_32_2_euad.10
FAIL
5999.59
ncf_8_16_8_d.4
FAIL
5999.61
ncf_16_32_4_u.6
FAIL
5999.62
ncf_16_32_8_edau.2
FAIL
5999.62
ncf_16_32_8_u.8
FAIL
5999.64
ncf_4_16_8_d.3
FAIL
5999.64
ncf_16_32_8_euad.5
FAIL
5999.64
ncf_16_32_4_edau.6
FAIL
5999.64
ncf_4_16_8_d.2
FAIL
5999.65
ncf_4_16_4_d.4
FAIL
5999.66
ncf_16_32_8_u.2
FAIL
5999.67
ncf_16_32_8_euad.9
FAIL
5999.69
ncf_16_32_8_euad.8
FAIL
5999.7
ncf_8_16_8_d.8
FAIL
5999.71
ncf_16_32_8_edau.8
FAIL
5999.73
ncf_16_32_8_d.5
FAIL
5999.74
ncf_4_8_8_d.10
FAIL
5999.74
ncf_16_32_4_euad.6
FAIL
5999.77
ncf_4_16_8_d.4
FAIL
5999.78
ncf_16_32_8_euad.2
FAIL
5999.81
ncf_16_32_8_d.9
FAIL
5999.87
ncf_16_32_8_edau.9
FAIL
5999.87
ncf_8_16_8_d.2
FAIL
5999.88
ncf_4_8_8_d.6
FAIL
5999.88
ncf_16_32_8_d.8
FAIL
5999.91
ncf_8_16_8_d.3
FAIL
5999.94
ncf_4_16_4_d.2
FAIL
5999.96
ncf_4_16_8_d.10
FAIL
5999.99
ncf_16_32_8_edau.5
FAIL
6000
ncf_16_32_8_d.2
FAIL
6000.13
ncf_16_32_8_u.5
FAIL
6000.14
ncf_4_16_8_d.1
FAIL
6000.19
ncf_16_32_8_edau.1
FAIL
6000.23
ncf_16_32_8_d.1
FAIL
6000.24
ncf_4_16_8_euad.3
FAIL
6000.25
ncf_16_32_8_euad.1
FAIL
6000.3
ncf_16_32_4_edau.10
FAIL
6000.33
Contact
|
Organization
|
Links
|
Citing QBFLIB