QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family CounterFactual solved by
sKizzo-0.9-abs
QBFEVAL'06
Instance
Result
Time
ncf_8_16_4_d.1
SAT
0
ncf_16_32_2_edau.6
SAT
0
ncf_4_16_4_d.5
SAT
0
ncf_4_16_2_d.2
SAT
0
ncf_8_16_4_d.10
SAT
0
ncf_4_16_4_d.8
SAT
0
ncf_4_8_8_d.1
SAT
0
ncf_4_8_4_u.9
SAT
0
ncf_4_16_2_edau.6
SAT
0
ncf_4_16_4_edau.5
SAT
0
ncf_16_32_4_d.3
SAT
0
ncf_8_16_4_d.4
SAT
0.01
ncf_4_8_4_euad.9
SAT
0.01
ncf_4_8_8_edau.3
SAT
0.01
ncf_4_8_8_d.8
SAT
0.01
ncf_4_16_2_edau.4
SAT
0.01
ncf_4_16_2_edau.2
SAT
0.01
ncf_4_16_4_d.1
SAT
0.01
ncf_8_16_4_edau.10
SAT
0.01
ncf_8_16_4_edau.1
SAT
0.01
ncf_16_32_4_edau.3
SAT
0.01
ncf_8_16_4_u.1
SAT
0.01
ncf_16_32_2_d.6
SAT
0.01
ncf_4_8_8_edau.1
SAT
0.01
ncf_4_16_4_edau.8
SAT
0.01
ncf_4_16_2_d.4
SAT
0.01
ncf_4_8_8_d.3
SAT
0.01
ncf_8_16_4_edau.4
SAT
0.01
ncf_16_32_4_edau.9
SAT
0.01
ncf_16_32_4_edau.2
SAT
0.01
ncf_4_8_2_euad.10
SAT
0.01
ncf_4_16_4_edau.1
SAT
0.01
ncf_16_32_4_edau.8
SAT
0.01
ncf_4_8_2_u.10
SAT
0.01
ncf_4_8_8_edau.8
SAT
0.01
ncf_4_8_8_u.9
UNSAT
0.01
ncf_16_32_2_d.7
UNSAT
0.01
ncf_8_16_4_u.5
UNSAT
0.01
ncf_8_16_4_d.5
UNSAT
0.01
ncf_4_8_8_euad.9
UNSAT
0.01
ncf_16_32_2_edau.7
UNSAT
0.01
ncf_4_8_8_d.9
UNSAT
0.01
ncf_4_8_8_edau.9
UNSAT
0.01
ncf_4_16_2_d.6
SAT
0.02
ncf_8_16_4_euad.1
SAT
0.02
ncf_4_16_8_d.7
SAT
0.02
ncf_16_32_4_d.8
SAT
0.02
ncf_16_32_4_d.2
SAT
0.02
ncf_16_32_4_d.9
SAT
0.02
ncf_4_8_8_edau.5
UNSAT
0.02
ncf_8_16_4_euad.5
UNSAT
0.02
ncf_4_8_8_d.5
UNSAT
0.02
ncf_8_16_4_edau.5
UNSAT
0.02
ncf_8_16_4_euad.2
UNSAT
0.02
ncf_16_32_8_d.3
SAT
0.03
ncf_16_32_8_edau.3
SAT
0.03
ncf_4_8_2_euad.5
SAT
0.03
ncf_4_8_2_u.7
UNSAT
0.03
ncf_4_8_2_euad.4
UNSAT
0.03
ncf_4_8_2_u.4
UNSAT
0.03
ncf_4_8_2_euad.8
SAT
0.04
ncf_4_8_2_u.8
SAT
0.04
ncf_4_8_2_u.5
SAT
0.04
ncf_4_8_2_euad.7
UNSAT
0.04
ncf_4_8_2_euad.6
SAT
0.05
ncf_4_8_2_u.9
SAT
0.05
ncf_4_16_2_euad.6
SAT
0.05
ncf_4_8_2_euad.1
UNSAT
0.05
ncf_8_16_4_d.2
UNSAT
0.05
ncf_8_16_4_edau.8
UNSAT
0.05
ncf_4_8_2_euad.9
SAT
0.06
ncf_4_16_2_u.6
SAT
0.06
ncf_4_8_2_u.6
SAT
0.06
ncf_4_8_2_u.2
SAT
0.06
ncf_4_8_2_euad.2
SAT
0.06
ncf_4_8_2_u.1
UNSAT
0.06
ncf_8_16_4_d.8
UNSAT
0.06
ncf_4_16_2_d.7
SAT
0.07
ncf_8_16_4_edau.2
UNSAT
0.07
ncf_8_16_4_u.2
UNSAT
0.07
ncf_4_16_2_edau.7
SAT
0.09
ncf_4_16_2_edau.9
SAT
0.09
ncf_4_16_2_u.9
SAT
0.1
ncf_4_16_2_euad.9
SAT
0.12
ncf_4_16_2_d.9
SAT
0.12
ncf_16_32_4_d.5
UNSAT
0.12
ncf_16_32_4_edau.5
UNSAT
0.12
ncf_4_16_2_u.2
SAT
0.13
ncf_4_16_2_u.4
SAT
0.13
ncf_4_16_2_euad.4
SAT
0.13
ncf_4_16_2_euad.2
SAT
0.14
ncf_8_16_4_d.6
UNSAT
0.16
ncf_8_16_4_edau.6
UNSAT
0.16
ncf_4_8_4_u.2
UNSAT
0.17
ncf_4_16_4_u.5
SAT
0.18
ncf_4_8_4_euad.2
UNSAT
0.18
ncf_4_16_4_euad.5
SAT
0.19
ncf_4_8_4_u.5
SAT
0.22
ncf_4_8_4_euad.5
SAT
0.23
ncf_4_16_2_edau.5
UNSAT
0.23
ncf_4_8_2_euad.3
UNSAT
0.23
ncf_4_8_2_u.3
UNSAT
0.24
ncf_16_32_4_edau.10
UNSAT
0.25
ncf_16_32_4_d.10
UNSAT
0.25
ncf_16_32_2_u.9
UNSAT
0.26
ncf_4_16_2_d.5
UNSAT
0.27
ncf_16_32_2_edau.9
UNSAT
0.27
ncf_4_8_8_d.4
SAT
0.29
ncf_4_8_4_u.6
SAT
0.31
ncf_4_8_4_euad.6
SAT
0.31
ncf_4_16_4_edau.9
SAT
0.32
ncf_4_16_4_euad.9
SAT
0.33
ncf_4_16_2_edau.1
UNSAT
0.33
ncf_16_32_2_d.8
UNSAT
0.35
ncf_4_16_4_d.9
SAT
0.36
ncf_4_8_8_edau.4
SAT
0.36
ncf_16_32_2_euad.9
UNSAT
0.36
ncf_16_32_2_d.9
UNSAT
0.36
ncf_4_16_2_u.7
SAT
0.39
ncf_4_16_4_u.9
SAT
0.41
ncf_4_8_4_euad.7
UNSAT
0.41
ncf_4_16_4_euad.1
SAT
0.42
ncf_4_8_8_u.1
SAT
0.43
ncf_4_8_8_euad.1
SAT
0.43
ncf_4_8_4_u.7
UNSAT
0.43
ncf_4_16_4_u.1
SAT
0.44
ncf_4_16_2_euad.7
SAT
0.46
ncf_4_16_2_d.1
UNSAT
0.46
ncf_4_16_2_edau.8
SAT
0.47
ncf_16_32_2_edau.8
UNSAT
0.47
ncf_4_8_4_u.10
SAT
0.48
ncf_4_8_4_euad.10
SAT
0.48
ncf_4_16_2_d.8
SAT
0.49
ncf_4_8_8_u.3
SAT
0.49
ncf_4_8_4_euad.3
UNSAT
0.53
ncf_4_8_4_u.3
UNSAT
0.59
ncf_4_8_8_euad.3
SAT
0.62
ncf_4_8_4_u.8
UNSAT
0.64
ncf_4_8_4_euad.8
UNSAT
0.68
ncf_4_16_4_euad.8
SAT
0.69
ncf_4_8_4_euad.4
UNSAT
0.77
ncf_4_16_4_u.8
SAT
0.78
ncf_4_16_2_d.10
UNSAT
0.84
ncf_16_32_2_u.7
UNSAT
0.87
ncf_4_8_4_u.4
UNSAT
0.97
ncf_16_32_4_d.7
UNSAT
0.99
ncf_4_16_2_edau.10
UNSAT
1
ncf_16_32_8_edau.8
UNSAT
1.03
ncf_8_16_4_u.6
UNSAT
1.04
ncf_16_32_8_d.8
UNSAT
1.1
ncf_16_32_4_edau.7
UNSAT
1.13
ncf_16_32_2_euad.7
UNSAT
1.29
ncf_8_16_4_euad.6
UNSAT
1.36
ncf_4_16_2_euad.10
UNSAT
1.81
ncf_4_16_2_u.10
UNSAT
1.86
ncf_4_8_4_euad.1
SAT
2.1
ncf_4_8_8_u.5
UNSAT
2.1
ncf_4_8_4_u.1
SAT
2.18
ncf_4_16_2_u.8
SAT
2.2
ncf_4_8_8_euad.5
UNSAT
2.3
ncf_4_16_2_euad.8
SAT
2.4
ncf_4_32_2_edau.1
UNSAT
2.51
ncf_8_16_4_d.3
SAT
4.13
ncf_4_16_2_u.5
UNSAT
5.37
ncf_8_16_4_edau.3
SAT
5.51
ncf_4_16_2_euad.5
UNSAT
6.09
ncf_4_8_8_euad.4
SAT
6.13
ncf_4_32_2_edau.2
SAT
6.6
ncf_4_8_8_u.4
SAT
7.45
ncf_4_16_4_edau.4
UNSAT
10.51
ncf_4_16_4_d.4
UNSAT
11.29
ncf_8_16_4_u.8
UNSAT
12.23
ncf_4_32_2_u.1
UNSAT
15.56
ncf_8_16_8_d.1
SAT
15.86
ncf_8_16_8_euad.1
SAT
15.93
ncf_4_16_4_d.7
SAT
16.4
ncf_8_16_8_d.7
UNSAT
17.93
ncf_4_16_4_edau.7
SAT
23.98
ncf_8_16_8_edau.7
UNSAT
26.04
ncf_8_16_4_euad.8
UNSAT
28.87
ncf_16_32_2_d.5
UNSAT
35.79
ncf_16_32_2_d.2
UNSAT
39.14
ncf_4_16_4_u.7
SAT
48.42
ncf_4_16_4_d.10
UNSAT
52.21
ncf_4_32_2_u.2
SAT
60.43
ncf_16_32_2_edau.5
UNSAT
61.86
ncf_4_16_2_u.1
UNSAT
66.73
ncf_4_8_8_d.2
UNSAT
75.42
ncf_4_16_4_euad.7
SAT
78.07
ncf_4_16_2_euad.1
UNSAT
79.03
ncf_16_32_2_edau.2
UNSAT
102
ncf_4_8_8_edau.2
UNSAT
121.14
ncf_4_16_4_edau.10
UNSAT
148.14
ncf_4_8_8_euad.8
FAIL
167.74
ncf_4_16_4_euad.10
UNSAT
168.53
ncf_4_16_2_edau.3
UNSAT
175.08
ncf_4_8_8_u.8
FAIL
181.29
ncf_8_16_8_edau.1
SAT
196.8
ncf_4_16_4_euad.6
UNSAT
235.62
ncf_4_16_4_d.3
SAT
272.97
ncf_4_16_4_edau.3
SAT
286.05
ncf_4_16_4_d.2
SAT
401.2
ncf_4_32_2_edau.3
UNSAT
405.09
ncf_4_16_4_u.10
UNSAT
420.09
ncf_8_16_8_d.9
UNSAT
434.11
ncf_4_8_8_euad.2
UNSAT
454.55
ncf_4_32_2_u.8
FAIL
466.1
ncf_4_16_2_d.3
UNSAT
480.48
ncf_4_16_4_edau.2
SAT
497.25
ncf_4_16_8_d.8
UNSAT
521.16
ncf_8_16_8_edau.6
UNSAT
526.05
ncf_4_16_4_u.6
UNSAT
536.92
ncf_4_32_2_edau.8
FAIL
546.84
ncf_4_16_4_euad.3
FAIL
565.86
ncf_4_16_4_edau.6
UNSAT
569.15
ncf_4_16_2_euad.3
FAIL
578.78
ncf_4_16_2_u.3
UNSAT
588.04
ncf_4_16_8_u.7
FAIL
592.59
ncf_8_16_8_euad.7
UNSAT
602.98
ncf_4_8_8_d.7
SAT
659.35
ncf_4_16_8_euad.7
FAIL
698.85
ncf_4_8_8_euad.10
FAIL
765.04
ncf_4_8_8_edau.7
SAT
765.58
ncf_4_16_4_euad.2
FAIL
780.18
ncf_4_8_8_edau.10
FAIL
869.92
ncf_8_16_4_u.10
FAIL
879.9
ncf_8_16_4_euad.10
FAIL
1046.95
ncf_4_32_2_edau.9
UNSAT
1139.78
ncf_4_32_2_u.3
UNSAT
1162.3
ncf_4_32_2_edau.7
FAIL
1198.04
ncf_4_8_8_edau.6
FAIL
1214.41
ncf_4_8_8_d.10
SAT
1261.57
ncf_4_32_2_u.4
UNSAT
1270.13
ncf_8_16_4_d.7
FAIL
1349.9
ncf_4_8_8_u.2
UNSAT
1489.03
ncf_8_16_8_edau.9
UNSAT
1509.06
ncf_4_16_4_u.3
FAIL
1596.71
ncf_4_16_4_u.4
FAIL
1666.16
ncf_4_16_8_u.10
FAIL
1748.65
ncf_16_32_4_euad.8
FAIL
1765.93
ncf_4_8_8_u.7
FAIL
1825.1
ncf_4_8_8_u.6
FAIL
1828.68
ncf_4_16_4_euad.4
FAIL
1848.52
ncf_4_16_4_u.2
FAIL
1884.81
ncf_4_16_4_d.6
UNSAT
1902.37
ncf_4_32_2_edau.4
UNSAT
1979.78
ncf_16_32_4_u.8
FAIL
2048.52
ncf_8_16_4_u.3
FAIL
2135.87
ncf_8_16_4_euad.3
FAIL
2210.91
ncf_4_8_8_euad.7
FAIL
2307.44
ncf_4_8_8_u.10
FAIL
2344.71
ncf_16_32_4_euad.7
FAIL
2598.74
ncf_16_32_2_d.10
FAIL
2638.99
ncf_16_32_4_edau.4
FAIL
2769.08
ncf_4_16_8_euad.10
FAIL
2815.68
ncf_8_16_8_euad.8
FAIL
2908.22
ncf_16_32_4_u.2
FAIL
2925.96
ncf_4_32_2_u.9
FAIL
3041.48
ncf_8_16_4_edau.9
UNSAT
3082.76
ncf_4_8_8_euad.6
FAIL
3164.93
ncf_8_16_8_edau.10
FAIL
3301.23
ncf_8_16_4_d.9
UNSAT
3427.58
ncf_4_16_8_euad.9
FAIL
3562.71
ncf_4_32_2_u.7
FAIL
3792.57
ncf_8_16_8_edau.3
FAIL
3860.31
ncf_4_32_2_u.6
FAIL
3860.38
ncf_4_16_8_euad.4
FAIL
3963.46
ncf_4_32_2_u.5
FAIL
4346.33
ncf_4_16_8_u.9
FAIL
4435.39
ncf_16_32_4_euad.1
FAIL
4490.99
ncf_4_16_8_d.9
FAIL
4592.91
ncf_4_8_8_d.6
FAIL
4624.5
ncf_16_32_4_u.9
FAIL
4638.99
ncf_16_32_2_euad.2
FAIL
4749.3
ncf_16_32_4_u.7
FAIL
4835.78
ncf_16_32_2_u.5
FAIL
4853.27
ncf_8_16_8_euad.3
FAIL
5036.23
ncf_8_16_8_edau.2
FAIL
5102.12
ncf_16_32_8_edau.1
FAIL
5269.8
ncf_8_16_8_d.6
UNSAT
5279.67
ncf_8_16_8_d.3
FAIL
5310.89
ncf_4_16_8_u.4
FAIL
5329.32
ncf_4_32_2_edau.6
FAIL
5354.64
ncf_16_32_8_euad.1
FAIL
5489.82
ncf_4_16_8_euad.2
FAIL
5541.61
ncf_16_32_8_d.4
FAIL
5708.25
ncf_8_16_4_u.4
FAIL
5838.78
ncf_16_32_2_u.10
FAIL
5884.11
ncf_8_16_8_euad.2
FAIL
5895.92
ncf_16_32_8_u.4
FAIL
5914.79
ncf_16_32_2_u.6
FAIL
5995.09
ncf_16_32_2_euad.6
FAIL
5999.32
ncf_16_32_8_u.1
FAIL
5999.58
ncf_16_32_4_u.1
FAIL
5999.67
ncf_16_32_2_edau.10
FAIL
5999.91
ncf_16_32_8_u.2
FAIL
5999.99
ncf_16_32_2_u.4
FAIL
6000.02
ncf_8_16_8_d.4
FAIL
6000.1
ncf_16_32_4_euad.9
FAIL
6000.13
ncf_16_32_4_edau.1
FAIL
6000.14
ncf_16_32_4_euad.3
FAIL
6000.18
ncf_8_16_4_edau.7
FAIL
6000.18
ncf_16_32_8_edau.5
FAIL
6000.2
ncf_16_32_2_edau.4
FAIL
6000.21
ncf_16_32_8_d.2
FAIL
6000.23
ncf_16_32_8_edau.7
FAIL
6000.24
ncf_16_32_8_d.9
FAIL
6000.25
ncf_8_16_8_euad.10
FAIL
6000.26
ncf_16_32_4_euad.6
FAIL
6000.3
ncf_16_32_4_u.10
FAIL
6000.31
ncf_16_32_8_euad.5
FAIL
6000.33
ncf_16_32_8_d.1
FAIL
6000.34
ncf_16_32_4_u.4
FAIL
6000.35
ncf_8_16_8_euad.4
FAIL
6000.37
ncf_16_32_4_u.3
FAIL
6000.38
ncf_16_32_4_u.5
FAIL
6000.39
ncf_4_16_8_euad.6
FAIL
6000.39
ncf_8_16_4_euad.7
FAIL
6000.39
ncf_16_32_2_euad.10
FAIL
6000.4
ncf_4_16_8_u.3
FAIL
6000.41
ncf_4_16_8_euad.3
FAIL
6000.41
ncf_16_32_2_euad.4
FAIL
6000.41
ncf_8_16_8_d.10
FAIL
6000.41
ncf_8_16_8_edau.4
FAIL
6000.42
ncf_16_32_2_d.4
FAIL
6000.42
ncf_16_32_8_euad.4
FAIL
6000.43
ncf_8_16_4_u.7
FAIL
6000.43
ncf_16_32_8_euad.2
FAIL
6000.44
ncf_16_32_2_euad.1
FAIL
6000.45
ncf_16_32_8_u.7
FAIL
6000.46
ncf_16_32_8_euad.7
FAIL
6000.49
ncf_4_16_8_euad.5
FAIL
6000.49
ncf_16_32_2_euad.3
FAIL
6000.49
ncf_16_32_8_edau.2
FAIL
6000.49
ncf_8_16_8_euad.5
FAIL
6000.5
ncf_16_32_8_u.5
FAIL
6000.5
ncf_8_16_4_euad.9
FAIL
6000.52
ncf_16_32_8_euad.9
FAIL
6000.52
ncf_4_16_8_d.4
FAIL
6000.53
ncf_8_16_8_euad.6
FAIL
6000.54
ncf_16_32_8_d.5
FAIL
6000.55
ncf_16_32_4_d.4
FAIL
6000.56
ncf_8_16_8_edau.8
FAIL
6000.56
ncf_8_16_4_euad.4
FAIL
6000.57
ncf_16_32_8_euad.10
FAIL
6000.57
ncf_4_16_8_d.10
FAIL
6000.57
ncf_16_32_4_d.1
FAIL
6000.58
ncf_16_32_8_euad.6
FAIL
6000.59
ncf_16_32_4_euad.4
FAIL
6000.59
ncf_4_16_8_u.5
FAIL
6000.6
ncf_4_16_8_u.8
FAIL
6000.61
ncf_4_16_8_d.5
FAIL
6000.61
ncf_4_32_2_edau.5
FAIL
6000.61
ncf_4_16_8_d.6
FAIL
6000.61
ncf_16_32_8_edau.6
FAIL
6000.61
ncf_16_32_8_euad.8
FAIL
6000.61
ncf_8_16_8_edau.5
FAIL
6000.61
ncf_16_32_2_u.2
FAIL
6000.62
ncf_16_32_4_u.6
FAIL
6000.62
ncf_16_32_8_edau.9
FAIL
6000.62
ncf_16_32_2_edau.3
FAIL
6000.62
ncf_16_32_8_u.9
FAIL
6000.63
ncf_4_16_8_d.1
FAIL
6000.63
ncf_8_16_8_d.8
FAIL
6000.64
ncf_16_32_8_d.7
FAIL
6000.65
ncf_4_16_8_d.3
FAIL
6000.65
ncf_16_32_2_d.3
FAIL
6000.65
ncf_4_16_8_d.2
FAIL
6000.65
ncf_8_16_8_euad.9
FAIL
6000.67
ncf_4_16_8_u.6
FAIL
6000.68
ncf_4_16_8_euad.1
FAIL
6000.68
ncf_4_32_2_edau.10
FAIL
6000.69
ncf_16_32_8_u.6
FAIL
6000.69
ncf_4_16_8_u.1
FAIL
6000.69
ncf_16_32_8_u.8
FAIL
6000.7
ncf_16_32_8_edau.4
FAIL
6000.71
ncf_16_32_2_euad.5
FAIL
6000.72
ncf_16_32_2_d.1
FAIL
6000.73
ncf_4_16_8_euad.8
FAIL
6000.73
ncf_16_32_2_u.1
FAIL
6000.74
ncf_8_16_4_u.9
FAIL
6000.75
ncf_16_32_8_u.10
FAIL
6000.75
ncf_16_32_8_d.6
FAIL
6000.75
ncf_16_32_2_euad.8
FAIL
6000.76
ncf_16_32_2_edau.1
FAIL
6000.77
ncf_8_16_8_d.2
FAIL
6000.78
ncf_16_32_2_u.3
FAIL
6000.78
ncf_4_16_8_u.2
FAIL
6000.79
ncf_16_32_2_u.8
FAIL
6000.79
ncf_16_32_8_u.3
FAIL
6000.79
ncf_16_32_4_euad.2
FAIL
6000.8
ncf_16_32_8_euad.3
FAIL
6000.81
ncf_16_32_4_euad.5
FAIL
6000.82
ncf_4_32_2_u.10
FAIL
6000.84
ncf_16_32_4_euad.10
FAIL
6000.85
ncf_16_32_4_d.6
FAIL
6000.85
ncf_8_16_8_d.5
FAIL
6000.86
ncf_16_32_4_edau.6
FAIL
6000.87
ncf_16_32_8_d.10
FAIL
6000.88
ncf_16_32_8_edau.10
FAIL
6000.91
Contact
|
Organization
|
Links
|
Citing QBFLIB