QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family CounterFactual solved by
WalkQSAT
QBFEVAL'06
Instance
Result
Time
ncf_4_8_2_u.1
UNSAT
0
ncf_4_8_2_euad.10
SAT
0
ncf_8_16_4_u.5
UNSAT
0
ncf_4_8_2_euad.1
UNSAT
0
ncf_8_16_4_d.5
UNSAT
0
ncf_4_16_2_edau.6
SAT
0
ncf_4_8_2_u.7
UNSAT
0
ncf_4_8_4_euad.9
SAT
0
ncf_8_16_4_euad.8
UNSAT
0
ncf_8_16_4_euad.5
UNSAT
0
ncf_4_8_2_u.2
SAT
0
ncf_4_8_2_u.9
SAT
0
ncf_8_16_4_d.10
SAT
0.01
ncf_8_16_4_d.2
UNSAT
0.01
ncf_16_32_2_d.6
SAT
0.01
ncf_16_32_2_edau.6
SAT
0.01
ncf_4_8_2_u.5
SAT
0.01
ncf_4_8_8_edau.5
UNSAT
0.01
ncf_16_32_2_d.7
UNSAT
0.01
ncf_4_8_4_u.3
UNSAT
0.01
ncf_4_8_2_euad.2
SAT
0.01
ncf_4_16_2_u.2
SAT
0.01
ncf_4_16_2_edau.9
SAT
0.01
ncf_8_16_4_u.1
SAT
0.01
ncf_4_8_4_u.7
UNSAT
0.01
ncf_8_16_4_edau.6
UNSAT
0.01
ncf_4_8_2_euad.9
SAT
0.01
ncf_4_8_4_u.9
SAT
0.01
ncf_4_8_4_u.2
UNSAT
0.01
ncf_8_16_4_edau.1
SAT
0.01
ncf_4_8_2_euad.3
UNSAT
0.01
ncf_4_8_4_euad.5
SAT
0.01
ncf_4_16_4_edau.5
SAT
0.01
ncf_16_32_2_edau.7
UNSAT
0.01
ncf_4_16_2_euad.6
SAT
0.01
ncf_8_16_4_edau.5
UNSAT
0.01
ncf_4_8_2_u.4
UNSAT
0.01
ncf_4_8_2_u.10
SAT
0.01
ncf_4_16_2_d.6
SAT
0.01
ncf_4_8_8_euad.9
UNSAT
0.01
ncf_8_16_4_euad.6
UNSAT
0.01
ncf_4_8_2_u.3
UNSAT
0.01
ncf_4_8_4_euad.3
UNSAT
0.01
ncf_4_8_2_u.8
SAT
0.01
ncf_16_32_2_d.9
UNSAT
0.01
ncf_4_8_4_u.6
SAT
0.01
ncf_4_16_2_euad.2
SAT
0.01
ncf_4_8_4_euad.6
SAT
0.01
ncf_8_16_4_u.2
UNSAT
0.01
ncf_16_32_2_u.6
SAT
0.01
ncf_4_16_2_u.6
SAT
0.01
ncf_8_16_4_d.1
SAT
0.02
ncf_4_8_4_euad.2
UNSAT
0.02
ncf_16_32_2_edau.8
UNSAT
0.02
ncf_4_16_2_edau.2
SAT
0.02
ncf_4_8_4_euad.8
UNSAT
0.02
ncf_4_16_2_d.9
SAT
0.02
ncf_8_16_4_edau.2
UNSAT
0.02
ncf_16_32_2_u.9
UNSAT
0.02
ncf_4_8_2_euad.5
SAT
0.02
ncf_8_16_4_euad.10
SAT
0.02
ncf_8_16_4_edau.8
UNSAT
0.02
ncf_16_32_2_d.8
UNSAT
0.02
ncf_4_8_4_u.5
SAT
0.02
ncf_16_32_2_euad.2
UNSAT
0.02
ncf_4_16_2_d.2
SAT
0.02
ncf_4_8_8_d.8
SAT
0.02
ncf_4_8_2_euad.7
UNSAT
0.02
ncf_4_8_8_d.9
UNSAT
0.02
ncf_4_16_2_u.9
SAT
0.02
ncf_4_8_2_euad.8
SAT
0.02
ncf_8_16_4_d.8
UNSAT
0.02
ncf_4_16_4_d.5
SAT
0.02
ncf_4_16_2_euad.9
SAT
0.02
ncf_16_32_2_euad.6
SAT
0.02
ncf_8_16_4_edau.10
SAT
0.02
ncf_4_16_4_u.5
SAT
0.02
ncf_8_16_4_euad.1
SAT
0.02
ncf_4_16_4_euad.5
SAT
0.02
ncf_4_8_2_euad.4
UNSAT
0.02
ncf_4_8_4_euad.7
UNSAT
0.02
ncf_4_8_8_edau.9
UNSAT
0.02
ncf_16_32_2_u.5
UNSAT
0.02
ncf_16_32_2_euad.7
UNSAT
0.02
ncf_16_32_2_u.2
UNSAT
0.02
ncf_4_8_8_d.5
UNSAT
0.02
ncf_8_16_4_euad.2
UNSAT
0.02
ncf_4_8_8_u.5
UNSAT
0.02
ncf_16_32_4_edau.9
SAT
0.03
ncf_16_32_2_u.10
UNSAT
0.03
ncf_4_8_8_u.4
SAT
0.03
ncf_4_16_2_euad.4
SAT
0.03
ncf_4_8_8_u.9
UNSAT
0.03
ncf_8_16_4_u.10
SAT
0.03
ncf_8_16_4_u.6
UNSAT
0.03
ncf_16_32_2_edau.2
UNSAT
0.03
ncf_16_32_2_u.7
UNSAT
0.03
ncf_8_16_4_d.4
SAT
0.03
ncf_8_16_4_d.6
UNSAT
0.03
ncf_4_8_4_u.8
UNSAT
0.03
ncf_8_16_8_edau.6
UNSAT
0.03
ncf_4_16_4_d.8
SAT
0.03
ncf_8_16_4_u.8
UNSAT
0.03
ncf_16_32_2_edau.9
UNSAT
0.03
ncf_16_32_2_u.8
UNSAT
0.03
ncf_16_32_2_euad.8
UNSAT
0.04
ncf_16_32_2_d.5
UNSAT
0.04
ncf_16_32_4_d.9
SAT
0.04
ncf_4_8_8_euad.8
SAT
0.04
ncf_4_16_4_euad.8
SAT
0.04
ncf_8_16_4_u.4
SAT
0.04
ncf_4_16_2_euad.1
UNSAT
0.04
ncf_4_16_2_u.7
SAT
0.04
ncf_16_32_4_edau.10
UNSAT
0.04
ncf_4_16_4_u.8
SAT
0.04
ncf_16_32_2_euad.5
UNSAT
0.04
ncf_4_8_8_euad.5
UNSAT
0.04
ncf_16_32_2_u.4
UNSAT
0.04
ncf_16_32_2_euad.9
UNSAT
0.04
ncf_16_32_4_euad.3
SAT
0.04
ncf_8_16_8_d.6
UNSAT
0.04
ncf_4_8_2_u.6
SAT
0.04
ncf_16_32_2_edau.5
UNSAT
0.04
ncf_16_32_4_euad.9
SAT
0.04
ncf_8_16_8_euad.6
UNSAT
0.04
ncf_16_32_4_u.9
SAT
0.04
ncf_4_8_8_u.8
SAT
0.05
ncf_4_8_2_euad.6
SAT
0.05
ncf_4_16_2_euad.7
SAT
0.05
ncf_4_16_2_u.5
UNSAT
0.05
ncf_4_8_8_edau.4
SAT
0.05
ncf_16_32_4_d.7
UNSAT
0.05
ncf_16_32_4_edau.5
UNSAT
0.05
ncf_16_32_2_euad.4
UNSAT
0.05
ncf_16_32_2_edau.3
SAT
0.05
ncf_16_32_2_d.4
UNSAT
0.05
ncf_16_32_4_u.4
UNSAT
0.05
ncf_4_16_2_euad.5
UNSAT
0.05
ncf_16_32_4_d.3
SAT
0.05
ncf_16_32_2_d.2
UNSAT
0.05
ncf_16_32_4_euad.5
UNSAT
0.05
ncf_4_32_2_edau.1
UNSAT
0.05
ncf_16_32_4_d.4
UNSAT
0.05
ncf_8_16_4_euad.4
SAT
0.05
ncf_4_16_2_u.4
SAT
0.05
ncf_16_32_4_edau.4
UNSAT
0.05
ncf_4_16_2_edau.4
SAT
0.05
ncf_16_32_2_u.3
SAT
0.06
ncf_16_32_4_d.1
SAT
0.06
ncf_16_32_4_d.5
UNSAT
0.06
ncf_4_16_4_edau.8
SAT
0.06
ncf_4_16_4_euad.9
SAT
0.06
ncf_16_32_4_d.10
UNSAT
0.06
ncf_4_8_8_euad.4
SAT
0.06
ncf_16_32_2_edau.4
UNSAT
0.06
ncf_4_32_2_u.1
UNSAT
0.06
ncf_16_32_2_edau.10
UNSAT
0.06
ncf_4_8_4_u.1
SAT
0.06
ncf_16_32_4_euad.4
UNSAT
0.07
ncf_16_32_4_euad.1
SAT
0.07
ncf_16_32_4_u.7
UNSAT
0.07
ncf_16_32_4_u.3
SAT
0.07
ncf_16_32_4_edau.7
UNSAT
0.07
ncf_16_32_2_u.1
UNSAT
0.07
ncf_8_16_8_d.7
UNSAT
0.08
ncf_16_32_4_edau.3
SAT
0.08
ncf_4_16_2_edau.5
UNSAT
0.08
ncf_16_32_4_euad.7
UNSAT
0.08
ncf_4_16_2_d.1
UNSAT
0.08
ncf_8_16_4_edau.4
SAT
0.08
ncf_16_32_2_euad.1
UNSAT
0.09
ncf_4_16_2_d.4
SAT
0.09
ncf_4_16_2_edau.7
FAIL
0.09
ncf_4_8_4_euad.4
UNSAT
0.09
ncf_16_32_4_u.5
UNSAT
0.09
ncf_16_32_2_euad.3
SAT
0.09
ncf_16_32_8_d.8
UNSAT
0.1
ncf_16_32_4_euad.10
UNSAT
0.1
ncf_8_16_4_euad.9
UNSAT
0.1
ncf_16_32_2_d.3
SAT
0.1
ncf_4_8_8_euad.6
UNSAT
0.1
ncf_16_32_4_u.10
UNSAT
0.1
ncf_8_16_8_edau.1
SAT
0.1
ncf_4_8_8_u.6
UNSAT
0.11
ncf_4_8_8_d.4
SAT
0.11
ncf_16_32_2_d.1
UNSAT
0.12
ncf_16_32_4_u.1
SAT
0.12
ncf_16_32_8_edau.8
UNSAT
0.13
ncf_8_16_8_d.1
SAT
0.13
ncf_16_32_8_u.8
UNSAT
0.13
ncf_8_16_8_euad.1
SAT
0.13
ncf_16_32_4_edau.1
SAT
0.14
ncf_8_16_8_euad.7
UNSAT
0.15
ncf_4_8_8_edau.8
SAT
0.15
ncf_16_32_2_euad.10
UNSAT
0.17
ncf_4_16_8_euad.7
SAT
0.18
ncf_16_32_4_u.8
SAT
0.18
ncf_16_32_4_euad.8
SAT
0.19
ncf_16_32_8_euad.8
UNSAT
0.19
ncf_16_32_4_euad.2
SAT
0.19
ncf_8_16_4_d.9
UNSAT
0.2
ncf_8_16_8_edau.8
UNSAT
0.21
ncf_4_8_4_euad.1
SAT
0.21
ncf_16_32_4_u.2
SAT
0.22
ncf_4_16_8_u.7
SAT
0.23
ncf_4_16_2_d.5
UNSAT
0.23
ncf_16_32_4_d.2
SAT
0.23
ncf_4_16_2_d.7
FAIL
0.26
ncf_16_32_4_d.8
SAT
0.29
ncf_4_16_4_edau.9
SAT
0.29
ncf_16_32_2_edau.1
UNSAT
0.3
ncf_16_32_4_euad.6
UNSAT
0.3
ncf_4_16_4_u.9
SAT
0.3
ncf_4_8_4_euad.10
SAT
0.31
ncf_8_16_8_edau.7
UNSAT
0.32
ncf_16_32_4_d.6
UNSAT
0.33
ncf_4_8_8_u.1
SAT
0.34
ncf_4_8_8_euad.1
SAT
0.46
ncf_16_32_8_u.4
SAT
0.48
ncf_16_32_4_edau.8
SAT
0.52
ncf_4_8_8_u.3
SAT
0.55
ncf_16_32_8_d.7
SAT
0.55
ncf_16_32_2_d.10
UNSAT
0.56
ncf_16_32_8_euad.4
SAT
0.58
ncf_4_8_4_u.10
SAT
0.6
ncf_4_16_2_u.10
UNSAT
0.62
ncf_16_32_4_u.6
UNSAT
0.69
ncf_4_16_4_u.1
SAT
0.75
ncf_4_8_4_u.4
UNSAT
0.76
ncf_4_16_4_u.7
SAT
0.83
ncf_4_16_8_d.7
SAT
0.93
ncf_16_32_4_edau.2
SAT
0.95
ncf_16_32_8_euad.5
UNSAT
1.07
ncf_16_32_8_d.4
SAT
1.08
ncf_16_32_8_euad.7
SAT
1.08
ncf_4_16_4_euad.1
SAT
1.08
ncf_4_8_8_euad.3
SAT
1.13
ncf_16_32_8_u.7
SAT
1.43
ncf_16_32_4_edau.6
UNSAT
1.48
ncf_4_16_2_euad.10
UNSAT
1.51
ncf_4_16_4_d.9
SAT
1.56
ncf_8_16_8_euad.9
UNSAT
1.59
ncf_4_8_8_euad.2
UNSAT
1.77
ncf_16_32_8_edau.5
UNSAT
1.95
ncf_4_16_2_u.1
UNSAT
2.1
ncf_16_32_8_u.5
UNSAT
3.08
ncf_4_16_2_edau.10
UNSAT
3.25
ncf_16_32_8_edau.4
SAT
3.33
ncf_16_32_8_euad.2
UNSAT
3.44
ncf_4_16_8_u.4
SAT
3.53
ncf_4_16_4_euad.7
SAT
3.53
ncf_16_32_8_euad.10
SAT
3.73
ncf_4_16_2_u.8
SAT
4.39
ncf_16_32_8_d.5
UNSAT
4.71
ncf_4_32_2_edau.2
SAT
5.31
ncf_4_16_8_u.10
SAT
5.45
ncf_4_16_4_u.4
UNSAT
5.56
ncf_4_32_2_u.2
SAT
6.42
ncf_4_16_2_edau.1
UNSAT
6.67
ncf_16_32_8_edau.7
SAT
6.76
ncf_4_16_2_edau.8
SAT
7.69
ncf_8_16_8_euad.8
UNSAT
8.07
ncf_4_16_4_edau.7
SAT
8.73
ncf_16_32_8_euad.6
SAT
9.95
ncf_4_16_4_edau.1
SAT
12.87
ncf_16_32_8_u.6
SAT
13.16
ncf_4_8_8_u.10
SAT
13.36
ncf_4_16_4_u.3
SAT
13.39
ncf_4_16_4_euad.4
UNSAT
14.87
ncf_16_32_8_d.6
SAT
15.03
ncf_16_32_8_edau.10
SAT
15.26
ncf_4_8_8_d.3
SAT
17.24
ncf_16_32_8_u.3
SAT
17.39
ncf_16_32_8_u.10
SAT
17.66
ncf_16_32_8_d.2
UNSAT
18.3
ncf_4_8_8_edau.3
SAT
19.2
ncf_16_32_8_d.10
SAT
19.26
ncf_4_16_4_d.1
SAT
19.44
ncf_4_16_2_euad.8
SAT
19.45
ncf_8_16_8_edau.2
SAT
19.74
ncf_4_16_4_u.10
UNSAT
22.47
ncf_16_32_8_edau.3
SAT
23.65
ncf_4_16_8_d.10
SAT
27.35
ncf_4_16_4_euad.3
SAT
29.74
ncf_4_16_4_euad.10
UNSAT
30.06
ncf_16_32_8_euad.3
SAT
31.33
ncf_4_8_8_edau.1
SAT
31.57
ncf_4_16_2_u.3
UNSAT
33.03
ncf_4_16_4_edau.4
UNSAT
38.45
ncf_4_16_4_d.7
SAT
43.79
ncf_8_16_8_edau.9
UNSAT
44.61
ncf_4_16_4_d.4
FAIL
47.05
ncf_4_8_8_edau.10
SAT
49.11
ncf_4_8_8_u.2
UNSAT
49.14
ncf_4_8_8_d.6
FAIL
52.49
ncf_4_8_8_d.1
SAT
56.36
ncf_4_16_8_u.8
UNSAT
57.44
ncf_4_8_8_d.7
SAT
57.56
ncf_4_8_8_euad.7
SAT
62.63
ncf_8_16_8_d.8
UNSAT
63.05
ncf_4_16_2_euad.3
UNSAT
69.44
ncf_4_16_8_euad.10
SAT
71
ncf_4_8_8_edau.6
FAIL
73.93
ncf_4_16_4_edau.10
UNSAT
75.19
ncf_8_16_4_u.9
UNSAT
85.17
ncf_4_16_4_u.6
UNSAT
89.75
ncf_4_8_8_euad.10
SAT
92.28
ncf_4_16_2_d.10
FAIL
93.86
ncf_4_32_2_u.4
UNSAT
103.21
ncf_4_16_4_edau.3
SAT
105.44
ncf_4_16_2_d.8
SAT
117.28
ncf_8_16_4_euad.3
SAT
118.36
ncf_4_16_8_u.2
SAT
119.68
ncf_16_32_8_d.3
SAT
120.26
ncf_4_16_8_u.9
SAT
122.04
ncf_4_16_8_d.5
UNSAT
132.79
ncf_8_16_8_d.9
UNSAT
135.82
ncf_4_16_8_euad.8
UNSAT
157.14
ncf_8_16_4_edau.7
SAT
157.34
ncf_4_8_8_d.2
UNSAT
170.73
ncf_4_16_4_euad.6
UNSAT
173.1
ncf_8_16_4_u.3
SAT
183.44
ncf_4_16_2_edau.3
UNSAT
194.54
ncf_4_16_8_euad.2
SAT
298.73
ncf_4_8_8_u.7
SAT
306.19
ncf_16_32_8_edau.6
SAT
333.47
ncf_4_8_8_edau.7
SAT
517.17
ncf_4_16_8_u.5
UNSAT
536.84
ncf_4_32_2_u.9
FAIL
600.94
ncf_16_32_8_edau.2
FAIL
600.96
ncf_4_16_8_euad.4
FAIL
600.97
ncf_8_16_4_euad.7
FAIL
600.97
ncf_4_16_8_euad.5
FAIL
600.97
ncf_4_16_8_euad.1
FAIL
600.97
ncf_8_16_8_euad.10
FAIL
600.97
ncf_8_16_4_edau.3
FAIL
600.97
ncf_4_32_2_u.6
FAIL
600.97
ncf_8_16_8_euad.2
FAIL
600.98
ncf_4_16_8_euad.3
FAIL
600.98
ncf_16_32_8_u.1
FAIL
600.98
ncf_4_32_2_u.5
FAIL
600.98
ncf_16_32_8_euad.1
FAIL
600.98
ncf_4_16_8_u.6
FAIL
600.98
ncf_4_16_4_edau.6
FAIL
600.99
ncf_4_16_8_d.6
FAIL
600.99
ncf_4_32_2_u.8
FAIL
600.99
ncf_16_32_8_u.2
FAIL
600.99
ncf_4_16_4_d.3
FAIL
600.99
ncf_16_32_8_edau.1
FAIL
600.99
ncf_8_16_8_euad.5
FAIL
600.99
ncf_8_16_8_edau.3
FAIL
600.99
ncf_8_16_8_edau.5
FAIL
600.99
ncf_8_16_8_edau.4
FAIL
600.99
ncf_8_16_4_edau.9
FAIL
600.99
ncf_4_32_2_edau.10
FAIL
600.99
ncf_16_32_8_euad.9
FAIL
600.99
ncf_4_16_4_d.6
FAIL
600.99
ncf_8_16_8_euad.3
FAIL
600.99
ncf_8_16_8_d.4
FAIL
600.99
ncf_4_8_8_edau.2
FAIL
600.99
ncf_16_32_8_u.9
FAIL
600.99
ncf_4_16_8_u.1
FAIL
600.99
ncf_4_16_4_d.2
FAIL
601
ncf_8_16_4_u.7
FAIL
601
ncf_4_16_8_d.9
FAIL
601
ncf_16_32_8_d.9
FAIL
601
ncf_4_32_2_edau.8
FAIL
601
ncf_16_32_8_d.1
FAIL
601
ncf_8_16_8_edau.10
FAIL
601
ncf_8_16_4_d.3
FAIL
601
ncf_4_16_2_d.3
FAIL
601
ncf_4_16_4_d.10
FAIL
601
ncf_4_16_4_euad.2
FAIL
601
ncf_4_16_8_d.2
FAIL
601
ncf_8_16_8_euad.4
FAIL
601
ncf_4_32_2_edau.6
FAIL
601
ncf_16_32_8_edau.9
FAIL
601
ncf_4_16_8_u.3
FAIL
601
ncf_4_16_8_d.3
FAIL
601
ncf_4_16_4_edau.2
FAIL
601
ncf_4_16_4_u.2
FAIL
601
ncf_4_8_8_d.10
FAIL
601
ncf_8_16_8_d.5
FAIL
601
ncf_4_32_2_edau.7
FAIL
601
ncf_8_16_4_d.7
FAIL
601
ncf_8_16_8_d.10
FAIL
601
ncf_4_16_8_d.4
FAIL
601
ncf_4_16_8_euad.9
FAIL
601
ncf_8_16_8_d.3
FAIL
601
ncf_4_32_2_u.3
FAIL
601
ncf_8_16_8_d.2
FAIL
601
ncf_4_32_2_u.7
FAIL
601
ncf_4_32_2_edau.4
FAIL
601
ncf_4_16_8_d.8
FAIL
601
ncf_4_16_8_euad.6
FAIL
601
ncf_4_32_2_u.10
FAIL
601.01
ncf_4_16_8_d.1
FAIL
601.01
ncf_4_32_2_edau.9
FAIL
601.01
ncf_4_32_2_edau.5
FAIL
601.01
ncf_4_32_2_edau.3
FAIL
601.01
Contact
|
Organization
|
Links
|
Citing QBFLIB