QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Solver performance
QBFEVAL'07 - Evaluation of Suite Audemard as hors concours formulas.
Solver
Total
Sat
Unsat
Unique
#
Time
#
Time
#
Time
#
Time
ncQuBE1.1
286
1006.18
152
810.57
134
195.62
1
176.71
ncQuBE1.0
284
1511.78
151
1221.78
133
290
0
0
AQME-1NN
280
13528.2
146
7281.82
134
6246.37
0
0
AQME-C4.5
278
3891.58
145
2593.44
133
1298.14
0
0
AQME-RIPPER
270
1906.38
138
1228.16
132
678.22
0
0
yQuaffle
260
384.3
132
197.83
128
186.47
0
0
Adaptive2clsQ
223
16291.3
116
8177.7
107
8113.6
0
0
qSS
211
4065.3
103
2085.52
108
1979.78
0
0
aigqbf_s
193
23807.5
99
9775.53
94
14032
0
0
preQuel_sKizzo-0.10
169
201.9
75
70.12
94
131.78
0
0
sKizzo-0.10-std
162
190.53
70
59.08
92
131.45
0
0
sKizzo-0.10-qck
149
283.33
66
76.41
83
206.92
0
0
aigqbf_sr
146
12258.6
75
4811.29
71
7447.33
0
0
qZilla
142
6574.44
76
3553.68
66
3020.77
0
0
QUANTOR_2.15
73
4539.18
33
2698.88
40
1840.31
0
0
EBDDRES
21
126.24
10
59.18
11
67.06
0
0
squolem
12
2205.47
5
1155.19
7
1050.29
0
0
yQuaffle
0
0
0
0
0
0
0
0
QUANTOR_2.15
0
0
0
0
0
0
0
0
squolem
0
0
0
0
0
0
0
0
aigqbf_s
0
0
0
0
0
0
0
0
aigqbf_sr
0
0
0
0
0
0
0
0
sKizzo-0.10-std
0
0
0
0
0
0
0
0
sKizzo-0.10-qck
0
0
0
0
0
0
0
0
preQuel_sKizzo-0.10
0
0
0
0
0
0
0
0
qZilla
0
0
0
0
0
0
0
0
Adaptive2clsQ
0
0
0
0
0
0
0
0
qSS
0
0
0
0
0
0
0
0
EBDDRES
0
0
0
0
0
0
0
0
ncQuBE1.0
0
0
0
0
0
0
0
0
ncQuBE1.1
0
0
0
0
0
0
0
0
AQME-RIPPER
0
0
0
0
0
0
0
0
AQME-C4.5
0
0
0
0
0
0
0
0
AQME-1NN
0
0
0
0
0
0
0
0
Problematic solver
Hors-Concours solver
Contact
|
Organization
|
Links
|
Citing QBFLIB