QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Solver performance
QBFEVAL'16 - Random QBFs Track.
Solver
Total
Sat
Unsat
Unique
#
Time
#
Time
#
Time
#
Time
xb-bid-qsts
336
9303.64
181
3961.4
155
5342.24
29
877.52
aqua-s2v
306
10976.2
127
4952.36
179
6023.87
2
9.63
aqua-f3v
306
11419.7
127
5031.04
179
6388.62
1
22.47
aqua-s3o
300
10360.1
127
5085.79
173
5274.28
0
0
caqe-picosat
298
7324.49
128
2579.82
170
4744.67
6
869.06
rareqs
295
4305.78
127
1699.99
168
2605.79
4
762.33
xb-qsts
294
7963.03
132
2295.17
162
5667.86
0
0
qesto
291
9398.91
131
3720.64
160
5678.27
1
308.61
depqbf-v2
287
8977.03
113
1613.3
174
7363.73
0
0
hiqqer1
267
6712.26
111
1709.68
156
5002.58
0
0
hiqqer1ldsq
267
7013.05
111
1681.42
156
5331.63
0
0
hiqqer3
261
4763.45
111
1560.89
150
3202.56
0
0
depqbf-v1
257
7572
104
2130.39
153
5441.61
0
0
depqbf-v3
257
7772.75
108
2726.88
149
5045.87
1
37.04
qestos
246
6904.9
107
2340.14
139
4564.76
0
0
qsts
239
5231.98
106
2339.49
133
2892.49
6
309.34
caqe-minisat
212
7360.3
107
3758.12
105
3602.18
0
0
iprover-QBF-bloqqer
59
264.61
58
75.49
1
189.12
0
0
squeezebf+struqs
41
5851.1
27
3814.07
14
2037.03
0
0
struqs-10
35
3623.79
21
1602.65
14
2021.14
0
0
iprover-QBF
25
4341.95
25
4341.95
0
0
0
0
struqs-10
0
0
0
0
0
0
0
0
aqua-f3v
0
0
0
0
0
0
0
0
aqua-s2v
0
0
0
0
0
0
0
0
aqua-s3o
0
0
0
0
0
0
0
0
qesto
0
0
0
0
0
0
0
0
qestos
0
0
0
0
0
0
0
0
rareqs
0
0
0
0
0
0
0
0
caqe-minisat
0
0
0
0
0
0
0
0
caqe-picosat
0
0
0
0
0
0
0
0
depqbf-v1
0
0
0
0
0
0
0
0
depqbf-v2
0
0
0
0
0
0
0
0
depqbf-v3
0
0
0
0
0
0
0
0
hiqqer1
0
0
0
0
0
0
0
0
hiqqer1ldsq
0
0
0
0
0
0
0
0
hiqqer3
0
0
0
0
0
0
0
0
iprover-QBF-bloqqer
0
0
0
0
0
0
0
0
iprover-QBF
0
0
0
0
0
0
0
0
qsts
0
0
0
0
0
0
0
0
squeezebf+struqs
0
0
0
0
0
0
0
0
xb-bid-qsts
0
0
0
0
0
0
0
0
xb-qsts
0
0
0
0
0
0
0
0
Problematic solver
Hors-Concours solver
Contact
|
Organization
|
Links
|
Citing QBFLIB