QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Solver performance
QBFEVAL'16 - Prenex CNF Track.
Solver
Total
Sat
Unsat
Unique
#
Time
#
Time
#
Time
#
Time
xb-bid-qsts
658
19032.2
343
8447.22
315
10585
18
2191.93
rareqs
640
14166.8
309
4598.66
331
9568.11
3
860.07
xb-qsts
613
15296.7
299
5212.69
314
10084
0
0
depqbf-v2
603
14076.9
297
6256.31
306
7820.6
0
0
caqe-picosat
590
17178.8
294
6272.92
296
10905.9
0
0
AIGSolve
589
15981.3
293
7833.21
296
8148.14
19
595.75
ghostq-cegar
585
14538.8
298
7739.39
287
6799.38
0
0
qesto
582
15552.8
285
4394.35
297
11158.5
0
0
hiqqer1
579
11943.1
287
6322.99
292
5620.11
0
0
caqe-minisat
576
15219.1
292
4878.17
284
10340.9
0
0
hiqqer1ldsq
574
10951.5
288
6319.74
286
4631.8
0
0
hiqqer3
572
12602.9
286
7331
286
5271.88
0
0
ghostq-plain
568
13727.8
282
7000.2
286
6727.6
2
408.42
qsts
563
5261.85
263
2248.88
300
3012.97
3
7.13
qestos
527
4356.04
252
1848
275
2508.04
0
0
depqbf-v3
527
16186.7
261
8995.82
266
7190.88
1
499.59
aqua-s2v
484
7869.78
229
3290.43
255
4579.35
0
0
aqua-f3v
482
7947.8
229
3753.27
253
4194.53
0
0
aqua-s3o
479
6774.68
225
3036.41
254
3738.27
0
0
depqbf-v1
456
9999.76
201
4319.97
255
5679.79
0
0
struqs-10
358
12825.2
175
4595.09
183
8230.08
0
0
squeezebf+struqs
355
12671.6
205
4892.15
150
7779.44
0
0
iprover-QBF
348
12922
158
5385.42
190
7536.62
0
0
iprover-QBF-bloqqer
324
9369.12
243
3955.44
81
5413.68
0
0
struqs-10
0
0
0
0
0
0
0
0
AIGSolve
0
0
0
0
0
0
0
0
aqua-f3v
0
0
0
0
0
0
0
0
aqua-s2v
0
0
0
0
0
0
0
0
aqua-s3o
0
0
0
0
0
0
0
0
qesto
0
0
0
0
0
0
0
0
qestos
0
0
0
0
0
0
0
0
rareqs
0
0
0
0
0
0
0
0
caqe-minisat
0
0
0
0
0
0
0
0
caqe-picosat
0
0
0
0
0
0
0
0
depqbf-v1
0
0
0
0
0
0
0
0
depqbf-v2
0
0
0
0
0
0
0
0
depqbf-v3
0
0
0
0
0
0
0
0
ghostq-cegar
0
0
0
0
0
0
0
0
ghostq-plain
0
0
0
0
0
0
0
0
hiqqer1
0
0
0
0
0
0
0
0
hiqqer1ldsq
0
0
0
0
0
0
0
0
hiqqer3
0
0
0
0
0
0
0
0
iprover-QBF-bloqqer
0
0
0
0
0
0
0
0
iprover-QBF
0
0
0
0
0
0
0
0
qsts
0
0
0
0
0
0
0
0
squeezebf+struqs
0
0
0
0
0
0
0
0
xb-bid-qsts
0
0
0
0
0
0
0
0
xb-qsts
0
0
0
0
0
0
0
0
Problematic solver
Hors-Concours solver
Contact
|
Organization
|
Links
|
Citing QBFLIB