QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Family CounterFactual results for solvers
QBFEVAL'17 - Random QBFs Track
Solver
Total time
Mean time
Std time
Median time
IQ range time
Solved/Total
AIGSolve
27900
900
0
900
0
0
caqe_2017_v1
27216.46
877.95
120.77
900
0
0.032
caqe_2017_v2
27900
900
0
900
0
0
caqe_2017_v3
27216.31
877.95
120.8
900
0
0.032
CUED1919_NL
2295.49
74.05
53.17
103.45
117.43
0
CUED1919_NNL
345.01
11.13
7.93
15.52
17.44
0
dynQBF-bloqqer-hqspre
27900
900
0
900
0
0
ghostq-cegar
27900
900
0
900
0
0
GhostQ-PG_cegar
27900
900
0
900
0
0
GhostQ-PG_plain
27046.46
872.47
150.81
900
0
0.032
heretiq
26486.75
854.41
143.91
900
0
0.129
HQSpre_solver
27900
900
0
900
0
0
ijtihad_v1
27900
900
0
900
0
0
ijtihad_v2
24492.88
790.09
158.54
900
313.51
0
iProver-qbf-2017-07-27-v3
27900
900
0
900
0
0
iProver-qbf-bloqqer-2017-07-27-v3
27900
900
0
900
0
0
prefix-opt-depqbf
27703.87
893.67
34.65
900
0
0.032
qbfrelay
4096.66
132.15
73.33
170.72
152.36
0
qbfrelay-limited-depqbf
25893.85
835.29
194.13
888.39
2.47
0.097
QELL_default
27085.48
873.73
143.91
900
0
0.032
QELL_unit
27004.15
871.1
158.28
900
0
0.032
qesto
27303.17
880.75
105.45
900
0
0.032
Qute_default
27900
900
0
900
0
0
Qute_opt500
24312.99
784.29
300.62
900
0
0.129
Qute_random
24313.02
784.29
300.62
900
0
0.129
rareqs
27058.07
872.84
148.76
900
0
0.032
rev_qfun0.1
27900
900
0
900
0
0
xb-qsts_bqsts2.0
27004.69
871.12
158.19
900
0
0.032
xb-qsts_xbqsts1.0
27005.51
871.15
158.04
900
0
0.032
xb-qsts_xbqsts2.0
27005.46
871.14
158.05
900
0
0.032
Contact
|
Organization
|
Links
|
Citing QBFLIB