QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Solver performances for family instances
QBFEVAL'16 - Parallel QBF Solvers (non-competitive) Track.
Family
Overall
Time
Reference solver
N
#
S
U
Abduction
10
9
4
5
14.63
hordeqbf
Adder
10
3
1
2
72.8
hiqqerfork
blackbox-01X-QBF
10
9
0
9
46.24
par-pd-depqbf
blackbox_design
10
10
10
0
8.14
par-pd-depqbf
Blocks
10
10
3
7
3.6
hiqqerfork
BMC
10
8
5
3
990.6
hiqqerfork
bomb
10
5
4
1
8.31
mpiDepQBF
C432
8
8
3
5
167.63
par-pd-depqbf
C499
8
6
3
3
241.83
par-pd-depqbf
C5315
8
4
2
2
2.07
par-pd-depqbf
C6288
8
2
2
0
1.02
par-pd-depqbf
C880
8
8
2
6
872.9
par-pd-depqbf
Chain
10
10
10
0
0.25
hiqqerfork
circuits
10
1
1
0
0.03
caqe-minisat-par
conformant_planning
10
7
5
2
246.98
mpiDepQBF
Connect4
10
6
0
6
25.23
hordeqbf
Counter
10
9
9
0
216.03
caqe-picosat-par
Debug
10
1
1
0
600
caqe-minisat-par
DFlipFlop
10
10
0
10
1.38
hiqqerfork
dungeon
10
4
0
4
33.85
hordeqbf
evader-pursuer-4x4-logarithmic
7
7
7
0
5.88
caqe-minisat-par
evader-pursuer-4x4-standard
7
7
7
0
30.82
mpiDepQBF
evader-pursuer-6x6-logarithmic
8
6
0
6
418.11
mpiDepQBF
evader-pursuer-6x6-standard
8
2
0
2
521.77
hordeqbf
evader-pursuer-8x8-logarithmic
8
5
0
5
546.82
hiqqerfork
FPGA_PLB_FIT_FAST
5
5
4
1
0.47
mpiDepQBF
FPGA_PLB_FIT_SLOW
3
3
1
2
20.29
caqe-minisat-par
fpu
10
10
0
10
11.97
hiqqerfork
Generalized-Tic-Tac-Toe
10
10
1
9
579.57
hiqqerfork
HardwareFixpoint
10
8
2
6
122.98
par-pd-depqbf
Impl
10
10
10
0
0.02
caqe-minisat-par
incrementer-encoder
10
7
1
6
336.76
hiqqerfork
irqlkeapclte
10
2
2
0
134.28
hiqqerfork
ISCAS89
8
8
7
1
61.72
hiqqerfork
ITC99
7
3
2
1
1.78
mpiDepQBF
jmc_quant_squaring
10
4
2
2
249.17
mpiDepQBF
k_branch_n
10
9
9
0
8.12
par-pd-depqbf
k_branch_p
10
10
0
10
14.66
par-pd-depqbf
k_d4_n
10
10
10
0
0.54
hiqqerfork
k_d4_p
10
10
0
10
0.39
hiqqerfork
k_dum_n
10
10
10
0
0.27
hiqqerfork
k_dum_p
10
10
0
10
0.27
hiqqerfork
k_grz_n
10
10
10
0
0.43
hiqqerfork
k_grz_p
10
10
0
10
0.39
hiqqerfork
k_lin_n
10
10
10
0
5.12
par-pd-depqbf
k_lin_p
10
10
0
10
0.35
hiqqerfork
k_path_n
10
10
10
0
0.3
hiqqerfork
k_path_p
10
10
0
10
0.33
hiqqerfork
k_ph_n
10
10
10
0
26.38
hiqqerfork
k_ph_p
10
8
5
3
95.86
mpiDepQBF
k_poly_n
10
10
10
0
0.25
hiqqerfork
k_poly_p
10
10
0
10
0.25
hiqqerfork
k_t4p_n
10
10
10
0
0.53
hiqqerfork
k_t4p_p
10
10
0
10
0.45
hiqqerfork
Logn
4
4
0
4
3.96
hiqqerfork
mqm
10
10
5
5
56.25
mpiDepQBF
MutexP
7
7
7
0
0.39
hiqqerfork
Planning-CTE
7
3
2
1
38.52
caqe-minisat-par
QBF-Hardness
10
9
0
9
21.96
hordeqbf
qbfeval12
5
5
1
4
0.17
hiqqerfork
Qshifter
6
6
6
0
5.49
hiqqerfork
RankingFunctions
10
10
10
0
0.41
hiqqerfork
Reduction-finding
10
7
2
5
317.38
hiqqerfork
Rewriting
10
10
0
10
0.12
caqe-minisat-par
s1196
6
6
1
5
852.2
caqe-picosat-par
s1269
10
4
4
0
12.08
par-pd-depqbf
s27
4
4
1
3
0.36
caqe-picosat-par
s298
10
8
6
2
737.02
caqe-picosat-par
s3330
10
3
3
0
373.51
caqe-picosat-par
s386
10
10
5
5
356.25
par-pd-depqbf
s499
10
9
7
2
1529.94
caqe-picosat-par
s510
10
4
4
0
717.17
hiqqerfork
s641
9
9
5
4
8.62
par-pd-depqbf
s713
10
10
5
5
13.64
par-pd-depqbf
s820
10
8
5
3
1632.81
caqe-picosat-par
Sorting_networks
10
6
3
3
547.59
caqe-picosat-par
SzymanskiP
10
10
0
10
23.56
hiqqerfork
term1
8
8
4
4
5.03
hiqqerfork
terminator
10
10
1
9
5.1
par-pd-depqbf
tipdiam
10
7
6
1
124.5
par-pd-depqbf
tipfixpoint
10
7
4
3
12.13
par-pd-depqbf
ToiletA
10
10
3
7
1.46
hiqqerfork
ToiletC
10
10
1
9
6.01
caqe-minisat-par
ToiletG
7
7
7
0
0.01
caqe-minisat-par
trafficlight-controller
10
10
0
10
50.67
hiqqerfork
Tree
10
10
2
8
0
caqe-minisat-par
uclid
3
2
1
1
44.16
par-pd-depqbf
VonNeumann
10
10
0
10
5.43
hiqqerfork
wmiforward
10
10
10
0
0.32
hiqqerfork
z4ml
8
8
4
4
0.17
hiqqerfork
Contact
|
Organization
|
Links
|
Citing QBFLIB
qbflib.org