QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Solver performances for family instances
QBFEVAL'16 - Solver Portfolio Track.
Family
Overall
Time
Reference solver
N
#
S
U
Abduction
10
9
4
5
14.7
squeezebf+aqme
Adder
10
4
2
2
297.29
aqme-10
blackbox-01X-QBF
10
7
0
7
181.36
caqe-portfolio
blackbox_design
10
10
10
0
15.53
caqe-portfolio
Blocks
10
10
3
7
23.82
squeezebf+aqme
BMC
10
7
4
3
79.27
aqme-10
bomb
10
4
4
0
50.99
aqme-10
C432
8
8
3
5
353.88
squeezebf+aqme
C499
8
5
3
2
4.01
caqe-portfolio
C5315
8
4
2
2
10.74
aqme-10
C6288
8
2
2
0
8.42
aqme-10
C880
8
2
2
0
0.84
caqe-portfolio
Chain
10
10
10
0
1.6
caqe-portfolio
circuits
10
2
2
0
43.94
aqme-10
conformant_planning
10
9
5
4
664.02
aqme-10
Connect4
10
6
0
6
13.15
aqme-10
Counter
10
9
9
0
52.66
squeezebf+aqme
Debug
10
8
8
0
584.95
aqme-10
DFlipFlop
10
10
0
10
12.85
aqme-10
dungeon
10
10
0
10
84.85
aqme-10
evader-pursuer-4x4-logarithmic
7
7
7
0
11.18
caqe-portfolio
evader-pursuer-4x4-standard
7
3
3
0
28.01
caqe-portfolio
evader-pursuer-6x6-logarithmic
8
3
0
3
48.13
aqme-10
evader-pursuer-6x6-standard
8
2
0
2
66.46
aqme-10
evader-pursuer-8x8-logarithmic
8
4
0
4
110.64
aqme-10
FPGA_PLB_FIT_FAST
5
5
4
1
3.65
aqme-10
FPGA_PLB_FIT_SLOW
3
3
1
2
3.62
aqme-10
fpu
10
10
0
10
61.83
caqe-portfolio
Generalized-Tic-Tac-Toe
10
9
1
8
252.21
caqe-portfolio
HardwareFixpoint
10
5
2
3
15.53
caqe-portfolio
Impl
10
10
10
0
1.2
caqe-portfolio
incrementer-encoder
10
6
0
6
16.62
aqme-10
ISCAS89
8
7
6
1
67.65
caqe-portfolio
ITC99
7
3
2
1
10.88
squeezebf+aqme
jmc_quant_squaring
10
3
2
1
153.82
caqe-portfolio
k_branch_n
10
9
9
0
21.11
caqe-portfolio
k_branch_p
10
9
0
9
35.04
caqe-portfolio
k_d4_n
10
10
10
0
6.22
caqe-portfolio
k_d4_p
10
10
0
10
2.6
caqe-portfolio
k_dum_n
10
10
10
0
1.51
caqe-portfolio
k_dum_p
10
10
0
10
1.72
caqe-portfolio
k_grz_n
10
10
10
0
3.1
caqe-portfolio
k_grz_p
10
10
0
10
2.6
caqe-portfolio
k_lin_n
10
10
10
0
19.55
caqe-portfolio
k_lin_p
10
10
0
10
2.21
caqe-portfolio
k_path_n
10
10
10
0
2.02
caqe-portfolio
k_path_p
10
10
0
10
2.4
caqe-portfolio
k_ph_n
10
10
10
0
90.55
caqe-portfolio
k_ph_p
10
4
0
4
173.44
caqe-portfolio
k_poly_n
10
10
10
0
1.73
caqe-portfolio
k_poly_p
10
10
0
10
1.61
caqe-portfolio
k_t4p_n
10
10
10
0
4.9
caqe-portfolio
k_t4p_p
10
10
0
10
3.73
caqe-portfolio
Logn
4
4
0
4
5.65
aqme-10
mqm
10
9
5
4
634.17
squeezebf+aqme
MutexP
7
7
7
0
5.85
aqme-10
Planning-CTE
7
5
2
3
344.19
aqme-10
QBF-Hardness
10
8
1
7
66.48
caqe-portfolio
qbfeval12
5
5
1
4
3.77
squeezebf+aqme
Qshifter
6
6
6
0
13.44
caqe-portfolio
RankingFunctions
10
10
10
0
6.33
caqe-portfolio
Reduction-finding
10
7
2
5
17.48
caqe-portfolio
Rewriting
10
10
0
10
1.2
caqe-portfolio
s1196
6
5
1
4
762.3
caqe-portfolio
s1269
10
3
3
0
212.15
caqe-portfolio
s27
4
4
1
3
0.88
caqe-portfolio
s298
10
6
6
0
239.65
caqe-portfolio
s3330
10
2
2
0
139.39
caqe-portfolio
s386
10
10
5
5
607.96
caqe-portfolio
s499
10
6
6
0
650.41
caqe-portfolio
s510
10
3
3
0
113.07
caqe-portfolio
s641
9
8
5
3
575.62
caqe-portfolio
s713
10
8
5
3
789.03
caqe-portfolio
s820
10
5
5
0
601.88
caqe-portfolio
Sorting_networks
10
7
4
3
52.87
squeezebf+aqme
SzymanskiP
10
10
0
10
124.83
aqme-10
term1
8
8
4
4
198.73
caqe-portfolio
terminator
10
6
0
6
46.43
aqme-10
tipdiam
10
5
5
0
9.56
squeezebf+aqme
tipfixpoint
10
5
3
2
6.71
caqe-portfolio
ToiletA
10
10
3
7
4.7
caqe-portfolio
ToiletC
10
10
1
9
10.51
caqe-portfolio
ToiletG
7
7
7
0
0.91
caqe-portfolio
trafficlight-controller
10
10
0
10
56.98
squeezebf+aqme
Tree
10
10
2
8
1.21
caqe-portfolio
VonNeumann
10
10
0
10
26.94
caqe-portfolio
wmiforward
10
10
10
0
2.51
caqe-portfolio
z4ml
8
8
4
4
0.96
caqe-portfolio
Contact
|
Organization
|
Links
|
Citing QBFLIB
qbflib.org