QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Solver performances for family instances
QBFEVAL'10 - Competitive Track.
Family
Overall
Time
Reference solver
N
#
S
U
Abduction
52
50
31
19
100.48
aqme-10
Adder
15
13
8
5
1507.56
nenofex-qbfeval10
blackbox-01X-QBF
59
54
0
54
1709.51
QuBE7
blackbox_design
2
2
2
0
1.72
QuBE7-c
Blocks
5
5
2
3
16.16
quantor-3.1
BMC
18
17
7
10
130.59
quantor-3.1
C432
4
4
1
3
0.57
qmaiga
C499
2
2
0
2
0.9
quantor-3.1
C5315
7
3
1
2
4.91
quantor-3.1
C6288
4
2
2
0
21.09
aqme-10
C880
1
1
1
0
0.18
QuBE7-c
Chain
1
1
1
0
0.02
qmaiga
circuits
3
3
3
0
18.16
AIGSolve
comp
2
2
0
2
0.04
depqbf-pre
conformant_planning
15
9
4
5
1044.84
quantor-3.1
Connect4
11
9
0
9
168.11
aqme-10
Counter
4
4
4
0
943.51
AIGSolve
Debug
5
4
4
0
506.16
aqme-10
evader-pursuer-4x4-logarithmic
3
2
2
0
2.92
depqbf-pre
evader-pursuer-4x4-standard
7
7
7
0
597.81
QuBE7
evader-pursuer-6x6-logarithmic
4
3
0
3
807.23
depqbf
evader-pursuer-6x6-standard
2
2
0
2
892.65
aqme-10
evader-pursuer-8x8-logarithmic
6
4
0
4
98.29
aqme-10
FPGA_PLB_FIT_FAST
2
2
1
1
0.1
depqbf-pre
FPGA_PLB_FIT_SLOW
1
1
0
1
1.61
quantor-3.1
Impl
1
1
1
0
0
quantor-3.1
jmc_quant
2
2
1
1
1.15
qmaiga
jmc_quant_squaring
1
1
1
0
0.1
QuBE7
k_branch_n
4
4
4
0
870.51
qmaiga
k_branch_p
7
7
0
7
710.92
aqme-10
k_d4_n
10
10
10
0
15.94
AIGSolve
k_d4_p
5
5
0
5
1.64
qmaiga
k_dum_n
2
2
2
0
0.04
quantor-3.1
k_dum_p
4
4
0
4
0.77
AIGSolve
k_grz_n
4
4
4
0
4.98
AIGSolve
k_grz_p
3
3
0
3
3.16
AIGSolve
k_lin_n
5
5
5
0
9.12
QuBE7-c
k_lin_p
4
4
0
4
0.4
AIGSolve
k_path_n
3
3
3
0
0.12
quantor-3.1
k_path_p
4
4
0
4
0.14
quantor-3.1
k_ph_n
6
6
6
0
7.86
quantor-3.1
k_ph_p
4
4
0
4
642.59
QuBE7
k_poly_n
4
4
4
0
0.09
quantor-3.1
k_poly_p
2
2
0
2
0.06
quantor-3.1
k_t4p_n
4
4
4
0
5.85
AIGSolve
k_t4p_p
5
5
0
5
3.16
qmaiga
Logn
1
1
0
1
1.12
AIGSolve
mqm
136
136
66
70
9095.69
depqbf-pre
s1196
1
1
1
0
275.13
QuBE7-c
s1269
1
1
1
0
63.18
QuBE7-c
s27
1
1
0
1
0.02
AIGSolve
s298
4
4
4
0
158.26
AIGSolve
s386
1
1
0
1
715.71
AIGSolve
s499
2
2
2
0
160.23
AIGSolve
s510
3
2
2
0
403.96
AIGSolve
s713
2
2
2
0
166.88
QuBE7-c
s820
2
2
2
0
854.35
QuBE7
Sorting_networks
6
6
4
2
53.76
quantor-3.1
SzymanskiP
2
2
0
2
60.7
QuBE7-c
term1
3
3
1
2
0.61
AIGSolve
tipdiam
14
14
12
2
1140.69
QuBE7
tipfixpoint
24
21
12
9
2195.6
QuBE7
Toilet
4
4
3
1
0.6
quantor-3.1
ToiletA
10
10
5
5
1.94
depqbf
ToiletC
23
23
15
8
2.68
AIGSolve
ToiletG
4
4
4
0
0.02
struqs-10
VonNeumann
2
2
0
2
6.54
struqs-10
z4ml
1
1
0
1
0
AIGSolve
Contact
|
Organization
|
Links
|
Citing QBFLIB