QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Solver performance
QBFEVAL'06
Solver
Total
Sat
Unsat
Unique
#
Time
#
Time
#
Time
#
Time
qube5.0
2187
203696
1258
43772.3
929
159924
0
0
qube4.0
2187
204196
1258
43843.4
929
160353
0
0
qube3.0
2092
190473
1194
28281.8
898
162191
10
6683.72
sSolve
1989
120820
1295
52438.9
694
68380.9
0
0
ssolve+ut
1983
109057
1291
51411.4
692
57645.9
0
0
ssolve-ut
1953
104609
1285
33274.5
668
71334.7
0
0
semprop
1920
25008.2
1295
13708.2
625
11300
117
17.72
2clsQ
1791
318123
1140
130771
651
187353
0
0
WalkQSAT
1726
21711.2
1158
6714.26
568
14996.9
8
28.69
sKizzo-0.9-std
1663
93300.1
1080
22249.6
583
71050.5
0
0
sKizzo-0.9-abs
1638
103096
1099
24358.6
539
78737.3
0
0
GRL
1610
14936.2
1155
10939.7
455
3996.51
0
0
SQBF
1599
85285.3
1128
21211
471
64074.3
0
0
openQbf
1598
216910
1122
96658.8
476
120252
1
835.8
sKizzo-0.9-grn
1565
56348.2
1005
5483.1
560
50865.1
0
0
yQuaffle
1502
36172.9
1060
15132.1
442
21040.9
0
0
Qbfl
1402
89891
1061
19963
341
69928
0
0
QUANTOR
1148
12645
1006
7939.87
142
4705.12
0
0
QUANTOR_hc
1144
6043.77
1002
1485.29
142
4558.48
0
0
preQuantor
981
3143.44
836
2040.71
145
1102.73
0
0
Quaffle
816
9576.98
584
5100.4
232
4476.58
0
0
2clsQ
259
26110.1
145
4692.9
114
21417.2
0
0
sKizzo-0.9-abs
254
20510.2
150
18663
104
1847.18
0
0
sKizzo-0.9-std
248
42924
145
23849.6
103
19074.4
2
4245.62
SQBF
245
5794.89
143
2722.46
102
3072.43
0
0
preQuantor
238
6890.3
139
4873.3
99
2017
0
0
QUANTOR_hc
236
1342.09
86
576.32
150
765.77
0
0
qube5.0
232
65369.8
146
20454.6
86
44915.2
45
1311.09
ssolve+ut
225
58751.7
125
34871.3
100
23880.4
0
0
sSolve
223
63086.8
125
34285.3
98
28801.5
0
0
sKizzo-0.9-grn
219
23766.5
120
15497.1
99
8269.37
0
0
QUANTOR
214
5027
129
4384.94
85
642.06
0
0
ssolve-ut
211
63029.8
125
34300.4
86
28729.3
0
0
semprop
183
8961.76
112
2923.51
71
6038.25
15
1.47
qube4.0
164
53457.1
80
17069.6
84
36387.5
0
0
qube3.0
153
29687
75
21439.9
78
8247.03
1
4085.56
Quaffle
145
22152.5
78
10299.9
67
11852.7
0
0
yQuaffle
143
33116.3
69
17798.5
74
15317.8
0
0
GRL
118
4576.17
55
2714.24
63
1861.93
0
0
WalkQSAT
99
3079.99
55
1869.35
44
1210.64
0
0
openQbf
81
38004.6
43
14906.8
38
23097.8
0
0
Qbfl
77
14222.2
46
4742.16
31
9480.05
0
0
Problematic solver
Hors-Concours solver
Contact
|
Organization
|
Links
|
Citing QBFLIB
qbflib.org