QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Solver performances for family instances
QBFEVAL'18 - Hard Instances Track
Family
Overall
Time
Reference solver
N
#
S
U
Abduction
3
0
0
0
-
-
amba
3
1
1
0
3250.45
caqe_hit18
BMC
7
0
0
0
-
-
C5315
3
0
0
0
-
-
C6288
4
0
0
0
-
-
circuits
11
0
0
0
-
-
conformant_planning
2
0
0
0
-
-
Connect3
1
0
0
0
-
-
Connect4
7
0
0
0
-
-
Connect6
1
0
0
0
-
-
Connect7
2
0
0
0
-
-
Counter
2
0
0
0
-
-
CounterFactual
20
0
0
0
-
-
Debug
7
0
0
0
-
-
disjunctive_decomposition
1
1
1
0
40.61
depqbf_hit18
evader-pursuer-6x6-logarithmic
2
1
0
1
1802.25
depqbf_hit18
evader-pursuer-6x6-standard
6
2
0
2
1980.33
depqbf_hit18
evader-pursuer-8x8-logarithmic
2
0
0
0
-
-
formula_add
3
0
0
0
-
-
genbuf
5
0
0
0
-
-
HardwareFixpoint
15
0
0
0
-
-
ITC99
1
0
0
0
-
-
jmc_quant
1
0
0
0
-
-
jmc_quant_squaring
2
0
0
0
-
-
k_ph_p
5
0
0
0
-
-
LinearBitvectorRankingFunction
14
0
0
0
-
-
ltl2aig-comp
5
0
0
0
-
-
LTL2DBA
3
0
0
0
-
-
Model_instances
18
7
7
0
12023.8
caqe_hit18
mult-matrix
1
0
0
0
-
-
PositionalGames_gttt
23
2
2
0
152.87
depqbf_hit18
PositionalGames_hex
36
4
4
0
7107.62
caqe_hit18
Q_2_2_3
50
0
0
0
-
-
Q_2_3
31
10
10
0
1306.51
aspq3_hit18
Q_3_3
50
0
0
0
-
-
Q_3_3_3
49
0
0
0
-
-
Reduction-finding
12
1
1
0
2411.5
aspq3_hit18
s1269
1
0
0
0
-
-
s3330
1
0
0
0
-
-
Selection-hard
5
4
4
0
1488.29
aspq3_hit18
sketch
4
1
0
1
2886.5
aspq3_hit18
Sorting_networks
3
2
1
1
5630.61
caqe_hit18
Strategic_Companies
21
6
0
6
10090.6
depqbf_hit18
tipfixpoint
1
0
0
0
-
-
wgrowing
27
16
16
0
9956.39
aspq3_hit18
Contact
|
Organization
|
Links
|
Citing QBFLIB