QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Solver performances for family instances
QBFEVAL'19 - Prenex CNF Track
Family
Overall
Time
Reference solver
N
#
S
U
Adder
10
7
5
2
413.24
Caqe-hqspre
amba
4
4
3
1
871.39
Caqe-bloqqer-qdo
arithmetic
8
6
6
0
0
Hiqqer2019_1
blackbox-01X-QBF
20
20
0
20
548.21
Qute_rrs
BMC
10
10
7
3
2868.73
caqe-pre
CombinationalEquivalence
20
20
10
10
1124.89
GhostQ___cegar_pcnf_2019
cycle-sched
8
7
6
1
1332.08
depqbf_pre_QxQBH
Debug
10
7
7
0
2823.44
Caqe-hqspre
disjunctive_decomposition
9
8
7
1
1883.58
caqe-pre
driver
6
6
6
0
0
Hiqqer2019_1
dungeon
21
21
0
21
486.47
caqe-pre
formula_add
7
6
6
0
1332.55
depqbf_prefix_opt_qdo
fpu
10
10
0
10
19.3
Hiqqer2019_2
genbuf
3
2
0
2
219.87
Caqe-bloqqer-qdo
Generalized-Tic-Tac-Toe
10
10
3
7
166.23
Hiqqer2019_2
genpatch
5
5
3
2
592.26
GhostQ___cegar_pcnf_2019
HardwareFixpoint
65
46
12
34
368.52
GhostQ___cegar_pcnf_2019
hwmcc
6
1
1
0
8.23
depqbf_pre_QxQBH
incrementer-encoder
10
10
1
9
75.9
Caqe-hqspre
irqlkeapclte
10
10
10
0
859.56
depqbf_pre_QxQBH
ISCAS89
10
10
6
4
3.65
depqbf_prefix_opt_qdo
ITC99
10
8
5
3
228.87
depqbf_pre_QxQBH
jmc_quant_squaring
6
2
1
1
84.53
Qute_default
k_branch_n
6
6
6
0
602.1
depqbf_pre_QxQBH
k_branch_p
8
8
0
8
2.55
depqbf_prefix_opt_qdo
k_ph_p
5
1
0
1
214.99
GhostQ___cegar_pcnf_2019
LinearBitvectorRankingFunction
15
8
4
4
228.76
Caqe-hqspre
ltl2aig-comp
3
3
1
2
68.96
depqbf_pre_QxQBH
LTL2DBA
2
2
2
0
0
Hiqqer2019_1
LTL2DPA
1
1
1
0
1.05
Hiqqer2019_1
Model_instances
6
5
1
4
380.22
Qute_default
mqm
10
10
7
3
376.41
Caqe-hqspre
mult-matrix
7
5
5
0
4.12
Hiqqer2019_1
Planning-CTE
26
26
2
24
2115.9
Caqe-hqspre
PositionalGames_gttt
15
13
13
0
681.52
depqbf_pre_QxQBH
PositionalGames_hex
15
13
10
3
2628.56
Hiqqer2019_1
QBF-Hardness
10
10
1
9
462.04
Caqe-bloqqer-qdo
Q_2_3
20
16
0
16
654.72
depqbf_prefix_opt_qdo
RankingFunctions
15
15
15
0
0
Qute_default
Reduction-finding
24
21
11
10
2078.02
GhostQ___cegar_pcnf_2019
Selection-hard
5
5
5
0
292.28
Caqe-hqspre
sketch
10
3
0
3
158.66
Caqe-hqspre
Sorting_networks
10
10
3
7
516.89
Caqe-bloqqer-qdo
SzymanskiP
2
2
0
2
9.31
Hiqqer2019_2
terminator
10
10
1
9
21.97
Qute_rrs
tipdiam
10
6
5
1
199.83
GhostQ___plain_pcnf_2019
tipfixpoint
12
10
9
1
237.79
GhostQ___plain_pcnf_2019
toy
5
5
5
0
10.09
depqbf_pre_QxQBH
trafficlight-controller
10
10
0
10
24.95
Qute_rrs
wgrowing
9
8
8
0
876.18
Caqe-bloqqer-qdo
wmiforward
10
10
10
0
0
Hiqqer2019_1
Contact
|
Organization
|
Links
|
Citing QBFLIB
qbflib.org