QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Solver performances for family instances
QBFEVAL'17 - Prenex non-CNF Track
Family
Overall
Time
Reference solver
N
#
S
U
Abduction
1
0
0
0
-
-
Adder
4
0
0
0
-
-
amba
4
2
1
1
684.91
Qute_opt617
Blocks
1
1
0
1
0.42
Qute_opt993
BMC
3
1
1
0
106.98
qfun0.1
bomb
3
2
1
1
269.39
qfun0.1
BoundedSynthesisPetriGames
42
23
10
13
2924.12
QuAbS_2017
C499
3
3
0
3
3.02
qfun0.1
C5315
1
0
0
0
-
-
C6288
4
1
1
0
196.18
Qute_hybrid
C880
2
1
0
1
2.44
qfun0.1
Chain
3
3
3
0
0.34
Qute_opt993
circuits
4
1
1
0
360.12
qfun0.1
CombinationalEquivalence
30
30
15
15
17.73
qfun0.1
conformant_planning
3
2
2
0
117.61
qfun0.1
Connect4
2
0
0
0
-
-
Counter
2
1
1
0
87.64
Qute_opt993
cycle-sched
4
1
0
1
796.48
qfun0.1
Debug
5
0
0
0
-
-
driver
4
3
1
2
214.28
qfun0.1
dungeon
3
1
0
1
1.56
Qute_opt993
evader-pursuer-4x4-logarithmic
2
2
2
0
7.15
Qute_opt993
evader-pursuer-4x4-standard
4
0
0
0
-
-
evader-pursuer-6x6-logarithmic
4
1
0
1
166.35
ghostq-plain
evader-pursuer-6x6-standard
4
0
0
0
-
-
evader-pursuer-8x8-logarithmic
4
1
0
1
19.05
cqesto
fpu
2
2
0
2
14.25
Qute_opt993
genbuf
4
2
0
2
482.28
qfun0.1
HardwareFixpoint
5
0
0
0
-
-
hwmcc
4
2
0
2
2.14
cqesto
hyperLTL
2
2
1
1
0
cqesto
incrementer-encoder
3
3
1
2
0.88
cqesto
irqlkeapclte
5
5
5
0
180.62
cqesto
ISCAS89
1
1
1
0
18.46
Qute_opt993
ITC99
4
4
4
0
249.87
qfun0.1
jmc_quant_squaring
5
1
0
1
266.44
Qute_opt993
k_branch_n
2
2
2
0
114.54
QuAbS_2017
k_branch_p
3
3
0
3
11.72
QuAbS_2017
k_ph_n
1
1
1
0
0.24
Qute_opt993
k_ph_p
2
1
0
1
31.59
qfun0.1
LinearBitvectorRankingFunction
5
1
0
1
0.66
cqesto
ltl2aig-comp
4
2
0
2
116.28
qfun0.1
LTL2DBA
2
1
0
1
0.27
qfun0.1
LTL2DPA
2
1
0
1
0.64
qfun0.1
Model_instances
20
13
10
3
1002.47
QuAbS_2017
mqm
2
2
1
1
470.62
QuAbS_2017
mult-matrix
4
0
0
0
-
-
MutexP
3
3
3
0
0.12
cqesto
Planning-CTE
2
1
0
1
478.93
qfun0.1
QBF-Hardness
2
1
1
0
6.33
cqesto
QLTL_safety
50
27
19
8
3877.64
Qute_hybrid
Qshifter
2
0
0
0
-
-
RankingFunctions
5
0
0
0
-
-
Reduction-finding
2
0
0
0
-
-
s1269
3
0
0
0
-
-
s3330
2
0
0
0
-
-
Sorting_networks
4
2
1
1
33.16
qfun0.1
SzymanskiP
5
5
0
5
41.53
Qute_opt993
terminator
1
1
0
1
3.37
QuAbS_2017
tipdiam
2
1
0
1
340.32
QuAbS_2017
toy
4
4
2
2
0.58
Qute_hybrid
uclid
2
2
2
0
90.67
Qute_opt993
VonNeumann
1
1
0
1
13.63
cqesto
wmiforward
2
2
2
0
0.04
cqesto
Contact
|
Organization
|
Links
|
Citing QBFLIB
qbflib.org