QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
SOTA views
QBFEVAL'16 - Prenex non-CNF Track.
Family
Overall
Time
Hardness
N
#
S
U
EA
ME
MH
Abduction
5
4
1
3
0.45
3
1
Adder
5
4
4
388.05
1
3
blackbox-01X-QBF
5
5
5
0.89
3
2
blackbox_design
5
5
5
0.74
5
Blocks
5
5
2
3
0.19
4
1
BMC
5
2
2
0.02
2
bomb
5
3
1
2
39.18
2
1
C432
4
4
4
0.16
2
2
C499
4
4
4
0.28
1
3
C5315
4
4
2
2
2.72
2
2
C6288
4
3
3
1.19
3
C880
4
4
2
2
0.56
1
3
Chain
5
5
5
0.11
1
4
circuits
5
3
3
451.75
1
2
conformant_planning
6
4
3
1
20.31
2
2
Connect4
5
4
1
3
345.85
2
1
1
Counter
5
4
4
2.08
1
3
Debug
5
0
0
0
-
DFlipFlop
5
5
5
7.79
3
2
dungeon
5
5
5
20.92
2
3
evader-pursuer-4x4-logarithmic
4
4
4
18.43
4
evader-pursuer-4x4-standard
4
0
0
0
-
evader-pursuer-6x6-logarithmic
4
2
2
95.54
2
evader-pursuer-6x6-standard
4
0
0
0
-
evader-pursuer-8x8-logarithmic
4
2
2
570.36
2
FPGA_PLB_FIT_FAST
3
3
2
1
1.03
2
1
FPGA_PLB_FIT_SLOW
2
2
2
6.56
2
fpu
5
5
5
8.3
2
3
Generalized-Tic-Tac-Toe
5
5
5
9.82
5
HardwareFixpoint
5
5
2
3
60.65
5
Impl
5
5
5
0.08
5
incrementer-encoder
5
5
1
4
3.23
1
4
irqlkeapclte
5
5
5
1093.11
1
4
ISCAS89
3
3
3
54.72
3
ITC99
5
3
3
121.8
2
1
jmc_quant_squaring
5
1
1
8
1
k_branch_n
5
5
5
7.67
1
4
k_branch_p
5
5
5
14.07
5
k_d4_n
5
5
5
0.34
1
4
k_d4_p
5
5
5
0.23
5
k_dum_n
5
5
5
0.14
1
4
k_dum_p
5
5
5
0.09
5
k_grz_n
5
5
5
0.14
5
k_grz_p
5
5
5
0.17
5
k_lin_n
5
5
5
0.8
1
4
k_lin_p
5
5
5
0.08
5
k_path_n
5
5
5
0.13
5
k_path_p
5
5
5
0.11
1
4
k_ph_n
5
5
3
2
0.12
2
3
k_ph_p
5
5
5
59.01
2
1
2
k_poly_n
5
5
5
0.28
5
k_poly_p
5
5
5
0.24
5
k_t4p_n
5
5
5
0.53
5
k_t4p_p
5
5
5
0.37
5
LinearBitvectorRankingFunction
5
1
1
30.25
1
Logn
2
2
2
2.12
1
1
mqm
136
136
75
61
5.66
132
4
MutexP
4
4
4
0.1
1
3
NuSMV_diam
92
92
81
11
1.45
92
Planning-CTE
3
1
1
0.52
1
QBF-Hardness
5
4
1
3
29.9
2
2
qbfeval12
2
2
2
0.45
2
QLTL_safety
250
250
250
13.39
250
Qshifter
3
2
2
28.01
1
1
RankingFunctions
5
5
5
3.39
5
Reduction-finding
5
3
3
3.04
2
1
Rewriting
5
5
5
0.01
3
2
s1196
3
3
2
1
1.49
1
2
s1269
5
5
1
4
0.36
2
3
s27
2
2
2
0
2
s298
5
5
2
3
0.56
2
3
s3330
5
5
5
0.5
1
2
2
s386
5
5
2
3
0.2
5
s499
5
5
2
3
0.25
5
s510
5
5
2
3
0.35
4
1
s641
5
5
3
2
0.66
3
2
s713
5
5
3
2
1.23
3
2
s820
5
5
2
3
0.26
5
Sorting_networks
5
4
3
1
190.24
2
2
SzymanskiP
5
5
5
634.97
5
term1
4
4
3
1
0.2
4
terminator
5
5
5
0.41
3
2
tipdiam
5
5
3
2
0.13
2
2
1
tipfixpoint
5
5
4
1
0.35
2
3
ToiletA
5
5
5
3.13
4
1
ToiletC
5
5
1
4
10.06
4
1
ToiletG
4
4
4
0.02
4
trafficlight-controller
5
5
5
4.29
3
2
Tree
5
5
1
4
0.1
1
4
uclid
2
2
2
0.24
2
VonNeumann
5
5
5
12.3
3
2
wmiforward
5
5
5
0.94
2
3
z4ml
4
4
3
1
0
4
Contact
|
Organization
|
Links
|
Citing QBFLIB
qbflib.org