QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
SOTA views
QBFEVAL'06
Family
Overall
Time
Hardness
N
#
S
U
EA
ME
MH
Adder
16
11
10
1
4864.6
10
1
ASP_Program_Inclusion
40
40
40
34.17
40
blackbox_design
28
28
27
1
19.83
1
27
Blocks
11
11
4
7
4.65
11
C432
4
4
1
3
588.61
4
C499
3
3
1
2
2.31
3
C5315
4
4
2
2
0.34
4
C6288
1
1
1
0.64
1
C880
2
2
2
0.72
2
Chain
4
4
4
0.11
4
comp
2
2
2
0.02
2
Connect4
13
13
13
3.07
13
Counter
5
5
5
6.82
5
CounterFactual
400
390
212
178
7751.31
381
9
evader-pursuer-4x4-logarithmic
4
4
4
1.62
4
evader-pursuer-6x6-logarithmic
2
2
2
14.98
2
evader-pursuer-8x8-logarithmic
4
4
4
5.23
4
FPGA_PLB_FIT_FAST
3
3
3
0.66
3
FPGA_PLB_FIT_SLOW
3
3
1
2
5.11
3
jmc_quant
4
3
2
1
1855.71
2
1
jmc_quant_squaring
3
0
0
0
-
k_branch_n
2
2
2
0.03
2
k_branch_p
3
3
3
0.16
3
k_d4_n
6
6
6
0.11
6
k_d4_p
5
5
5
0.06
5
k_dum_n
5
5
5
0.05
5
k_dum_p
4
4
4
0.03
4
k_grz_n
5
5
5
0.04
5
k_grz_p
6
6
6
0.08
6
k_lin_n
6
6
6
5.44
6
k_lin_p
5
5
5
0.11
5
k_path_n
5
5
5
0.07
5
k_path_p
5
5
5
0.09
5
k_ph_n
3
3
1
2
4.84
3
k_ph_p
1
1
1
0.03
1
k_poly_n
6
6
2
4
0.04
6
k_poly_p
3
3
3
0.04
3
k_t4p_n
6
6
6
0.14
6
k_t4p_p
6
6
6
0.1
6
Logn
2
2
2
1
2
mA-t2-1qbf-5cnf-160var-2560cl
10
10
10
5.03
10
mA-t2-1qbf-5cnf-80var-2560cl
10
10
10
395.04
10
mA-t2-2qbf-5cnf-160var-2560cl
10
10
10
0.17
10
mA-t2-2qbf-5cnf-160var-320cl
10
10
10
0.95
10
mA-t2-2qbf-5cnf-160var-5120cl
10
10
10
0.21
10
mA-t2-2qbf-5cnf-40var-160cl
10
10
6
4
1.5
10
mA-t2-2qbf-5cnf-40var-320cl
10
10
10
0.87
10
mA-t2-2qbf-5cnf-40var-640cl
10
10
10
0.04
10
mA-t2-2qbf-5cnf-80var-1280cl
10
10
10
0.08
10
mA-t2-2qbf-5cnf-80var-320cl
10
10
4
6
5140.16
10
mA-t2-2qbf-5cnf-80var-640cl
10
10
10
3.22
10
mA-t2-3qbf-5cnf-160var-2560cl
10
10
10
1.62
10
mA-t2-3qbf-5cnf-160var-640cl
10
10
10
0.02
10
mA-t2-3qbf-5cnf-20var-160cl
10
10
10
0.02
10
mA-t2-3qbf-5cnf-20var-320cl
10
10
10
0.07
3
7
mA-t2-3qbf-5cnf-40var-320cl
10
10
9
1
0.12
10
mA-t2-3qbf-5cnf-40var-640cl
10
10
10
0.16
10
mA-t2-3qbf-5cnf-80var-1280cl
10
10
10
1.26
10
mA-t2-3qbf-5cnf-80var-2560cl
10
10
10
0.02
10
mA-t2-3qbf-5cnf-80var-320cl
10
10
10
0.01
10
mA-t2-4qbf-5cnf-160var-2560cl
10
10
10
0.62
10
mA-t2-4qbf-5cnf-160var-5120cl
10
10
10
0.27
10
mA-t2-4qbf-5cnf-160var-640cl
10
10
10
1.57
10
mA-t2-4qbf-5cnf-20var-160cl
10
10
2
8
1.17
10
mA-t2-4qbf-5cnf-20var-320cl
10
10
10
0.06
10
mA-t2-4qbf-5cnf-20var-640cl
10
10
10
0.02
10
mA-t2-4qbf-5cnf-40var-1280cl
10
10
10
0.06
1
9
mA-t2-4qbf-5cnf-40var-320cl
10
10
10
6.02
10
mA-t2-4qbf-5cnf-40var-640cl
10
10
10
0.08
10
mA-t2-4qbf-5cnf-80var-1280cl
10
10
10
0.13
10
mA-t2-4qbf-5cnf-80var-2560cl
10
10
10
0.13
10
mA-t2-4qbf-5cnf-80var-320cl
10
10
10
0.93
10
mA-t2-5qbf-5cnf-160var-2560cl
10
10
10
2.26
10
mA-t2-5qbf-5cnf-160var-5120cl
10
10
10
0.2
10
mA-t2-5qbf-5cnf-160var-640cl
10
10
10
0.01
10
mA-t2-5qbf-5cnf-20var-320cl
10
10
10
0.16
10
mA-t2-5qbf-5cnf-20var-640cl
10
10
10
0.01
1
9
mA-t2-5qbf-5cnf-40var-1280cl
10
10
10
0.04
10
mA-t2-5qbf-5cnf-40var-320cl
10
10
10
0.06
10
mA-t2-5qbf-5cnf-40var-640cl
10
10
10
0.3
10
mA-t2-5qbf-5cnf-80var-1280cl
10
10
10
1.33
10
mA-t2-5qbf-5cnf-80var-2560cl
10
10
10
0.05
10
mA-t2-5qbf-5cnf-80var-640cl
10
10
10
0.08
10
mA-t2-6qbf-5cnf-160var-2560cl
10
10
10
1.56
10
mA-t2-6qbf-5cnf-160var-5120cl
10
10
10
0.26
10
mA-t2-6qbf-5cnf-160var-640cl
10
10
10
0
10
mA-t2-6qbf-5cnf-20var-160cl
10
10
9
1
0.29
10
mA-t2-6qbf-5cnf-20var-320cl
10
10
10
0.17
10
mA-t2-6qbf-5cnf-20var-640cl
10
10
10
0.01
10
mA-t2-6qbf-5cnf-40var-1280cl
10
10
10
0.09
10
mA-t2-6qbf-5cnf-40var-320cl
10
10
8
2
147.21
10
mA-t2-6qbf-5cnf-40var-640cl
10
10
10
0.43
10
mA-t2-6qbf-5cnf-80var-1280cl
10
10
10
1.01
10
mA-t2-6qbf-5cnf-80var-2560cl
10
10
10
0.14
10
mA-t2-6qbf-5cnf-80var-640cl
10
10
8
2
1758.03
10
MutexP
4
4
4
0.25
4
Qq2k1k4v40v40m16
10
10
5
5
0
1
9
Qq2k1k4v40v40m2
10
10
10
0
9
1
Qq2k1k4v40v40m32
10
10
10
0
3
7
Qq2k1k4v40v40m4
10
10
9
1
0
6
4
Qq2k1k4v40v40m8
10
10
8
2
0
10
Qq2k1k4v80v80m16
10
10
7
3
0
10
Qq2k1k4v80v80m2
10
10
10
0
7
3
Qq2k1k4v80v80m32
10
10
2
8
0
10
Qq2k1k4v80v80m4
10
10
10
0
10
Qq2k1k4v80v80m8
10
10
10
0
5
5
Qq2k2k3v40v40m16
10
10
10
0
10
Qq2k2k3v40v40m2
10
10
10
0
10
Qq2k2k3v40v40m32
10
10
10
0
10
Qq2k2k3v40v40m4
10
10
10
0
10
Qq2k2k3v40v40m8
10
10
10
0
10
Qq2k2k3v80v80m16
10
10
10
0
10
Qq2k2k3v80v80m2
10
10
10
0
10
Qq2k2k3v80v80m32
10
10
10
0
10
Qq2k2k3v80v80m4
10
10
10
0
10
Qq2k2k3v80v80m8
10
10
10
0
10
Qq2k3k2v40v40m16
10
10
10
0
10
Qq2k3k2v40v40m2
10
10
10
0
10
Qq2k3k2v40v40m32
10
10
10
0
10
Qq2k3k2v40v40m4
10
10
10
0
10
Qq2k3k2v40v40m8
10
10
10
0
10
Qq2k3k2v80v80m16
10
10
10
0
10
Qq2k3k2v80v80m2
10
10
10
0
10
Qq2k3k2v80v80m32
10
10
10
0
10
Qq2k3k2v80v80m4
10
10
10
0
10
Qq2k3k2v80v80m8
10
10
10
0
10
Qq3k1k1k3v40v40v40m16
10
10
10
0
8
2
Qq3k1k1k3v40v40v40m2
10
10
10
0
1
9
Qq3k1k1k3v40v40v40m32
10
10
10
0
8
2
Qq3k1k1k3v40v40v40m4
10
10
10
0
5
5
Qq3k1k1k3v40v40v40m8
10
10
10
0
10
Qq3k1k1k3v80v80v80m16
10
10
10
0
8
2
Qq3k1k1k3v80v80v80m2
10
10
10
0
2
8
Qq3k1k1k3v80v80v80m32
10
10
10
0
9
1
Qq3k1k1k3v80v80v80m4
10
10
10
0
8
2
Qq3k1k1k3v80v80v80m8
10
10
10
0
8
2
Qq3k1k2k2v40v40v40m16
10
10
10
0
9
1
Qq3k1k2k2v40v40v40m2
10
10
10
0
10
Qq3k1k2k2v40v40v40m32
10
10
10
0
9
1
Qq3k1k2k2v40v40v40m4
10
10
10
0
10
Qq3k1k2k2v40v40v40m8
10
10
10
0
10
Qq3k1k2k2v80v80v80m16
10
10
10
0
9
1
Qq3k1k2k2v80v80v80m2
10
10
10
0
10
Qq3k1k2k2v80v80v80m32
10
10
10
0
4
6
Qq3k1k2k2v80v80v80m4
10
10
10
0
7
3
Qq3k1k2k2v80v80v80m8
10
10
10
0
10
Qq3k1k3k1v40v40v40m16
10
10
10
0
6
4
Qq3k1k3k1v40v40v40m2
10
10
10
0
10
Qq3k1k3k1v40v40v40m32
10
10
10
0
4
6
Qq3k1k3k1v40v40v40m4
10
10
10
0
7
3
Qq3k1k3k1v40v40v40m8
10
10
10
0
7
3
Qq3k1k3k1v80v80v80m16
10
10
10
0
5
5
Qq3k1k3k1v80v80v80m2
10
10
10
0
10
Qq3k1k3k1v80v80v80m32
10
10
10
0
2
8
Qq3k1k3k1v80v80v80m4
10
10
10
0
9
1
Qq3k1k3k1v80v80v80m8
10
10
10
0
10
Qq3k2k1k2v40v40v40m16
10
10
10
0
5
5
Qq3k2k1k2v40v40v40m2
10
10
10
0
2
8
Qq3k2k1k2v40v40v40m32
10
10
10
0
1
9
Qq3k2k1k2v40v40v40m4
10
10
10
0
10
Qq3k2k1k2v40v40v40m8
10
10
10
0
8
2
Qq3k2k1k2v80v80v80m16
10
10
10
0
5
5
Qq3k2k1k2v80v80v80m2
10
10
10
0
2
8
Qq3k2k1k2v80v80v80m32
10
10
10
0
5
5
Qq3k2k1k2v80v80v80m4
10
10
10
0
9
1
Qq3k2k1k2v80v80v80m8
10
10
10
0
6
4
Qq3k2k2k1v40v40v40m16
10
10
10
0
3
7
Qq3k2k2k1v40v40v40m2
10
10
10
0
1
9
Qq3k2k2k1v40v40v40m32
10
10
10
0
10
Qq3k2k2k1v40v40v40m4
10
10
10
0
7
3
Qq3k2k2k1v40v40v40m8
10
10
10
0
9
1
Qq3k2k2k1v80v80v80m16
10
10
10
0
7
3
Qq3k2k2k1v80v80v80m2
10
10
10
0
2
8
Qq3k2k2k1v80v80v80m32
10
10
10
0
10
Qq3k2k2k1v80v80v80m4
10
10
10
0
8
2
Qq3k2k2k1v80v80v80m8
10
10
10
0
8
2
Qq3k3k1k1v40v40v40m16
10
10
10
0
2
8
Qq3k3k1k1v40v40v40m2
10
10
10
0
3
7
Qq3k3k1k1v40v40v40m32
10
10
10
0
10
Qq3k3k1k1v40v40v40m4
10
10
10
0
8
2
Qq3k3k1k1v40v40v40m8
10
10
10
0
8
2
Qq3k3k1k1v80v80v80m16
10
10
10
0
7
3
Qq3k3k1k1v80v80v80m2
10
10
10
0
2
8
Qq3k3k1k1v80v80v80m32
10
10
10
0
10
Qq3k3k1k1v80v80v80m4
10
10
10
0
9
1
Qq3k3k1k1v80v80v80m8
10
10
10
0
8
2
Qshifter
4
4
4
5.3
4
RobotsD2
10
10
10
17.03
10
RobotsD3
10
10
10
22.69
10
RobotsD4
10
10
10
17.31
10
RobotsD5
10
10
10
16.23
10
s27
3
3
3
0.07
3
s298
2
2
2
0.09
2
s386
1
1
1
0.22
1
s499
2
2
2
4.95
2
s510
1
1
1
0.13
1
s713
1
1
1
0.81
1
s820
1
1
1
0.43
1
Sorting_networks
84
81
56
25
10283.57
6
59
16
Strategic_Companies
530
528
264
264
18259.53
15
386
127
SzymanskiP
9
9
9
227.38
9
term1
4
4
4
338.52
4
tipdiam
30
30
30
0.54
24
6
tipfixpoint
74
46
35
11
1504.93
2
26
18
Toilet
3
3
2
1
0.15
3
ToiletA
2
2
1
1
2.1
2
ToiletC
1
1
1
0.01
1
Tree
1
1
1
0
1
Contact
|
Organization
|
Links
|
Citing QBFLIB
qbflib.org