QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
SOTA views
QBFEVAL'05
Family
Overall
Time
Hardness
N
#
S
U
EA
ME
MH
Adder
32
24
12
12
1109.49
3
12
9
Blocks
13
13
3
10
35.01
12
1
C432
8
7
3
4
737.28
6
1
C499
8
7
2
5
20.3
5
2
C5315
8
4
2
2
0.32
4
C6288
8
1
1
1.43
1
C880
8
6
2
4
149.35
2
4
Chain
12
12
12
0.31
2
10
comp
8
8
4
4
0.05
1
7
Connect4
60
48
1
47
2319.03
43
5
Counter
24
24
6
18
2.95
4
10
10
CounterFactual
1080
551
270
281
23475.86
2
442
107
DFlipFlop
10
10
10
2.68
2
8
evader-pursuer-4x4-logarithmic
7
7
7
2.51
7
evader-pursuer-4x4-standard
7
1
1
5.78
1
evader-pursuer-6x6-logarithmic
8
4
4
489.71
4
evader-pursuer-6x6-standard
8
0
0
0
-
evader-pursuer-8x8-logarithmic
8
4
4
92.59
4
FPGA_PLB_FIT_FAST
5
5
4
1
0.71
5
FPGA_PLB_FIT_SLOW
3
3
1
2
3.74
3
horn
156
156
79
77
2.51
155
1
Impl
10
10
10
0
6
4
jmc_quant
10
4
2
2
61.53
1
3
jmc_quant_squaring
10
3
2
1
11.37
3
k_branch_n
6
2
2
46.29
1
1
k_branch_p
6
6
6
24.03
6
k_d4_n
6
6
6
36.8
5
1
k_d4_p
6
6
6
0.49
6
k_dum_n
6
6
6
0.13
6
k_dum_p
6
6
6
0.14
6
k_grz_n
6
6
6
14.64
4
2
k_grz_p
6
6
6
6.63
6
k_lin_n
6
6
6
11.84
6
k_lin_p
6
6
6
0.55
6
k_path_n
6
6
6
0.28
6
k_path_p
6
6
6
0.26
6
k_ph_n
6
6
3
3
12.73
1
3
2
k_ph_p
6
6
6
48.82
2
4
k_poly_n
6
6
6
0.11
6
k_poly_p
6
6
6
0.06
6
k_t4p_n
6
6
6
70.21
4
2
k_t4p_p
6
6
6
7.68
6
Logn
2
2
2
0.85
2
mA-t2-1qbf-5cnf-160var-1280cl
10
10
10
0.01
10
mA-t2-1qbf-5cnf-160var-2560cl
10
10
10
1.26
10
mA-t2-1qbf-5cnf-160var-320cl
10
10
10
0
1
9
mA-t2-1qbf-5cnf-160var-5120cl
10
0
0
0
-
mA-t2-1qbf-5cnf-160var-640cl
10
10
10
0
10
mA-t2-1qbf-5cnf-20var-160cl
10
10
10
0
10
mA-t2-1qbf-5cnf-20var-320cl
10
10
10
0
10
mA-t2-1qbf-5cnf-20var-40cl
10
10
10
0
10
mA-t2-1qbf-5cnf-20var-640cl
10
10
10
0
10
mA-t2-1qbf-5cnf-20var-80cl
10
10
10
0
10
mA-t2-1qbf-5cnf-40var-1280cl
10
10
10
0.7
10
mA-t2-1qbf-5cnf-40var-160cl
10
10
10
0
10
mA-t2-1qbf-5cnf-40var-320cl
10
10
10
0
10
mA-t2-1qbf-5cnf-40var-640cl
10
10
10
0.01
10
mA-t2-1qbf-5cnf-40var-80cl
10
10
10
0
10
mA-t2-1qbf-5cnf-80var-1280cl
10
10
10
0.12
10
mA-t2-1qbf-5cnf-80var-160cl
10
10
10
0
10
mA-t2-1qbf-5cnf-80var-2560cl
10
10
10
220.18
10
mA-t2-1qbf-5cnf-80var-320cl
10
10
10
0
10
mA-t2-1qbf-5cnf-80var-640cl
10
10
10
0
10
mA-t2-2qbf-5cnf-160var-1280cl
10
10
10
1136.11
8
2
mA-t2-2qbf-5cnf-160var-2560cl
10
10
10
0.15
10
mA-t2-2qbf-5cnf-160var-320cl
10
10
10
0.03
9
1
mA-t2-2qbf-5cnf-160var-5120cl
10
10
10
0.19
10
mA-t2-2qbf-5cnf-160var-640cl
10
8
8
461.56
7
1
mA-t2-2qbf-5cnf-20var-160cl
10
10
10
0.04
9
1
mA-t2-2qbf-5cnf-20var-320cl
10
10
10
0
10
mA-t2-2qbf-5cnf-20var-40cl
10
10
10
0
5
5
mA-t2-2qbf-5cnf-20var-640cl
10
10
10
0
10
mA-t2-2qbf-5cnf-20var-80cl
10
10
10
0.04
10
mA-t2-2qbf-5cnf-40var-1280cl
10
10
10
0
10
mA-t2-2qbf-5cnf-40var-160cl
10
10
6
4
0.29
8
2
mA-t2-2qbf-5cnf-40var-320cl
10
10
10
0.1
10
mA-t2-2qbf-5cnf-40var-640cl
10
10
10
0.01
10
mA-t2-2qbf-5cnf-40var-80cl
10
10
10
0.01
8
2
mA-t2-2qbf-5cnf-80var-1280cl
10
10
10
0.06
10
mA-t2-2qbf-5cnf-80var-160cl
10
10
10
0.02
10
mA-t2-2qbf-5cnf-80var-2560cl
10
10
10
0.02
10
mA-t2-2qbf-5cnf-80var-320cl
10
8
2
6
754.79
6
2
mA-t2-2qbf-5cnf-80var-640cl
10
10
10
1.59
10
mA-t2-3qbf-5cnf-160var-1280cl
10
9
9
11.47
2
7
mA-t2-3qbf-5cnf-160var-2560cl
10
10
10
0.2
10
mA-t2-3qbf-5cnf-160var-320cl
10
10
10
0
10
mA-t2-3qbf-5cnf-160var-5120cl
10
10
10
0.2
10
mA-t2-3qbf-5cnf-160var-640cl
10
10
10
0
10
mA-t2-3qbf-5cnf-20var-160cl
10
10
10
0.01
10
mA-t2-3qbf-5cnf-20var-320cl
10
10
10
0.05
10
mA-t2-3qbf-5cnf-20var-40cl
10
10
10
0
8
2
mA-t2-3qbf-5cnf-20var-640cl
10
10
10
0
2
8
mA-t2-3qbf-5cnf-20var-80cl
10
10
10
0
10
mA-t2-3qbf-5cnf-40var-1280cl
10
10
10
0.03
10
mA-t2-3qbf-5cnf-40var-160cl
10
10
10
0
10
mA-t2-3qbf-5cnf-40var-320cl
10
10
9
1
0.15
10
mA-t2-3qbf-5cnf-40var-640cl
10
10
10
0
10
mA-t2-3qbf-5cnf-40var-80cl
10
10
10
0
10
mA-t2-3qbf-5cnf-80var-1280cl
10
10
10
0.09
10
mA-t2-3qbf-5cnf-80var-160cl
10
10
10
0
10
mA-t2-3qbf-5cnf-80var-2560cl
10
10
10
0.08
10
mA-t2-3qbf-5cnf-80var-320cl
10
10
10
0
10
mA-t2-3qbf-5cnf-80var-640cl
10
10
10
0.08
8
2
mA-t2-4qbf-5cnf-160var-1280cl
10
10
10
335.76
10
mA-t2-4qbf-5cnf-160var-2560cl
10
10
10
0.26
10
mA-t2-4qbf-5cnf-160var-320cl
10
10
10
0
10
mA-t2-4qbf-5cnf-160var-5120cl
10
10
10
0.29
10
mA-t2-4qbf-5cnf-160var-640cl
10
10
10
0.04
10
mA-t2-4qbf-5cnf-20var-160cl
10
10
2
8
0.28
10
mA-t2-4qbf-5cnf-20var-320cl
10
10
10
0.01
10
mA-t2-4qbf-5cnf-20var-40cl
10
10
10
0
1
9
mA-t2-4qbf-5cnf-20var-640cl
10
10
10
0
10
mA-t2-4qbf-5cnf-20var-80cl
10
10
10
0
10
mA-t2-4qbf-5cnf-40var-1280cl
10
10
10
0.05
10
mA-t2-4qbf-5cnf-40var-160cl
10
10
10
0.01
10
mA-t2-4qbf-5cnf-40var-320cl
10
10
10
68.15
10
mA-t2-4qbf-5cnf-40var-640cl
10
10
10
0.02
10
mA-t2-4qbf-5cnf-40var-80cl
10
10
10
0
10
mA-t2-4qbf-5cnf-80var-1280cl
10
10
10
0.1
10
mA-t2-4qbf-5cnf-80var-160cl
10
10
10
0
10
mA-t2-4qbf-5cnf-80var-2560cl
10
10
10
0.11
10
mA-t2-4qbf-5cnf-80var-320cl
10
10
10
0.04
6
4
mA-t2-4qbf-5cnf-80var-640cl
10
10
10
352.84
10
mA-t2-5qbf-5cnf-160var-1280cl
10
10
10
0.11
9
1
mA-t2-5qbf-5cnf-160var-2560cl
10
10
10
0.46
10
mA-t2-5qbf-5cnf-160var-320cl
10
10
10
0.01
10
mA-t2-5qbf-5cnf-160var-5120cl
10
10
10
0.34
10
mA-t2-5qbf-5cnf-160var-640cl
10
10
10
0
10
mA-t2-5qbf-5cnf-20var-160cl
10
10
10
0
10
mA-t2-5qbf-5cnf-20var-320cl
10
10
10
0.03
10
mA-t2-5qbf-5cnf-20var-40cl
10
10
10
0
10
mA-t2-5qbf-5cnf-20var-640cl
10
10
10
0.01
10
mA-t2-5qbf-5cnf-20var-80cl
10
10
10
0
10
mA-t2-5qbf-5cnf-40var-1280cl
10
10
10
0.05
10
mA-t2-5qbf-5cnf-40var-160cl
10
10
10
0
10
mA-t2-5qbf-5cnf-40var-320cl
10
10
10
0.02
10
mA-t2-5qbf-5cnf-40var-640cl
10
10
10
0.04
10
mA-t2-5qbf-5cnf-40var-80cl
10
10
10
0
10
mA-t2-5qbf-5cnf-80var-1280cl
10
10
10
0.14
10
mA-t2-5qbf-5cnf-80var-160cl
10
10
10
0
10
mA-t2-5qbf-5cnf-80var-2560cl
10
10
10
0.11
10
mA-t2-5qbf-5cnf-80var-320cl
10
10
10
0
10
mA-t2-5qbf-5cnf-80var-640cl
10
10
10
0.03
10
mA-t2-6qbf-5cnf-160var-1280cl
10
7
4
3
34.66
3
4
mA-t2-6qbf-5cnf-160var-2560cl
10
10
10
0.49
10
mA-t2-6qbf-5cnf-160var-320cl
10
10
10
0
10
mA-t2-6qbf-5cnf-160var-5120cl
10
10
10
0.23
10
mA-t2-6qbf-5cnf-160var-640cl
10
10
10
0
10
mA-t2-6qbf-5cnf-20var-160cl
10
10
9
1
0.04
10
mA-t2-6qbf-5cnf-20var-320cl
10
10
10
0.08
10
mA-t2-6qbf-5cnf-20var-40cl
10
10
10
0
10
mA-t2-6qbf-5cnf-20var-640cl
10
10
10
0.01
10
mA-t2-6qbf-5cnf-20var-80cl
10
10
10
0
10
mA-t2-6qbf-5cnf-40var-1280cl
10
10
10
0.04
10
mA-t2-6qbf-5cnf-40var-160cl
10
10
10
0
10
mA-t2-6qbf-5cnf-40var-320cl
10
10
8
2
12.12
8
2
mA-t2-6qbf-5cnf-40var-640cl
10
10
10
0.13
10
mA-t2-6qbf-5cnf-40var-80cl
10
10
10
0
10
mA-t2-6qbf-5cnf-80var-1280cl
10
10
10
0.14
10
mA-t2-6qbf-5cnf-80var-160cl
10
10
10
0
10
mA-t2-6qbf-5cnf-80var-2560cl
10
10
10
0.13
10
mA-t2-6qbf-5cnf-80var-320cl
10
10
10
0
10
mA-t2-6qbf-5cnf-80var-640cl
10
9
7
2
0.9
4
5
MutexP
7
7
7
0.09
2
5
Qshifter
6
6
6
5.15
1
5
renHorn
84
84
56
28
1.46
84
RobotsD2
30
28
25
3
3344.05
25
3
RobotsD3
30
28
21
7
2121.04
25
3
RobotsD4
30
26
20
6
1721.43
24
2
RobotsD5
30
28
21
7
2977.09
25
3
s1196
2
0
0
0
-
s1269
5
0
0
0
-
s27
4
4
1
3
0.47
1
3
s298
6
2
2
25.26
2
s3330
5
0
0
0
-
s386
4
1
1
3.56
1
s499
6
2
2
62.71
2
s510
7
1
1
1.13
1
s641
4
0
0
0
-
s713
4
1
1
17.47
1
s820
5
1
1
32.5
1
SzymanskiP
12
12
12
292.1
12
term1
8
8
4
4
16.11
7
1
Toilet
8
8
5
3
0.33
2
6
ToiletA
18
18
8
10
6.84
5
13
ToiletC
20
20
11
9
2.65
4
16
Tree
14
14
7
7
0
4
10
uclid
3
1
1
0.3
1
VonNeumann
10
10
10
5.45
10
z4ml
8
8
4
4
0
5
3
Contact
|
Organization
|
Links
|
Citing QBFLIB
qbflib.org