QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
SOTA views
QBFEVAL'04
Family
Overall
Time
Hardness
N
#
S
U
EA
ME
MH
Adder
8
6
2
4
132.52
2
4
Blocks
8
8
2
6
1.05
8
C432
8
8
3
5
1787.97
5
3
C499
8
5
3
2
19.75
4
1
C5315
8
4
2
2
134.68
3
1
C6288
8
1
1
3.93
1
C880
8
2
2
0.22
2
Chain
8
8
8
0.22
8
comp
8
8
4
4
0.15
8
Connect2
8
8
1
7
0.8
8
Connect3
8
8
8
2.66
8
Connect4
8
8
8
1.29
3
5
Connect5
8
8
8
1.21
1
7
Connect6
8
8
8
1.34
1
7
Connect7
8
8
8
1.56
8
Connect8
8
8
8
3.06
8
Connect9
3
3
3
1.45
3
Counter
8
4
4
0.04
2
2
DFlipFlop
8
8
8
1.71
1
7
Impl
8
8
8
0
4
4
jmc_quant
8
3
2
1
18.68
1
2
jmc_quant_squaring
8
3
2
1
11.45
3
k_branch_n
8
4
4
269.05
1
3
k_branch_p
8
8
8
111.29
3
5
k_d4_n
8
8
8
32.64
1
7
k_d4_p
8
8
8
0.08
8
k_dum_n
8
8
8
0.21
8
k_dum_p
8
8
8
4.63
8
k_grz_n
8
8
8
679.09
7
1
k_grz_p
8
8
8
9.19
7
1
k_lin_n
8
8
8
18.74
1
7
k_lin_p
8
8
8
0.4
8
k_path_n
8
8
8
0.11
8
k_path_p
8
8
8
0.2
8
k_ph_n
8
7
6
1
22.86
1
7
k_ph_p
8
5
5
88.41
3
2
k_poly_n
8
8
8
0.17
8
k_poly_p
8
8
8
0.06
8
k_t4p_n
8
8
8
93.72
2
6
k_t4p_p
8
8
8
22.58
4
4
Logn
4
4
2
2
0.31
4
mA-t2-2qbf-5cnf-100var-1000cl
2
2
2
1.08
2
mA-t2-2qbf-5cnf-100var-1200cl
2
2
2
0.02
2
mA-t2-2qbf-5cnf-100var-1400cl
2
2
2
0.01
2
mA-t2-2qbf-5cnf-100var-1600cl
2
2
2
0.02
2
mA-t2-2qbf-5cnf-100var-1800cl
2
2
2
0.03
2
mA-t2-2qbf-5cnf-100var-200cl
2
2
2
0.01
2
mA-t2-2qbf-5cnf-100var-400cl
2
1
1
0.98
2
mA-t2-2qbf-5cnf-100var-600cl
2
2
2
48.63
2
mA-t2-2qbf-5cnf-100var-800cl
2
2
2
1.46
1
1
mA-t2-2qbf-5cnf-150var-1200cl
2
1
1
208.12
1
mA-t2-2qbf-5cnf-150var-1500cl
2
2
2
0.04
2
mA-t2-2qbf-5cnf-150var-1800cl
2
2
2
0.02
2
mA-t2-2qbf-5cnf-150var-2100cl
2
2
2
0.03
2
mA-t2-2qbf-5cnf-150var-2400cl
2
2
2
0.04
2
mA-t2-2qbf-5cnf-150var-2700cl
2
2
2
0.02
2
mA-t2-2qbf-5cnf-150var-300cl
2
2
2
0
2
mA-t2-2qbf-5cnf-150var-600cl
2
2
2
1.07
2
mA-t2-2qbf-5cnf-150var-900cl
2
0
0
0
-
mA-t2-2qbf-5cnf-50var-100cl
2
2
2
0.01
2
mA-t2-2qbf-5cnf-50var-200cl
2
2
1
1
0.36
2
mA-t2-2qbf-5cnf-50var-300cl
2
2
2
2.24
2
mA-t2-2qbf-5cnf-50var-400cl
2
2
2
0.1
2
mA-t2-2qbf-5cnf-50var-500cl
2
2
2
0.02
2
mA-t2-2qbf-5cnf-50var-600cl
2
2
2
0
2
mA-t2-2qbf-5cnf-50var-700cl
2
2
2
0.01
2
mA-t2-2qbf-5cnf-50var-800cl
2
2
2
0.01
2
mA-t2-2qbf-5cnf-50var-900cl
2
2
2
0
2
mA-t2-3qbf-5cnf-100var-1000cl
2
1
1
0.04
2
mA-t2-3qbf-5cnf-100var-1200cl
2
2
2
0.08
2
mA-t2-3qbf-5cnf-100var-1400cl
2
2
2
0.03
2
mA-t2-3qbf-5cnf-100var-1600cl
2
2
2
0.01
2
mA-t2-3qbf-5cnf-100var-1800cl
2
2
2
0.02
2
mA-t2-3qbf-5cnf-100var-200cl
2
2
2
0
2
mA-t2-3qbf-5cnf-100var-400cl
2
2
2
0
2
mA-t2-3qbf-5cnf-100var-600cl
2
2
2
0
2
mA-t2-3qbf-5cnf-100var-800cl
2
2
2
0.01
2
mA-t2-3qbf-5cnf-150var-1200cl
2
2
2
0.01
2
mA-t2-3qbf-5cnf-150var-1500cl
2
0
0
0
-
2
mA-t2-3qbf-5cnf-150var-1800cl
2
2
2
1.75
2
mA-t2-3qbf-5cnf-150var-2100cl
2
2
2
0.08
2
mA-t2-3qbf-5cnf-150var-2400cl
2
2
2
0.06
2
mA-t2-3qbf-5cnf-150var-2700cl
2
2
2
0.05
2
mA-t2-3qbf-5cnf-150var-300cl
2
2
2
0
2
mA-t2-3qbf-5cnf-150var-600cl
2
2
2
0
2
mA-t2-3qbf-5cnf-150var-900cl
2
2
2
0.01
2
mA-t2-3qbf-5cnf-50var-100cl
2
2
2
0
2
mA-t2-3qbf-5cnf-50var-200cl
2
2
2
0
2
mA-t2-3qbf-5cnf-50var-300cl
2
2
2
0
2
mA-t2-3qbf-5cnf-50var-400cl
2
2
2
0.17
2
mA-t2-3qbf-5cnf-50var-500cl
2
1
1
0
2
mA-t2-3qbf-5cnf-50var-600cl
2
2
2
0.04
2
mA-t2-3qbf-5cnf-50var-700cl
2
2
2
0.02
2
mA-t2-3qbf-5cnf-50var-800cl
2
2
2
0.02
2
mA-t2-3qbf-5cnf-50var-900cl
2
2
2
0.02
2
mA-t2-4qbf-5cnf-100var-1000cl
2
2
2
0.17
2
mA-t2-4qbf-5cnf-100var-1200cl
2
2
2
0.02
2
mA-t2-4qbf-5cnf-100var-1400cl
2
2
2
0.02
2
mA-t2-4qbf-5cnf-100var-1600cl
2
2
2
0.02
2
mA-t2-4qbf-5cnf-100var-1800cl
2
2
2
0.03
2
mA-t2-4qbf-5cnf-100var-200cl
2
2
2
0
2
mA-t2-4qbf-5cnf-100var-400cl
2
2
2
0
2
mA-t2-4qbf-5cnf-100var-600cl
2
1
1
0.08
2
mA-t2-4qbf-5cnf-100var-800cl
2
1
1
0.03
2
mA-t2-4qbf-5cnf-150var-1200cl
2
1
1
0.8
2
mA-t2-4qbf-5cnf-150var-1500cl
2
1
1
0.02
2
mA-t2-4qbf-5cnf-150var-1800cl
2
2
2
0.04
2
mA-t2-4qbf-5cnf-150var-2100cl
2
2
2
0.06
2
mA-t2-4qbf-5cnf-150var-2400cl
2
2
2
0.04
2
mA-t2-4qbf-5cnf-150var-2700cl
2
2
2
0.05
2
mA-t2-4qbf-5cnf-150var-300cl
2
2
2
0
2
mA-t2-4qbf-5cnf-150var-600cl
2
2
2
0
2
mA-t2-4qbf-5cnf-150var-900cl
2
2
1
1
2.04
2
mA-t2-4qbf-5cnf-50var-100cl
2
2
2
0.01
2
mA-t2-4qbf-5cnf-50var-200cl
2
2
2
0
2
mA-t2-4qbf-5cnf-50var-300cl
2
2
2
0.01
2
mA-t2-4qbf-5cnf-50var-400cl
2
2
2
0.47
2
mA-t2-4qbf-5cnf-50var-500cl
2
2
2
0
2
mA-t2-4qbf-5cnf-50var-600cl
2
2
2
0.02
2
mA-t2-4qbf-5cnf-50var-700cl
2
2
2
0.02
2
mA-t2-4qbf-5cnf-50var-800cl
2
2
2
0.01
2
mA-t2-4qbf-5cnf-50var-900cl
2
2
2
0.01
2
mA-t2-5qbf-5cnf-100var-1000cl
2
2
1
1
2.8
2
mA-t2-5qbf-5cnf-100var-1200cl
2
0
0
0
-
2
mA-t2-5qbf-5cnf-100var-1400cl
2
2
2
0.56
2
mA-t2-5qbf-5cnf-100var-1600cl
2
2
2
0.05
2
mA-t2-5qbf-5cnf-100var-1800cl
2
2
2
0.03
2
mA-t2-5qbf-5cnf-100var-200cl
2
2
2
0
2
mA-t2-5qbf-5cnf-100var-400cl
2
2
2
0
2
mA-t2-5qbf-5cnf-100var-600cl
2
2
2
0.01
2
mA-t2-5qbf-5cnf-100var-800cl
2
2
2
0.01
2
mA-t2-5qbf-5cnf-150var-1200cl
2
2
2
0
2
mA-t2-5qbf-5cnf-150var-1500cl
2
2
2
0.02
2
mA-t2-5qbf-5cnf-150var-1800cl
2
1
1
51.22
2
mA-t2-5qbf-5cnf-150var-2100cl
2
2
2
0.09
2
mA-t2-5qbf-5cnf-150var-2400cl
2
2
2
0.06
2
mA-t2-5qbf-5cnf-150var-2700cl
2
2
2
0.06
2
mA-t2-5qbf-5cnf-150var-300cl
2
2
2
0
2
mA-t2-5qbf-5cnf-150var-600cl
2
2
2
0
2
mA-t2-5qbf-5cnf-150var-900cl
2
2
2
0.02
2
mA-t2-5qbf-5cnf-50var-100cl
2
2
2
0
2
mA-t2-5qbf-5cnf-50var-200cl
2
2
2
0
2
mA-t2-5qbf-5cnf-50var-300cl
2
2
2
0
2
mA-t2-5qbf-5cnf-50var-400cl
2
2
2
0.02
2
mA-t2-5qbf-5cnf-50var-500cl
2
2
2
0.01
2
mA-t2-5qbf-5cnf-50var-600cl
2
1
1
0.07
2
mA-t2-5qbf-5cnf-50var-700cl
2
2
2
0.25
2
mA-t2-5qbf-5cnf-50var-800cl
2
2
2
0.05
2
mA-t2-5qbf-5cnf-50var-900cl
2
2
2
0.04
2
mB-t2-2qbf-5cnf-100var-1000cl
2
2
2
0
2
mB-t2-2qbf-5cnf-100var-1200cl
2
2
2
0.01
2
mB-t2-2qbf-5cnf-100var-1400cl
2
2
2
0.02
2
mB-t2-2qbf-5cnf-100var-1600cl
2
2
2
0.02
2
mB-t2-2qbf-5cnf-100var-1800cl
2
2
2
0.01
2
mB-t2-2qbf-5cnf-100var-200cl
2
2
1
1
0.03
2
mB-t2-2qbf-5cnf-100var-400cl
2
2
2
0.02
2
mB-t2-2qbf-5cnf-100var-600cl
2
2
2
0.01
2
mB-t2-2qbf-5cnf-100var-800cl
2
2
2
0
2
mB-t2-2qbf-5cnf-150var-1200cl
2
2
2
0
2
mB-t2-2qbf-5cnf-150var-1500cl
2
2
2
0.02
2
mB-t2-2qbf-5cnf-150var-1800cl
2
2
2
0.02
2
mB-t2-2qbf-5cnf-150var-2100cl
2
2
2
0.02
2
mB-t2-2qbf-5cnf-150var-2400cl
2
2
2
0.02
2
mB-t2-2qbf-5cnf-150var-2700cl
2
2
2
0.03
2
mB-t2-2qbf-5cnf-150var-300cl
2
2
2
0.01
2
mB-t2-2qbf-5cnf-150var-600cl
2
2
2
0
2
mB-t2-2qbf-5cnf-150var-900cl
2
2
2
0
2
mB-t2-2qbf-5cnf-50var-100cl
2
2
1
1
0
2
mB-t2-2qbf-5cnf-50var-200cl
2
2
2
0.01
2
mB-t2-2qbf-5cnf-50var-300cl
2
2
2
0
2
mB-t2-2qbf-5cnf-50var-400cl
2
2
2
0
2
mB-t2-2qbf-5cnf-50var-500cl
2
2
2
0
2
mB-t2-2qbf-5cnf-50var-600cl
2
2
2
0
2
mB-t2-2qbf-5cnf-50var-700cl
2
2
2
0
2
mB-t2-2qbf-5cnf-50var-800cl
2
2
2
0
2
mB-t2-2qbf-5cnf-50var-900cl
2
2
2
0
2
mB-t2-3qbf-5cnf-100var-1000cl
2
2
2
0
2
mB-t2-3qbf-5cnf-100var-1200cl
2
2
2
0
2
mB-t2-3qbf-5cnf-100var-1400cl
2
2
2
0.01
2
mB-t2-3qbf-5cnf-100var-1600cl
2
2
2
0
2
mB-t2-3qbf-5cnf-100var-1800cl
2
2
2
0.01
2
mB-t2-3qbf-5cnf-100var-200cl
2
2
2
0
2
mB-t2-3qbf-5cnf-100var-400cl
2
2
2
0
2
mB-t2-3qbf-5cnf-100var-600cl
2
2
2
0.01
2
mB-t2-3qbf-5cnf-100var-800cl
2
2
2
0.01
2
mB-t2-3qbf-5cnf-150var-1200cl
2
2
2
0
2
mB-t2-3qbf-5cnf-150var-1500cl
2
2
2
0
2
mB-t2-3qbf-5cnf-150var-1800cl
2
2
2
0.02
2
mB-t2-3qbf-5cnf-150var-2100cl
2
2
2
0.01
2
mB-t2-3qbf-5cnf-150var-2400cl
2
2
2
0
2
mB-t2-3qbf-5cnf-150var-2700cl
2
2
2
0.02
2
mB-t2-3qbf-5cnf-150var-300cl
2
2
2
0
2
mB-t2-3qbf-5cnf-150var-600cl
2
2
2
0.02
2
mB-t2-3qbf-5cnf-150var-900cl
2
2
2
0.01
2
mB-t2-3qbf-5cnf-50var-100cl
2
2
2
0
2
mB-t2-3qbf-5cnf-50var-200cl
2
2
2
0
2
mB-t2-3qbf-5cnf-50var-300cl
2
2
2
0
1
1
mB-t2-3qbf-5cnf-50var-400cl
2
2
2
0
1
1
mB-t2-3qbf-5cnf-50var-500cl
2
2
2
0
2
mB-t2-3qbf-5cnf-50var-600cl
2
2
2
0
2
mB-t2-3qbf-5cnf-50var-700cl
2
2
2
0
2
mB-t2-3qbf-5cnf-50var-800cl
2
2
2
0
2
mB-t2-3qbf-5cnf-50var-900cl
2
2
2
0
1
1
mB-t2-4qbf-5cnf-100var-1000cl
2
2
2
0
2
mB-t2-4qbf-5cnf-100var-1200cl
2
2
2
0.01
2
mB-t2-4qbf-5cnf-100var-1400cl
2
2
2
0.02
2
mB-t2-4qbf-5cnf-100var-1600cl
2
2
2
0.02
2
mB-t2-4qbf-5cnf-100var-1800cl
2
2
2
0.02
2
mB-t2-4qbf-5cnf-100var-200cl
2
2
2
0
2
mB-t2-4qbf-5cnf-100var-400cl
2
2
2
0
2
mB-t2-4qbf-5cnf-100var-600cl
2
2
2
0
2
mB-t2-4qbf-5cnf-100var-800cl
2
2
2
0
2
mB-t2-4qbf-5cnf-150var-1200cl
2
2
2
0.02
2
mB-t2-4qbf-5cnf-150var-1500cl
2
2
2
0.02
2
mB-t2-4qbf-5cnf-150var-1800cl
2
2
2
0.02
2
mB-t2-4qbf-5cnf-150var-2100cl
2
2
2
0.03
2
mB-t2-4qbf-5cnf-150var-2400cl
2
2
2
0.02
2
mB-t2-4qbf-5cnf-150var-2700cl
2
2
2
0.02
2
mB-t2-4qbf-5cnf-150var-300cl
2
2
2
0
2
mB-t2-4qbf-5cnf-150var-600cl
2
2
2
0.01
2
mB-t2-4qbf-5cnf-150var-900cl
2
2
2
0.01
2
mB-t2-4qbf-5cnf-50var-100cl
2
2
2
0
2
mB-t2-4qbf-5cnf-50var-200cl
2
2
2
0.01
2
mB-t2-4qbf-5cnf-50var-300cl
2
2
2
0
2
mB-t2-4qbf-5cnf-50var-400cl
2
2
2
0
2
mB-t2-4qbf-5cnf-50var-500cl
2
2
2
0
2
mB-t2-4qbf-5cnf-50var-600cl
2
2
2
0
2
mB-t2-4qbf-5cnf-50var-700cl
2
2
2
0
2
mB-t2-4qbf-5cnf-50var-800cl
2
2
2
0
2
mB-t2-4qbf-5cnf-50var-900cl
2
2
2
0
2
mB-t2-5qbf-5cnf-100var-1000cl
2
2
2
0
2
mB-t2-5qbf-5cnf-100var-1200cl
2
2
2
0
2
mB-t2-5qbf-5cnf-100var-1400cl
2
2
2
0
2
mB-t2-5qbf-5cnf-100var-1600cl
2
2
2
0
2
mB-t2-5qbf-5cnf-100var-1800cl
2
2
2
0.02
2
mB-t2-5qbf-5cnf-100var-200cl
2
2
2
0
2
mB-t2-5qbf-5cnf-100var-400cl
2
2
2
0
2
mB-t2-5qbf-5cnf-100var-600cl
2
2
2
0
2
mB-t2-5qbf-5cnf-100var-800cl
2
2
2
0.02
2
mB-t2-5qbf-5cnf-150var-1200cl
2
2
2
0.01
2
mB-t2-5qbf-5cnf-150var-1500cl
2
2
2
0.01
2
mB-t2-5qbf-5cnf-150var-1800cl
2
2
2
0.02
2
mB-t2-5qbf-5cnf-150var-2100cl
2
2
2
0.02
2
mB-t2-5qbf-5cnf-150var-2400cl
2
2
2
0.02
2
mB-t2-5qbf-5cnf-150var-2700cl
2
2
2
0.02
2
mB-t2-5qbf-5cnf-150var-300cl
2
2
2
0
2
mB-t2-5qbf-5cnf-150var-600cl
2
2
2
0
2
mB-t2-5qbf-5cnf-150var-900cl
2
2
2
0.01
2
mB-t2-5qbf-5cnf-50var-100cl
2
2
2
0
2
mB-t2-5qbf-5cnf-50var-200cl
2
2
2
0
2
mB-t2-5qbf-5cnf-50var-300cl
2
2
2
0
2
mB-t2-5qbf-5cnf-50var-400cl
2
2
2
0
2
mB-t2-5qbf-5cnf-50var-500cl
2
2
2
0
2
mB-t2-5qbf-5cnf-50var-600cl
2
2
2
0
2
mB-t2-5qbf-5cnf-50var-700cl
2
2
2
0
2
mB-t2-5qbf-5cnf-50var-800cl
2
2
2
0
1
1
mB-t2-5qbf-5cnf-50var-900cl
2
2
2
0
2
MutexP
7
7
7
0.12
2
5
RobotsD2
8
5
5
2.44
8
RobotsD3
8
1
1
0.18
8
RobotsD4
8
4
3
1
3.35
7
1
RobotsD5
8
7
4
3
70.49
8
s1196
6
0
0
0
-
s1269
8
0
0
0
-
s27
4
4
1
3
3.03
1
3
s298
8
1
1
452.96
1
s3271
8
8
8
1.83
8
s3330
8
1
1
154.87
1
s386
8
0
0
0
-
s499
8
3
3
70.41
1
2
s510
8
0
0
0
-
s641
8
1
1
350.81
1
s713
8
1
1
287.14
1
s820
8
0
0
0
-
SzymanskiP
8
8
8
55.45
8
term1
8
8
4
4
142.55
8
Toilet
8
8
5
3
0.61
2
6
ToiletA
8
8
1
7
1.57
3
5
ToiletC
8
8
3
5
0.18
4
4
ToiletG
7
7
7
0
6
1
Tree
8
8
2
6
0.01
1
7
uclid
3
0
0
0
-
VonNeumann
8
8
8
3.95
8
z4ml
8
8
4
4
0.01
5
3
Contact
|
Organization
|
Links
|
Citing QBFLIB
qbflib.org