QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
SOTA views
QBFEVAL'17 - Prenex CNF Track
Family
Overall
Time
Hardness
N
#
S
U
EA
ME
MH
Abduction
5
2
1
1
45.26
2
Adder
10
10
7
3
94.4
8
2
amba
4
3
1
2
136.82
3
arithmetic
5
5
5
9.01
5
blackbox-01X-QBF
20
20
20
30.56
20
BMC
13
6
4
2
138.43
6
C432
2
2
2
0.28
2
C499
3
3
3
14.37
3
C5315
5
2
1
1
2.99
2
C6288
7
3
3
733.11
1
2
C880
6
6
6
568.07
5
1
circuits
14
3
3
90.21
3
conformant_planning
10
8
3
5
881.55
8
Connect2
1
1
1
9.56
1
Connect3
1
0
0
0
-
Connect4
8
1
1
0.05
1
Connect5
2
2
2
128.14
2
Connect6
2
1
1
0.05
1
Connect7
2
0
0
0
-
Connect8
2
2
2
0.36
2
Counter
5
3
3
55.25
2
1
cycle-sched
4
4
2
2
65.23
4
Debug
14
7
7
1787.95
7
disjunctive_decomposition
5
4
3
1
1.73
4
driver
4
4
2
2
0.37
4
dungeon
26
26
1
25
465.42
26
evader-pursuer-4x4-logarithmic
1
1
1
0.48
1
evader-pursuer-4x4-standard
7
7
7
14.23
7
evader-pursuer-6x6-logarithmic
5
3
3
1013.88
2
1
evader-pursuer-6x6-standard
8
2
2
187.68
2
evader-pursuer-8x8-logarithmic
5
3
3
1255.86
2
1
formula_add
12
9
9
1411.26
7
2
fpu
20
20
20
23.32
20
genbuf
4
3
1
2
411.32
2
1
Generalized-Tic-Tac-Toe
7
7
1
6
144
7
genpatch
5
5
3
2
106.2
5
HardwareFixpoint
26
17
2
15
568.74
1
16
hwmcc
4
4
2
2
141.22
4
hyperLTL
2
2
1
1
0
1
1
incrementer-encoder
13
13
2
11
23.31
13
irqlkeapclte
10
10
10
107.39
10
ISCAS89
4
4
2
2
1.04
4
ITC99
9
8
7
1
736.08
6
2
jmc_quant
1
0
0
0
-
jmc_quant_squaring
8
6
3
3
16.73
3
3
k_branch_n
6
6
6
133.19
6
k_branch_p
8
8
8
20.19
8
k_ph_p
10
5
5
618.17
2
3
LinearBitvectorRankingFunction
23
9
6
3
835.58
9
ltl2aig-comp
4
2
2
21.61
2
LTL2DBA
2
2
1
1
0.24
2
LTL2DPA
2
2
1
1
1.5
2
mqm
3
3
3
45.89
3
mult-matrix
4
4
2
2
41.47
2
2
Planning-CTE
29
29
2
27
610.59
29
QBF-Hardness
10
10
1
9
152.85
10
qbfeval12
3
3
3
14.03
3
RankingFunctions
2
2
2
0.08
2
Reduction-finding
6
6
3
3
74.36
5
1
s1196
2
2
2
101.35
2
s1269
2
1
1
3.33
1
s298
2
2
1
1
9.58
2
s3330
2
1
1
2.92
1
s499
2
2
1
1
2.35
2
s510
2
2
2
36.64
2
s641
2
2
1
1
8.7
2
s713
2
2
2
51.37
2
s820
2
2
1
1
3.36
2
sketch
5
2
2
413.67
2
Sorting_networks
6
6
2
4
96.05
6
SzymanskiP
2
2
2
34.98
2
terminator
9
9
1
8
12.46
9
tipdiam
10
10
5
5
200.18
8
2
tipfixpoint
13
12
9
3
157.78
11
1
toy
4
4
2
2
0.42
4
trafficlight-controller
10
10
10
10.63
10
uclid
3
3
2
1
23.52
3
Contact
|
Organization
|
Links
|
Citing QBFLIB
qbflib.org