QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Sota solver results for family tipdiam
QBFEVAL'08
Instance
Solver
Result
Time
cmu.dme1.B-d2
Nenofex
SAT
0
cmu.dme1.B-d3
ssolveC
SAT
0.01
cmu.dme1.B-d4
ssolveB
SAT
0.03
cmu.dme2.B-d2
quantor3.0
SAT
0
cmu.dme2.B-d3
ssolveC
SAT
0.02
cmu.dme2.B-d4
ssolveC
SAT
0.04
cmu.gigamax.B-d2
QuBE6.1
SAT
1.27
cmu.periodic.N-d2
QuBE6.1
SAT
0.18
cmu.periodic.N-d3
QuBE6.1
SAT
0.3
cmu.periodic.N-d4
QuBE6.1
SAT
0.46
eijk.bs1512.S-d2
ssolveC
SAT
0.03
eijk.bs1512.S-d3
QuBE6.1
SAT
0.07
eijk.bs1512.S-d4
QuBE6.1
SAT
0.12
eijk.bs3330.S-d2
ssolveC
SAT
0.08
eijk.bs4863.S-d2
QuBE6.1
SAT
0.66
eijk.bs4863.S-d3
QuBE6.1
SAT
27.78
eijk.bs6669.S-d3
QuBE6.1
SAT
0.64
eijk.bs6669.S-d4
QuBE6.1
SAT
1.74
eijk.S1196.S-d2
ssolveC
SAT
0.1
eijk.S1196.S-d3
QuBE6.1
UNSAT
35.97
eijk.S1196.S-d4
QuBE6.1
UNSAT
70.78
eijk.S1238.S-d2
ssolve-A
SAT
0.06
eijk.S1238.S-d3
QuBE6.1
UNSAT
15.01
eijk.S1238.S-d4
QuBE6.1
UNSAT
18.37
eijk.S1423.S-d2
ssolveC
SAT
0.04
eijk.S1423.S-d3
QuBE6.1
SAT
0.14
eijk.S1423.S-d4
QuBE6.1
SAT
0.28
eijk.S208.S-d2
Nenofex
SAT
0
eijk.S208.S-d3
ssolveC
SAT
0
eijk.S208.S-d4
ssolve-A
SAT
0
eijk.S208c.S-d2
ssolveB
SAT
0
eijk.S208c.S-d3
quantor3.0
SAT
0.01
eijk.S208c.S-d4
ssolve-A
SAT
0
eijk.S208o.S-d2
ssolve-A
SAT
0
eijk.S208o.S-d3
ssolveC
SAT
0
eijk.S208o.S-d4
ssolve-A
SAT
0.01
eijk.S298.S-d2
quantor3.0
SAT
0
eijk.S298.S-d3
ssolve-A
SAT
0.01
eijk.S298.S-d4
ssolveC
SAT
0.04
eijk.S344.S-d2
ssolveC
SAT
0.02
eijk.S344.S-d3
ssolveC
SAT
0.08
eijk.S344.S-d4
ssolveC
SAT
0.18
eijk.S349.S-d2
ssolveC
SAT
0.03
eijk.S349.S-d3
ssolveC
SAT
0.08
eijk.S349.S-d4
ssolveC
SAT
0.17
eijk.S382.S-d2
quantor3.0
SAT
0
eijk.S382.S-d3
ssolve-A
SAT
0.01
eijk.S382.S-d4
ssolveC
SAT
0.05
eijk.S386.S-d2
ssolve-A
SAT
0.01
eijk.S386.S-d3
QuBE6.1
SAT
0.1
eijk.S386.S-d4
QuBE6.1
SAT
0.2
eijk.S420.S-d4
quantor3.0
SAT
0.01
eijk.S444.S-d2
quantor3.0
SAT
0.01
eijk.S444.S-d3
ssolveB
SAT
0.02
eijk.S444.S-d4
ssolveC
SAT
0.05
eijk.S510.S-d3
quantor3.0
SAT
0
eijk.S510.S-d4
quantor3.0
SAT
0.02
eijk.S526.S-d2
quantor3.0
SAT
0
eijk.S526.S-d3
ssolveC
SAT
0.01
eijk.S526.S-d4
ssolveB
SAT
0.06
eijk.S641.S-d3
ssolveC
SAT
0.02
eijk.S641.S-d4
ssolveC
SAT
0.14
eijk.S713.S-d4
ssolveC
SAT
0.14
eijk.S820.S-d2
quantor3.0
SAT
0.05
eijk.S820.S-d3
QuBE6.1
SAT
0.23
eijk.S820.S-d4
QuBE6.1
SAT
63.24
eijk.S832.S-d2
quantor3.0
SAT
0.04
eijk.S832.S-d3
QuBE6.1
SAT
0.28
eijk.S832.S-d4
AQME-1NN
SAT
65.3
eijk.S953.S-d2
quantor3.0
SAT
0.02
eijk.S953.S-d3
QuBE6.1
SAT
0.07
eijk.S953.S-d4
QuBE6.1
SAT
0.16
irst.dme4.B-d2
ssolve-A
SAT
0.02
irst.dme4.B-d3
ssolveC
SAT
0.05
irst.dme4.B-d4
ssolveC
SAT
0.22
irst.dme5.B-d2
ssolveC
SAT
0.02
irst.dme5.B-d3
ssolveC
SAT
0.08
irst.dme5.B-d4
ssolveC
SAT
0.56
irst.dme6.B-d2
ssolveC
SAT
0.04
irst.dme6.B-d3
ssolveC
SAT
0.12
irst.dme6.B-d4
ssolve-A
SAT
1.02
ken.flash^02.C-d2
QuBE6.1
SAT
0.88
ken.flash^02.C-d3
AQME-1NN
SAT
4.32
ken.flash^02.C-d4
AQME-1NN
SAT
71.12
ken.flash^03.C-d2
AQME-1NN
UNSAT
8.35
ken.flash^03.C-d3
AQME-1NN
UNSAT
185.59
ken.flash^03.C-d4
AQME-1NN
UNSAT
22.67
ken.flash^06.C-d2
QuBE6.1
UNSAT
0.88
ken.flash^06.C-d3
QuBE6.1
UNSAT
3.58
ken.flash^06.C-d4
AQME-1NN
UNSAT
6.98
ken.flash^09.C-d2
AQME-1NN
UNSAT
78.95
ken.flash^10.C-d2
AQME-1NN
UNSAT
83.87
ken.flash^12.C-d2
QuBE6.1
SAT
4.54
ken.flash^12.C-d3
AQME-1NN
SAT
8
ken.flash^13.C-d2
QuBE6.1
UNSAT
0.62
ken.flash^13.C-d3
QuBE6.1
UNSAT
1.08
ken.flash^13.C-d4
QuBE6.1
UNSAT
1.8
ken.flash^14.C-d2
QuBE6.1
UNSAT
24.61
ken.flash^14.C-d3
AQME-1NN
UNSAT
6.99
ken.flash^14.C-d4
AQME-1NN
UNSAT
13.03
nusmv.brp.B-d2
QuBE6.1
SAT
0.06
nusmv.brp.B-d3
QuBE6.1
SAT
0.12
nusmv.brp.B-d4
QuBE6.1
SAT
0.27
nusmv.dme1-16.B-d2
ssolve-A
SAT
0.02
nusmv.dme1-16.B-d3
QuBE6.1
SAT
0.06
nusmv.dme1-16.B-d4
QuBE6.1
SAT
0.1
nusmv.dme2-16.B-d2
ssolveC
SAT
0.04
nusmv.dme2-16.B-d3
ssolveC
SAT
0.22
nusmv.dme2-16.B-d4
ssolve-A
SAT
8.38
nusmv.queue.B-d2
QuBE6.1
SAT
0.09
nusmv.queue.B-d3
QuBE6.1
SAT
0.37
nusmv.queue.B-d4
QuBE6.1
SAT
1.39
nusmv.reactor^1.C-d2
QuBE6.1
SAT
0.24
nusmv.reactor^1.C-d3
QuBE6.1
SAT
3.52
nusmv.reactor^1.C-d4
QuBE6.1
SAT
32.96
nusmv.reactor^2.C-d2
QuBE6.1
SAT
0.22
nusmv.reactor^2.C-d3
QuBE6.1
SAT
3.24
nusmv.reactor^2.C-d4
QuBE6.1
SAT
16.14
nusmv.reactor^3.C-d2
QuBE6.1
SAT
0.21
nusmv.reactor^3.C-d3
QuBE6.1
SAT
2.98
nusmv.reactor^3.C-d4
QuBE6.1
SAT
15.64
nusmv.reactor^4.C-d2
QuBE6.1
SAT
0.22
nusmv.reactor^4.C-d3
QuBE6.1
SAT
3.38
nusmv.reactor^4.C-d4
QuBE6.1
SAT
16.07
nusmv.reactor^5.C-d2
QuBE6.1
SAT
0.21
nusmv.reactor^5.C-d3
QuBE6.1
SAT
4.02
nusmv.reactor^5.C-d4
QuBE6.1
SAT
13.81
nusmv.tcas-t^1.B-d2
QuBE6.1
SAT
5.8
nusmv.tcas^1.B-d2
QuBE6.1
SAT
5.81
texas.ifetch1^1.E-d3
quantor3.0
SAT
0.01
texas.ifetch1^1.E-d4
ssolveC
SAT
0.04
texas.ifetch1^3.E-d3
quantor3.0
SAT
0.01
texas.ifetch1^3.E-d4
ssolveC
SAT
0.04
texas.ifetch1^9.E-d3
ssolveC
SAT
0.02
texas.ifetch1^9.E-d4
ssolveC
SAT
0.04
texas.parsesys^1.E-d2
QuBE6.1
SAT
0
texas.parsesys^1.E-d3
quantor3.0
SAT
0
texas.parsesys^1.E-d4
quantor3.0
SAT
0.02
vis.4-arbit^1.E-d2
ssolveC
SAT
0.01
vis.4-arbit^1.E-d3
ssolveC
SAT
0.04
vis.4-arbit^1.E-d4
QuBE6.1
SAT
0.1
vis.arbiter.E-d4
ssolveC
SAT
0.02
vis.bakery.E-d2
quantor3.0
SAT
0
vis.bakery.E-d3
quantor3.0
SAT
0.01
vis.bakery.E-d4
quantor3.0
SAT
0.04
vis.coherence^1.E-d2
quantor3.0
SAT
0.02
vis.coherence^1.E-d3
QuBE6.1
SAT
0.11
vis.coherence^1.E-d4
QuBE6.1
SAT
0.64
vis.eisenberg.E-d2
ssolveB
SAT
0
vis.eisenberg.E-d3
ssolve-A
SAT
0.01
vis.eisenberg.E-d4
quantor3.0
SAT
0.03
vis.elevator^1.E-d2
QuBE6.1
SAT
0.1
vis.elevator^1.E-d3
QuBE6.1
SAT
0.18
vis.elevator^1.E-d4
QuBE6.1
SAT
0.32
vis.emodel.E-d2
ssolve-A
SAT
0.04
vis.emodel.E-d3
QuBE6.1
SAT
0.07
vis.emodel.E-d4
QuBE6.1
SAT
0.1
vis.prodcell^01.E-d2
QuBE6.1
SAT
0.08
vis.prodcell^01.E-d3
QuBE6.1
SAT
0.18
vis.prodcell^01.E-d4
QuBE6.1
SAT
0.42
Contact
|
Organization
|
Links
|
Citing QBFLIB