QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family tipdiam solved by
AQME-1NN
QBFEVAL'08
Instance
Result
Time
eijk.S208.S-d2
SAT
0.74
eijk.S208c.S-d3
SAT
0.78
texas.parsesys^1.E-d2
SAT
0.78
eijk.S298.S-d2
SAT
0.8
eijk.S510.S-d3
SAT
0.82
eijk.S444.S-d2
SAT
0.82
eijk.S386.S-d2
SAT
0.83
eijk.S208o.S-d4
SAT
0.84
cmu.dme1.B-d2
SAT
0.84
vis.bakery.E-d2
SAT
0.84
eijk.S444.S-d4
SAT
0.84
eijk.S208.S-d3
SAT
0.84
vis.eisenberg.E-d2
SAT
0.85
eijk.S526.S-d3
SAT
0.86
eijk.S208o.S-d3
SAT
0.86
eijk.S526.S-d2
SAT
0.86
eijk.S208c.S-d4
SAT
0.86
cmu.dme2.B-d2
SAT
0.86
vis.4-arbit^1.E-d2
SAT
0.86
vis.emodel.E-d2
SAT
0.87
eijk.S382.S-d2
SAT
0.87
eijk.S208c.S-d2
SAT
0.88
eijk.S208.S-d4
SAT
0.88
vis.eisenberg.E-d3
SAT
0.88
eijk.S641.S-d3
SAT
0.88
cmu.dme1.B-d3
SAT
0.88
cmu.dme1.B-d4
SAT
0.88
eijk.S298.S-d3
SAT
0.9
irst.dme5.B-d2
SAT
0.91
nusmv.dme1-16.B-d2
SAT
0.93
vis.4-arbit^1.E-d3
SAT
0.93
eijk.S444.S-d3
SAT
0.94
texas.ifetch1^3.E-d3
SAT
0.94
texas.ifetch1^3.E-d4
SAT
0.94
vis.bakery.E-d3
SAT
0.94
eijk.S382.S-d4
SAT
0.95
texas.ifetch1^1.E-d3
SAT
0.95
eijk.S510.S-d4
SAT
0.96
texas.ifetch1^1.E-d4
SAT
0.96
irst.dme4.B-d2
SAT
0.97
eijk.S526.S-d4
SAT
0.97
nusmv.dme1-16.B-d3
SAT
0.97
texas.parsesys^1.E-d3
SAT
0.97
eijk.S298.S-d4
SAT
0.98
vis.coherence^1.E-d2
SAT
0.98
eijk.S349.S-d2
SAT
0.99
eijk.S344.S-d2
SAT
0.99
cmu.dme2.B-d3
SAT
1
texas.parsesys^1.E-d4
SAT
1
eijk.S1423.S-d2
SAT
1.01
eijk.S382.S-d3
SAT
1.01
vis.emodel.E-d3
SAT
1.02
eijk.S953.S-d3
SAT
1.04
vis.prodcell^01.E-d2
SAT
1.05
nusmv.dme2-16.B-d2
SAT
1.06
vis.eisenberg.E-d4
SAT
1.07
vis.bakery.E-d4
SAT
1.18
eijk.bs3330.S-d2
SAT
1.21
nusmv.brp.B-d2
SAT
1.22
vis.4-arbit^1.E-d4
SAT
1.25
vis.emodel.E-d4
SAT
1.34
eijk.bs1512.S-d4
SAT
1.36
vis.coherence^1.E-d3
SAT
1.38
eijk.S1196.S-d2
SAT
1.4
eijk.S386.S-d4
SAT
1.44
eijk.S953.S-d4
SAT
1.44
eijk.S208o.S-d2
SAT
1.58
eijk.S953.S-d2
SAT
1.67
eijk.S420.S-d4
SAT
1.68
vis.arbiter.E-d4
SAT
1.69
eijk.S1238.S-d2
SAT
1.7
irst.dme6.B-d2
SAT
1.72
texas.ifetch1^9.E-d3
SAT
1.73
eijk.bs1512.S-d2
SAT
1.75
texas.ifetch1^9.E-d4
SAT
1.76
eijk.S820.S-d2
SAT
1.76
eijk.S1423.S-d3
SAT
1.79
eijk.S832.S-d2
SAT
1.82
eijk.S349.S-d3
SAT
2.05
irst.dme5.B-d3
SAT
2.23
nusmv.brp.B-d3
SAT
2.47
nusmv.brp.B-d4
SAT
2.53
nusmv.reactor^2.C-d2
SAT
2.6
eijk.S641.S-d4
SAT
2.68
nusmv.reactor^3.C-d2
SAT
2.69
cmu.periodic.N-d2
SAT
2.75
nusmv.reactor^5.C-d2
SAT
2.78
eijk.S832.S-d3
SAT
2.79
vis.prodcell^01.E-d3
SAT
2.82
vis.elevator^1.E-d3
SAT
2.88
nusmv.reactor^1.C-d2
SAT
2.98
vis.elevator^1.E-d4
SAT
3.06
eijk.S820.S-d3
SAT
3.08
nusmv.queue.B-d3
SAT
3.08
eijk.S1423.S-d4
SAT
3.1
cmu.dme2.B-d4
SAT
3.18
nusmv.reactor^4.C-d2
SAT
3.19
ken.flash^02.C-d2
SAT
3.23
cmu.periodic.N-d3
SAT
3.27
vis.prodcell^01.E-d4
SAT
3.28
vis.coherence^1.E-d4
SAT
3.4
ken.flash^13.C-d2
UNSAT
3.42
eijk.bs4863.S-d2
SAT
3.52
eijk.bs1512.S-d3
SAT
3.57
cmu.periodic.N-d4
SAT
3.68
ken.flash^06.C-d2
UNSAT
3.69
vis.elevator^1.E-d2
SAT
3.82
ken.flash^13.C-d3
UNSAT
3.86
cmu.gigamax.B-d2
SAT
4.19
irst.dme4.B-d3
SAT
4.19
ken.flash^02.C-d3
SAT
4.32
nusmv.queue.B-d4
SAT
4.51
eijk.S713.S-d4
SAT
4.57
ken.flash^06.C-d3
UNSAT
4.61
ken.flash^13.C-d4
UNSAT
4.67
eijk.S344.S-d4
SAT
5.43
nusmv.reactor^3.C-d3
SAT
5.75
nusmv.reactor^2.C-d3
SAT
5.96
nusmv.reactor^4.C-d3
SAT
6.27
nusmv.reactor^1.C-d3
SAT
6.28
eijk.S349.S-d4
SAT
6.57
ken.flash^06.C-d4
UNSAT
6.98
ken.flash^14.C-d3
UNSAT
6.99
nusmv.reactor^5.C-d3
SAT
7
ken.flash^12.C-d3
SAT
8
ken.flash^03.C-d2
UNSAT
8.35
nusmv.tcas^1.B-d2
SAT
8.47
nusmv.tcas-t^1.B-d2
SAT
8.84
irst.dme6.B-d3
SAT
10.72
irst.dme4.B-d4
SAT
10.79
ken.flash^14.C-d4
UNSAT
13.03
eijk.S1238.S-d3
UNSAT
16.11
nusmv.reactor^5.C-d4
SAT
16.94
nusmv.dme2-16.B-d3
SAT
18.22
nusmv.reactor^3.C-d4
SAT
18.55
nusmv.reactor^2.C-d4
SAT
19.31
nusmv.reactor^4.C-d4
SAT
19.33
eijk.S1238.S-d4
UNSAT
19.53
ken.flash^03.C-d4
UNSAT
22.67
ken.flash^14.C-d2
UNSAT
27.73
nusmv.reactor^1.C-d4
SAT
36.16
eijk.S1196.S-d3
UNSAT
37.04
eijk.S386.S-d3
SAT
38.17
eijk.S832.S-d4
SAT
65.3
ken.flash^12.C-d2
SAT
65.64
eijk.S820.S-d4
SAT
66.16
ken.flash^02.C-d4
SAT
71.12
eijk.S1196.S-d4
UNSAT
72.24
ken.flash^09.C-d2
UNSAT
78.95
ken.flash^10.C-d2
UNSAT
83.87
nusmv.queue.B-d2
SAT
88.33
eijk.bs6669.S-d3
SAT
130.99
eijk.bs6669.S-d4
SAT
136.18
eijk.S344.S-d3
SAT
155.03
eijk.bs4863.S-d3
SAT
170.31
ken.flash^03.C-d3
UNSAT
185.59
nusmv.dme1-16.B-d4
SAT
215.22
irst.dme6.B-d4
SAT
322.56
nusmv.dme2-16.B-d4
FAIL
540.13
ken.flash^12.C-d4
FAIL
547.31
nusmv.guidance^1.C-d3
FAIL
548.41
ken.oop^2.C-d2
FAIL
552.88
ken.oop^1.C-d3
FAIL
555.61
irst.dme5.B-d4
FAIL
556.42
ken.oop^1.C-d4
FAIL
556.83
nusmv.guidance^5.C-d3
FAIL
556.95
nusmv.guidance^2.C-d3
FAIL
556.99
eijk.bs4863.S-d4
FAIL
557.31
nusmv.tcas-t^1.B-d4
FAIL
557.51
nusmv.tcas^1.B-d4
FAIL
557.56
nusmv.guidance^4.C-d3
FAIL
557.77
nusmv.guidance^6.C-d3
FAIL
557.83
nusmv.guidance^1.C-d2
FAIL
558.8
nusmv.tcas^1.B-d3
FAIL
559.11
nusmv.tcas-t^1.B-d3
FAIL
559.84
ken.oop^2.C-d3
FAIL
562.02
ken.oop^1.C-d2
FAIL
562.28
eijk.bs3330.S-d4
FAIL
562.82
eijk.bs3330.S-d3
FAIL
565.32
ken.flash^11.C-d4
FAIL
569.57
nusmv.guidance^1.C-d4
FAIL
574.34
ken.flash^09.C-d4
FAIL
576.55
ken.flash^01.C-d3
FAIL
579.42
ken.flash^10.C-d4
FAIL
583.08
ken.flash^10.C-d3
FAIL
588.25
ken.flash^08.C-d2
FAIL
589.4
ken.flash^05.C-d2
FAIL
589.51
ken.flash^11.C-d3
FAIL
590.65
ken.flash^04.C-d4
FAIL
596.23
ken.flash^01.C-d2
FAIL
598.25
cmu.gigamax.B-d3
FAIL
598.37
cmu.gigamax.B-d4
FAIL
598.38
ken.oop^2.C-d4
FAIL
598.56
ken.flash^04.C-d2
FAIL
598.61
ken.flash^08.C-d3
FAIL
599.09
ken.flash^04.C-d3
FAIL
599.36
ken.flash^01.C-d4
FAIL
599.43
ken.flash^07.C-d4
FAIL
599.92
ken.flash^09.C-d3
FAIL
600
ken.flash^11.C-d2
FAIL
600
ken.flash^05.C-d3
FAIL
600
ken.flash^08.C-d4
FAIL
600
ken.flash^05.C-d4
FAIL
600
Contact
|
Organization
|
Links
|
Citing QBFLIB