QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family tipfixpoint solved by
AQME-C4.5
QBFEVAL'07
Instance
Result
Time
texas.parsesys^3.E-f2
SAT
0.64
texas.parsesys^4.E-f3
UNSAT
0.69
vis.emodel.E-f4
UNSAT
0.7
texas.parsesys^4.E-f4
UNSAT
0.71
vis.prodcell^21.E-f2
UNSAT
0.72
texas.ifetch1^3.E-f2
UNSAT
0.78
texas.ifetch1^2.E-f2
UNSAT
0.78
texas.ifetch1^1.E-f3
UNSAT
0.99
texas.ifetch1^8.E-f4
SAT
1.08
vis.prodcell^21.E-f3
UNSAT
1.1
texas.ifetch1^8.E-f2
SAT
1.19
texas.ifetch1^4.E-f4
UNSAT
1.25
texas.ifetch1^1.E-f4
UNSAT
1.25
ken.flash^10.C-f2
UNSAT
1.26
texas.ifetch1^9.E-f4
SAT
1.44
texas.ifetch1^3.E-f4
UNSAT
1.54
texas.ifetch1^7.E-f2
SAT
1.54
vis.prodcell^21.E-f4
UNSAT
1.59
texas.PI_main^01.E-f2
SAT
1.76
vis.prodcell^04.E-f3
UNSAT
1.82
texas.PI_main^14.E-f3
UNSAT
1.82
ken.flash^10.C-f4
UNSAT
1.92
vis.elevator^1.E-f3
UNSAT
2.13
texas.ifetch1^5.E-f2
SAT
2.13
ken.flash^06.C-f2
UNSAT
2.26
vis.prodcell^08.E-f3
UNSAT
2.34
eijk.S344.S-f2
SAT
2.41
texas.two_proc^6.E-f2
SAT
2.58
vis.prodcell^04.E-f4
UNSAT
2.77
ken.flash^09.C-f2
UNSAT
2.91
vis.prodcell^20.E-f4
UNSAT
3.06
texas.ifetch1^2.E-f3
UNSAT
3.16
nusmv.reactor^3.C-f4
UNSAT
3.28
texas.ifetch1^9.E-f2
SAT
3.6
nusmv.reactor^5.C-f4
UNSAT
3.77
vis.prodcell^08.E-f4
UNSAT
3.87
nusmv.brp.B-f2
SAT
3.96
nusmv.tcas^1.B-f2
SAT
3.97
ken.flash^03.C-f4
UNSAT
4.07
ken.flash^03.C-f3
UNSAT
5.14
eijk.S208c.S-f2
SAT
6.36
texas.parsesys^2.E-f2
UNSAT
6.5
ken.flash^08.C-f4
UNSAT
6.93
ken.oop^1.C-f2
SAT
6.95
ken.oop^2.C-f2
SAT
7.04
eijk.S526.S-f2
SAT
9.73
texas.parsesys^3.E-f4
SAT
9.75
eijk.S444.S-f2
SAT
10.13
texas.parsesys^1.E-f3
SAT
12.45
nusmv.reactor^6.C-f2
SAT
14.01
eijk.S208.S-f2
SAT
14.78
eijk.S208o.S-f2
SAT
16.07
nusmv.queue.B-f2
SAT
21.04
vis.elevator^1.E-f4
UNSAT
45.03
ken.flash^08.C-f3
UNSAT
48.52
vis.prodcell^03.E-f3
UNSAT
66.78
vis.prodcell^02.E-f4
UNSAT
75.21
cmu.periodic.N-f2
SAT
83.11
cmu.periodic.N-f3
SAT
84.16
nusmv.syncarb5^2.B-f4
SAT
85.21
vis.prodcell^09.E-f4
UNSAT
86.15
ken.flash^09.C-f4
UNSAT
93.55
nusmv.tcas^1.B-f4
FAIL
129.15
eijk.S298.S-f2
SAT
158.19
vis.arbiter.E-f3
FAIL
159.29
nusmv.syncarb5^2.B-f3
SAT
161.56
eijk.S208o.S-f3
SAT
163.29
ken.flash^02.C-f2
SAT
163.62
cmu.gigamax.B-f2
SAT
164.7
nusmv.tcas-t^6.B-f2
SAT
165.99
irst.dme4.B-f2
FAIL
206.92
nusmv.tcas^5.B-f2
FAIL
210.76
vis.4-arbit^1.E-f2
SAT
213.05
irst.dme5.B-f2
FAIL
213.5
nusmv.reactor^7.C-f2
FAIL
217.48
nusmv.reactor^4.C-f2
FAIL
218.72
vis.arbiter.E-f2
SAT
221.23
eijk.S382.S-f2
FAIL
241.78
eijk.S349.S-f2
FAIL
259.38
vis.4-arbit^2.E-f2
SAT
282.12
irst.dme6.B-f2
FAIL
299.3
texas.parsesys^2.E-f4
UNSAT
302.86
eijk.S832.S-f2
FAIL
305.99
eijk.S820.S-f2
FAIL
411.29
texas.PI_main^12.E-f3
FAIL
600
texas.two_proc^1.E-f4
FAIL
600
vis.4-arbit^2.E-f3
FAIL
600
vis.prodcell^04.E-f2
FAIL
600
vis.prodcell^10.E-f3
FAIL
600
vis.prodcell^22.E-f4
FAIL
600
eijk.S1423.S-f3
FAIL
600
eijk.S298.S-f4
FAIL
600
eijk.S820.S-f4
FAIL
600
ken.flash^05.C-f3
FAIL
600
nusmv.brp.B-f4
FAIL
600
nusmv.guidance^5.C-f4
FAIL
600
nusmv.reactor^7.C-f3
FAIL
600
nusmv.tcas^2.B-f3
FAIL
600
nusmv.tcas^6.B-f4
FAIL
600
texas.PI_main^12.E-f4
FAIL
600
texas.two_proc^2.E-f3
FAIL
600
vis.4-arbit^2.E-f4
FAIL
600
vis.prodcell^19.E-f2
FAIL
600
vis.prodcell^23.E-f2
FAIL
600
eijk.S1423.S-f4
FAIL
600
eijk.S526.S-f3
FAIL
600
irst.dme6.B-f3
FAIL
600
nusmv.dme1-16.B-f2
FAIL
600
nusmv.guidance^7.C-f4
FAIL
600
nusmv.reactor^7.C-f4
FAIL
600
nusmv.tcas^3.B-f2
FAIL
600
nusmv.tcas-t^3.B-f2
FAIL
600
texas.PI_main^05.E-f2
FAIL
600
texas.PI_main^13.E-f3
FAIL
600
texas.two_proc^3.E-f4
FAIL
600
vis.elevator^2.E-f3
FAIL
600
vis.prodcell^23.E-f3
FAIL
600
cmu.periodic.N-f4
FAIL
600
eijk.S526.S-f4
FAIL
600
eijk.S832.S-f3
FAIL
600
ken.flash^01.C-f4
FAIL
600
ken.flash^07.C-f3
FAIL
600
ken.flash^11.C-f3
FAIL
600
nusmv.dme2-16.B-f2
FAIL
600
nusmv.guidance^9.C-f3
FAIL
600
nusmv.reactor^4.C-f3
FAIL
600
nusmv.syncarb10^2.B-f3
FAIL
600
nusmv.tcas^3.B-f4
FAIL
600
nusmv.tcas-t^4.B-f4
FAIL
600
texas.PI_main^05.E-f3
FAIL
600
texas.two_proc^5.E-f3
FAIL
600
vis.elevator^2.E-f4
FAIL
600
vis.prodcell^07.E-f2
FAIL
600
vis.prodcell^23.E-f4
FAIL
600
cmu.dme1.B-f3
FAIL
600
eijk.bs1512.S-f3
FAIL
600
eijk.S5378.S-f2
FAIL
600
eijk.S838.S-f3
FAIL
600
ken.flash^07.C-f4
FAIL
600
ken.flash^11.C-f4
FAIL
600
nusmv.dme2-16.B-f3
FAIL
600
nusmv.reactor^4.C-f4
FAIL
600
nusmv.tcas^4.B-f3
FAIL
600
texas.PI_main^05.E-f4
FAIL
600
texas.PI_main^15.E-f3
FAIL
600
vis.bakery.E-f4
FAIL
600
vis.prodcell^07.E-f4
FAIL
600
vis.prodcell^24.E-f2
FAIL
600
cmu.dme2.B-f4
FAIL
600
eijk.bs3271.S-f4
FAIL
600
eijk.S382.S-f4
FAIL
600
eijk.S641.S-f3
FAIL
600
eijk.S838.S-f4
FAIL
600
ken.flash^02.C-f4
FAIL
600
nusmv.dme2-16.B-f4
FAIL
600
nusmv.queue.B-f3
FAIL
600
nusmv.tcas^4.B-f4
FAIL
600
nusmv.tcas-t^6.B-f4
FAIL
600
texas.PI_main^08.E-f2
FAIL
600
texas.PI_main^15.E-f4
FAIL
600
vis.coherence^1.E-f4
FAIL
600
vis.prodcell^02.E-f3
FAIL
600
vis.prodcell^24.E-f3
FAIL
600
eijk.bs3330.S-f2
FAIL
600
eijk.S420.S-f4
FAIL
600
eijk.S641.S-f4
FAIL
600
ken.oop^1.C-f3
FAIL
600
nusmv.guidance^1.C-f3
FAIL
600
nusmv.queue.B-f4
FAIL
600
texas.PI_main^08.E-f3
FAIL
600
texas.PI_main^16.E-f3
FAIL
600
vis.4-arbit^1.E-f3
FAIL
600
vis.coherence^2.E-f3
FAIL
600
vis.prodcell^22.E-f2
FAIL
600
vis.prodcell^24.E-f4
FAIL
600
cmu.gigamax.B-f3
FAIL
600
eijk.bs4863.S-f2
FAIL
600
eijk.S208.S-f3
FAIL
600
nusmv.guidance^2.C-f3
FAIL
600
nusmv.reactor^2.C-f2
FAIL
600
nusmv.reactor^6.C-f4
FAIL
600
nusmv.tcas^5.B-f4
FAIL
600
texas.PI_main^11.E-f4
FAIL
600
texas.two_proc^1.E-f3
FAIL
600
vis.eisenberg.E-f3
FAIL
600
vis.prodcell^22.E-f3
FAIL
600
cmu.gigamax.B-f4
FAIL
600
eijk.S1423.S-f2
FAIL
600
eijk.S510.S-f4
FAIL
600
eijk.S820.S-f3
FAIL
600
irst.dme5.B-f3
FAIL
600
ken.flash^04.C-f2
FAIL
600
nusmv.guidance^3.C-f2
FAIL
600
nusmv.reactor^3.C-f3
FAIL
600
nusmv.tcas^2.B-f2
FAIL
600
nusmv.tcas^6.B-f3
FAIL
600
Contact
|
Organization
|
Links
|
Citing QBFLIB