QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family tipfixpoint solved by
AQME-RIPPER
QBFEVAL'07
Instance
Result
Time
texas.parsesys^4.E-f3
UNSAT
0.68
texas.parsesys^3.E-f2
SAT
0.7
texas.ifetch1^3.E-f2
UNSAT
0.84
texas.ifetch1^2.E-f2
UNSAT
0.85
vis.elevator^1.E-f3
UNSAT
0.88
texas.ifetch1^1.E-f3
UNSAT
1.05
texas.ifetch1^8.E-f4
SAT
1.12
texas.ifetch1^4.E-f4
UNSAT
1.28
vis.emodel.E-f4
UNSAT
1.28
texas.ifetch1^8.E-f2
SAT
1.29
texas.ifetch1^1.E-f4
UNSAT
1.34
texas.ifetch1^9.E-f4
SAT
1.44
texas.ifetch1^7.E-f2
SAT
1.6
texas.ifetch1^3.E-f4
UNSAT
1.6
texas.parsesys^4.E-f4
UNSAT
1.7
vis.prodcell^21.E-f2
UNSAT
1.92
texas.ifetch1^5.E-f2
SAT
2.2
ken.flash^10.C-f4
UNSAT
2.26
ken.flash^06.C-f2
UNSAT
2.28
eijk.S344.S-f2
SAT
2.41
texas.two_proc^6.E-f2
SAT
2.62
cmu.periodic.N-f2
SAT
3.01
texas.ifetch1^2.E-f3
UNSAT
3.19
nusmv.reactor^3.C-f4
UNSAT
3.3
vis.elevator^1.E-f4
UNSAT
3.62
texas.ifetch1^9.E-f2
SAT
3.72
nusmv.reactor^5.C-f4
UNSAT
3.92
nusmv.brp.B-f2
SAT
3.98
nusmv.tcas^1.B-f2
SAT
4.02
cmu.periodic.N-f3
SAT
4.04
vis.prodcell^04.E-f3
UNSAT
4.27
ken.flash^08.C-f3
UNSAT
4.52
eijk.S208c.S-f2
SAT
6.42
texas.parsesys^2.E-f2
UNSAT
6.57
ken.oop^1.C-f2
SAT
6.92
ken.flash^08.C-f4
UNSAT
6.97
ken.oop^2.C-f2
SAT
7.15
vis.prodcell^04.E-f4
UNSAT
8.82
ken.flash^10.C-f2
UNSAT
9.33
eijk.S526.S-f2
SAT
9.56
eijk.S444.S-f2
SAT
10.16
ken.flash^09.C-f2
UNSAT
10.2
vis.prodcell^08.E-f3
UNSAT
11.45
nusmv.reactor^6.C-f2
SAT
14.13
vis.prodcell^20.E-f4
UNSAT
14.15
ken.flash^03.C-f3
UNSAT
14.73
eijk.S208.S-f2
SAT
14.9
eijk.S208o.S-f2
SAT
16.19
nusmv.tcas^1.B-f4
SAT
17.47
vis.prodcell^08.E-f4
UNSAT
18.76
ken.flash^03.C-f4
UNSAT
24.14
vis.prodcell^21.E-f3
UNSAT
46.62
vis.prodcell^21.E-f4
UNSAT
53.35
vis.prodcell^03.E-f3
UNSAT
66.81
vis.prodcell^02.E-f4
UNSAT
75.2
texas.PI_main^14.E-f3
UNSAT
76.39
nusmv.syncarb5^2.B-f4
SAT
85.4
vis.prodcell^09.E-f4
UNSAT
86.18
ken.flash^09.C-f4
UNSAT
93.53
texas.parsesys^3.E-f4
SAT
122.54
texas.PI_main^01.E-f2
SAT
142.38
eijk.S298.S-f2
SAT
158.26
vis.arbiter.E-f3
FAIL
159.49
nusmv.syncarb5^2.B-f3
SAT
161.59
eijk.S208o.S-f3
SAT
163.24
ken.flash^02.C-f2
SAT
163.7
cmu.gigamax.B-f2
SAT
164.77
nusmv.tcas-t^6.B-f2
SAT
165.89
nusmv.queue.B-f2
FAIL
199.6
texas.PI_main^08.E-f3
FAIL
206.01
irst.dme4.B-f2
FAIL
206.54
nusmv.tcas^5.B-f2
FAIL
210.82
texas.PI_main^11.E-f4
FAIL
211.81
texas.PI_main^05.E-f4
FAIL
213.06
vis.4-arbit^1.E-f2
SAT
213.07
irst.dme5.B-f2
FAIL
214.24
nusmv.reactor^7.C-f2
FAIL
217.94
nusmv.reactor^4.C-f2
FAIL
218.71
vis.arbiter.E-f2
SAT
221.22
texas.PI_main^15.E-f4
FAIL
222.06
vis.prodcell^07.E-f4
FAIL
223.51
texas.PI_main^13.E-f3
FAIL
232.05
vis.prodcell^10.E-f3
FAIL
234.77
texas.PI_main^05.E-f3
FAIL
234.84
eijk.S382.S-f2
FAIL
242.62
texas.PI_main^16.E-f3
FAIL
248.81
vis.elevator^2.E-f3
FAIL
253.08
eijk.S349.S-f2
FAIL
258.13
eijk.S208.S-f3
SAT
268.42
vis.4-arbit^2.E-f2
SAT
283.63
irst.dme6.B-f2
FAIL
297.58
vis.bakery.E-f4
FAIL
298.17
eijk.S832.S-f2
FAIL
305.54
eijk.S820.S-f2
FAIL
408.77
cmu.periodic.N-f4
FAIL
526.16
texas.two_proc^1.E-f3
FAIL
600
vis.eisenberg.E-f3
FAIL
600
vis.prodcell^22.E-f3
FAIL
600
cmu.gigamax.B-f4
FAIL
600
eijk.S1423.S-f2
FAIL
600
eijk.S510.S-f4
FAIL
600
eijk.S820.S-f3
FAIL
600
irst.dme5.B-f3
FAIL
600
ken.flash^04.C-f2
FAIL
600
nusmv.guidance^3.C-f2
FAIL
600
nusmv.reactor^3.C-f3
FAIL
600
nusmv.tcas^2.B-f2
FAIL
600
nusmv.tcas^6.B-f3
FAIL
600
texas.PI_main^12.E-f3
FAIL
600
texas.two_proc^1.E-f4
FAIL
600
vis.4-arbit^2.E-f3
FAIL
600
vis.prodcell^04.E-f2
FAIL
600
vis.prodcell^22.E-f4
FAIL
600
eijk.S1423.S-f3
FAIL
600
eijk.S298.S-f4
FAIL
600
eijk.S820.S-f4
FAIL
600
ken.flash^05.C-f3
FAIL
600
nusmv.brp.B-f4
FAIL
600
nusmv.guidance^5.C-f4
FAIL
600
nusmv.reactor^7.C-f3
FAIL
600
nusmv.tcas^2.B-f3
FAIL
600
nusmv.tcas^6.B-f4
FAIL
600
texas.PI_main^12.E-f4
FAIL
600
texas.two_proc^2.E-f3
FAIL
600
vis.4-arbit^2.E-f4
FAIL
600
vis.prodcell^19.E-f2
FAIL
600
vis.prodcell^23.E-f2
FAIL
600
eijk.S1423.S-f4
FAIL
600
eijk.S526.S-f3
FAIL
600
irst.dme6.B-f3
FAIL
600
nusmv.dme1-16.B-f2
FAIL
600
nusmv.guidance^7.C-f4
FAIL
600
nusmv.reactor^7.C-f4
FAIL
600
nusmv.tcas^3.B-f2
FAIL
600
nusmv.tcas-t^3.B-f2
FAIL
600
texas.parsesys^1.E-f3
FAIL
600
texas.PI_main^05.E-f2
FAIL
600
texas.two_proc^3.E-f4
FAIL
600
vis.prodcell^23.E-f3
FAIL
600
eijk.S526.S-f4
FAIL
600
eijk.S832.S-f3
FAIL
600
ken.flash^01.C-f4
FAIL
600
ken.flash^07.C-f3
FAIL
600
ken.flash^11.C-f3
FAIL
600
nusmv.dme2-16.B-f2
FAIL
600
nusmv.guidance^9.C-f3
FAIL
600
nusmv.reactor^4.C-f3
FAIL
600
nusmv.syncarb10^2.B-f3
FAIL
600
nusmv.tcas^3.B-f4
FAIL
600
nusmv.tcas-t^4.B-f4
FAIL
600
texas.two_proc^5.E-f3
FAIL
600
vis.elevator^2.E-f4
FAIL
600
vis.prodcell^07.E-f2
FAIL
600
vis.prodcell^23.E-f4
FAIL
600
cmu.dme1.B-f3
FAIL
600
eijk.bs1512.S-f3
FAIL
600
eijk.S5378.S-f2
FAIL
600
eijk.S838.S-f3
FAIL
600
ken.flash^07.C-f4
FAIL
600
ken.flash^11.C-f4
FAIL
600
nusmv.dme2-16.B-f3
FAIL
600
nusmv.reactor^4.C-f4
FAIL
600
nusmv.tcas^4.B-f3
FAIL
600
nusmv.tcas-t^6.B-f4
FAIL
600
texas.parsesys^2.E-f4
FAIL
600
texas.PI_main^15.E-f3
FAIL
600
vis.prodcell^24.E-f2
FAIL
600
cmu.dme2.B-f4
FAIL
600
eijk.bs3271.S-f4
FAIL
600
eijk.S382.S-f4
FAIL
600
eijk.S641.S-f3
FAIL
600
eijk.S838.S-f4
FAIL
600
ken.flash^02.C-f4
FAIL
600
nusmv.dme2-16.B-f4
FAIL
600
nusmv.queue.B-f3
FAIL
600
nusmv.tcas^4.B-f4
FAIL
600
texas.PI_main^08.E-f2
FAIL
600
vis.coherence^1.E-f4
FAIL
600
vis.prodcell^02.E-f3
FAIL
600
vis.prodcell^24.E-f3
FAIL
600
eijk.bs3330.S-f2
FAIL
600
eijk.S420.S-f4
FAIL
600
eijk.S641.S-f4
FAIL
600
ken.oop^1.C-f3
FAIL
600
nusmv.guidance^1.C-f3
FAIL
600
nusmv.queue.B-f4
FAIL
600
vis.4-arbit^1.E-f3
FAIL
600
vis.coherence^2.E-f3
FAIL
600
vis.prodcell^22.E-f2
FAIL
600
vis.prodcell^24.E-f4
FAIL
600
cmu.gigamax.B-f3
FAIL
600
eijk.bs4863.S-f2
FAIL
600
nusmv.guidance^2.C-f3
FAIL
600
nusmv.reactor^2.C-f2
FAIL
600
nusmv.reactor^6.C-f4
FAIL
600
nusmv.tcas^5.B-f4
FAIL
600
Contact
|
Organization
|
Links
|
Citing QBFLIB