QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family tipfixpoint solved by
AQME-1NN
QBFEVAL'07
Instance
Result
Time
texas.parsesys^3.E-f2
SAT
0.58
vis.prodcell^21.E-f2
UNSAT
0.66
texas.ifetch1^3.E-f2
UNSAT
0.73
texas.ifetch1^2.E-f2
UNSAT
0.76
texas.ifetch1^1.E-f3
UNSAT
0.92
texas.ifetch1^8.E-f4
SAT
1.05
texas.parsesys^4.E-f3
UNSAT
1.11
texas.ifetch1^8.E-f2
SAT
1.14
texas.ifetch1^4.E-f4
UNSAT
1.14
vis.emodel.E-f4
UNSAT
1.2
texas.ifetch1^1.E-f4
UNSAT
1.2
texas.ifetch1^9.E-f4
SAT
1.36
texas.ifetch1^3.E-f4
UNSAT
1.48
texas.ifetch1^7.E-f2
SAT
1.52
texas.parsesys^4.E-f4
UNSAT
1.62
texas.PI_main^01.E-f2
SAT
1.71
vis.prodcell^04.E-f3
UNSAT
1.73
texas.PI_main^14.E-f3
UNSAT
1.74
nusmv.reactor^3.C-f4
UNSAT
1.81
texas.ifetch1^5.E-f2
SAT
2.03
ken.flash^10.C-f2
UNSAT
2.08
eijk.S344.S-f2
SAT
2.32
vis.prodcell^08.E-f3
UNSAT
2.44
texas.two_proc^6.E-f2
SAT
2.55
vis.prodcell^04.E-f4
UNSAT
2.68
ken.flash^03.C-f4
UNSAT
2.76
eijk.S208o.S-f3
SAT
2.9
ken.flash^09.C-f2
UNSAT
3.06
texas.ifetch1^2.E-f3
UNSAT
3.07
texas.ifetch1^9.E-f2
SAT
3.55
nusmv.brp.B-f2
SAT
3.9
ken.flash^09.C-f4
UNSAT
4.68
eijk.S208c.S-f2
SAT
6.34
texas.parsesys^2.E-f2
UNSAT
6.38
ken.oop^1.C-f2
SAT
6.79
ken.oop^2.C-f2
SAT
6.96
eijk.S526.S-f2
SAT
9.74
eijk.S444.S-f2
SAT
10.14
nusmv.reactor^6.C-f2
SAT
14.19
eijk.S208.S-f2
SAT
14.79
eijk.S208o.S-f2
SAT
16.04
ken.flash^10.C-f4
UNSAT
26.7
vis.elevator^1.E-f3
UNSAT
43.03
ken.flash^06.C-f2
UNSAT
44.71
vis.elevator^1.E-f4
UNSAT
44.97
vis.prodcell^21.E-f3
UNSAT
46.56
ken.flash^08.C-f3
UNSAT
48.43
vis.prodcell^21.E-f4
UNSAT
53.36
vis.prodcell^20.E-f4
UNSAT
56.65
ken.flash^03.C-f3
UNSAT
63.69
nusmv.reactor^5.C-f4
UNSAT
66.58
vis.prodcell^03.E-f3
UNSAT
66.69
ken.flash^08.C-f4
UNSAT
69.42
vis.prodcell^02.E-f4
UNSAT
75.01
nusmv.syncarb5^2.B-f4
SAT
85.24
vis.prodcell^09.E-f4
UNSAT
85.98
vis.prodcell^08.E-f4
UNSAT
90.14
nusmv.tcas^1.B-f4
FAIL
101.41
cmu.periodic.N-f2
SAT
104.63
texas.parsesys^3.E-f4
SAT
122.58
eijk.S298.S-f2
SAT
158.14
vis.arbiter.E-f3
FAIL
159.23
nusmv.syncarb5^2.B-f3
SAT
161.5
ken.flash^02.C-f2
SAT
163.57
cmu.gigamax.B-f2
SAT
164.65
nusmv.tcas^1.B-f2
SAT
165.09
nusmv.tcas-t^6.B-f2
SAT
165.89
cmu.periodic.N-f3
SAT
167.8
irst.dme4.B-f2
FAIL
206.35
vis.4-arbit^1.E-f2
SAT
213.04
irst.dme5.B-f2
FAIL
213.34
nusmv.reactor^4.C-f2
FAIL
217.72
nusmv.reactor^7.C-f2
FAIL
218.03
vis.arbiter.E-f2
SAT
221.01
eijk.S382.S-f2
FAIL
242.58
eijk.S349.S-f2
FAIL
259.46
eijk.S208.S-f3
SAT
267.52
vis.4-arbit^2.E-f2
SAT
284.11
irst.dme6.B-f2
FAIL
299.44
eijk.S832.S-f2
FAIL
305.63
eijk.S820.S-f2
FAIL
408.75
vis.prodcell^24.E-f2
FAIL
600
cmu.dme2.B-f4
FAIL
600
eijk.bs3271.S-f4
FAIL
600
eijk.S382.S-f4
FAIL
600
eijk.S641.S-f3
FAIL
600
eijk.S838.S-f4
FAIL
600
ken.flash^02.C-f4
FAIL
600
nusmv.dme2-16.B-f4
FAIL
600
nusmv.queue.B-f3
FAIL
600
nusmv.tcas^4.B-f4
FAIL
600
nusmv.tcas-t^6.B-f4
FAIL
600
texas.parsesys^2.E-f4
FAIL
600
texas.PI_main^05.E-f4
FAIL
600
texas.PI_main^15.E-f3
FAIL
600
vis.bakery.E-f4
FAIL
600
vis.prodcell^07.E-f4
FAIL
600
vis.prodcell^24.E-f3
FAIL
600
eijk.bs3330.S-f2
FAIL
600
eijk.S420.S-f4
FAIL
600
eijk.S641.S-f4
FAIL
600
ken.oop^1.C-f3
FAIL
600
nusmv.guidance^1.C-f3
FAIL
600
nusmv.queue.B-f4
FAIL
600
nusmv.tcas^5.B-f2
FAIL
600
texas.PI_main^08.E-f2
FAIL
600
texas.PI_main^15.E-f4
FAIL
600
vis.coherence^1.E-f4
FAIL
600
vis.prodcell^02.E-f3
FAIL
600
vis.prodcell^22.E-f2
FAIL
600
vis.prodcell^24.E-f4
FAIL
600
cmu.gigamax.B-f3
FAIL
600
eijk.bs4863.S-f2
FAIL
600
nusmv.guidance^2.C-f3
FAIL
600
nusmv.reactor^2.C-f2
FAIL
600
nusmv.reactor^6.C-f4
FAIL
600
nusmv.tcas^5.B-f4
FAIL
600
texas.PI_main^08.E-f3
FAIL
600
texas.PI_main^16.E-f3
FAIL
600
vis.4-arbit^1.E-f3
FAIL
600
vis.coherence^2.E-f3
FAIL
600
vis.prodcell^22.E-f3
FAIL
600
cmu.gigamax.B-f4
FAIL
600
eijk.S1423.S-f2
FAIL
600
eijk.S510.S-f4
FAIL
600
eijk.S820.S-f3
FAIL
600
irst.dme5.B-f3
FAIL
600
ken.flash^04.C-f2
FAIL
600
nusmv.guidance^3.C-f2
FAIL
600
nusmv.reactor^3.C-f3
FAIL
600
nusmv.tcas^2.B-f2
FAIL
600
nusmv.tcas^6.B-f3
FAIL
600
texas.PI_main^11.E-f4
FAIL
600
texas.two_proc^1.E-f3
FAIL
600
vis.eisenberg.E-f3
FAIL
600
vis.prodcell^22.E-f4
FAIL
600
eijk.S1423.S-f3
FAIL
600
eijk.S298.S-f4
FAIL
600
eijk.S820.S-f4
FAIL
600
ken.flash^05.C-f3
FAIL
600
nusmv.brp.B-f4
FAIL
600
nusmv.guidance^5.C-f4
FAIL
600
nusmv.reactor^7.C-f3
FAIL
600
nusmv.tcas^2.B-f3
FAIL
600
nusmv.tcas^6.B-f4
FAIL
600
texas.PI_main^12.E-f3
FAIL
600
texas.two_proc^1.E-f4
FAIL
600
vis.4-arbit^2.E-f3
FAIL
600
vis.prodcell^04.E-f2
FAIL
600
vis.prodcell^10.E-f3
FAIL
600
vis.prodcell^23.E-f2
FAIL
600
eijk.S1423.S-f4
FAIL
600
eijk.S526.S-f3
FAIL
600
irst.dme6.B-f3
FAIL
600
nusmv.dme1-16.B-f2
FAIL
600
nusmv.guidance^7.C-f4
FAIL
600
nusmv.reactor^7.C-f4
FAIL
600
nusmv.tcas^3.B-f2
FAIL
600
nusmv.tcas-t^3.B-f2
FAIL
600
texas.PI_main^12.E-f4
FAIL
600
texas.two_proc^2.E-f3
FAIL
600
vis.4-arbit^2.E-f4
FAIL
600
vis.prodcell^19.E-f2
FAIL
600
vis.prodcell^23.E-f3
FAIL
600
cmu.periodic.N-f4
FAIL
600
eijk.S526.S-f4
FAIL
600
eijk.S832.S-f3
FAIL
600
ken.flash^01.C-f4
FAIL
600
ken.flash^07.C-f3
FAIL
600
ken.flash^11.C-f3
FAIL
600
nusmv.dme2-16.B-f2
FAIL
600
nusmv.guidance^9.C-f3
FAIL
600
nusmv.reactor^4.C-f3
FAIL
600
nusmv.syncarb10^2.B-f3
FAIL
600
nusmv.tcas^3.B-f4
FAIL
600
nusmv.tcas-t^4.B-f4
FAIL
600
texas.parsesys^1.E-f3
FAIL
600
texas.PI_main^05.E-f2
FAIL
600
texas.PI_main^13.E-f3
FAIL
600
texas.two_proc^3.E-f4
FAIL
600
vis.elevator^2.E-f3
FAIL
600
vis.prodcell^23.E-f4
FAIL
600
cmu.dme1.B-f3
FAIL
600
eijk.bs1512.S-f3
FAIL
600
eijk.S5378.S-f2
FAIL
600
eijk.S838.S-f3
FAIL
600
ken.flash^07.C-f4
FAIL
600
ken.flash^11.C-f4
FAIL
600
nusmv.dme2-16.B-f3
FAIL
600
nusmv.queue.B-f2
FAIL
600
nusmv.reactor^4.C-f4
FAIL
600
nusmv.tcas^4.B-f3
FAIL
600
texas.PI_main^05.E-f3
FAIL
600
texas.two_proc^5.E-f3
FAIL
600
vis.elevator^2.E-f4
FAIL
600
vis.prodcell^07.E-f2
FAIL
600
Contact
|
Organization
|
Links
|
Citing QBFLIB