QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Sota solver results for family tipfixpoint
QBFEVAL'08
Instance
Solver
Result
Time
cmu.gigamax.B-f2
AQME-1NN
SAT
5.15
cmu.gigamax.B-f3
AQME-1NN
UNSAT
247.38
cmu.periodic.N-f2
QuBE6.1
SAT
1.63
cmu.periodic.N-f3
QuBE6.1
SAT
43.01
eijk.bs3271.S-f2
QuBE6.1
SAT
0.7
eijk.bs3271.S-f3
QuBE6.1
SAT
1.43
eijk.bs4863.S-f2
QuBE6.1
SAT
88.21
eijk.S1196.S-f4
AQME-1NN
UNSAT
78.71
eijk.S1238.S-f4
AQME-1NN
UNSAT
5.2
eijk.S208.S-f2
QuBE6.1
SAT
0.94
eijk.S208.S-f3
ssolve-A
SAT
44.77
eijk.S208.S-f4
ssolve-A
SAT
22.02
eijk.S208c.S-f2
QuBE6.1
SAT
0.58
eijk.S208c.S-f3
ssolve-A
SAT
2.86
eijk.S208c.S-f4
AQME-1NN
SAT
15.87
eijk.S208o.S-f2
QuBE6.1
SAT
0.12
eijk.S208o.S-f3
ssolveC
SAT
0.5
eijk.S208o.S-f4
QuBE6.1
SAT
4.63
eijk.S298.S-f2
QuBE6.1
SAT
0.08
eijk.S298.S-f3
QuBE6.1
SAT
5.96
eijk.S344.S-f2
QuBE6.1
SAT
0.12
eijk.S344.S-f4
QuBE6.1
SAT
0.7
eijk.S349.S-f2
QuBE6.1
SAT
0.22
eijk.S349.S-f4
QuBE6.1
SAT
3.9
eijk.S382.S-f2
QuBE6.1
SAT
0.11
eijk.S382.S-f3
QuBE6.1
SAT
31.94
eijk.S444.S-f2
QuBE6.1
SAT
0.14
eijk.S444.S-f3
QuBE6.1
SAT
3.03
eijk.S526.S-f2
QuBE6.1
SAT
0.12
eijk.S526.S-f3
QuBE6.1
SAT
0.33
eijk.S526.S-f4
QuBE6.1
SAT
1
eijk.S820.S-f2
QuBE6.1
SAT
18.74
eijk.S832.S-f2
QuBE6.1
SAT
209.21
irst.dme4.B-f2
QuBE6.1
SAT
0.34
irst.dme5.B-f2
QuBE6.1
SAT
0.3
irst.dme6.B-f2
QuBE6.1
SAT
1.67
ken.flash^02.C-f2
AQME-1NN
SAT
3.46
ken.flash^02.C-f3
AQME-1NN
SAT
9.34
ken.flash^03.C-f2
QuBE6.1
UNSAT
0.72
ken.flash^03.C-f3
QuBE6.1
UNSAT
1.23
ken.flash^03.C-f4
QuBE6.1
UNSAT
1.95
ken.flash^06.C-f2
QuBE6.1
UNSAT
0.28
ken.flash^06.C-f3
QuBE6.1
UNSAT
0.48
ken.flash^06.C-f4
QuBE6.1
UNSAT
0.72
ken.flash^08.C-f2
QuBE6.1
UNSAT
0.33
ken.flash^08.C-f3
QuBE6.1
UNSAT
0.57
ken.flash^08.C-f4
QuBE6.1
UNSAT
0.88
ken.flash^09.C-f2
QuBE6.1
UNSAT
1.06
ken.flash^09.C-f3
QuBE6.1
UNSAT
1.81
ken.flash^09.C-f4
QuBE6.1
UNSAT
2.84
ken.flash^10.C-f2
quantor3.0
UNSAT
0.09
ken.flash^10.C-f3
quantor3.0
UNSAT
0.13
ken.flash^10.C-f4
quantor3.0
UNSAT
0.19
ken.flash^12.C-f2
QuBE6.1
SAT
132.72
ken.oop^1.C-f2
QuBE6.1
SAT
0.12
ken.oop^2.C-f2
QuBE6.1
SAT
0.17
nusmv.brp.B-f2
QuBE6.1
SAT
0.11
nusmv.dme2-16.B-f2
QuBE6.1
SAT
2.85
nusmv.guidance^1.C-f2
QuBE6.1
SAT
21.57
nusmv.guidance^2.C-f2
QuBE6.1
SAT
0.62
nusmv.guidance^2.C-f3
QuBE6.1
SAT
171.45
nusmv.guidance^3.C-f2
QuBE6.1
SAT
0.55
nusmv.guidance^3.C-f3
QuBE6.1
SAT
23.6
nusmv.guidance^4.C-f2
QuBE6.1
SAT
2.27
nusmv.guidance^4.C-f3
QuBE6.1
SAT
528.63
nusmv.guidance^5.C-f2
QuBE6.1
SAT
0.57
nusmv.guidance^5.C-f3
QuBE6.1
SAT
123.75
nusmv.guidance^6.C-f2
QuBE6.1
SAT
0.97
nusmv.guidance^6.C-f3
QuBE6.1
SAT
53.39
nusmv.guidance^7.C-f2
QuBE6.1
SAT
0.75
nusmv.guidance^7.C-f3
QuBE6.1
SAT
67.09
nusmv.guidance^8.C-f2
QuBE6.1
SAT
0.56
nusmv.guidance^8.C-f3
QuBE6.1
SAT
120.25
nusmv.guidance^9.C-f2
QuBE6.1
SAT
0.57
nusmv.guidance^9.C-f3
QuBE6.1
SAT
63.69
nusmv.queue.B-f2
QuBE6.1
SAT
16.09
nusmv.reactor^2.C-f2
QuBE6.1
SAT
2.51
nusmv.reactor^2.C-f3
QuBE6.1
SAT
25.25
nusmv.reactor^3.C-f2
QuBE6.1
SAT
3.35
nusmv.reactor^3.C-f3
QuBE6.1
SAT
64.37
nusmv.reactor^3.C-f4
quantor3.0
UNSAT
0.05
nusmv.reactor^4.C-f2
QuBE6.1
SAT
0.42
nusmv.reactor^4.C-f3
QuBE6.1
SAT
17.72
nusmv.reactor^5.C-f2
QuBE6.1
UNSAT
0.25
nusmv.reactor^5.C-f3
QuBE6.1
UNSAT
0.42
nusmv.reactor^5.C-f4
QuBE6.1
UNSAT
0.71
nusmv.reactor^6.C-f2
QuBE6.1
SAT
0.75
nusmv.reactor^6.C-f3
QuBE6.1
SAT
15.93
nusmv.reactor^7.C-f2
QuBE6.1
SAT
0.52
nusmv.reactor^7.C-f3
QuBE6.1
SAT
15.47
nusmv.syncarb5^2.B-f2
QuBE6.1
SAT
0.86
nusmv.syncarb5^2.B-f3
QuBE6.1
SAT
1.28
nusmv.syncarb5^2.B-f4
QuBE6.1
SAT
1.64
nusmv.tcas-t^1.B-f2
QuBE6.1
SAT
98.6
nusmv.tcas-t^6.B-f2
QuBE6.1
SAT
6.56
nusmv.tcas-t^6.B-f3
AQME-1NN
SAT
4.84
nusmv.tcas^1.B-f2
QuBE6.1
SAT
97.47
nusmv.tcas^2.B-f2
QuBE6.1
SAT
539.52
texas.ifetch1^1.E-f2
QuBE6.1
UNSAT
0.08
texas.ifetch1^1.E-f3
QuBE6.1
UNSAT
0.12
texas.ifetch1^1.E-f4
QuBE6.1
UNSAT
0.18
texas.ifetch1^2.E-f2
QuBE6.1
UNSAT
0.09
texas.ifetch1^2.E-f3
QuBE6.1
UNSAT
0.14
texas.ifetch1^2.E-f4
QuBE6.1
UNSAT
0.28
texas.ifetch1^3.E-f2
QuBE6.1
UNSAT
0.08
texas.ifetch1^3.E-f3
QuBE6.1
UNSAT
0.13
texas.ifetch1^3.E-f4
QuBE6.1
UNSAT
0.19
texas.ifetch1^4.E-f2
quantor3.0
UNSAT
0.01
texas.ifetch1^4.E-f3
quantor3.0
UNSAT
0.02
texas.ifetch1^4.E-f4
quantor3.0
UNSAT
0.02
texas.ifetch1^5.E-f2
QuBE6.1
SAT
0.1
texas.ifetch1^5.E-f3
QuBE6.1
SAT
0.14
texas.ifetch1^5.E-f4
QuBE6.1
SAT
0.17
texas.ifetch1^7.E-f2
QuBE6.1
SAT
0.09
texas.ifetch1^7.E-f3
QuBE6.1
SAT
0.12
texas.ifetch1^7.E-f4
QuBE6.1
SAT
0.17
texas.ifetch1^8.E-f2
QuBE6.1
SAT
0.08
texas.ifetch1^8.E-f3
QuBE6.1
SAT
0.1
texas.ifetch1^8.E-f4
QuBE6.1
SAT
0.14
texas.ifetch1^9.E-f2
QuBE6.1
SAT
0.09
texas.ifetch1^9.E-f3
QuBE6.1
SAT
0.12
texas.ifetch1^9.E-f4
QuBE6.1
SAT
0.18
texas.parsesys^1.E-f2
QuBE6.1
SAT
0.12
texas.parsesys^1.E-f3
QuBE6.1
SAT
0.62
texas.parsesys^1.E-f4
QuBE6.1
SAT
4
texas.parsesys^2.E-f2
quantor3.0
UNSAT
2.8
texas.parsesys^2.E-f3
QuBE6.1
UNSAT
19.04
texas.parsesys^2.E-f4
QuBE6.1
UNSAT
51.42
texas.parsesys^3.E-f2
quantor3.0
SAT
0.14
texas.parsesys^3.E-f3
QuBE6.1
SAT
0.56
texas.parsesys^3.E-f4
AQME-1NN
SAT
6.74
texas.parsesys^4.E-f2
quantor3.0
UNSAT
0.01
texas.parsesys^4.E-f3
quantor3.0
UNSAT
0.02
texas.parsesys^4.E-f4
quantor3.0
UNSAT
0.03
texas.PI_main^01.E-f2
QuBE6.1
SAT
0.24
texas.PI_main^02.E-f2
QuBE6.1
SAT
20.85
texas.PI_main^03.E-f2
QuBE6.1
SAT
0.28
texas.PI_main^05.E-f2
QuBE6.1
SAT
19.46
texas.PI_main^08.E-f2
QuBE6.1
SAT
21.08
texas.PI_main^10.E-f2
QuBE6.1
SAT
0.25
texas.PI_main^13.E-f2
QuBE6.1
SAT
0.36
texas.PI_main^14.E-f2
QuBE6.1
UNSAT
0.4
texas.PI_main^14.E-f3
QuBE6.1
UNSAT
1.04
texas.PI_main^14.E-f4
AQME-1NN
UNSAT
4.59
texas.PI_main^16.E-f2
QuBE6.1
SAT
0.18
texas.two_proc^1.E-f2
QuBE6.1
SAT
0.18
texas.two_proc^1.E-f3
QuBE6.1
SAT
102.29
texas.two_proc^2.E-f2
QuBE6.1
SAT
0.26
texas.two_proc^2.E-f3
QuBE6.1
SAT
161.14
texas.two_proc^3.E-f2
QuBE6.1
SAT
0.29
texas.two_proc^3.E-f3
QuBE6.1
SAT
103.97
texas.two_proc^4.E-f2
QuBE6.1
SAT
0.64
texas.two_proc^4.E-f3
QuBE6.1
SAT
213.6
texas.two_proc^5.E-f2
QuBE6.1
SAT
0.17
texas.two_proc^5.E-f3
QuBE6.1
SAT
185.44
texas.two_proc^6.E-f2
QuBE6.1
SAT
0.16
texas.two_proc^6.E-f3
QuBE6.1
SAT
83.1
vis.4-arbit^1.E-f2
QuBE6.1
SAT
0.13
vis.4-arbit^1.E-f3
QuBE6.1
SAT
77.1
vis.4-arbit^2.E-f2
QuBE6.1
SAT
0.35
vis.4-arbit^2.E-f3
QuBE6.1
SAT
42.16
vis.arbiter.E-f2
QuBE6.1
SAT
1.6
vis.arbiter.E-f3
QuBE6.1
SAT
27.52
vis.arbiter.E-f4
QuBE6.1
SAT
340.75
vis.bakery.E-f2
QuBE6.1
SAT
0.22
vis.bakery.E-f3
QuBE6.1
SAT
10.03
vis.coherence^1.E-f2
QuBE6.1
SAT
2.67
vis.coherence^2.E-f2
QuBE6.1
SAT
5.88
vis.coherence^3.E-f2
QuBE6.1
SAT
1.99
vis.coherence^5.E-f2
QuBE6.1
SAT
9.62
vis.eisenberg.E-f2
QuBE6.1
SAT
0.27
vis.eisenberg.E-f3
QuBE6.1
SAT
4.19
vis.eisenberg.E-f4
QuBE6.1
SAT
53.48
vis.elevator^1.E-f2
QuBE6.1
UNSAT
0.16
vis.elevator^1.E-f3
QuBE6.1
UNSAT
0.29
vis.elevator^1.E-f4
QuBE6.1
UNSAT
0.45
vis.elevator^2.E-f2
QuBE6.1
SAT
12.22
vis.emodel.E-f2
QuBE6.1
UNSAT
0.08
vis.emodel.E-f3
QuBE6.1
UNSAT
0.12
vis.emodel.E-f4
QuBE6.1
UNSAT
0.16
vis.prodcell^01.E-f2
QuBE6.1
SAT
39.09
vis.prodcell^01.E-f4
QuBE6.1
UNSAT
0.87
vis.prodcell^02.E-f2
QuBE6.1
SAT
101.87
vis.prodcell^02.E-f4
QuBE6.1
UNSAT
0.98
vis.prodcell^03.E-f2
QuBE6.1
SAT
52.9
vis.prodcell^03.E-f3
QuBE6.1
UNSAT
0.56
vis.prodcell^03.E-f4
QuBE6.1
UNSAT
0.88
vis.prodcell^04.E-f2
QuBE6.1
SAT
130.21
vis.prodcell^04.E-f3
QuBE6.1
UNSAT
0.55
vis.prodcell^04.E-f4
QuBE6.1
UNSAT
0.94
vis.prodcell^05.E-f2
QuBE6.1
SAT
15.12
vis.prodcell^05.E-f3
QuBE6.1
SAT
317.88
vis.prodcell^05.E-f4
QuBE6.1
UNSAT
1.07
vis.prodcell^06.E-f2
QuBE6.1
SAT
164.76
vis.prodcell^06.E-f3
QuBE6.1
UNSAT
0.64
vis.prodcell^06.E-f4
QuBE6.1
UNSAT
1.13
vis.prodcell^07.E-f2
QuBE6.1
SAT
100.52
vis.prodcell^08.E-f2
QuBE6.1
UNSAT
0.34
vis.prodcell^08.E-f3
QuBE6.1
UNSAT
1.76
vis.prodcell^08.E-f4
QuBE6.1
UNSAT
2.67
vis.prodcell^09.E-f2
QuBE6.1
UNSAT
0.33
vis.prodcell^09.E-f3
QuBE6.1
UNSAT
0.9
vis.prodcell^09.E-f4
QuBE6.1
UNSAT
2.82
vis.prodcell^11.E-f2
QuBE6.1
UNSAT
0.35
vis.prodcell^11.E-f3
QuBE6.1
UNSAT
1.05
vis.prodcell^11.E-f4
QuBE6.1
UNSAT
2.06
vis.prodcell^12.E-f2
QuBE6.1
SAT
24.05
vis.prodcell^12.E-f3
QuBE6.1
SAT
189.49
vis.prodcell^13.E-f2
QuBE6.1
SAT
27.95
vis.prodcell^13.E-f3
QuBE6.1
SAT
281.93
vis.prodcell^14.E-f2
QuBE6.1
SAT
31.28
vis.prodcell^14.E-f3
QuBE6.1
SAT
338.79
vis.prodcell^15.E-f2
QuBE6.1
SAT
28.47
vis.prodcell^15.E-f3
QuBE6.1
SAT
280.28
vis.prodcell^16.E-f2
QuBE6.1
SAT
24.56
vis.prodcell^16.E-f3
QuBE6.1
SAT
282.38
vis.prodcell^17.E-f2
QuBE6.1
SAT
28.47
vis.prodcell^17.E-f3
QuBE6.1
SAT
371.8
vis.prodcell^18.E-f2
QuBE6.1
SAT
24.58
vis.prodcell^18.E-f3
QuBE6.1
SAT
290.15
vis.prodcell^19.E-f2
QuBE6.1
SAT
26.92
vis.prodcell^19.E-f3
QuBE6.1
SAT
242.57
vis.prodcell^20.E-f2
QuBE6.1
SAT
48.93
vis.prodcell^20.E-f3
QuBE6.1
SAT
174.7
vis.prodcell^20.E-f4
QuBE6.1
UNSAT
1.12
vis.prodcell^21.E-f2
QuBE6.1
UNSAT
0.27
vis.prodcell^21.E-f3
QuBE6.1
UNSAT
0.65
vis.prodcell^21.E-f4
QuBE6.1
UNSAT
1.16
vis.prodcell^22.E-f2
QuBE6.1
SAT
74.49
vis.prodcell^22.E-f3
QuBE6.1
SAT
206.87
vis.prodcell^23.E-f2
QuBE6.1
SAT
42.6
vis.prodcell^23.E-f3
QuBE6.1
SAT
410.66
vis.prodcell^24.E-f2
QuBE6.1
SAT
43.8
vis.prodcell^24.E-f3
QuBE6.1
SAT
199.44
Contact
|
Organization
|
Links
|
Citing QBFLIB