QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances solved by
GhostQ-PG_cegar
QBFEVAL'17 - Prenex 2QBF Track
Instance
Result
Time
small-bug1-fixpoint-3
SAT
0.08
small-bug1-fixpoint-5
SAT
0.09
small-dyn-partition-fixpoint-1
UNSAT
0.09
small-bug1-fixpoint-4
SAT
0.09
small-bug1-fixpoint-6
SAT
0.1
small-bug1-fixpoint-8
SAT
0.12
small-bug1-fixpoint-9
SAT
0.12
small-bug1-fixpoint-10
SAT
0.13
small-dyn-partition-fixpoint-2
UNSAT
0.14
trueque_query42_1344n
UNSAT
0.19
falsequ_query42_1344n
UNSAT
0.21
small-dyn-partition-fixpoint-3
UNSAT
0.21
small-dyn-partition-fixpoint-4
UNSAT
0.25
stmt5_731_730
SAT
0.27
rankfunc38_signed_64
SAT
0.28
query64_query01_1344n
SAT
0.3
itc-b13-fixpoint-1
UNSAT
0.3
small-dyn-partition-fixpoint-5
UNSAT
0.31
rankfunc38_unsigned_64
SAT
0.32
query04_query25_1344n
SAT
0.32
stmt25_597_598
SAT
0.34
sdlx-fixpoint-1
UNSAT
0.34
small-dyn-partition-fixpoint-6
UNSAT
0.37
stmt41_262_275
SAT
0.38
axquery_query42_1344n
UNSAT
0.41
small-dyn-partition-fixpoint-7
UNSAT
0.42
query52_query25_1344n
SAT
0.42
nxquery_query42_1344n
UNSAT
0.44
exquery_query42_1344n
UNSAT
0.5
query02_query42_1344n
UNSAT
0.5
query36_query25_1344n
SAT
0.53
stmt27_16_224
UNSAT
0.53
query31_eequery_1344n
SAT
0.53
small-dyn-partition-fixpoint-9
UNSAT
0.54
small-dyn-partition-fixpoint-10
UNSAT
0.59
query24_query42_1344n
UNSAT
0.61
stmt19_66_214
UNSAT
0.63
rankfunc60_unsigned_32
SAT
0.64
small-pipeline-fixpoint-1
UNSAT
0.64
rankfunc55_unsigned_32
SAT
0.65
stmt21_84_215
UNSAT
0.66
stmt19_133_217
UNSAT
0.68
query04_query42_1344n
UNSAT
0.68
query05_query31_1344n
SAT
0.68
stmt46_111_238
UNSAT
0.69
query23_query42_1344n
UNSAT
0.7
usb-phy-fixpoint-1
UNSAT
0.73
eequery_query64_1344n
SAT
0.77
stmt27_93_98
SAT
0.8
stmt27_149_224
UNSAT
0.8
rankfunc48_unsigned_16
SAT
0.82
query45_query42_1344n
SAT
0.83
stmt31_22_328
UNSAT
0.86
stmt31_190_227
UNSAT
0.91
sdlx-fixpoint-2
UNSAT
0.92
itc-b13-fixpoint-2
UNSAT
0.94
small-seq-fixpoint-1
UNSAT
0.96
stmt21_178_258
UNSAT
0.96
query02_query44_1344n
UNSAT
0.98
stmt21_71_354
UNSAT
1
small-swap2-fixpoint-5
SAT
1.01
stmt53_208_245
UNSAT
1.01
stmt21_181_218
UNSAT
1.02
stmt44_40_387
UNSAT
1.03
stmt21_70_369
UNSAT
1.05
stmt22_6_414
UNSAT
1.07
rankfunc56_signed_64
SAT
1.08
stmt19_3_401
UNSAT
1.1
stmt21_71_413
UNSAT
1.11
cache-coherence-3-fixpoint-1
UNSAT
1.12
rankfunc56_unsigned_64
SAT
1.12
small-swap2-fixpoint-6
SAT
1.21
query26_query42_1344n
UNSAT
1.21
stmt21_84_364
UNSAT
1.21
stmt19_90_408
UNSAT
1.22
query15_query42_1344n
UNSAT
1.26
small-synabs-fixpoint-10
UNSAT
1.27
stmt19_180_352
UNSAT
1.28
stmt21_143_403
UNSAT
1.28
stmt19_137_408
UNSAT
1.3
rankfunc55_signed_64
SAT
1.3
query36_query42_1344n
SAT
1.32
rankfunc55_unsigned_64
SAT
1.33
rankfunc2_unsigned_64
SAT
1.39
query25_query42_1344n
SAT
1.39
query30_query42_1344n
UNSAT
1.4
ethernet-fixpoint-1
UNSAT
1.42
small-swap2-fixpoint-7
SAT
1.44
query31_query50_1344n
SAT
1.46
trivial_query42_1344n
UNSAT
1.46
query50_query06_1344n
SAT
1.47
ntrivil_query42_1344n
UNSAT
1.52
stmt31_276_328
UNSAT
1.61
stmt22_311_370
UNSAT
1.63
small-swap2-fixpoint-8
SAT
1.65
query48_exquery_1344n
SAT
1.68
cache-coherence-2-fixpoint-2
UNSAT
1.69
stmt41_286_385
UNSAT
1.71
query27_query42_1344n
UNSAT
1.74
rankfunc34_unsigned_64
SAT
1.78
itc-b13-fixpoint-3
SAT
1.79
stmt19_352_359
UNSAT
1.81
usb-phy-fixpoint-2
UNSAT
1.82
rankfunc34_signed_64
SAT
1.84
stmt47_340_389
UNSAT
1.85
small-swap2-fixpoint-9
SAT
1.86
stmt50_343_392
UNSAT
1.87
query49_ntrivil_1344n
SAT
1.88
query33_query45_1344n
SAT
1.88
small-pipeline-fixpoint-2
UNSAT
1.9
rankfunc49_unsigned_64
SAT
1.97
rankfunc49_signed_64
SAT
2.11
small-swap2-fixpoint-10
SAT
2.11
rankfunc57_unsigned_64
SAT
2.13
query54_query58_1344n
SAT
2.14
rankfunc53_unsigned_64
SAT
2.2
rankfunc53_signed_64
SAT
2.21
sdlx-fixpoint-4
UNSAT
2.29
rankfunc61_unsigned_64
SAT
2.36
nxquery_query50_1344n
SAT
2.47
cache-coherence-3-fixpoint-2
UNSAT
2.5
query11_query42_1344n
SAT
2.56
rankfunc51_signed_64
SAT
2.69
itc-b13-fixpoint-4
SAT
2.81
rankfunc35_unsigned_64
SAT
2.88
sdlx-fixpoint-5
UNSAT
2.97
query07_query42_1344n
UNSAT
2.99
rankfunc51_unsigned_64
SAT
2.99
rankfunc52_unsigned_64
SAT
3.11
rankfunc58_unsigned_64
SAT
3.2
small-seq-fixpoint-2
UNSAT
3.22
small-pipeline-fixpoint-3
UNSAT
3.25
rankfunc54_signed_64
SAT
3.29
rankfunc52_signed_64
SAT
3.31
rankfunc58_signed_64
SAT
3.36
rankfunc48_unsigned_64
SAT
3.49
rankfunc54_unsigned_64
SAT
3.59
query50_query42_1344n
SAT
3.61
rankfunc61_signed_64
SAT
3.62
query03_query42_1344n
UNSAT
3.75
itc-b13-fixpoint-8
SAT
4.07
rankfunc59_signed_64
SAT
4.2
rankfunc59_unsigned_64
SAT
4.49
cache-coherence-2-fixpoint-5
UNSAT
4.57
query21_query42_1344n
UNSAT
4.57
query34_query11_1344n
SAT
4.67
rankfunc31_signed_64
SAT
4.71
usb-phy-fixpoint-4
UNSAT
4.72
rankfunc35_signed_64
SAT
4.76
query31_query42_1344n
SAT
5.04
query33_query51_1344n
SAT
5.38
query05_query42_1344n
SAT
5.43
rankfunc48_signed_64
SAT
5.45
sdlx-fixpoint-6
UNSAT
5.5
rankfunc31_unsigned_64
SAT
5.98
rankfunc41_signed_64
SAT
6.15
rankfunc41_unsigned_64
SAT
6.52
itc-b13-fixpoint-6
SAT
6.74
usb-phy-fixpoint-5
UNSAT
7.01
itc-b13-fixpoint-10
SAT
7.03
small-seq-fixpoint-4
UNSAT
7.84
ethernet-fixpoint-2
UNSAT
8.07
sdlx-fixpoint-7
SAT
8.19
stmt29_275_376
UNSAT
8.41
query55_query42_1344n
SAT
9.18
sdlx-fixpoint-8
SAT
9.64
sdlx-fixpoint-9
SAT
11.24
itc-b13-fixpoint-7
SAT
11.6
query54_query42_1344n
SAT
11.69
itc-b13-fixpoint-9
SAT
12.5
small-seq-fixpoint-6
UNSAT
12.9
sdlx-fixpoint-10
SAT
13.82
ethernet-fixpoint-3
UNSAT
15.85
query51_query42_1344n
SAT
15.94
query08_query42_1344n
UNSAT
16.31
pi-bus-fixpoint-2
UNSAT
19.14
query01_query42_1344n
SAT
19.59
query64_query11_1344n
SAT
19.78
stmt46_289_388
UNSAT
20.95
stmt52_295_394
UNSAT
21.35
query52_query42_1344n
SAT
22.03
small-seq-fixpoint-10
UNSAT
22.27
query60_query45_1344n
SAT
28.17
stmt41_336_385
UNSAT
32.32
query33_query42_1344n
SAT
33.15
eequery_query42_1344n
SAT
34.07
ethernet-fixpoint-4
UNSAT
40.31
stmt23_66_67
SAT
43.06
query09_query42_1344n
UNSAT
45.48
query58_query42_1344n
UNSAT
45.53
query06_query42_1344n
UNSAT
45.53
stmt28_68_73
SAT
48.67
stmt28_68_69
SAT
53.66
query71_query31_1344n
SAT
56.47
stmt17_63_70
SAT
59.15
query34_query42_1344n
SAT
59.44
stmt23_66_76
SAT
59.73
stmt17_62_78
SAT
70.84
stmt19_79_83
SAT
73.01
sortnetsort7.AE.stepl.009
UNSAT
73.73
stmt17_74_78
SAT
73.88
stmt17_70_78
SAT
74.19
stmt23_88_92
SAT
81.36
stmt17_70_86
SAT
81.47
stmt19_65_87
SAT
82.34
stmt19_79_87
SAT
84.35
stmt17_70_82
SAT
86.7
stmt19_87_95
SAT
87.2
stmt19_75_83
SAT
92.53
stmt23_92_96
SAT
93.23
stmt28_73_85
SAT
94.29
query33_query57_1344n
SAT
94.86
stmt19_83_91
SAT
97.34
stmt17_78_94
SAT
98.85
AR-fixpoint-2
FAIL
100.78
stmt17_74_90
SAT
102.23
stmt17_63_78
SAT
102.68
query71_query36_1344n
UNSAT
103.62
stmt17_82_86
SAT
104.78
stmt23_67_92
SAT
105.03
stmt17_78_98
SAT
107.06
stmt19_64_87
SAT
107.73
stmt19_75_95
SAT
109.39
stmt19_71_95
SAT
110.98
stmt17_94_98
SAT
112.92
nreachq_query11_1344n
UNSAT
112.97
stmt19_64_91
SAT
116.09
stmt17_82_94
SAT
129.93
stmt28_89_97
SAT
132.75
stmt47_290_340
UNSAT
150.46
stmt53_296_346
UNSAT
151.16
stmt28_73_97
SAT
158.22
query64_query42_1344n
SAT
191.29
query51_query57_1344n
SAT
197.49
query42_query42_1344n
UNSAT
206.56
sortnetsort10.AE.stepl.012
UNSAT
215.13
stmt19_65_95
SAT
246.93
AR-fixpoint-4
FAIL
253.29
sortnetsort9.AE.stepl.011
UNSAT
262.92
stmt17_78_90
SAT
268.72
reachqu_query42_1344n
UNSAT
306.89
query60_query44_1344n
SAT
389.45
AR-fixpoint-6
FAIL
400.42
query42_query45_1344n
SAT
448.44
query48_query42_1344n
UNSAT
470.18
AR-fixpoint-8
FAIL
551.82
sortnetsort7.AE.stepl.008
UNSAT
583.36
nreachq_query54_1344n
SAT
597.43
AR-fixpoint-10
FAIL
697.01
sortnetsort7.AE.stepl.007
UNSAT
717.56
ctrl.e#1.a#3.E#110.A#48.c#.w#9.s#13.asp
SAT
878.17
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#26.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#60.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#5.s#1.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#5.s#60.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#9.s#1.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#17.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#1.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#60.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#1.asp
FAIL
900
ActivityService
FAIL
900
LoginService
FAIL
900
GuidanceService2
FAIL
900
GuidanceService
FAIL
900
IterationService
FAIL
900
IssueServiceImpl
FAIL
900
ConcreteActivityService
FAIL
900
pdtpmsrotate32
FAIL
900
PhaseService
FAIL
900
NotificationServiceImpl2
FAIL
900
ctrl.e#1.a#3.E#134.A#48.c#.w#9.s#40.asp
FAIL
900
ctrl.e#1.a#3.E#130.A#48.c#.w#7.s#11.asp
FAIL
900
ctrl.e#1.a#3.E#120.A#48.c#.w#3.s#3.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#7.asp
FAIL
900
ctrl.e#1.a#3.E#124.A#48.c#.w#7.s#50.asp
FAIL
900
ctrl.e#1.a#3.E#122.A#48.c#.w#3.s#51.asp
FAIL
900
ctrl.e#1.a#3.E#118.A#48.c#.w#5.s#7.asp
FAIL
900
ctrl.e#1.a#3.E#116.A#48.c#.w#7.s#56.asp
FAIL
900
ctrl.e#1.a#3.E#112.A#48.c#.w#5.s#27.asp
FAIL
900
neclaftp2002
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#9.s#60.asp
FAIL
900
oski3ub5i_c0to511.sat
FAIL
900
oski3ub5i_c0to63.sat
FAIL
900
load_2c_comp_comp7_REAL.sat
FAIL
900
load_3c_comp_comp6_REAL.sat
FAIL
900
load_4c_comp_comp4_REAL.sat
FAIL
900
load_full_3_comp5_REAL.sat
FAIL
900
ltl2dba_C2-8_comp4_REAL.sat
FAIL
900
ltl2dba_E6_comp2_REAL.sat
FAIL
900
ltl2dba_Q4_comp4_REAL.sat
FAIL
900
mult_bool_matrix_12_13_11.sat
FAIL
900
mult_bool_matrix_18_18_18.sat
FAIL
900
mult_bool_matrix_dyn_7_7.sat
FAIL
900
mult_bool_matrix_dyn_9_5.sat
FAIL
900
add20y.sat
FAIL
900
bs128n.sat
FAIL
900
bs128y.sat
FAIL
900
beemskbn1f1_c0to7.sat
FAIL
900
6s289rb05233_c0to63.sat
FAIL
900
genbuf8b4n.sat
FAIL
900
amba2c7n.sat
FAIL
900
amba3b5y.sat
FAIL
900
amba4c7n.sat
FAIL
900
ltl2dba_U1-4_comp4_REAL.sat
FAIL
900
amba5b5n.sat
FAIL
900
cycle_sched_12_2_1.sat
FAIL
900
cycle_sched_2_10_1.sat
FAIL
900
cycle_sched_4_4_2.sat
FAIL
900
cycle_sched_6_6_2.sat
FAIL
900
driver_a10y.sat
FAIL
900
driver_b8n.sat
FAIL
900
driver_c9n.sat
FAIL
900
driver_c9y.sat
FAIL
900
genbuf12b4y.sat
FAIL
900
genbuf14b4y.sat
FAIL
900
genbuf7b4n.sat
FAIL
900
mult9.sat
FAIL
900
small-equiv-fixpoint-3
FAIL
900
small-pipeline-fixpoint-4
FAIL
900
query42_query60_1344n
FAIL
900
small-equiv-fixpoint-8
FAIL
900
small-equiv-fixpoint-2
FAIL
900
small-equiv-fixpoint-5
FAIL
900
sortnetsort10.AE.stepl.004
FAIL
900
stmt21_354_403
FAIL
900
query60_query10_1344n
FAIL
900
query60_query33_1344n
FAIL
900
stmt85_300_399
FAIL
900
stmt19_368_417
FAIL
900
stmt22_320_370
FAIL
900
query71_query34_1344n
FAIL
900
stmt19_302_352
FAIL
900
small-equiv-fixpoint-4
FAIL
900
small-equiv-fixpoint-7
FAIL
900
small-pipeline-fixpoint-10
FAIL
900
small-swap1-fixpoint-10
FAIL
900
small-swap1-fixpoint-9
FAIL
900
small-swap1-fixpoint-5
FAIL
900
small-pipeline-fixpoint-8
FAIL
900
small-swap1-fixpoint-4
FAIL
900
small-swap1-fixpoint-7
FAIL
900
small-pipeline-fixpoint-9
FAIL
900
small-swap1-fixpoint-6
FAIL
900
small-swap1-fixpoint-8
FAIL
900
small-pipeline-fixpoint-5
FAIL
900
query10_query06_1344n
FAIL
900
query10_query34_1344n
FAIL
900
query10_query45_1344n
FAIL
900
small-equiv-fixpoint-1
FAIL
900
nreachq_query42_1344n
FAIL
900
sortnetsort9.AE.stepl.010
FAIL
900
query10_query42_1344n
FAIL
900
sortnetsort10.AE.stepl.008
FAIL
900
query57_query42_1344n
FAIL
900
sortnetsort10.AE.stepl.007
FAIL
900
query60_query42_1344n
FAIL
900
query71_query42_1344n
FAIL
900
sortnetsort10.AE.stepl.006
FAIL
900
sortnetsort10.AE.stepl.005
FAIL
900
ceiling256
FAIL
900
decomposition128
FAIL
900
equalization128
FAIL
900
floor128
FAIL
900
intermediate256
FAIL
900
bobtuint31neg
FAIL
900
eijkbs3330
FAIL
900
sortnetsort10.AE.stepl.009
FAIL
900
sortnetsort10.AE.stepl.010
FAIL
900
sortnetsort10.AE.stepl.011
FAIL
900
sortnetsort9.AE.stepl.008
FAIL
900
sortnetsort9.AE.stepl.007
FAIL
900
sortnetsort9.AE.stepl.006
FAIL
900
sortnetsort9.AE.stepl.005
FAIL
900
sortnetsort9.AE.stepl.004
FAIL
900
sortnetsort8.AE.stepl.009
FAIL
900
sortnetsort8.AE.stepl.008
FAIL
900
sortnetsort8.AE.stepl.006
FAIL
900
sortnetsort8.AE.stepl.005
FAIL
900
sortnetsort8.AE.stepl.004
FAIL
900
sortnetsort7.AE.stepl.006
FAIL
900
query44_query42_1344n
FAIL
900
sortnetsort7.AE.stepl.005
FAIL
900
query49_query42_1344n
FAIL
900
kenflashp04
FAIL
900
Contact
|
Organization
|
Links
|
Citing QBFLIB