QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances solved by
depqbf_pre_QxQBH
QBFEVAL'18 - Prenex 2QBF Track
Instance
Result
Time
stmt19_66_214
UNSAT
0
rankfunc58_unsigned_64
SAT
0
rankfunc48_signed_64
SAT
0
rankfunc56_signed_64
SAT
0
rankfunc61_signed_64
SAT
0
rankfunc41_unsigned_64
SAT
0
rankfunc31_unsigned_64
SAT
0
rankfunc54_unsigned_64
SAT
0
rankfunc49_signed_64
SAT
0
rankfunc59_unsigned_64
SAT
0
rankfunc51_signed_64
SAT
0
rankfunc49_unsigned_64
SAT
0
rankfunc54_signed_64
SAT
0
rankfunc58_signed_64
SAT
0
rankfunc61_unsigned_64
SAT
0
rankfunc52_unsigned_64
SAT
0
stmt19_133_217
UNSAT
0
driver_d9y.sat
SAT
0
floor256
SAT
0
rankfunc48_unsigned_16
SAT
0
stmt124_966_965
SAT
0
decomposition256
SAT
0
stmt41_262_275
SAT
0
stmt5_731_730
SAT
0
stmt44_554_604
SAT
0
stmt25_597_598
SAT
0
stmt16_818_819
SAT
0
stmt9_445_446
SAT
0
stmt27_16_224
UNSAT
0
kenflashp12
SAT
0
pdtpmsmiim
SAT
0
stmt21_178_258
UNSAT
0
ceiling128
SAT
0
rankfunc35_unsigned_64
SAT
0
rankfunc60_unsigned_32
SAT
0
rankfunc53_unsigned_64
SAT
0
rankfunc31_signed_64
SAT
0
add20y.sat
SAT
0
itc-b13-fixpoint-1
UNSAT
0
mult9.sat
SAT
0
Q_2-3_v-80-100_r-13.2
UNSAT
0
Q_2-3_v-80-100_r-13.4
UNSAT
0
driver_c9y.sat
SAT
0
driver_c9n.sat
SAT
0
itc-b13-fixpoint-2
UNSAT
0
rankfunc52_signed_64
SAT
0
small-synabs-fixpoint-3
UNSAT
0
floor128
SAT
0
rankfunc59_signed_64
SAT
0
decomposition128
SAT
0
kenflashp04
SAT
0
rankfunc51_unsigned_64
SAT
0
rankfunc56_unsigned_64
SAT
0
rankfunc41_signed_64
SAT
0
rankfunc53_signed_64
SAT
0
stmt21_71_354
UNSAT
0.43
stmt19_3_401
UNSAT
0.44
ltl2dba_C2-6_comp3_REAL.sat
SAT
0.45
stmt21_143_403
UNSAT
0.47
stmt21_181_369
UNSAT
0.48
stmt19_90_408
UNSAT
0.48
stmt21_70_369
UNSAT
0.48
small-seq-fixpoint-1
UNSAT
0.51
stmt21_71_413
UNSAT
0.53
stmt21_181_218
UNSAT
0.53
stmt53_208_245
UNSAT
0.54
stmt19_137_408
UNSAT
0.54
stmt22_6_414
UNSAT
0.55
small-swap1-fixpoint-4
SAT
0.55
stmt46_111_238
UNSAT
0.56
bobtuint31neg
SAT
0.58
itc-b13-fixpoint-3
SAT
0.61
stmt21_84_364
UNSAT
0.63
small-swap1-fixpoint-6
SAT
0.64
mult_bool_matrix_10_9_11.sat
SAT
0.65
stmt31_190_227
UNSAT
0.67
stmt31_22_328
UNSAT
0.7
stmt41_160_235
UNSAT
0.7
stmt25_52_53
SAT
0.72
stmt1_79_80
SAT
0.74
rankfunc55_unsigned_64
SAT
0.75
stmt19_83_412
UNSAT
0.75
cycle_sched_12_2_1.sat
SAT
0.78
Q_2-3_v-80-100_r-13.6
UNSAT
0.8
Q_2-3_v-80-100_r-13.9
UNSAT
0.8
Q_2-3_v-80-100_r-13.8
UNSAT
0.8
Q_2-3_v-80-100_r-13.1
UNSAT
0.8
Q_2-3_v-80-100_r-13.5
UNSAT
0.8
usb-phy-fixpoint-1
UNSAT
0.8
stmt27_93_98
SAT
0.8
Q_2-3_v-80-100_r-13.0
UNSAT
0.81
Q_2-3_v-80-100_r-13.3
UNSAT
0.81
Q_2-3_v-80-100_r-13.7
UNSAT
0.83
rankfunc2_unsigned_64
SAT
0.85
stmt27_149_224
UNSAT
0.88
rankfunc35_signed_64
SAT
1.1
stmt22_311_370
UNSAT
1.11
itc-b13-fixpoint-4
SAT
1.12
small-swap1-fixpoint-5
SAT
1.12
small-swap1-fixpoint-8
SAT
1.2
mult_bool_matrix_12_13_11.sat
SAT
1.21
stmt29_226_376
UNSAT
1.22
mult_bool_matrix_dyn_9_5.sat
SAT
1.22
small-swap1-fixpoint-7
SAT
1.26
ltl2dba_C2-8_comp4_REAL.sat
SAT
1.4
driver_b8n.sat
SAT
1.44
ceiling256
SAT
1.44
pdtpmsrotate32
SAT
1.48
rankfunc57_unsigned_64
SAT
1.48
itc-b13-fixpoint-5
SAT
1.57
stmt21_319_418
SAT
1.57
stmt22_320_370
SAT
1.59
stay24n.sat
SAT
1.61
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#1.asp
SAT
1.62
ctrl.e#1.a#3.E#110.A#48.c#.w#9.s#13.asp
SAT
1.71
small-swap1-fixpoint-10
SAT
1.8
Q_2-3_v-80-100_r-11.3
UNSAT
1.85
ltl2dpa_C26_comp2_REAL.sat
SAT
1.94
stmt19_368_417
SAT
1.95
query02_query42_1344n
UNSAT
1.96
small-synabs-fixpoint-10
UNSAT
1.98
itc-b13-fixpoint-6
SAT
2.26
stmt19_352_359
UNSAT
2.33
nxquery_query42_1344n
UNSAT
2.37
rankfunc48_unsigned_64
SAT
2.39
driver_a10y.sat
SAT
2.39
axquery_query42_1344n
UNSAT
2.47
eijkbs3330
SAT
2.7
small-pipeline-fixpoint-1
UNSAT
2.72
cache-coherence-3-fixpoint-1
UNSAT
2.73
exquery_query42_1344n
UNSAT
2.78
small-swap1-fixpoint-9
SAT
2.9
driver_a9n.sat
SAT
2.94
bs128n.sat
SAT
3.06
bs128y.sat
SAT
3.11
itc-b13-fixpoint-7
SAT
3.16
ethernet-fixpoint-1
UNSAT
3.24
cache-coherence-2-fixpoint-2
UNSAT
3.49
stmt85_300_399
SAT
3.5
eijkbs4863
SAT
3.66
usb-phy-fixpoint-2
UNSAT
3.71
mult_bool_matrix_17_17_17.sat
SAT
3.97
ntrivil_query42_1344n
UNSAT
4.11
trivial_query42_1344n
UNSAT
4.2
small-seq-fixpoint-2
UNSAT
4.29
stmt19_302_352
SAT
4.42
mult_bool_matrix_18_18_18.sat
SAT
4.75
Q_2-3_v-80-100_r-11.2
UNSAT
5.45
sdlx-fixpoint-3
UNSAT
5.85
itc-b13-fixpoint-8
SAT
7.03
beemskbn1f1_c0to7.sat
SAT
7.05
query07_query42_1344n
UNSAT
7.73
stmt23_66_67
SAT
9.49
stmt21_354_403
SAT
9.94
query21_query42_1344n
UNSAT
10.22
Q_2-3_v-80-100_r-11.6
UNSAT
10.52
stmt17_63_70
SAT
10.84
itc-b13-fixpoint-9
SAT
11.12
load_2c_comp_comp7_REAL.sat
SAT
11.74
stmt28_68_69
SAT
12.24
cache-coherence-3-fixpoint-2
UNSAT
12.61
stmt28_68_73
SAT
14.02
stmt44_40_387
UNSAT
14.39
stmt17_63_82
SAT
14.57
stmt17_62_78
SAT
14.81
itc-b13-fixpoint-10
SAT
14.93
stmt23_72_76
SAT
15
stmt17_63_78
SAT
15.27
stmt19_64_87
SAT
15.66
stmt23_66_76
SAT
16.17
small-seq-fixpoint-3
UNSAT
16.61
stmt28_68_81
SAT
16.65
stmt17_70_78
SAT
17.97
ethernet-fixpoint-2
UNSAT
18.12
stmt23_66_96
SAT
18.57
stmt17_74_78
SAT
18.63
stmt23_67_92
SAT
19.7
usb-phy-fixpoint-3
UNSAT
19.77
stmt19_64_99
SAT
20.14
stmt19_65_95
SAT
21.49
stmt17_70_90
SAT
21.5
stmt28_73_85
SAT
21.63
cycle_sched_4_4_2.sat
SAT
23.95
query26_query42_1344n
UNSAT
28.79
stmt17_82_98
SAT
30.93
pi-bus-fixpoint-1
UNSAT
38.05
stmt21_310_360
UNSAT
38.85
ethernet-fixpoint-3
UNSAT
41.67
stmt52_295_394
UNSAT
42.13
cache-coherence-2-fixpoint-4
UNSAT
50.53
stmt53_296_346
UNSAT
51.85
usb-phy-fixpoint-4
UNSAT
55.5
query27_query42_1344n
UNSAT
133.61
Q_2-3_v-80-100_r-11.4
UNSAT
144.63
amba2c7n.sat
SAT
159.75
stmt41_336_385
UNSAT
162.37
stmt39_285_335
UNSAT
168.02
stmt32_329_378
UNSAT
169.2
stmt17_70_82
SAT
177.49
stmt19_65_87
SAT
179.62
stmt19_64_91
SAT
179.63
stmt19_313_412
UNSAT
180.03
stmt47_290_340
UNSAT
182.67
stmt19_75_83
SAT
185.33
stmt19_79_83
SAT
186.38
stmt17_70_86
SAT
187.2
stmt17_62_98
SAT
187.25
stmt31_276_328
UNSAT
188.71
stmt19_79_87
SAT
189.57
stmt41_286_385
UNSAT
190.09
stmt19_71_95
SAT
191.53
stmt2_976_999
SAT
192.8
stmt19_75_95
SAT
193.22
sortnetsort8.AE.stepl.004
SAT
193.77
sortnetsort9.AE.stepl.004
SAT
194.05
stmt17_78_90
SAT
194.63
stmt17_82_86
SAT
194.93
stmt17_74_90
SAT
194.93
cache-coherence-2-fixpoint-5
UNSAT
194.93
cache-coherence-3-fixpoint-3
UNSAT
195.05
stmt17_70_98
SAT
195.68
stmt28_73_97
SAT
198.19
stmt17_78_94
SAT
198.4
cache-coherence-2-fixpoint-6
UNSAT
198.76
stmt19_83_91
SAT
199.32
stmt17_78_98
SAT
203.55
stmt23_88_92
SAT
204.93
stmt17_82_94
SAT
205.44
stmt19_87_95
SAT
211.04
stmt23_92_96
SAT
214.4
stmt17_86_98
SAT
216
stmt28_89_97
SAT
220.71
sdlx-fixpoint-4
UNSAT
221.63
nxquery_query50_1344n
SAT
232.04
cycle_sched_6_6_2.sat
SAT
236.33
amba2f9n.sat
SAT
249.36
cycle_sched_6_7_1.sat
SAT
256.95
sortnetsort10.AE.stepl.004
SAT
258.02
usb-phy-fixpoint-5
UNSAT
313.1
cycle_sched_2_10_1.sat
SAT
314.1
small-seq-fixpoint-4
UNSAT
315.96
sortnetsort8.AE.stepl.008
UNSAT
322.78
query31_query50_1344n
SAT
336.69
small-seq-fixpoint-6
UNSAT
337.35
query03_query42_1344n
UNSAT
339.75
small-seq-fixpoint-5
UNSAT
352.4
small-seq-fixpoint-7
UNSAT
358.03
sortnetsort9.AE.stepl.005
SAT
362.56
pi-bus-fixpoint-2
UNSAT
388.95
cycle_sched_4_7_1.sat
SAT
395.64
amba3b5y.sat
SAT
401.74
sortnetsort7.AE.stepl.005
SAT
403.59
ci.e#1.a#3.E#40.A#60.c#416.w#2.s#3.asp
UNSAT
423.08
sortnetsort9.AE.stepl.012
UNSAT
451.06
sortnetsort10.AE.stepl.010
UNSAT
451.43
sortnetsort9.AE.stepl.011
UNSAT
454.47
sortnetsort10.AE.stepl.009
UNSAT
467.41
ci.e#1.a#3.E#40.A#60.c#400.w#2.s#1.asp
UNSAT
483.84
sortnetsort9.AE.stepl.008
UNSAT
499.04
sortnetsort9.AE.stepl.009
UNSAT
499.13
sortnetsort8.AE.stepl.009
UNSAT
507.67
sortnetsort9.AE.stepl.010
UNSAT
515.87
ci.e#1.a#3.E#40.A#60.c#408.w#2.s#1.asp
UNSAT
579.94
sortnetsort8.AE.stepl.005
SAT
609.64
Q_2-3_v-80-100_r-11.0
UNSAT
634.3
sortnetsort10.AE.stepl.005
SAT
659.33
AR-fixpoint-2
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#60.asp
FAIL
900
query06_query42_1344n
FAIL
900
GuidanceService
FAIL
900
query31_query42_1344n
FAIL
900
ethernet-fixpoint-4
FAIL
900
query51_query42_1344n
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#9.s#1.asp
FAIL
900
neclaftp4001
FAIL
900
UserServiceImpl
FAIL
900
small-equiv-fixpoint-5
FAIL
900
eequery_query64_1344n
FAIL
900
query33_query45_1344n
FAIL
900
query31_eequery_1344n
FAIL
900
query01_query42_1344n
FAIL
900.01
query11_query42_1344n
FAIL
900.01
small-equiv-fixpoint-8
FAIL
900.01
ctrl.e#1.a#3.E#134.A#48.c#.w#9.s#40.asp
FAIL
900.01
query08_query42_1344n
FAIL
900.01
neclaftp2002
FAIL
900.01
query10_query42_1344n
FAIL
900.01
query10_query45_1344n
FAIL
900.01
query31_reachqu_1344n
FAIL
900.01
query71_query31_1344n
FAIL
900.01
sortnetsort8.AE.stepl.006
FAIL
900.01
sortnetsort10.AE.stepl.008
FAIL
900.01
sdlx-fixpoint-10
FAIL
900.01
reachqu_query42_1344n
FAIL
900.01
query60_query44_1344n
FAIL
900.01
query48_exquery_1344n
FAIL
900.01
query42_query42_1344n
FAIL
900.02
query60_query45_1344n
FAIL
900.02
intermediate128
FAIL
900.02
query04_query25_1344n
FAIL
900.02
stmt50_343_392
FAIL
900.02
query33_query51_1344n
FAIL
900.02
NotificationServiceImpl2
FAIL
900.02
nreachq_query11_1344n
FAIL
900.02
stmt17_94_98
FAIL
900.02
sortnetsort7.AE.stepl.007
FAIL
900.02
6s289rb05233_c0to63.sat
FAIL
900.02
sdlx-fixpoint-6
FAIL
900.02
AR-fixpoint-6
FAIL
900.02
small-equiv-fixpoint-1
FAIL
900.02
query44_query26_1344n
FAIL
900.02
small-equiv-fixpoint-3
FAIL
900.02
query42_query06_1344n
FAIL
900.03
small-seq-fixpoint-10
FAIL
900.03
AR-fixpoint-10
FAIL
900.03
stmt47_340_389
FAIL
900.03
sortnetsort10.AE.stepl.011
FAIL
900.03
ctrl.e#1.a#3.E#118.A#48.c#.w#5.s#7.asp
FAIL
900.03
ctrl.e#1.a#3.E#116.A#48.c#.w#7.s#56.asp
FAIL
900.03
GuidanceService2
FAIL
900.03
sortnetsort7.AE.stepl.009
FAIL
900.03
query50_query06_1344n
FAIL
900.03
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#7.asp
FAIL
900.03
IterationService
FAIL
900.03
sortnetsort7.AE.stepl.006
FAIL
900.03
query02_query44_1344n
FAIL
900.03
query36_query25_1344n
FAIL
900.03
query36_query42_1344n
FAIL
900.03
pi-bus-fixpoint-3
FAIL
900.03
small-seq-fixpoint-8
FAIL
900.03
query55_query42_1344n
FAIL
900.03
query58_query42_1344n
FAIL
900.03
query05_query42_1344n
FAIL
900.03
query09_query42_1344n
FAIL
900.03
query64_query42_1344n
FAIL
900.03
small-seq-fixpoint-9
FAIL
900.03
AR-fixpoint-4
FAIL
900.03
query34_query42_1344n
FAIL
900.04
small-pipeline-fixpoint-3
FAIL
900.04
query45_query42_1344n
FAIL
900.04
ctrl.e#1.a#3.E#128.A#48.c#.w#5.s#60.asp
FAIL
900.04
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#26.asp
FAIL
900.04
ConcreteActivityService
FAIL
900.04
ctrl.e#1.a#3.E#128.A#48.c#.w#9.s#60.asp
FAIL
900.04
nreachq_query54_1344n
FAIL
900.04
small-equiv-fixpoint-2
FAIL
900.04
sortnetsort7.AE.stepl.008
FAIL
900.04
query54_query58_1344n
FAIL
900.04
query51_query57_1344n
FAIL
900.04
genbuf9b4n.sat
FAIL
900.04
query64_query01_1344n
FAIL
900.04
beemldelec4b1_c0to127.sat
FAIL
900.04
oski3ub5i_c0to255.sat
FAIL
900.04
eequery_query42_1344n
FAIL
900.04
query64_query11_1344n
FAIL
900.04
reachqu_query64_1344n
FAIL
900.04
query21_query58_1344n
FAIL
900.05
query05_query31_1344n
FAIL
900.05
PhaseService
FAIL
900.05
ctrl.e#1.a#3.E#112.A#48.c#.w#5.s#27.asp
FAIL
900.05
ActivityService
FAIL
900.05
sdlx-fixpoint-9
FAIL
900.05
query42_query45_1344n
FAIL
900.05
small-equiv-fixpoint-4
FAIL
900.05
small-pipeline-fixpoint-2
FAIL
900.05
Q_2-3_v-80-100_r-11.5
FAIL
900.05
Q_2-3_v-80-100_r-11.7
FAIL
900.05
sortnetsort9.AE.stepl.007
FAIL
900.06
sortnetsort10.AE.stepl.012
FAIL
900.06
Q_2-3_v-80-100_r-11.8
FAIL
900.06
stmt46_289_388
FAIL
900.06
query33_query42_1344n
FAIL
900.06
query71_query36_1344n
FAIL
900.06
reachqu_query71_1344n
FAIL
900.06
query25_query42_1344n
FAIL
900.06
query54_query42_1344n
FAIL
900.06
query49_ntrivil_1344n
FAIL
900.07
sdlx-fixpoint-8
FAIL
900.07
query33_query57_1344n
FAIL
900.07
sdlx-fixpoint-7
FAIL
900.07
ActivityService2
FAIL
900.07
ctrl.e#1.a#3.E#124.A#48.c#.w#7.s#50.asp
FAIL
900.07
ci.e#1.a#3.E#40.A#60.c#384.w#6.s#8.asp
FAIL
900.07
query04_query42_1344n
FAIL
900.07
ctrl.e#1.a#3.E#120.A#48.c#.w#3.s#3.asp
FAIL
900.07
ci.e#1.a#3.E#40.A#60.c#288.w#6.s#2.asp
FAIL
900.07
ci.e#1.a#3.E#40.A#60.c#408.w#2.s#2.asp
FAIL
900.07
Q_2-3_v-80-100_r-11.9
FAIL
900.08
sdlx-fixpoint-5
FAIL
900.08
query48_query42_1344n
FAIL
900.08
query52_query25_1344n
FAIL
900.08
query52_query42_1344n
FAIL
900.08
oski3ub5i_c0to63.sat
FAIL
900.08
stmt29_275_376
FAIL
900.08
Q_2-3_v-80-100_r-11.1
FAIL
900.08
query34_query11_1344n
FAIL
900.08
IssueServiceImpl
FAIL
900.08
oski3ub5i_c0to511.sat
FAIL
900.09
AR-fixpoint-1
FAIL
900.09
query50_query42_1344n
FAIL
900.09
AR-fixpoint-8
FAIL
900.09
intermediate256
FAIL
900.09
Contact
|
Organization
|
Links
|
Citing QBFLIB