QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances solved by
ASPQ_2018
QBFEVAL'18 - Prenex 2QBF Track
Instance
Result
Time
driver_d9y.sat
SAT
0
decomposition256
SAT
0
itc-b13-fixpoint-1
UNSAT
0
floor256
SAT
0
rankfunc56_unsigned_64
SAT
0
kenflashp12
SAT
0
stmt124_966_965
SAT
0
rankfunc53_signed_64
SAT
0
pdtpmsmiim
SAT
0
stmt5_731_730
SAT
0
rankfunc61_unsigned_64
SAT
0
stmt41_262_275
SAT
0
pdtpmsrotate32
SAT
0
kenflashp04
SAT
0
ceiling256
SAT
0
floor128
SAT
0
ceiling128
SAT
0
rankfunc60_unsigned_32
SAT
0
small-synabs-fixpoint-3
UNSAT
0
small-swap1-fixpoint-5
SAT
0
add20y.sat
SAT
0
rankfunc56_signed_64
SAT
0
small-swap1-fixpoint-6
SAT
0
driver_c9y.sat
SAT
0
bobtuint31neg
SAT
0
stmt9_445_446
SAT
0
rankfunc48_unsigned_16
SAT
0
stmt16_818_819
SAT
0
stmt25_597_598
SAT
0
stmt44_554_604
SAT
0
rankfunc53_unsigned_64
SAT
0
decomposition128
SAT
0
Q_2-3_v-80-100_r-13.3
UNSAT
0.05
Q_2-3_v-80-100_r-13.9
UNSAT
0.05
Q_2-3_v-80-100_r-13.0
UNSAT
0.05
Q_2-3_v-80-100_r-13.4
UNSAT
0.06
stmt25_52_53
SAT
0.51
itc-b13-fixpoint-2
UNSAT
0.52
stmt1_79_80
SAT
0.53
usb-phy-fixpoint-1
UNSAT
0.54
rankfunc51_unsigned_64
SAT
0.6
rankfunc51_signed_64
SAT
0.6
driver_c9n.sat
SAT
0.61
small-seq-fixpoint-1
UNSAT
0.61
stmt27_93_98
SAT
0.61
small-swap1-fixpoint-4
SAT
0.62
eijkbs4863
SAT
0.63
rankfunc54_unsigned_64
SAT
0.66
Q_2-3_v-80-100_r-13.2
UNSAT
0.66
rankfunc54_signed_64
SAT
0.66
nxquery_query42_1344n
UNSAT
0.73
cycle_sched_12_2_1.sat
SAT
0.73
small-pipeline-fixpoint-1
UNSAT
0.77
exquery_query42_1344n
UNSAT
0.82
rankfunc52_unsigned_64
SAT
0.83
small-swap1-fixpoint-7
SAT
0.84
axquery_query42_1344n
UNSAT
0.84
rankfunc61_signed_64
SAT
0.85
rankfunc52_signed_64
SAT
0.86
rankfunc58_unsigned_64
SAT
0.86
rankfunc58_signed_64
SAT
0.89
small-synabs-fixpoint-10
UNSAT
0.9
small-swap1-fixpoint-8
SAT
0.98
rankfunc31_unsigned_64
SAT
1.07
itc-b13-fixpoint-3
SAT
1.07
rankfunc55_unsigned_64
SAT
1.08
rankfunc59_signed_64
SAT
1.08
rankfunc31_signed_64
SAT
1.08
query02_query42_1344n
UNSAT
1.11
rankfunc59_unsigned_64
SAT
1.12
rankfunc41_signed_64
SAT
1.12
rankfunc41_unsigned_64
SAT
1.14
ethernet-fixpoint-1
UNSAT
1.14
query04_query25_1344n
SAT
1.19
ltl2dba_C2-6_comp3_REAL.sat
SAT
1.2
rankfunc49_signed_64
SAT
1.24
rankfunc35_unsigned_64
SAT
1.26
rankfunc49_unsigned_64
SAT
1.28
Q_2-3_v-80-100_r-13.5
UNSAT
1.44
query26_query42_1344n
UNSAT
1.44
query27_query42_1344n
UNSAT
1.44
trivial_query42_1344n
UNSAT
1.45
small-swap1-fixpoint-9
SAT
1.47
ntrivil_query42_1344n
UNSAT
1.5
small-swap1-fixpoint-10
SAT
1.52
query52_query25_1344n
SAT
1.66
driver_a10y.sat
SAT
1.67
itc-b13-fixpoint-4
SAT
1.68
rankfunc57_unsigned_64
SAT
1.71
rankfunc2_unsigned_64
SAT
1.75
driver_b8n.sat
SAT
1.79
query36_query25_1344n
SAT
1.93
query31_eequery_1344n
SAT
1.96
mult_bool_matrix_dyn_9_5.sat
SAT
1.98
stmt21_181_218
UNSAT
2.28
bs128n.sat
SAT
2.39
bs128y.sat
SAT
2.39
driver_a9n.sat
SAT
2.4
itc-b13-fixpoint-5
SAT
2.41
stmt53_208_245
UNSAT
2.41
cache-coherence-3-fixpoint-1
UNSAT
2.46
usb-phy-fixpoint-2
UNSAT
2.5
rankfunc48_unsigned_64
SAT
2.61
ltl2dba_C2-8_comp4_REAL.sat
SAT
2.69
query07_query42_1344n
UNSAT
2.75
rankfunc35_signed_64
SAT
2.78
query02_query44_1344n
UNSAT
2.9
Q_2-3_v-80-100_r-13.7
UNSAT
2.94
cache-coherence-2-fixpoint-2
UNSAT
3.02
stmt19_66_214
UNSAT
3.33
Q_2-3_v-80-100_r-13.1
UNSAT
3.35
sortnetsort7.AE.stepl.007
UNSAT
3.44
itc-b13-fixpoint-6
SAT
3.48
sortnetsort8.AE.stepl.004
SAT
3.6
sortnetsort7.AE.stepl.006
UNSAT
3.86
ctrl.e#1.a#3.E#112.A#48.c#.w#5.s#27.asp
SAT
3.86
ltl2dpa_C26_comp2_REAL.sat
SAT
3.92
cycle_sched_4_4_2.sat
SAT
3.92
query21_query42_1344n
UNSAT
3.94
stmt23_66_67
SAT
4.1
usb-phy-fixpoint-3
UNSAT
4.13
stmt22_320_370
SAT
4.18
ethernet-fixpoint-2
UNSAT
4.37
stmt17_63_70
SAT
4.47
itc-b13-fixpoint-7
SAT
4.68
sortnetsort7.AE.stepl.008
UNSAT
4.72
sortnetsort7.AE.stepl.009
UNSAT
4.84
stay24n.sat
SAT
5.01
stmt21_354_403
SAT
5.07
ci.e#1.a#3.E#40.A#60.c#288.w#6.s#2.asp
SAT
5.14
nxquery_query50_1344n
SAT
5.59
itc-b13-fixpoint-8
SAT
5.89
cache-coherence-3-fixpoint-2
UNSAT
6.01
ctrl.e#1.a#3.E#110.A#48.c#.w#9.s#13.asp
SAT
6.26
stmt19_64_87
SAT
6.29
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#1.asp
SAT
6.38
ctrl.e#1.a#3.E#116.A#48.c#.w#7.s#56.asp
SAT
6.85
cache-coherence-2-fixpoint-4
UNSAT
6.95
stmt27_16_224
UNSAT
6.97
ci.e#1.a#3.E#40.A#60.c#416.w#2.s#3.asp
UNSAT
7.02
itc-b13-fixpoint-9
SAT
7.06
stmt22_6_414
UNSAT
7.18
query03_query42_1344n
UNSAT
7.3
query21_query58_1344n
UNSAT
7.37
mult_bool_matrix_10_9_11.sat
SAT
7.4
ctrl.e#1.a#3.E#120.A#48.c#.w#3.s#3.asp
SAT
7.86
sortnetsort8.AE.stepl.006
UNSAT
7.89
sortnetsort9.AE.stepl.004
SAT
8.49
query49_ntrivil_1344n
SAT
8.6
stmt19_352_359
UNSAT
8.89
stmt19_137_408
UNSAT
9.13
itc-b13-fixpoint-10
SAT
9.14
GuidanceService
UNSAT
9.26
GuidanceService2
UNSAT
9.4
cache-coherence-3-fixpoint-3
UNSAT
9.66
cycle_sched_2_10_1.sat
SAT
9.66
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#26.asp
SAT
10.58
cache-coherence-2-fixpoint-5
UNSAT
10.82
query04_query42_1344n
UNSAT
11.34
stmt19_90_408
UNSAT
11.67
load_2c_comp_comp7_REAL.sat
SAT
12.24
query08_query42_1344n
UNSAT
12.25
stmt21_84_364
UNSAT
12.3
ctrl.e#1.a#3.E#128.A#48.c#.w#9.s#60.asp
SAT
12.91
query09_query42_1344n
UNSAT
13.25
cache-coherence-2-fixpoint-6
UNSAT
14.11
sortnetsort10.AE.stepl.004
SAT
14.47
stmt22_311_370
UNSAT
14.66
stmt39_285_335
UNSAT
15.29
sortnetsort8.AE.stepl.008
UNSAT
15.85
query48_exquery_1344n
SAT
16.05
ctrl.e#1.a#3.E#118.A#48.c#.w#5.s#7.asp
SAT
17.25
stmt19_133_217
UNSAT
17.66
query33_query45_1344n
SAT
17.85
query31_query50_1344n
SAT
18.16
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#60.asp
SAT
18.28
query50_query42_1344n
SAT
18.37
pi-bus-fixpoint-1
UNSAT
18.79
Q_2-3_v-80-100_r-13.8
UNSAT
19.08
stmt2_976_999
SAT
20.49
sortnetsort8.AE.stepl.005
SAT
21.89
mult_bool_matrix_12_13_11.sat
SAT
22.5
stmt21_178_258
UNSAT
23.11
eequery_query64_1344n
SAT
23.29
query06_query42_1344n
UNSAT
24.2
amba2c7n.sat
SAT
24.42
Q_2-3_v-80-100_r-13.6
UNSAT
26.05
stmt29_226_376
UNSAT
28
query05_query31_1344n
SAT
28.58
sortnetsort8.AE.stepl.009
UNSAT
28.64
query25_query42_1344n
SAT
29.98
stmt21_143_403
UNSAT
34.81
stmt41_286_385
UNSAT
34.84
stmt41_160_235
UNSAT
35.66
sortnetsort9.AE.stepl.005
SAT
36.81
ci.e#1.a#3.E#40.A#60.c#400.w#2.s#1.asp
UNSAT
37.27
cycle_sched_4_7_1.sat
SAT
40.46
cycle_sched_6_6_2.sat
SAT
42.45
stmt31_22_328
UNSAT
45.18
stmt19_313_412
UNSAT
45.37
stmt47_340_389
UNSAT
46.51
sortnetsort9.AE.stepl.007
UNSAT
48.67
query55_query42_1344n
SAT
54.97
sortnetsort9.AE.stepl.008
UNSAT
61.95
stmt21_310_360
UNSAT
75.83
sortnetsort9.AE.stepl.009
UNSAT
78.6
query60_query45_1344n
SAT
81.76
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#7.asp
SAT
88.69
query50_query06_1344n
SAT
96.57
stmt46_111_238
UNSAT
101.23
amba2f9n.sat
SAT
102.65
eequery_query42_1344n
SAT
122.48
sortnetsort9.AE.stepl.011
UNSAT
124.25
query54_query42_1344n
SAT
128.26
sortnetsort9.AE.stepl.012
UNSAT
131.3
query51_query42_1344n
SAT
136.21
stmt47_290_340
UNSAT
142.26
stmt53_296_346
UNSAT
146.8
query45_query42_1344n
SAT
161.66
usb-phy-fixpoint-4
UNSAT
165.17
query33_query51_1344n
SAT
166.5
sortnetsort9.AE.stepl.010
UNSAT
166.57
query33_query57_1344n
SAT
172.62
sortnetsort10.AE.stepl.010
UNSAT
174.24
query51_query57_1344n
SAT
182.37
ctrl.e#1.a#3.E#128.A#48.c#.w#9.s#1.asp
SAT
187.57
query54_query58_1344n
SAT
215.82
stmt19_3_401
UNSAT
219.87
mult9.sat
SAT
257.96
query34_query11_1344n
SAT
265.53
sortnetsort10.AE.stepl.011
UNSAT
271.75
query31_query42_1344n
SAT
278.15
sortnetsort10.AE.stepl.009
UNSAT
301.1
ci.e#1.a#3.E#40.A#60.c#408.w#2.s#2.asp
UNSAT
301.45
ctrl.e#1.a#3.E#128.A#48.c#.w#5.s#60.asp
SAT
308.04
query52_query42_1344n
SAT
311.67
query05_query42_1344n
SAT
320.39
query31_reachqu_1344n
SAT
330.98
sortnetsort7.AE.stepl.005
SAT
331.86
query33_query42_1344n
SAT
398.39
ctrl.e#1.a#3.E#134.A#48.c#.w#9.s#40.asp
SAT
404.14
sortnetsort10.AE.stepl.008
UNSAT
423.06
query42_query42_1344n
UNSAT
427.26
sortnetsort10.AE.stepl.012
UNSAT
442.75
query11_query42_1344n
SAT
496.18
Q_2-3_v-80-100_r-11.8
UNSAT
498.22
stmt31_276_328
UNSAT
503.79
stmt21_71_354
UNSAT
547.67
stmt27_149_224
UNSAT
548.78
query64_query01_1344n
SAT
560.43
ci.e#1.a#3.E#40.A#60.c#408.w#2.s#1.asp
UNSAT
639.37
stmt41_336_385
UNSAT
641.69
stmt21_181_369
UNSAT
646.93
query10_query45_1344n
SAT
657.88
query64_query11_1344n
SAT
702.07
stmt46_289_388
UNSAT
717.86
query36_query42_1344n
SAT
791.56
stmt21_70_369
UNSAT
846.31
query01_query42_1344n
FAIL
900
sdlx-fixpoint-4
FAIL
900
rankfunc48_signed_64
FAIL
900
small-equiv-fixpoint-4
FAIL
900
stmt19_65_95
FAIL
900
query42_query45_1344n
FAIL
900
stmt50_343_392
FAIL
900
stmt17_63_82
FAIL
900
query10_query42_1344n
FAIL
900.01
sdlx-fixpoint-9
FAIL
900.01
stmt28_68_73
FAIL
900.01
query34_query42_1344n
FAIL
900.01
AR-fixpoint-10
FAIL
900.01
stmt17_82_86
FAIL
900.01
stmt17_70_90
FAIL
900.01
stmt29_275_376
FAIL
900.01
reachqu_query42_1344n
FAIL
900.01
reachqu_query64_1344n
FAIL
900.01
NotificationServiceImpl2
FAIL
900.01
mult_bool_matrix_17_17_17.sat
FAIL
900.01
stmt19_79_83
FAIL
900.01
beemldelec4b1_c0to127.sat
FAIL
900.01
cycle_sched_6_7_1.sat
FAIL
900.01
UserServiceImpl
FAIL
900.01
neclaftp4001
FAIL
900.01
stmt17_78_90
FAIL
900.01
sdlx-fixpoint-8
FAIL
900.01
IterationService
FAIL
900.01
sortnetsort10.AE.stepl.005
FAIL
900.01
Q_2-3_v-80-100_r-11.7
FAIL
900.01
small-seq-fixpoint-2
FAIL
900.01
Q_2-3_v-80-100_r-11.4
FAIL
900.01
Q_2-3_v-80-100_r-11.3
FAIL
900.01
stmt21_319_418
FAIL
900.01
stmt17_94_98
FAIL
900.02
sdlx-fixpoint-10
FAIL
900.02
Q_2-3_v-80-100_r-11.1
FAIL
900.02
query44_query26_1344n
FAIL
900.02
stmt23_72_76
FAIL
900.02
pi-bus-fixpoint-3
FAIL
900.02
stmt28_73_97
FAIL
900.02
stmt19_64_91
FAIL
900.02
stmt17_70_86
FAIL
900.02
stmt28_89_97
FAIL
900.02
stmt17_74_90
FAIL
900.02
AR-fixpoint-2
FAIL
900.02
sdlx-fixpoint-7
FAIL
900.02
small-pipeline-fixpoint-3
FAIL
900.02
reachqu_query71_1344n
FAIL
900.02
stmt19_368_417
FAIL
900.03
query60_query44_1344n
FAIL
900.03
stmt28_68_81
FAIL
900.03
stmt19_79_87
FAIL
900.03
stmt21_71_413
FAIL
900.03
mult_bool_matrix_18_18_18.sat
FAIL
900.03
nreachq_query11_1344n
FAIL
900.03
Q_2-3_v-80-100_r-11.5
FAIL
900.03
stmt19_83_91
FAIL
900.03
stmt17_70_82
FAIL
900.03
PhaseService
FAIL
900.04
stmt23_67_92
FAIL
900.04
amba3b5y.sat
FAIL
900.04
genbuf9b4n.sat
FAIL
900.04
sdlx-fixpoint-3
FAIL
900.04
stmt19_75_83
FAIL
900.04
stmt28_73_85
FAIL
900.04
ActivityService2
FAIL
900.04
stmt23_92_96
FAIL
900.04
stmt17_78_98
FAIL
900.04
oski3ub5i_c0to63.sat
FAIL
900.04
intermediate128
FAIL
900.04
stmt17_82_94
FAIL
900.04
Q_2-3_v-80-100_r-11.9
FAIL
900.04
stmt19_302_352
FAIL
900.04
usb-phy-fixpoint-5
FAIL
900.04
oski3ub5i_c0to511.sat
FAIL
900.04
AR-fixpoint-1
FAIL
900.04
neclaftp2002
FAIL
900.04
small-seq-fixpoint-10
FAIL
900.04
sdlx-fixpoint-5
FAIL
900.04
query58_query42_1344n
FAIL
900.05
stmt17_63_78
FAIL
900.05
small-equiv-fixpoint-8
FAIL
900.05
ConcreteActivityService
FAIL
900.05
IssueServiceImpl
FAIL
900.05
AR-fixpoint-4
FAIL
900.05
stmt17_86_98
FAIL
900.05
eijkbs3330
FAIL
900.05
stmt23_88_92
FAIL
900.05
stmt19_65_87
FAIL
900.05
sdlx-fixpoint-6
FAIL
900.05
stmt23_66_96
FAIL
900.05
AR-fixpoint-8
FAIL
900.05
pi-bus-fixpoint-2
FAIL
900.05
query64_query42_1344n
FAIL
900.05
small-seq-fixpoint-4
FAIL
900.05
query42_query06_1344n
FAIL
900.05
small-equiv-fixpoint-1
FAIL
900.06
small-seq-fixpoint-9
FAIL
900.06
stmt32_329_378
FAIL
900.06
AR-fixpoint-6
FAIL
900.06
small-equiv-fixpoint-5
FAIL
900.06
intermediate256
FAIL
900.06
small-seq-fixpoint-8
FAIL
900.06
stmt85_300_399
FAIL
900.06
Q_2-3_v-80-100_r-11.6
FAIL
900.06
Q_2-3_v-80-100_r-11.2
FAIL
900.06
stmt19_71_95
FAIL
900.06
stmt17_74_78
FAIL
900.06
small-pipeline-fixpoint-2
FAIL
900.06
stmt31_190_227
FAIL
900.06
ci.e#1.a#3.E#40.A#60.c#384.w#6.s#8.asp
FAIL
900.06
oski3ub5i_c0to255.sat
FAIL
900.06
query71_query31_1344n
FAIL
900.06
small-seq-fixpoint-6
FAIL
900.06
stmt44_40_387
FAIL
900.06
stmt17_62_98
FAIL
900.06
stmt17_70_98
FAIL
900.06
small-seq-fixpoint-5
FAIL
900.07
stmt52_295_394
FAIL
900.07
small-equiv-fixpoint-2
FAIL
900.07
ethernet-fixpoint-3
FAIL
900.07
stmt19_75_95
FAIL
900.07
small-equiv-fixpoint-3
FAIL
900.07
query48_query42_1344n
FAIL
900.07
6s289rb05233_c0to63.sat
FAIL
900.07
Q_2-3_v-80-100_r-11.0
FAIL
900.07
stmt19_83_412
FAIL
900.08
stmt17_78_94
FAIL
900.08
small-seq-fixpoint-3
FAIL
900.08
ctrl.e#1.a#3.E#124.A#48.c#.w#7.s#50.asp
FAIL
900.08
stmt19_64_99
FAIL
900.09
stmt23_66_76
FAIL
900.09
stmt17_70_78
FAIL
900.09
stmt17_62_78
FAIL
900.09
stmt17_82_98
FAIL
900.09
ethernet-fixpoint-4
FAIL
900.09
ActivityService
FAIL
900.1
query71_query36_1344n
FAIL
900.1
stmt28_68_69
FAIL
900.1
stmt19_87_95
FAIL
900.11
small-seq-fixpoint-7
FAIL
900.11
nreachq_query54_1344n
FAIL
900.11
beemskbn1f1_c0to7.sat
FAIL
900.23
Contact
|
Organization
|
Links
|
Citing QBFLIB