QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances solved by
ASPQ2
QBFEVAL'17 - Prenex 2QBF Track
Instance
Result
Time
trueque_query42_1344n
UNSAT
0
small-bug1-fixpoint-6
SAT
0
rankfunc38_signed_64
SAT
0
query24_query42_1344n
UNSAT
0
small-bug1-fixpoint-4
SAT
0
small-bug1-fixpoint-3
SAT
0
floor128
SAT
0
kenflashp04
SAT
0
small-dyn-partition-fixpoint-2
UNSAT
0
small-bug1-fixpoint-5
SAT
0
falsequ_query42_1344n
UNSAT
0
pdtpmsrotate32
SAT
0
small-dyn-partition-fixpoint-1
UNSAT
0
small-bug1-fixpoint-9
SAT
0
small-bug1-fixpoint-10
SAT
0
decomposition128
SAT
0.01
small-bug1-fixpoint-8
SAT
0.01
query23_query42_1344n
UNSAT
0.01
small-dyn-partition-fixpoint-3
UNSAT
0.01
rankfunc38_unsigned_64
SAT
0.01
add20y.sat
SAT
0.01
rankfunc53_signed_64
SAT
0.02
stmt25_597_598
SAT
0.02
equalization128
SAT
0.02
small-dyn-partition-fixpoint-4
UNSAT
0.02
stmt5_731_730
SAT
0.02
itc-b13-fixpoint-1
UNSAT
0.02
small-dyn-partition-fixpoint-5
UNSAT
0.02
query15_query42_1344n
UNSAT
0.02
query30_query42_1344n
UNSAT
0.02
bobtuint31neg
SAT
0.03
rankfunc61_unsigned_64
SAT
0.03
rankfunc53_unsigned_64
SAT
0.03
small-dyn-partition-fixpoint-6
UNSAT
0.03
rankfunc51_signed_64
SAT
0.04
small-dyn-partition-fixpoint-7
UNSAT
0.04
rankfunc54_signed_64
SAT
0.04
stmt41_262_275
SAT
0.04
ceiling256
SAT
0.04
rankfunc51_unsigned_64
SAT
0.04
rankfunc34_signed_64
SAT
0.04
rankfunc56_unsigned_64
SAT
0.04
rankfunc54_unsigned_64
SAT
0.04
rankfunc60_unsigned_32
SAT
0.04
rankfunc34_unsigned_64
SAT
0.04
driver_c9y.sat
SAT
0.05
sdlx-fixpoint-1
UNSAT
0.05
rankfunc41_unsigned_64
SAT
0.06
rankfunc41_signed_64
SAT
0.06
itc-b13-fixpoint-2
UNSAT
0.06
rankfunc31_unsigned_64
SAT
0.06
small-dyn-partition-fixpoint-9
UNSAT
0.06
rankfunc31_signed_64
SAT
0.06
driver_c9n.sat
SAT
0.07
rankfunc48_unsigned_16
SAT
0.07
stmt27_93_98
SAT
0.07
small-dyn-partition-fixpoint-10
UNSAT
0.07
cycle_sched_12_2_1.sat
SAT
0.07
rankfunc52_signed_64
SAT
0.08
rankfunc52_unsigned_64
SAT
0.08
rankfunc35_unsigned_64
SAT
0.08
rankfunc61_signed_64
SAT
0.09
rankfunc58_unsigned_64
SAT
0.09
rankfunc58_signed_64
SAT
0.09
rankfunc59_signed_64
SAT
0.11
rankfunc59_unsigned_64
SAT
0.12
driver_a10y.sat
SAT
0.13
driver_b8n.sat
SAT
0.14
rankfunc56_signed_64
SAT
0.14
itc-b13-fixpoint-3
SAT
0.14
bs128y.sat
SAT
0.15
bs128n.sat
SAT
0.15
rankfunc55_signed_64
SAT
0.16
eijkbs3330
SAT
0.17
small-swap1-fixpoint-4
SAT
0.18
small-swap1-fixpoint-6
SAT
0.2
small-swap2-fixpoint-5
SAT
0.23
itc-b13-fixpoint-4
SAT
0.24
rankfunc49_unsigned_64
SAT
0.26
stmt19_66_214
UNSAT
0.27
rankfunc49_signed_64
SAT
0.28
rankfunc35_signed_64
SAT
0.28
small-swap2-fixpoint-6
SAT
0.29
small-seq-fixpoint-1
UNSAT
0.31
exquery_query42_1344n
UNSAT
0.34
query26_query42_1344n
UNSAT
0.34
small-swap2-fixpoint-7
SAT
0.34
nxquery_query42_1344n
UNSAT
0.35
rankfunc48_unsigned_64
SAT
0.38
small-swap2-fixpoint-8
SAT
0.41
query02_query44_1344n
UNSAT
0.41
mult_bool_matrix_dyn_9_5.sat
SAT
0.42
rankfunc2_unsigned_64
SAT
0.43
rankfunc55_unsigned_64
SAT
0.43
query02_query42_1344n
UNSAT
0.43
ltl2dba_C2-8_comp4_REAL.sat
SAT
0.44
small-swap1-fixpoint-7
SAT
0.46
axquery_query42_1344n
UNSAT
0.46
query27_query42_1344n
UNSAT
0.46
ntrivil_query42_1344n
UNSAT
0.48
trivial_query42_1344n
UNSAT
0.48
small-swap1-fixpoint-5
SAT
0.53
itc-b13-fixpoint-6
SAT
0.57
query04_query25_1344n
SAT
0.58
ethernet-fixpoint-1
UNSAT
0.58
small-synabs-fixpoint-10
UNSAT
0.62
mult_bool_matrix_12_13_11.sat
SAT
0.64
small-pipeline-fixpoint-1
UNSAT
0.68
stmt19_180_352
UNSAT
0.69
rankfunc55_unsigned_32
SAT
0.71
query07_query42_1344n
UNSAT
0.77
ctrl.e#1.a#3.E#110.A#48.c#.w#9.s#13.asp
SAT
0.78
small-swap2-fixpoint-9
SAT
0.83
usb-phy-fixpoint-1
UNSAT
0.83
small-swap1-fixpoint-8
SAT
0.83
itc-b13-fixpoint-7
SAT
0.85
stmt22_311_370
UNSAT
0.85
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#1.asp
SAT
0.86
rankfunc57_unsigned_64
SAT
0.9
query52_query25_1344n
SAT
0.9
cache-coherence-3-fixpoint-1
UNSAT
0.99
query21_query42_1344n
UNSAT
1.05
query04_query42_1344n
UNSAT
1.14
query31_eequery_1344n
SAT
1.31
itc-b13-fixpoint-9
SAT
1.31
query36_query25_1344n
SAT
1.33
ctrl.e#1.a#3.E#112.A#48.c#.w#5.s#27.asp
SAT
1.41
usb-phy-fixpoint-2
UNSAT
1.47
stmt19_137_408
UNSAT
1.65
stmt47_340_389
UNSAT
1.68
stmt19_352_359
UNSAT
2.12
sortnetsort8.AE.stepl.004
SAT
2.12
stmt21_71_354
UNSAT
2.13
small-swap2-fixpoint-10
SAT
2.33
cycle_sched_4_4_2.sat
SAT
2.34
sortnetsort7.AE.stepl.007
UNSAT
2.53
stmt21_70_369
UNSAT
2.53
sortnetsort7.AE.stepl.006
UNSAT
2.71
ctrl.e#1.a#3.E#116.A#48.c#.w#7.s#56.asp
SAT
2.79
cycle_sched_2_10_1.sat
SAT
2.83
query08_query42_1344n
UNSAT
2.85
sortnetsort7.AE.stepl.009
UNSAT
2.95
sortnetsort7.AE.stepl.008
UNSAT
3.01
small-swap1-fixpoint-10
SAT
3.12
small-swap1-fixpoint-9
SAT
3.18
ctrl.e#1.a#3.E#128.A#48.c#.w#9.s#60.asp
SAT
4.37
sdlx-fixpoint-2
UNSAT
4.43
query03_query42_1344n
UNSAT
4.55
stmt21_84_364
UNSAT
4.72
stmt27_149_224
UNSAT
4.82
nxquery_query50_1344n
SAT
5.36
sortnetsort8.AE.stepl.006
UNSAT
5.48
ctrl.e#1.a#3.E#120.A#48.c#.w#3.s#3.asp
SAT
5.85
query49_ntrivil_1344n
SAT
6.16
sortnetsort9.AE.stepl.004
SAT
6.71
query09_query42_1344n
UNSAT
6.86
stmt22_6_414
UNSAT
7.43
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#60.asp
SAT
8.34
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#26.asp
SAT
9.04
stmt21_84_215
UNSAT
9.64
sortnetsort8.AE.stepl.008
UNSAT
10.87
GuidanceService
UNSAT
11.72
GuidanceService2
UNSAT
11.75
itc-b13-fixpoint-8
SAT
12.17
stmt19_90_408
UNSAT
12.48
eequery_query42_1344n
SAT
14.01
ctrl.e#1.a#3.E#118.A#48.c#.w#5.s#7.asp
SAT
14.3
sortnetsort10.AE.stepl.004
SAT
14.33
query45_query42_1344n
SAT
15.22
sortnetsort8.AE.stepl.005
SAT
15.82
query33_query45_1344n
SAT
15.87
query50_query42_1344n
SAT
16.15
query31_query50_1344n
SAT
16.35
load_2c_comp_comp7_REAL.sat
SAT
16.36
query48_exquery_1344n
SAT
17.34
eequery_query64_1344n
SAT
18.96
query05_query31_1344n
SAT
19.87
query36_query42_1344n
SAT
20.86
query52_query42_1344n
SAT
21.4
query31_query42_1344n
SAT
23.31
query05_query42_1344n
SAT
24.73
cycle_sched_6_6_2.sat
SAT
25.29
query25_query42_1344n
SAT
28.2
sortnetsort9.AE.stepl.005
SAT
33.77
sortnetsort8.AE.stepl.009
UNSAT
35.36
query11_query42_1344n
SAT
38.21
sortnetsort9.AE.stepl.007
UNSAT
39.97
stmt19_133_217
UNSAT
42.26
query33_query42_1344n
SAT
44.96
query54_query42_1344n
SAT
54.12
sortnetsort9.AE.stepl.011
UNSAT
56.37
query55_query42_1344n
SAT
56.65
sortnetsort9.AE.stepl.008
UNSAT
57.58
stmt27_16_224
UNSAT
59.59
stmt21_71_413
UNSAT
60.59
stmt31_22_328
UNSAT
68.8
query50_query06_1344n
SAT
75.84
query34_query42_1344n
SAT
78.63
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#7.asp
SAT
83.86
query60_query45_1344n
SAT
85.07
amba2c7n.sat
SAT
86.38
stmt46_289_388
UNSAT
91.02
stmt21_178_258
UNSAT
117.49
query01_query42_1344n
SAT
120.01
stmt21_143_403
UNSAT
125.94
query51_query42_1344n
SAT
146.57
stmt47_290_340
UNSAT
152.72
query33_query57_1344n
SAT
155.14
stmt46_111_238
UNSAT
160.51
query06_query42_1344n
UNSAT
167.59
query51_query57_1344n
SAT
178.12
query33_query51_1344n
SAT
183.39
ctrl.e#1.a#3.E#128.A#48.c#.w#9.s#1.asp
SAT
188.03
sortnetsort9.AE.stepl.010
UNSAT
189.45
mult9.sat
SAT
194.9
sortnetsort10.AE.stepl.011
UNSAT
255.75
ctrl.e#1.a#3.E#128.A#48.c#.w#5.s#60.asp
SAT
282.25
query34_query11_1344n
SAT
288.49
sortnetsort10.AE.stepl.008
UNSAT
291.56
stmt44_40_387
UNSAT
317.95
sortnetsort7.AE.stepl.005
SAT
361.64
ctrl.e#1.a#3.E#134.A#48.c#.w#9.s#40.asp
SAT
371.5
query64_query01_1344n
SAT
378.16
sortnetsort10.AE.stepl.009
UNSAT
386.48
query54_query58_1344n
SAT
429.51
sortnetsort10.AE.stepl.012
UNSAT
541.6
query64_query11_1344n
SAT
628.44
query48_query42_1344n
UNSAT
663.46
query64_query42_1344n
FAIL
700.37
ctrl.e#1.a#3.E#122.A#48.c#.w#3.s#51.asp
FAIL
700.4
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#1.asp
FAIL
700.4
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#60.asp
FAIL
700.41
mult_bool_matrix_dyn_7_7.sat
FAIL
700.42
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#17.asp
FAIL
700.44
small-equiv-fixpoint-1
FAIL
700.46
intermediate256
FAIL
700.52
small-pipeline-fixpoint-2
FAIL
700.53
ctrl.e#1.a#3.E#128.A#48.c#.w#5.s#1.asp
FAIL
700.55
amba3b5y.sat
FAIL
700.6
query71_query34_1344n
FAIL
700.62
query60_query10_1344n
FAIL
700.62
small-equiv-fixpoint-2
FAIL
700.63
query71_query36_1344n
FAIL
700.64
genbuf7b4n.sat
FAIL
700.64
query60_query33_1344n
FAIL
700.65
IssueServiceImpl
FAIL
700.65
stmt41_286_385
FAIL
700.66
query71_query42_1344n
FAIL
700.67
stmt28_68_69
FAIL
700.68
query71_query31_1344n
FAIL
700.69
sdlx-fixpoint-4
FAIL
700.69
query60_query42_1344n
FAIL
700.71
stmt50_343_392
FAIL
700.72
query58_query42_1344n
FAIL
700.72
ctrl.e#1.a#3.E#130.A#48.c#.w#7.s#11.asp
FAIL
700.73
stmt28_68_73
FAIL
700.74
query57_query42_1344n
FAIL
700.74
stmt21_181_218
FAIL
700.74
stmt17_63_78
FAIL
700.74
PhaseService
FAIL
700.75
IterationService
FAIL
700.76
ActivityService
FAIL
700.76
query60_query44_1344n
FAIL
700.76
stmt29_275_376
FAIL
700.77
stmt53_296_346
FAIL
700.78
ctrl.e#1.a#3.E#124.A#48.c#.w#7.s#50.asp
FAIL
700.78
stmt31_190_227
FAIL
700.79
stmt53_208_245
FAIL
700.79
stmt17_62_78
FAIL
700.8
stmt52_295_394
FAIL
700.8
stmt31_276_328
FAIL
700.81
stmt19_64_87
FAIL
700.81
stmt17_70_78
FAIL
700.83
stmt19_3_401
FAIL
700.84
small-equiv-fixpoint-3
FAIL
700.84
stmt17_63_70
FAIL
700.84
stmt19_368_417
FAIL
700.86
stmt85_300_399
FAIL
700.86
small-pipeline-fixpoint-3
FAIL
700.86
stmt19_64_91
FAIL
700.87
stmt19_65_87
FAIL
700.87
stmt19_302_352
FAIL
700.89
stmt17_70_82
FAIL
700.89
stmt41_336_385
FAIL
700.9
stmt21_354_403
FAIL
700.91
stmt17_74_78
FAIL
700.92
stmt19_75_83
FAIL
700.92
stmt23_67_92
FAIL
700.92
stmt17_70_86
FAIL
700.93
stmt23_66_67
FAIL
700.93
ConcreteActivityService
FAIL
700.94
stmt19_79_83
FAIL
700.96
stmt19_65_95
FAIL
700.96
stmt28_73_85
FAIL
700.97
sdlx-fixpoint-5
FAIL
700.98
genbuf8b4n.sat
FAIL
700.98
stmt17_74_90
FAIL
701
small-equiv-fixpoint-4
FAIL
701.01
stmt19_79_87
FAIL
701.01
stmt23_66_76
FAIL
701.02
stmt19_71_95
FAIL
701.02
LoginService
FAIL
701.03
stmt19_75_95
FAIL
701.05
stmt17_82_86
FAIL
701.06
stmt17_78_90
FAIL
701.06
stmt22_320_370
FAIL
701.07
ethernet-fixpoint-2
FAIL
701.08
stmt17_78_94
FAIL
701.09
stmt19_83_91
FAIL
701.11
stmt28_73_97
FAIL
701.12
stmt17_78_98
FAIL
701.13
cache-coherence-3-fixpoint-2
FAIL
701.14
stmt23_88_92
FAIL
701.15
amba4c7n.sat
FAIL
701.17
stmt17_82_94
FAIL
701.17
rankfunc48_signed_64
FAIL
701.18
NotificationServiceImpl2
FAIL
701.18
stmt19_87_95
FAIL
701.19
small-equiv-fixpoint-5
FAIL
701.21
stmt23_92_96
FAIL
701.23
cache-coherence-2-fixpoint-2
FAIL
701.23
small-pipeline-fixpoint-4
FAIL
701.29
stmt28_89_97
FAIL
701.3
stmt17_94_98
FAIL
701.3
amba5b5n.sat
FAIL
701.31
nreachq_query11_1344n
FAIL
701.35
query10_query06_1344n
FAIL
701.36
sdlx-fixpoint-6
FAIL
701.39
nreachq_query54_1344n
FAIL
701.52
sdlx-fixpoint-7
FAIL
701.55
small-equiv-fixpoint-7
FAIL
701.6
sdlx-fixpoint-8
FAIL
701.68
genbuf14b4y.sat
FAIL
701.71
query10_query42_1344n
FAIL
701.72
reachqu_query42_1344n
FAIL
701.73
small-equiv-fixpoint-8
FAIL
701.75
query42_query45_1344n
FAIL
701.76
nreachq_query42_1344n
FAIL
701.78
query10_query34_1344n
FAIL
701.84
query42_query60_1344n
FAIL
701.88
ltl2dba_U1-4_comp4_REAL.sat
FAIL
701.98
query42_query42_1344n
FAIL
701.99
query44_query42_1344n
FAIL
702.01
usb-phy-fixpoint-4
FAIL
702.04
sortnetsort10.AE.stepl.006
FAIL
702.04
ethernet-fixpoint-3
FAIL
702.06
query49_query42_1344n
FAIL
702.08
sdlx-fixpoint-9
FAIL
702.09
genbuf12b4y.sat
FAIL
702.1
cache-coherence-2-fixpoint-5
FAIL
702.28
sdlx-fixpoint-10
FAIL
702.32
itc-b13-fixpoint-10
FAIL
702.35
small-pipeline-fixpoint-5
FAIL
702.43
mult_bool_matrix_18_18_18.sat
FAIL
702.5
usb-phy-fixpoint-5
FAIL
702.52
beemskbn1f1_c0to7.sat
FAIL
702.59
neclaftp2002
FAIL
702.71
ethernet-fixpoint-4
FAIL
702.87
load_3c_comp_comp6_REAL.sat
FAIL
703.41
query10_query45_1344n
FAIL
703.58
sortnetsort10.AE.stepl.005
FAIL
704.02
sortnetsort9.AE.stepl.006
FAIL
705.53
small-pipeline-fixpoint-8
FAIL
706.33
ltl2dba_Q4_comp4_REAL.sat
FAIL
707.5
small-pipeline-fixpoint-9
FAIL
707.69
oski3ub5i_c0to511.sat
FAIL
708.11
small-seq-fixpoint-2
FAIL
708.19
oski3ub5i_c0to63.sat
FAIL
708.56
sortnetsort10.AE.stepl.010
FAIL
709.47
small-pipeline-fixpoint-10
FAIL
709.63
sortnetsort10.AE.stepl.007
FAIL
710.5
small-seq-fixpoint-6
FAIL
711.72
load_full_3_comp5_REAL.sat
FAIL
715.18
load_4c_comp_comp4_REAL.sat
FAIL
719.82
pi-bus-fixpoint-2
FAIL
722.55
AR-fixpoint-2
FAIL
722.91
small-seq-fixpoint-4
FAIL
726.3
ltl2dba_E6_comp2_REAL.sat
FAIL
729.23
small-seq-fixpoint-10
FAIL
730.49
6s289rb05233_c0to63.sat
FAIL
742.52
AR-fixpoint-4
FAIL
748.19
AR-fixpoint-6
FAIL
758.47
AR-fixpoint-8
FAIL
789.06
AR-fixpoint-10
FAIL
794.67
Contact
|
Organization
|
Links
|
Citing QBFLIB