QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances solved by
caqe_2017_v1
QBFEVAL'17 - Prenex 2QBF Track
Instance
Result
Time
rankfunc38_signed_64
SAT
0
pdtpmsrotate32
SAT
0
small-bug1-fixpoint-8
SAT
0
rankfunc38_unsigned_64
SAT
0
query24_query42_1344n
UNSAT
0
small-bug1-fixpoint-5
SAT
0
small-bug1-fixpoint-9
SAT
0
falsequ_query42_1344n
UNSAT
0
query23_query42_1344n
UNSAT
0
small-dyn-partition-fixpoint-1
UNSAT
0
floor128
SAT
0
small-bug1-fixpoint-10
SAT
0
small-bug1-fixpoint-3
SAT
0
small-bug1-fixpoint-4
SAT
0
small-dyn-partition-fixpoint-2
UNSAT
0
small-bug1-fixpoint-6
SAT
0
trueque_query42_1344n
UNSAT
0
decomposition128
SAT
0
equalization128
SAT
0.01
add20y.sat
SAT
0.01
kenflashp04
SAT
0.01
small-dyn-partition-fixpoint-3
UNSAT
0.01
small-dyn-partition-fixpoint-4
UNSAT
0.01
itc-b13-fixpoint-1
UNSAT
0.02
query30_query42_1344n
UNSAT
0.02
stmt25_597_598
SAT
0.02
query15_query42_1344n
UNSAT
0.02
small-dyn-partition-fixpoint-5
UNSAT
0.02
stmt5_731_730
SAT
0.02
rankfunc53_signed_64
SAT
0.02
rankfunc53_unsigned_64
SAT
0.02
bobtuint31neg
SAT
0.03
ceiling256
SAT
0.03
rankfunc34_signed_64
SAT
0.03
rankfunc61_unsigned_64
SAT
0.03
rankfunc51_signed_64
SAT
0.03
stmt41_262_275
SAT
0.03
rankfunc60_unsigned_32
SAT
0.03
small-dyn-partition-fixpoint-7
UNSAT
0.03
small-dyn-partition-fixpoint-6
UNSAT
0.03
rankfunc51_unsigned_64
SAT
0.03
rankfunc54_unsigned_64
SAT
0.03
rankfunc56_unsigned_64
SAT
0.04
rankfunc54_signed_64
SAT
0.04
rankfunc34_unsigned_64
SAT
0.04
sdlx-fixpoint-1
UNSAT
0.04
driver_c9y.sat
SAT
0.04
itc-b13-fixpoint-2
UNSAT
0.06
rankfunc41_signed_64
SAT
0.06
rankfunc31_signed_64
SAT
0.06
small-dyn-partition-fixpoint-9
UNSAT
0.06
rankfunc41_unsigned_64
SAT
0.06
small-dyn-partition-fixpoint-10
UNSAT
0.06
stmt27_93_98
SAT
0.06
rankfunc31_unsigned_64
SAT
0.06
rankfunc48_unsigned_16
SAT
0.06
cycle_sched_12_2_1.sat
SAT
0.07
driver_c9n.sat
SAT
0.07
rankfunc61_signed_64
SAT
0.08
rankfunc52_signed_64
SAT
0.08
rankfunc35_unsigned_64
SAT
0.08
rankfunc52_unsigned_64
SAT
0.08
rankfunc58_unsigned_64
SAT
0.09
rankfunc58_signed_64
SAT
0.09
rankfunc59_unsigned_64
SAT
0.11
rankfunc59_signed_64
SAT
0.11
driver_a10y.sat
SAT
0.12
rankfunc56_signed_64
SAT
0.13
driver_b8n.sat
SAT
0.14
bs128y.sat
SAT
0.14
itc-b13-fixpoint-3
SAT
0.14
axquery_query42_1344n
UNSAT
0.15
bs128n.sat
SAT
0.15
rankfunc55_signed_64
SAT
0.16
small-swap1-fixpoint-4
SAT
0.17
eijkbs3330
SAT
0.17
small-swap1-fixpoint-6
SAT
0.19
nxquery_query42_1344n
UNSAT
0.2
small-swap2-fixpoint-5
SAT
0.22
query04_query25_1344n
SAT
0.22
itc-b13-fixpoint-4
SAT
0.22
mult_bool_matrix_dyn_9_5.sat
SAT
0.23
rankfunc49_signed_64
SAT
0.26
query02_query42_1344n
UNSAT
0.26
rankfunc49_unsigned_64
SAT
0.26
stmt19_66_214
UNSAT
0.26
rankfunc35_signed_64
SAT
0.27
exquery_query42_1344n
UNSAT
0.28
small-swap2-fixpoint-6
SAT
0.28
ntrivil_query42_1344n
UNSAT
0.3
small-seq-fixpoint-1
UNSAT
0.3
small-swap2-fixpoint-7
SAT
0.33
trivial_query42_1344n
UNSAT
0.34
query52_query25_1344n
SAT
0.36
rankfunc48_unsigned_64
SAT
0.37
small-swap2-fixpoint-8
SAT
0.4
rankfunc2_unsigned_64
SAT
0.42
query31_eequery_1344n
SAT
0.42
rankfunc55_unsigned_64
SAT
0.42
query36_query25_1344n
SAT
0.42
ltl2dba_C2-8_comp4_REAL.sat
SAT
0.43
small-swap1-fixpoint-7
SAT
0.44
query27_query42_1344n
UNSAT
0.46
small-pipeline-fixpoint-1
UNSAT
0.46
small-swap1-fixpoint-5
SAT
0.51
itc-b13-fixpoint-6
SAT
0.55
ethernet-fixpoint-1
UNSAT
0.57
small-synabs-fixpoint-10
UNSAT
0.6
mult_bool_matrix_12_13_11.sat
SAT
0.63
usb-phy-fixpoint-1
UNSAT
0.64
stmt19_180_352
UNSAT
0.67
rankfunc57_unsigned_64
SAT
0.67
rankfunc55_unsigned_32
SAT
0.7
query26_query42_1344n
UNSAT
0.76
small-swap1-fixpoint-8
SAT
0.8
small-swap2-fixpoint-9
SAT
0.8
itc-b13-fixpoint-7
SAT
0.81
stmt22_311_370
UNSAT
0.82
stmt19_352_359
UNSAT
0.82
query07_query42_1344n
UNSAT
0.86
cache-coherence-3-fixpoint-1
UNSAT
0.97
stmt21_71_354
UNSAT
1.12
query02_query44_1344n
UNSAT
1.14
nxquery_query50_1344n
SAT
1.22
usb-phy-fixpoint-2
UNSAT
1.24
itc-b13-fixpoint-9
SAT
1.26
sortnetsort7.AE.stepl.007
UNSAT
1.42
cycle_sched_4_4_2.sat
SAT
1.46
query04_query42_1344n
UNSAT
1.64
sortnetsort7.AE.stepl.006
UNSAT
2.11
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#1.asp
SAT
2.12
sortnetsort7.AE.stepl.009
UNSAT
2.14
sortnetsort8.AE.stepl.004
SAT
2.15
cycle_sched_2_10_1.sat
SAT
2.16
query21_query42_1344n
UNSAT
2.25
small-swap2-fixpoint-10
SAT
2.28
small-swap1-fixpoint-10
SAT
3.05
small-swap1-fixpoint-9
SAT
3.12
mult_bool_matrix_18_18_18.sat
SAT
3.36
sortnetsort7.AE.stepl.008
UNSAT
3.85
query31_query50_1344n
SAT
3.92
query64_query01_1344n
SAT
4.06
sortnetsort9.AE.stepl.004
SAT
4.14
stmt19_137_408
UNSAT
4.27
itc-b13-fixpoint-8
SAT
4.29
query49_ntrivil_1344n
SAT
4.6
sdlx-fixpoint-2
UNSAT
4.72
stmt46_289_388
UNSAT
5.53
stmt21_71_413
UNSAT
5.8
query33_query45_1344n
SAT
6.82
sortnetsort8.AE.stepl.006
UNSAT
6.96
eequery_query64_1344n
SAT
7.47
stmt21_70_369
UNSAT
10.71
sortnetsort8.AE.stepl.008
UNSAT
10.87
amba2c7n.sat
SAT
11.09
sortnetsort8.AE.stepl.005
SAT
11.44
query05_query31_1344n
SAT
11.8
query03_query42_1344n
UNSAT
12.75
sortnetsort10.AE.stepl.004
SAT
12.83
stmt19_90_408
UNSAT
13.5
query45_query42_1344n
SAT
16.82
cycle_sched_6_6_2.sat
SAT
18.9
query06_query42_1344n
UNSAT
19.22
stmt19_133_217
UNSAT
20.13
load_2c_comp_comp7_REAL.sat
SAT
20.7
sortnetsort8.AE.stepl.009
UNSAT
21.1
stmt21_143_403
UNSAT
21.57
stmt21_84_215
UNSAT
22.09
query08_query42_1344n
UNSAT
23.42
ctrl.e#1.a#3.E#112.A#48.c#.w#5.s#27.asp
SAT
23.92
ctrl.e#1.a#3.E#110.A#48.c#.w#9.s#13.asp
SAT
23.97
eequery_query42_1344n
SAT
24.92
query50_query42_1344n
SAT
25.27
query48_exquery_1344n
SAT
29.21
query50_query06_1344n
SAT
30.8
stmt21_178_258
UNSAT
31.11
sortnetsort9.AE.stepl.005
SAT
31.96
sortnetsort9.AE.stepl.011
UNSAT
35.1
query09_query42_1344n
UNSAT
38.31
sortnetsort7.AE.stepl.005
SAT
42.36
sortnetsort9.AE.stepl.008
UNSAT
43.57
query25_query42_1344n
SAT
55.24
query36_query42_1344n
SAT
58.81
itc-b13-fixpoint-10
SAT
61.76
query05_query42_1344n
SAT
69.92
query31_query42_1344n
SAT
73.27
stmt27_16_224
UNSAT
82.43
query52_query42_1344n
SAT
88.01
query34_query11_1344n
SAT
92.71
query42_query42_1344n
UNSAT
115.89
stmt47_340_389
UNSAT
143.96
query60_query45_1344n
SAT
145.22
stmt27_149_224
UNSAT
145.49
stmt53_208_245
UNSAT
147.38
stmt31_276_328
UNSAT
158.17
query58_query42_1344n
UNSAT
164.08
ctrl.e#1.a#3.E#120.A#48.c#.w#3.s#3.asp
SAT
164.11
sortnetsort9.AE.stepl.007
UNSAT
164.66
ctrl.e#1.a#3.E#116.A#48.c#.w#7.s#56.asp
SAT
165.04
sortnetsort10.AE.stepl.009
UNSAT
167.1
stmt22_6_414
UNSAT
169.85
query33_query51_1344n
SAT
178.25
sortnetsort10.AE.stepl.011
UNSAT
185.68
stmt21_84_364
UNSAT
231.25
stmt53_296_346
UNSAT
233.28
GuidanceService
UNSAT
244.85
GuidanceService2
UNSAT
247.57
stmt46_111_238
UNSAT
273.81
query11_query42_1344n
SAT
305.31
query33_query42_1344n
SAT
311.61
sortnetsort9.AE.stepl.010
UNSAT
325.66
mult9.sat
SAT
340.75
query54_query58_1344n
SAT
351.29
amba3b5y.sat
SAT
369.1
query55_query42_1344n
SAT
382.54
stmt47_290_340
UNSAT
442.97
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#26.asp
SAT
477.16
query51_query57_1344n
SAT
483.63
query34_query42_1344n
SAT
501.64
query33_query57_1344n
SAT
553.76
query01_query42_1344n
SAT
565.84
sortnetsort10.AE.stepl.008
UNSAT
637.16
query48_query42_1344n
UNSAT
660.39
sortnetsort10.AE.stepl.005
SAT
692.55
sortnetsort10.AE.stepl.010
UNSAT
718.58
query54_query42_1344n
SAT
734.69
query71_query36_1344n
UNSAT
789.33
query10_query45_1344n
SAT
845.88
ActivityService
FAIL
900
ctrl.e#1.a#3.E#118.A#48.c#.w#5.s#7.asp
FAIL
900
stmt19_75_83
FAIL
900
LoginService
FAIL
900
stmt17_78_90
FAIL
900
PhaseService
FAIL
900
stmt19_65_95
FAIL
900
NotificationServiceImpl2
FAIL
900
stmt19_65_87
FAIL
900
IterationService
FAIL
900
stmt17_62_78
FAIL
900
stmt17_70_78
FAIL
900
reachqu_query42_1344n
FAIL
900
query71_query42_1344n
FAIL
900
query64_query42_1344n
FAIL
900
query60_query42_1344n
FAIL
900
stmt19_87_95
FAIL
900
stmt17_74_78
FAIL
900
sortnetsort10.AE.stepl.012
FAIL
900
stmt19_75_95
FAIL
900
stmt17_74_90
FAIL
900
IssueServiceImpl
FAIL
900
ConcreteActivityService
FAIL
900
neclaftp2002
FAIL
900
stmt28_73_97
FAIL
900
stmt17_78_94
FAIL
900
stmt17_82_94
FAIL
900
intermediate256
FAIL
900
stmt28_68_69
FAIL
900
query57_query42_1344n
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#7.asp
FAIL
900
oski3ub5i_c0to511.sat
FAIL
900
beemskbn1f1_c0to7.sat
FAIL
900
6s289rb05233_c0to63.sat
FAIL
900
genbuf8b4n.sat
FAIL
900
genbuf7b4n.sat
FAIL
900
genbuf14b4y.sat
FAIL
900
genbuf12b4y.sat
FAIL
900
stmt19_79_83
FAIL
900
oski3ub5i_c0to63.sat
FAIL
900
sortnetsort9.AE.stepl.006
FAIL
900
load_3c_comp_comp6_REAL.sat
FAIL
900
sortnetsort10.AE.stepl.006
FAIL
900
sortnetsort10.AE.stepl.007
FAIL
900
mult_bool_matrix_dyn_7_7.sat
FAIL
900
ltl2dba_U1-4_comp4_REAL.sat
FAIL
900
ltl2dba_Q4_comp4_REAL.sat
FAIL
900
ltl2dba_E6_comp2_REAL.sat
FAIL
900
load_full_3_comp5_REAL.sat
FAIL
900
load_4c_comp_comp4_REAL.sat
FAIL
900
stmt28_73_85
FAIL
900
stmt23_66_76
FAIL
900
stmt28_68_73
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#60.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#17.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#1.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#9.s#60.asp
FAIL
900
ctrl.e#1.a#3.E#134.A#48.c#.w#9.s#40.asp
FAIL
900
ctrl.e#1.a#3.E#130.A#48.c#.w#7.s#11.asp
FAIL
900
ctrl.e#1.a#3.E#124.A#48.c#.w#7.s#50.asp
FAIL
900
ctrl.e#1.a#3.E#122.A#48.c#.w#3.s#51.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#5.s#1.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#5.s#60.asp
FAIL
900
stmt19_79_87
FAIL
900
stmt17_78_98
FAIL
900
stmt28_89_97
FAIL
900
stmt23_88_92
FAIL
900
amba5b5n.sat
FAIL
900
amba4c7n.sat
FAIL
900
stmt17_70_86
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#9.s#1.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#60.asp
FAIL
900
stmt17_63_78
FAIL
900
query42_query45_1344n
FAIL
900
small-pipeline-fixpoint-4
FAIL
900
cache-coherence-2-fixpoint-5
FAIL
900
nreachq_query54_1344n
FAIL
900
nreachq_query11_1344n
FAIL
900
sdlx-fixpoint-6
FAIL
900
small-equiv-fixpoint-4
FAIL
900
small-pipeline-fixpoint-10
FAIL
900
small-seq-fixpoint-2
FAIL
900
AR-fixpoint-4
FAIL
900
pi-bus-fixpoint-2
FAIL
900
cache-coherence-2-fixpoint-2
FAIL
900
small-seq-fixpoint-4
FAIL
900
small-equiv-fixpoint-7
FAIL
900
small-equiv-fixpoint-8
FAIL
900
AR-fixpoint-2
FAIL
900
sdlx-fixpoint-4
FAIL
900
query10_query34_1344n
FAIL
900
query10_query06_1344n
FAIL
900
small-pipeline-fixpoint-3
FAIL
900
AR-fixpoint-6
FAIL
900
sdlx-fixpoint-5
FAIL
900
ethernet-fixpoint-2
FAIL
900
sdlx-fixpoint-9
FAIL
900
small-pipeline-fixpoint-8
FAIL
900
small-pipeline-fixpoint-5
FAIL
900
sdlx-fixpoint-7
FAIL
900
ethernet-fixpoint-4
FAIL
900
usb-phy-fixpoint-5
FAIL
900
small-seq-fixpoint-10
FAIL
900
AR-fixpoint-10
FAIL
900
small-pipeline-fixpoint-2
FAIL
900
sdlx-fixpoint-8
FAIL
900
sdlx-fixpoint-10
FAIL
900
AR-fixpoint-8
FAIL
900
small-equiv-fixpoint-1
FAIL
900
ethernet-fixpoint-3
FAIL
900
small-equiv-fixpoint-3
FAIL
900
cache-coherence-3-fixpoint-2
FAIL
900
small-seq-fixpoint-6
FAIL
900
small-pipeline-fixpoint-9
FAIL
900
query42_query60_1344n
FAIL
900
stmt19_71_95
FAIL
900
stmt19_64_91
FAIL
900
stmt23_67_92
FAIL
900
stmt31_190_227
FAIL
900
stmt41_286_385
FAIL
900
stmt44_40_387
FAIL
900
query10_query42_1344n
FAIL
900
stmt19_302_352
FAIL
900
stmt52_295_394
FAIL
900
stmt17_94_98
FAIL
900
stmt23_92_96
FAIL
900
query51_query42_1344n
FAIL
900
stmt17_70_82
FAIL
900
query49_query42_1344n
FAIL
900
stmt19_64_87
FAIL
900
query44_query42_1344n
FAIL
900
stmt23_66_67
FAIL
900
stmt19_83_91
FAIL
900
stmt17_63_70
FAIL
900
stmt19_3_401
FAIL
900
stmt22_320_370
FAIL
900
stmt19_368_417
FAIL
900
stmt21_181_218
FAIL
900
stmt29_275_376
FAIL
900
query60_query44_1344n
FAIL
900
query60_query33_1344n
FAIL
900
query60_query10_1344n
FAIL
900
rankfunc48_signed_64
FAIL
900
small-equiv-fixpoint-5
FAIL
900
small-equiv-fixpoint-2
FAIL
900
query64_query11_1344n
FAIL
900
query71_query31_1344n
FAIL
900
stmt41_336_385
FAIL
900
stmt31_22_328
FAIL
900
stmt85_300_399
FAIL
900
stmt21_354_403
FAIL
900
nreachq_query42_1344n
FAIL
900
stmt50_343_392
FAIL
900
stmt17_82_86
FAIL
900
query71_query34_1344n
FAIL
900
usb-phy-fixpoint-4
FAIL
900
Contact
|
Organization
|
Links
|
Citing QBFLIB