QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances solved by
CUED1919_NL
QBFEVAL'17 - Prenex 2QBF Track
Instance
Result
Time
small-bug1-fixpoint-3
SAT
0.01
trueque_query42_1344n
UNSAT
0.01
falsequ_query42_1344n
UNSAT
0.02
small-bug1-fixpoint-4
SAT
0.04
query24_query42_1344n
UNSAT
0.07
small-dyn-partition-fixpoint-1
UNSAT
0.07
small-bug1-fixpoint-5
SAT
0.13
query23_query42_1344n
UNSAT
0.2
exquery_query42_1344n
UNSAT
0.35
axquery_query42_1344n
UNSAT
0.5
small-bug1-fixpoint-6
SAT
0.56
nxquery_query42_1344n
UNSAT
0.66
query04_query25_1344n
SAT
0.9
query02_query42_1344n
UNSAT
1.14
equalization128
SAT
1.4
nxquery_query50_1344n
SAT
1.61
query26_query42_1344n
UNSAT
1.77
query52_query25_1344n
SAT
1.89
query27_query42_1344n
UNSAT
3.17
query31_eequery_1344n
SAT
4.34
query36_query25_1344n
SAT
4.38
sortnetsort8.AE.stepl.004
SAT
6.38
query04_query42_1344n
UNSAT
8.49
query02_query44_1344n
UNSAT
8.55
sortnetsort7.AE.stepl.008
UNSAT
10.68
sortnetsort9.AE.stepl.004
SAT
11.24
sortnetsort7.AE.stepl.007
UNSAT
11.47
GuidanceService2
UNSAT
11.69
GuidanceService
UNSAT
11.8
sortnetsort7.AE.stepl.009
UNSAT
13.64
query50_query06_1344n
SAT
13.8
sortnetsort7.AE.stepl.006
UNSAT
16.83
query05_query31_1344n
SAT
18.27
small-bug1-fixpoint-8
SAT
20.45
sortnetsort10.AE.stepl.004
SAT
20.87
trivial_query42_1344n
UNSAT
22.82
ntrivil_query42_1344n
UNSAT
22.89
query30_query42_1344n
UNSAT
28.99
query15_query42_1344n
UNSAT
29.25
sortnetsort8.AE.stepl.009
UNSAT
30.11
query31_query50_1344n
SAT
30.82
sortnetsort8.AE.stepl.008
UNSAT
34.1
query07_query42_1344n
UNSAT
39.57
query33_query45_1344n
SAT
44.86
query03_query42_1344n
UNSAT
53.08
query50_query42_1344n
SAT
56.93
eequery_query42_1344n
SAT
58.28
query45_query42_1344n
SAT
68.45
query21_query42_1344n
UNSAT
69.82
query05_query42_1344n
SAT
78.88
query25_query42_1344n
SAT
82.27
AR-fixpoint-10
FAIL
98.64
AR-fixpoint-4
FAIL
108.34
sortnetsort8.AE.stepl.006
UNSAT
116.33
sortnetsort9.AE.stepl.011
UNSAT
117.27
AR-fixpoint-6
FAIL
119.34
AR-fixpoint-8
FAIL
121.15
query36_query42_1344n
SAT
126.63
small-bug1-fixpoint-9
SAT
150.43
rankfunc55_unsigned_32
SAT
156.92
sortnetsort10.AE.stepl.011
UNSAT
159.11
sortnetsort10.AE.stepl.012
UNSAT
175.47
query01_query42_1344n
SAT
234.13
sortnetsort7.AE.stepl.005
SAT
256.9
rankfunc34_unsigned_64
SAT
274.63
rankfunc34_signed_64
SAT
298.71
small-dyn-partition-fixpoint-2
UNSAT
311.02
amba3b5y.sat
FAIL
321.54
genbuf7b4n.sat
FAIL
327.82
cycle_sched_4_4_2.sat
FAIL
329.07
stmt19_64_87
FAIL
331.28
bs128y.sat
FAIL
332.21
stmt17_70_86
FAIL
332.58
genbuf8b4n.sat
FAIL
333.23
amba5b5n.sat
FAIL
333.58
6s289rb05233_c0to63.sat
FAIL
334.03
stmt17_70_78
FAIL
334.06
stmt19_75_83
FAIL
335.8
cycle_sched_6_6_2.sat
FAIL
337.03
itc-b13-fixpoint-9
FAIL
337.08
stmt19_65_87
FAIL
337.25
amba4c7n.sat
FAIL
338.36
sortnetsort9.AE.stepl.010
UNSAT
338.56
bs128n.sat
FAIL
339.03
stmt19_79_87
FAIL
340.23
stmt19_64_91
FAIL
341.08
load_2c_comp_comp7_REAL.sat
FAIL
342.19
stmt17_74_78
FAIL
342.98
stmt19_79_83
FAIL
343.71
nreachq_query11_1344n
FAIL
344.71
query10_query45_1344n
FAIL
345.12
driver_b8n.sat
FAIL
345.74
genbuf12b4y.sat
FAIL
346.31
stmt17_70_82
FAIL
347.12
query10_query34_1344n
FAIL
347.64
query42_query45_1344n
FAIL
348.11
stmt17_62_78
FAIL
348.35
stmt19_65_95
FAIL
349.18
itc-b13-fixpoint-7
FAIL
349.49
genbuf14b4y.sat
FAIL
350.17
stmt17_74_90
FAIL
351.17
stmt28_73_85
FAIL
351.53
stmt23_67_92
FAIL
352.07
reachqu_query42_1344n
FAIL
352.66
driver_a10y.sat
FAIL
352.82
query10_query42_1344n
FAIL
354.81
itc-b13-fixpoint-10
FAIL
358.37
itc-b13-fixpoint-8
FAIL
358.73
stmt17_63_78
FAIL
358.95
nreachq_query42_1344n
FAIL
359.18
stmt19_75_95
FAIL
362.99
stmt17_82_86
FAIL
363.1
stmt23_88_92
FAIL
366.92
stmt19_83_91
FAIL
369.13
stmt19_71_95
FAIL
369.9
small-pipeline-fixpoint-8
FAIL
374.61
query44_query42_1344n
FAIL
375.02
stmt28_73_97
FAIL
376.84
query42_query60_1344n
FAIL
377.02
stmt19_87_95
FAIL
378.45
stmt17_78_98
FAIL
380.02
ltl2dba_U1-4_comp4_REAL.sat
FAIL
383.41
query42_query42_1344n
FAIL
385.09
nreachq_query54_1344n
FAIL
386.18
small-pipeline-fixpoint-9
FAIL
386.73
stmt28_89_97
FAIL
387.13
load_3c_comp_comp6_REAL.sat
FAIL
387.45
stmt17_82_94
FAIL
388.79
stmt23_92_96
FAIL
390.14
query08_query42_1344n
FAIL
390.7
query49_query42_1344n
FAIL
392.35
query48_query42_1344n
FAIL
393.79
query09_query42_1344n
FAIL
394.41
load_full_3_comp5_REAL.sat
FAIL
398.15
beemskbn1f1_c0to7.sat
FAIL
401.93
stmt17_94_98
FAIL
403.69
small-pipeline-fixpoint-10
FAIL
412.46
ltl2dba_E6_comp2_REAL.sat
FAIL
413.51
small-seq-fixpoint-6
FAIL
414.91
ltl2dba_Q4_comp4_REAL.sat
FAIL
415.63
pi-bus-fixpoint-2
FAIL
420.67
small-seq-fixpoint-10
FAIL
428.12
mult_bool_matrix_18_18_18.sat
FAIL
454.36
mult_bool_matrix_12_13_11.sat
FAIL
464.14
query10_query06_1344n
FAIL
466.16
query49_ntrivil_1344n
SAT
481.72
sortnetsort9.AE.stepl.008
UNSAT
484.69
query31_query42_1344n
SAT
492.73
stmt17_78_90
FAIL
518.78
stmt17_78_94
FAIL
544.06
oski3ub5i_c0to63.sat
FAIL
552.27
load_4c_comp_comp4_REAL.sat
FAIL
560.77
oski3ub5i_c0to511.sat
FAIL
565.51
sortnetsort8.AE.stepl.005
SAT
580.85
query11_query42_1344n
SAT
596.05
AR-fixpoint-2
FAIL
634.89
query52_query42_1344n
SAT
649.15
query55_query42_1344n
SAT
781.98
sortnetsort9.AE.stepl.005
SAT
874.26
rankfunc55_signed_64
SAT
877.32
mult9.sat
FAIL
900
query64_query11_1344n
FAIL
900
query64_query01_1344n
FAIL
900
query60_query44_1344n
FAIL
900
query60_query45_1344n
FAIL
900
driver_c9y.sat
FAIL
900
query33_query57_1344n
FAIL
900
query71_query31_1344n
FAIL
900
query71_query34_1344n
FAIL
900
query71_query36_1344n
FAIL
900
query48_exquery_1344n
FAIL
900
query60_query33_1344n
FAIL
900
add20y.sat
FAIL
900
query33_query51_1344n
FAIL
900
query34_query11_1344n
FAIL
900
ltl2dba_C2-8_comp4_REAL.sat
FAIL
900
floor128
FAIL
900
neclaftp2002
FAIL
900
mult_bool_matrix_dyn_7_7.sat
FAIL
900
mult_bool_matrix_dyn_9_5.sat
FAIL
900
query51_query57_1344n
FAIL
900
query54_query58_1344n
FAIL
900
query60_query10_1344n
FAIL
900
driver_c9n.sat
FAIL
900
intermediate256
FAIL
900
pdtpmsrotate32
FAIL
900
ConcreteActivityService
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#1.asp
FAIL
900
IssueServiceImpl
FAIL
900
IterationService
FAIL
900
query34_query42_1344n
FAIL
900
query33_query42_1344n
FAIL
900
ActivityService
FAIL
900
LoginService
FAIL
900
query51_query42_1344n
FAIL
900
query54_query42_1344n
FAIL
900
query57_query42_1344n
FAIL
900
decomposition128
FAIL
900
ceiling256
FAIL
900
bobtuint31neg
FAIL
900
eijkbs3330
FAIL
900
kenflashp04
FAIL
900
query71_query42_1344n
FAIL
900
query64_query42_1344n
FAIL
900
query60_query42_1344n
FAIL
900
query58_query42_1344n
FAIL
900
PhaseService
FAIL
900
NotificationServiceImpl2
FAIL
900
ctrl.e#1.a#3.E#110.A#48.c#.w#9.s#13.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#26.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#60.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#5.s#1.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#5.s#60.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#60.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#9.s#1.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#9.s#60.asp
FAIL
900
amba2c7n.sat
FAIL
900
cycle_sched_12_2_1.sat
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#17.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#1.asp
FAIL
900
ctrl.e#1.a#3.E#134.A#48.c#.w#9.s#40.asp
FAIL
900
ctrl.e#1.a#3.E#112.A#48.c#.w#5.s#27.asp
FAIL
900
ctrl.e#1.a#3.E#116.A#48.c#.w#7.s#56.asp
FAIL
900
ctrl.e#1.a#3.E#118.A#48.c#.w#5.s#7.asp
FAIL
900
ctrl.e#1.a#3.E#120.A#48.c#.w#3.s#3.asp
FAIL
900
ctrl.e#1.a#3.E#122.A#48.c#.w#3.s#51.asp
FAIL
900
ctrl.e#1.a#3.E#124.A#48.c#.w#7.s#50.asp
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#7.asp
FAIL
900
query06_query42_1344n
FAIL
900
ctrl.e#1.a#3.E#130.A#48.c#.w#7.s#11.asp
FAIL
900
cycle_sched_2_10_1.sat
FAIL
900
rankfunc35_unsigned_64
FAIL
900
stmt29_275_376
FAIL
900
stmt21_181_218
FAIL
900
stmt19_133_217
FAIL
900
stmt21_84_364
FAIL
900
stmt21_143_403
FAIL
900
stmt21_84_215
FAIL
900
stmt46_111_238
FAIL
900
stmt46_289_388
FAIL
900
stmt50_343_392
FAIL
900
stmt22_6_414
FAIL
900
stmt21_178_258
FAIL
900
stmt21_354_403
FAIL
900
stmt53_296_346
FAIL
900
stmt19_180_352
FAIL
900
stmt85_300_399
FAIL
900
stmt31_22_328
FAIL
900
stmt41_336_385
FAIL
900
rankfunc58_unsigned_64
FAIL
900
rankfunc48_signed_64
FAIL
900
rankfunc52_unsigned_64
FAIL
900
rankfunc61_unsigned_64
FAIL
900
rankfunc58_signed_64
FAIL
900
rankfunc54_signed_64
FAIL
900
rankfunc49_unsigned_64
FAIL
900
rankfunc51_signed_64
FAIL
900
rankfunc59_unsigned_64
FAIL
900
rankfunc49_signed_64
FAIL
900
rankfunc54_unsigned_64
FAIL
900
rankfunc48_unsigned_16
FAIL
900
rankfunc31_unsigned_64
FAIL
900
rankfunc48_unsigned_64
FAIL
900
rankfunc38_signed_64
FAIL
900
rankfunc41_unsigned_64
FAIL
900
rankfunc61_signed_64
FAIL
900
rankfunc2_unsigned_64
FAIL
900
rankfunc56_signed_64
FAIL
900
stmt31_276_328
FAIL
900
stmt19_90_408
FAIL
900
stmt47_290_340
FAIL
900
stmt27_93_98
FAIL
900
stmt41_262_275
FAIL
900
stmt5_731_730
FAIL
900
stmt25_597_598
FAIL
900
stmt17_63_70
FAIL
900
stmt23_66_67
FAIL
900
stmt28_68_69
FAIL
900
stmt28_68_73
FAIL
900
stmt23_66_76
FAIL
900
sortnetsort9.AE.stepl.007
FAIL
900
sortnetsort9.AE.stepl.006
FAIL
900
sortnetsort10.AE.stepl.010
FAIL
900
sortnetsort10.AE.stepl.009
FAIL
900
sortnetsort10.AE.stepl.008
FAIL
900
sortnetsort10.AE.stepl.007
FAIL
900
sortnetsort10.AE.stepl.006
FAIL
900
stmt31_190_227
FAIL
900
stmt53_208_245
FAIL
900
stmt19_368_417
FAIL
900
stmt19_137_408
FAIL
900
stmt27_16_224
FAIL
900
stmt21_71_354
FAIL
900
stmt19_352_359
FAIL
900
stmt47_340_389
FAIL
900
stmt22_320_370
FAIL
900
stmt21_70_369
FAIL
900
stmt27_149_224
FAIL
900
stmt19_3_401
FAIL
900
stmt52_295_394
FAIL
900
stmt19_302_352
FAIL
900
stmt21_71_413
FAIL
900
stmt44_40_387
FAIL
900
stmt19_66_214
FAIL
900
stmt22_311_370
FAIL
900
stmt41_286_385
FAIL
900
sortnetsort10.AE.stepl.005
FAIL
900
rankfunc60_unsigned_32
FAIL
900
eequery_query64_1344n
FAIL
900
small-dyn-partition-fixpoint-7
FAIL
900
small-swap1-fixpoint-6
FAIL
900
small-swap1-fixpoint-8
FAIL
900
small-equiv-fixpoint-7
FAIL
900
cache-coherence-3-fixpoint-1
FAIL
900
sdlx-fixpoint-7
FAIL
900
small-dyn-partition-fixpoint-9
FAIL
900
small-pipeline-fixpoint-5
FAIL
900
ethernet-fixpoint-2
FAIL
900
small-pipeline-fixpoint-2
FAIL
900
small-seq-fixpoint-1
FAIL
900
small-swap2-fixpoint-7
FAIL
900
cache-coherence-3-fixpoint-2
FAIL
900
small-dyn-partition-fixpoint-4
FAIL
900
itc-b13-fixpoint-1
FAIL
900
small-dyn-partition-fixpoint-5
FAIL
900
small-equiv-fixpoint-1
FAIL
900
usb-phy-fixpoint-5
FAIL
900
ethernet-fixpoint-1
FAIL
900
small-dyn-partition-fixpoint-6
FAIL
900
small-seq-fixpoint-2
FAIL
900
small-pipeline-fixpoint-3
FAIL
900
small-dyn-partition-fixpoint-3
FAIL
900
small-swap1-fixpoint-10
FAIL
900
small-swap2-fixpoint-10
FAIL
900
small-swap2-fixpoint-9
FAIL
900
ethernet-fixpoint-3
FAIL
900
small-equiv-fixpoint-3
FAIL
900
small-swap1-fixpoint-9
FAIL
900
small-swap1-fixpoint-5
FAIL
900
sdlx-fixpoint-9
FAIL
900
small-swap1-fixpoint-4
FAIL
900
small-swap2-fixpoint-8
FAIL
900
ethernet-fixpoint-4
FAIL
900
small-dyn-partition-fixpoint-10
FAIL
900
small-swap1-fixpoint-7
FAIL
900
sdlx-fixpoint-10
FAIL
900
sdlx-fixpoint-8
FAIL
900
sdlx-fixpoint-1
FAIL
900
small-equiv-fixpoint-2
FAIL
900
small-synabs-fixpoint-10
FAIL
900
small-equiv-fixpoint-5
FAIL
900
small-pipeline-fixpoint-1
FAIL
900
small-swap2-fixpoint-5
FAIL
900
rankfunc31_signed_64
FAIL
900
rankfunc35_signed_64
FAIL
900
rankfunc53_unsigned_64
FAIL
900
rankfunc38_unsigned_64
FAIL
900
rankfunc52_signed_64
FAIL
900
rankfunc51_unsigned_64
FAIL
900
rankfunc41_signed_64
FAIL
900
rankfunc56_unsigned_64
FAIL
900
rankfunc55_unsigned_64
FAIL
900
rankfunc57_unsigned_64
FAIL
900
rankfunc59_signed_64
FAIL
900
usb-phy-fixpoint-4
FAIL
900
cache-coherence-2-fixpoint-2
FAIL
900
sdlx-fixpoint-5
FAIL
900
small-equiv-fixpoint-4
FAIL
900
sdlx-fixpoint-6
FAIL
900
small-swap2-fixpoint-6
FAIL
900
cache-coherence-2-fixpoint-5
FAIL
900
itc-b13-fixpoint-6
FAIL
900
usb-phy-fixpoint-2
FAIL
900
itc-b13-fixpoint-3
FAIL
900
itc-b13-fixpoint-2
FAIL
900
small-pipeline-fixpoint-4
FAIL
900
usb-phy-fixpoint-1
FAIL
900
sdlx-fixpoint-4
FAIL
900
sdlx-fixpoint-2
FAIL
900
small-bug1-fixpoint-10
FAIL
900
itc-b13-fixpoint-4
FAIL
900
small-equiv-fixpoint-8
FAIL
900
small-seq-fixpoint-4
FAIL
900
rankfunc53_signed_64
FAIL
900
Contact
|
Organization
|
Links
|
Citing QBFLIB