QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances solved by
iprover-QBF
QBFEVAL'16 - 2QBF Track.
Instance
Result
Time
k_ph_n-1
SAT
0.04
tree-exa10-10
SAT
0.04
stmt44_107_108
SAT
0.05
stmt24_7_8
SAT
0.05
qshifter_3
SAT
0.05
tree-exa10-25
SAT
0.05
tree-exa10-15
SAT
0.05
tree-exa10-30
SAT
0.05
tree-exa10-20
SAT
0.05
stmt1_20_21
SAT
0.07
mutex-2-s
SAT
0.08
stmt1_145_146
SAT
0.1
qshifter_4
SAT
0.1
stmt24_148_149
SAT
0.1
rankfunc37_signed_16
UNSAT
0.26
mutex-4-s
SAT
0.3
qshifter_5
SAT
0.71
mutex-8-s
SAT
2.04
qshifter_6
SAT
6.07
mutex-16-s
SAT
9.25
qshifter_8
FAIL
28.13
mutex-32-s
SAT
39.84
mutex-64-s
SAT
80.63
rankfunc43_signed_16
SAT
81.22
rankfunc28_signed_16
SAT
91.17
sortnetsort10.AE.stepl.012
FAIL
95.74
rankfunc5_unsigned_16
SAT
98.11
sortnetsort10.AE.stepl.011
FAIL
103.93
rankfunc27_signed_16
SAT
105.47
exquery_query04_1344n
UNSAT
107.09
rankfunc45_unsigned_16
SAT
114.77
rankfunc34_unsigned_32
SAT
122.19
rankfunc25_unsigned_16
SAT
122.83
rankfunc46_unsigned_16
SAT
128.3
rankfunc17_unsigned_16
SAT
138.85
sortnetsort10.AE.stepl.010
FAIL
142.53
sortnetsort8.AE.stepl.004
FAIL
182.43
qshifter_7
FAIL
190.24
sortnetsort9.AE.stepl.012
FAIL
196.83
rankfunc60_signed_64
FAIL
200.54
stmt27_296_297
FAIL
203.94
sortnetsort7.AE.stepl.006
FAIL
219.84
query60_query33_1344n
FAIL
226.53
stmt18_258_260
FAIL
227.85
sortnetsort10.AE.stepl.009
FAIL
230.83
rankfunc33_unsigned_64
FAIL
231.74
stmt24_292_293
FAIL
233.64
query60_query45_1344n
FAIL
236.83
stmt70_191_213
FAIL
238.65
query07_query60_1344n
FAIL
243.53
query07_query64_1344n
FAIL
244.84
stmt17_99_98
FAIL
247.44
stmt21_71_413
FAIL
262.04
stmt19_83_412
FAIL
267.45
rankfunc22_signed_32
FAIL
269.54
query44_query26_1344n
FAIL
270.24
stmt19_90_408
FAIL
270.75
stmt82_224_225
FAIL
275.64
stmt21_143_403
FAIL
276.93
mutex-128-s
FAIL
277.83
stmt19_137_408
FAIL
280.34
query60_query44_1344n
FAIL
282.53
rankfunc22_unsigned_64
FAIL
282.85
rankfunc44_unsigned_64
FAIL
284.14
rankfunc21_signed_32
FAIL
284.23
rankfunc18_signed_32
FAIL
287.33
sortnetsort9.AE.stepl.011
FAIL
288.73
rankfunc8_unsigned_64
FAIL
289.03
stmt16_0_1
FAIL
294.44
sortnetsort8.AE.stepl.005
FAIL
294.64
stmt31_22_328
FAIL
297.33
sortnetsort7.AE.stepl.007
FAIL
302.55
stmt19_180_352
FAIL
303.43
rankfunc52_unsigned_32
FAIL
307.64
stmt19_67_318
FAIL
313.23
rankfunc43_signed_64
FAIL
314.84
stmt22_73_311
FAIL
315.53
stmt22_311_370
FAIL
317.54
stmt21_79_304
FAIL
323.84
rankfunc25_signed_64
FAIL
324.44
stmt21_138_304
FAIL
325.75
stmt7_33_34
FAIL
326.34
rankfunc58_unsigned_32
FAIL
326.85
stmt19_352_359
FAIL
327.44
stmt17_63_70
FAIL
330.05
stmt11_643_645
FAIL
330.15
sortnetsort9.AE.stepl.004
FAIL
333.15
stmt2_649_776
FAIL
334.34
rankfunc58_signed_32
FAIL
336.14
stmt19_177_309
FAIL
336.53
rankfunc36_signed_32
FAIL
338.95
stmt16_285_286
FAIL
344.14
stmt19_217_309
FAIL
344.93
stmt28_68_69
FAIL
345.24
stmt27_946_955
FAIL
347.55
stmt44_916_917
FAIL
348.35
stmt1_919_920
FAIL
348.44
stmt124_966_965
FAIL
350.35
rankfunc1_signed_32
FAIL
351.64
stmt44_554_555
FAIL
354.94
rankfunc45_unsigned_64
FAIL
358.63
rankfunc43_unsigned_32
FAIL
360.53
stmt2_649_647
FAIL
362.85
stmt72_696_721
FAIL
365.25
stmt21_319_418
FAIL
366.45
stmt86_889_890
FAIL
368.24
rankfunc45_signed_64
FAIL
369.23
stmt44_435_436
FAIL
370.34
stmt41_118_131
FAIL
370.74
stmt2_480_551
FAIL
373.34
stmt41_738_737
FAIL
373.64
stmt23_66_76
FAIL
376.44
stmt137_903_911
FAIL
376.74
stmt32_570_572
FAIL
381.94
stmt44_554_604
FAIL
382.04
rankfunc27_signed_32
FAIL
382.44
stmt2_649_723
FAIL
384.06
stmt24_765_766
FAIL
384.24
stmt21_354_403
FAIL
388.84
rankfunc3_unsigned_32
FAIL
389.83
sortnetsort7.AE.stepl.008
FAIL
391.93
stmt28_68_73
FAIL
394.53
stmt70_495_501
FAIL
399.35
stmt2_976_999
FAIL
402.65
stmt70_854_859
FAIL
403.54
stmt16_950_951
FAIL
403.94
rankfunc1_unsigned_64
FAIL
404.63
stmt23_72_76
FAIL
412.44
rankfunc46_unsigned_64
FAIL
413.43
sortnetsort8.AE.stepl.006
FAIL
414.34
stmt41_738_749
FAIL
419.54
stmt21_326_327
FAIL
424.44
stmt41_566_580
FAIL
426.54
stmt17_63_78
FAIL
427.43
stmt38_943_942
FAIL
430.64
sortnetsort6.AE.stepl.007
FAIL
434.23
stmt9_350_351
FAIL
435.25
sortnetsort7.AE.stepl.004
FAIL
439.44
rankfunc45_signed_32
FAIL
440.74
sortnetsort7.AE.stepl.003
FAIL
442.63
sortnetsort10.AE.stepl.008
FAIL
442.93
rankfunc26_unsigned_64
FAIL
445.03
stmt16_47_48
FAIL
446.14
stmt17_62_78
FAIL
448.24
sortnetsort8.AE.stepl.003
FAIL
449.83
sortnetsort7.AE.stepl.005
FAIL
450.44
stmt37_941_942
FAIL
450.53
sortnetsort9.AE.stepl.010
FAIL
458.53
stmt17_70_78
FAIL
467.65
sortnetsort7.AE.stepl.009
FAIL
478.74
stmt16_818_819
FAIL
479.44
stmt17_63_82
FAIL
480.03
rankfunc61_signed_32
FAIL
481.24
stmt23_66_67
FAIL
481.83
stmt23_66_96
FAIL
482.33
sortnetsort5.AE.stepl.006
FAIL
486.94
stmt1_60_61
FAIL
487.03
stmt17_74_78
FAIL
490.43
sortnetsort5.AE.stepl.005
FAIL
491.24
sortnetsort9.AE.stepl.005
FAIL
497.73
rankfunc60_signed_16
FAIL
502.64
stmt27_584_603
FAIL
504.24
stmt28_68_81
FAIL
505.53
axquery_query44_1344n
FAIL
506.84
rankfunc16_signed_32
FAIL
507.15
stmt19_65_95
FAIL
508.37
stmt19_64_99
FAIL
509.23
sortnetsort10.AE.stepl.004
FAIL
515.13
sortnetsort5.AE.stepl.004
FAIL
515.64
stmt1_629_630
FAIL
517.54
stmt17_62_98
FAIL
519.24
sortnetsort6.AE.stepl.006
FAIL
519.93
stmt3_639_640
FAIL
520.84
stmt17_70_82
FAIL
523.24
stmt19_64_87
FAIL
528.17
sortnetsort6.AE.stepl.003
FAIL
528.83
stmt1_787_788
FAIL
529.73
stmt17_70_98
FAIL
530.03
sortnetsort6.AE.stepl.004
FAIL
530.83
sortnetsort5.AE.stepl.007
FAIL
534.24
rankfunc57_signed_32
FAIL
535.33
stmt28_73_97
FAIL
537.33
stmt19_71_95
FAIL
537.44
stmt19_75_83
FAIL
544.24
stmt17_78_98
FAIL
547.13
sortnetsort8.AE.stepl.007
FAIL
548.23
stmt19_75_95
FAIL
556.33
stmt17_82_98
FAIL
558.84
stmt17_70_86
FAIL
559.07
sortnetsort6.AE.stepl.005
FAIL
561.43
stmt19_79_83
FAIL
561.53
stmt19_65_87
FAIL
562.03
stmt17_86_98
FAIL
568.13
stmt1_811_812
FAIL
578.44
stmt17_78_94
FAIL
580.83
stmt28_89_97
FAIL
583.63
nxquery_query50_1344n
FAIL
585.14
stmt17_94_98
FAIL
587.03
query10_query34_1344n
FAIL
599.11
query64_query01_1344n
FAIL
599.12
query26_query34_1344n
FAIL
599.12
rankfunc19_unsigned_64
FAIL
599.12
stmt21_181_218
FAIL
599.12
axquery_query06_1344n
FAIL
599.12
stmt19_133_217
FAIL
599.12
query31_query26_1344n
FAIL
599.12
rankfunc15_unsigned_16
FAIL
599.12
query71_query34_1344n
FAIL
599.12
rankfunc55_signed_16
FAIL
599.12
query21_query55_1344n
FAIL
599.21
stmt46_111_238
FAIL
599.21
rankfunc16_signed_64
FAIL
599.21
rankfunc19_signed_16
FAIL
599.22
nreachq_query54_1344n
FAIL
599.22
sortnetsort9.AE.stepl.006
FAIL
599.22
nreachq_query11_1344n
FAIL
599.22
sortnetsort8.AE.stepl.009
FAIL
599.22
sortnetsort8.AE.stepl.008
FAIL
599.22
query31_reachqu_1344n
FAIL
599.22
eequery_query64_1344n
FAIL
599.22
eequery_query04_1344n
FAIL
599.22
query42_query06_1344n
FAIL
599.22
query02_query44_1344n
FAIL
599.22
query02_query58_1344n
FAIL
599.22
query48_exquery_1344n
FAIL
599.22
query49_ntrivil_1344n
FAIL
599.22
query50_query06_1344n
FAIL
599.22
query51_query57_1344n
FAIL
599.22
query52_query25_1344n
FAIL
599.22
query54_query58_1344n
FAIL
599.22
query60_query10_1344n
FAIL
599.22
sortnetsort10.AE.stepl.007
FAIL
599.22
sortnetsort10.AE.stepl.006
FAIL
599.22
sortnetsort10.AE.stepl.005
FAIL
599.22
query64_query11_1344n
FAIL
599.22
query71_query31_1344n
FAIL
599.22
query42_query60_1344n
FAIL
599.22
query42_query45_1344n
FAIL
599.22
query36_query25_1344n
FAIL
599.22
query04_query25_1344n
FAIL
599.22
query05_query31_1344n
FAIL
599.22
query26_query57_1344n
FAIL
599.22
sortnetsort5.AE.stepl.003
FAIL
599.22
query10_query06_1344n
FAIL
599.22
query10_query45_1344n
FAIL
599.22
query31_eequery_1344n
FAIL
599.22
query31_query50_1344n
FAIL
599.22
query33_query45_1344n
FAIL
599.22
query33_query51_1344n
FAIL
599.22
query33_query57_1344n
FAIL
599.22
query34_query11_1344n
FAIL
599.22
query71_query36_1344n
FAIL
599.22
stmt21_71_354
FAIL
599.22
stmt19_66_214
FAIL
599.22
stmt50_205_293
FAIL
599.22
stmt27_16_149
FAIL
599.22
stmt21_84_364
FAIL
599.22
stmt21_5_134
FAIL
599.22
stmt27_16_97
FAIL
599.22
stmt52_244_394
FAIL
599.22
stmt52_55_117
FAIL
599.22
stmt44_41_288
FAIL
599.22
stmt22_73_182
FAIL
599.22
stmt29_226_376
FAIL
599.22
stmt41_37_108
FAIL
599.22
stmt21_84_215
FAIL
599.22
stmt27_16_224
FAIL
599.22
stmt39_107_197
FAIL
599.22
stmt19_3_214
FAIL
599.22
stmt21_70_369
FAIL
599.22
stmt22_92_263
FAIL
599.22
stmt22_6_72
FAIL
599.22
stmt19_3_401
FAIL
599.22
stmt41_160_235
FAIL
599.22
stmt21_262_319
FAIL
599.22
stmt19_217_302
FAIL
599.22
stmt22_6_414
FAIL
599.22
stmt19_90_266
FAIL
599.22
stmt31_190_227
FAIL
599.22
stmt17_82_94
FAIL
599.22
rankfunc15_signed_16
FAIL
599.22
stmt19_87_95
FAIL
599.22
stmt17_78_90
FAIL
599.22
stmt44_40_387
FAIL
599.22
stmt19_79_87
FAIL
599.22
rankfunc42_signed_64
FAIL
599.22
stmt23_88_92
FAIL
599.22
stmt28_73_85
FAIL
599.22
sortnetsort9.AE.stepl.009
FAIL
599.22
sortnetsort9.AE.stepl.008
FAIL
599.22
rankfunc16_unsigned_64
FAIL
599.22
stmt17_74_90
FAIL
599.22
stmt19_83_142
FAIL
599.22
rankfunc2_signed_16
FAIL
599.22
stmt23_67_92
FAIL
599.22
rankfunc3_unsigned_64
FAIL
599.22
stmt19_64_91
FAIL
599.22
rankfunc57_signed_16
FAIL
599.22
stmt23_92_96
FAIL
599.22
stmt19_83_91
FAIL
599.22
stmt17_82_86
FAIL
599.22
stmt17_70_90
FAIL
599.22
sortnetsort9.AE.stepl.007
FAIL
599.22
rankfunc56_unsigned_16
FAIL
599.32
stmt21_178_258
FAIL
599.32
Contact
|
Organization
|
Links
|
Citing QBFLIB