QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances solved by
iprover-QBF-bloqqer
QBFEVAL'16 - 2QBF Track.
Instance
Result
Time
k_ph_n-1
SAT
0.04
stmt24_148_149
SAT
0.04
stmt1_20_21
SAT
0.04
tree-exa10-20
SAT
0.04
stmt1_145_146
SAT
0.04
qshifter_4
SAT
0.04
rankfunc37_signed_16
FAIL
0.04
stmt44_107_108
SAT
0.04
tree-exa10-10
SAT
0.04
mutex-2-s
SAT
0.04
stmt24_7_8
SAT
0.04
tree-exa10-30
SAT
0.04
tree-exa10-15
SAT
0.04
qshifter_3
SAT
0.04
tree-exa10-25
SAT
0.04
qshifter_5
SAT
0.06
mutex-4-s
SAT
0.06
stmt16_0_1
SAT
0.06
stmt1_811_812
SAT
0.07
rankfunc28_signed_16
SAT
0.09
rankfunc56_unsigned_16
SAT
0.09
rankfunc27_signed_16
SAT
0.09
rankfunc5_unsigned_16
SAT
0.09
stmt3_639_640
SAT
0.09
stmt9_350_351
SAT
0.1
mutex-8-s
SAT
0.11
stmt44_435_436
SAT
0.11
rankfunc60_signed_16
SAT
0.11
rankfunc25_unsigned_16
SAT
0.11
stmt16_818_819
SAT
0.12
stmt24_292_293
SAT
0.13
stmt70_191_213
SAT
0.13
stmt11_643_645
SAT
0.14
stmt2_649_723
SAT
0.14
rankfunc43_signed_16
SAT
0.14
stmt27_296_297
SAT
0.14
rankfunc45_unsigned_16
SAT
0.14
stmt2_649_647
SAT
0.14
stmt82_224_225
SAT
0.14
stmt18_258_260
SAT
0.14
rankfunc17_unsigned_16
SAT
0.15
stmt21_326_327
SAT
0.16
stmt2_480_551
SAT
0.16
rankfunc36_signed_32
SAT
0.16
rankfunc46_unsigned_16
SAT
0.17
stmt2_649_776
SAT
0.17
rankfunc55_signed_16
SAT
0.17
rankfunc27_signed_32
SAT
0.17
qshifter_6
SAT
0.18
stmt70_854_859
SAT
0.18
stmt124_966_965
SAT
0.18
stmt72_696_721
SAT
0.18
stmt44_916_917
SAT
0.18
stmt16_285_286
SAT
0.19
stmt1_919_920
SAT
0.19
stmt41_738_737
SAT
0.19
stmt24_765_766
SAT
0.19
stmt137_903_911
SAT
0.19
rankfunc15_unsigned_16
SAT
0.2
stmt27_946_955
SAT
0.2
stmt41_118_131
SAT
0.2
rankfunc15_signed_16
SAT
0.2
stmt32_570_572
SAT
0.21
stmt44_554_604
SAT
0.21
stmt70_495_501
SAT
0.21
stmt27_584_603
SAT
0.21
stmt44_554_555
SAT
0.21
rankfunc57_signed_16
SAT
0.22
rankfunc2_signed_16
SAT
0.23
stmt86_889_890
SAT
0.23
rankfunc34_unsigned_32
SAT
0.24
stmt16_950_951
SAT
0.24
mutex-16-s
SAT
0.25
rankfunc22_signed_32
SAT
0.28
stmt7_33_34
SAT
0.29
rankfunc19_signed_16
SAT
0.3
rankfunc43_unsigned_32
SAT
0.3
rankfunc58_unsigned_32
SAT
0.33
rankfunc52_unsigned_32
SAT
0.33
rankfunc58_signed_32
SAT
0.34
rankfunc44_unsigned_64
SAT
0.36
stmt1_629_630
SAT
0.36
rankfunc61_signed_32
SAT
0.36
stmt41_738_749
SAT
0.39
rankfunc1_signed_32
SAT
0.4
stmt41_566_580
SAT
0.43
rankfunc45_signed_32
SAT
0.43
stmt1_787_788
SAT
0.46
rankfunc57_signed_32
SAT
0.48
rankfunc18_signed_32
SAT
0.48
rankfunc25_signed_64
SAT
0.48
rankfunc21_signed_32
SAT
0.6
stmt22_6_72
FAIL
0.62
stmt38_943_942
SAT
0.62
stmt37_941_942
SAT
0.62
stmt1_60_61
SAT
0.63
rankfunc16_signed_32
SAT
0.64
stmt16_47_48
SAT
0.66
rankfunc33_unsigned_64
SAT
0.66
stmt17_99_98
SAT
0.71
rankfunc22_unsigned_64
SAT
0.72
rankfunc60_signed_64
SAT
0.73
stmt27_16_97
FAIL
0.77
mutex-32-s
SAT
0.77
rankfunc43_signed_64
SAT
0.78
rankfunc45_unsigned_64
SAT
0.84
rankfunc8_unsigned_64
SAT
0.84
qshifter_7
SAT
0.87
rankfunc3_unsigned_32
SAT
0.88
stmt41_37_108
FAIL
0.97
rankfunc1_unsigned_64
SAT
1.01
rankfunc46_unsigned_64
SAT
1.04
rankfunc45_signed_64
SAT
1.05
rankfunc42_signed_64
SAT
1.05
stmt52_55_117
FAIL
1.38
rankfunc26_unsigned_64
SAT
1.41
stmt21_84_215
FAIL
1.7
rankfunc16_unsigned_64
SAT
1.74
rankfunc16_signed_64
SAT
1.75
rankfunc19_unsigned_64
SAT
1.88
mutex-64-s
SAT
2.04
stmt21_181_218
FAIL
2.24
stmt39_107_197
FAIL
2.34
rankfunc3_unsigned_64
SAT
2.68
stmt23_66_67
SAT
3.83
stmt17_63_70
SAT
4.14
stmt21_354_403
SAT
4.88
mutex-128-s
SAT
5.22
stmt19_217_309
UNSAT
5.65
stmt19_64_87
SAT
5.96
qshifter_8
SAT
10.89
sortnetsort10.AE.stepl.007
FAIL
37.63
sortnetsort10.AE.stepl.012
FAIL
38.33
sortnetsort10.AE.stepl.010
FAIL
50.33
sortnetsort9.AE.stepl.010
FAIL
74.83
sortnetsort9.AE.stepl.012
FAIL
77.33
sortnetsort10.AE.stepl.011
FAIL
92.83
sortnetsort10.AE.stepl.009
FAIL
101.43
exquery_query04_1344n
UNSAT
103.83
stmt19_71_95
FAIL
119.34
stmt17_78_90
FAIL
123.03
stmt17_70_98
FAIL
126.43
stmt28_73_85
FAIL
131.23
stmt19_83_91
FAIL
134.34
stmt17_74_90
FAIL
134.45
stmt17_62_98
FAIL
138.75
sortnetsort9.AE.stepl.011
FAIL
141.23
stmt17_78_94
FAIL
142.05
stmt23_88_92
FAIL
143.23
stmt19_65_95
FAIL
146.44
stmt19_79_87
FAIL
146.84
stmt17_82_94
FAIL
148.24
stmt28_73_97
FAIL
153.34
stmt19_87_95
FAIL
154.33
stmt19_79_83
FAIL
156.84
stmt17_82_86
FAIL
160.33
sortnetsort7.AE.stepl.006
FAIL
164.83
sortnetsort10.AE.stepl.008
FAIL
166.63
sortnetsort8.AE.stepl.004
FAIL
167.14
stmt17_82_98
FAIL
169.64
stmt17_86_98
FAIL
171.43
stmt28_89_97
FAIL
171.65
stmt19_83_412
FAIL
173.43
stmt23_92_96
FAIL
174.53
stmt17_78_98
FAIL
180.93
stmt17_94_98
FAIL
181.64
stmt17_70_90
FAIL
194.33
stmt19_65_87
FAIL
194.74
stmt17_70_86
FAIL
200.53
stmt17_70_82
FAIL
204.83
stmt19_75_83
FAIL
217.94
stmt41_160_235
FAIL
222.84
stmt17_74_78
FAIL
231.94
sortnetsort7.AE.stepl.007
FAIL
235.83
query60_query33_1344n
FAIL
251.64
stmt44_40_387
FAIL
259.34
sortnetsort8.AE.stepl.005
FAIL
266.44
stmt21_178_258
FAIL
266.74
sortnetsort8.AE.stepl.009
FAIL
274.05
eequery_query04_1344n
FAIL
282.35
stmt22_6_414
FAIL
284.33
stmt52_244_394
FAIL
306.04
sortnetsort7.AE.stepl.008
FAIL
308.73
stmt19_217_302
FAIL
313.13
sortnetsort9.AE.stepl.004
FAIL
316.13
query07_query60_1344n
FAIL
341.73
query36_query25_1344n
FAIL
360.54
sortnetsort8.AE.stepl.006
FAIL
363.84
query60_query45_1344n
FAIL
367.33
query31_eequery_1344n
FAIL
369.14
sortnetsort7.AE.stepl.009
FAIL
369.24
query49_ntrivil_1344n
FAIL
379.55
query04_query25_1344n
FAIL
384.05
query60_query44_1344n
FAIL
384.94
query07_query64_1344n
FAIL
394.74
query71_query34_1344n
FAIL
394.95
query34_query11_1344n
FAIL
397.94
query48_exquery_1344n
FAIL
403.85
query60_query10_1344n
FAIL
408.05
query71_query36_1344n
FAIL
408.43
sortnetsort9.AE.stepl.009
FAIL
410.73
sortnetsort9.AE.stepl.005
FAIL
432.73
nxquery_query50_1344n
FAIL
434.84
stmt23_67_92
FAIL
435.64
stmt23_66_96
FAIL
444.93
query52_query25_1344n
FAIL
447.75
axquery_query06_1344n
FAIL
450.94
stmt19_64_91
FAIL
459.44
query64_query01_1344n
FAIL
461.64
query05_query31_1344n
FAIL
463.64
query33_query51_1344n
FAIL
465.64
query02_query44_1344n
FAIL
479.24
stmt17_70_78
FAIL
481.03
stmt28_68_81
FAIL
482.95
sortnetsort9.AE.stepl.007
FAIL
486.73
stmt23_66_76
FAIL
492.54
stmt17_63_78
FAIL
494.74
query44_query26_1344n
FAIL
501.84
query33_query45_1344n
FAIL
506.64
sortnetsort9.AE.stepl.006
FAIL
509.53
query33_query57_1344n
FAIL
511.34
axquery_query44_1344n
FAIL
518.74
stmt28_68_73
FAIL
522.14
query31_query50_1344n
FAIL
523.54
query02_query58_1344n
FAIL
526.94
query71_query31_1344n
FAIL
527.73
query31_query26_1344n
FAIL
540.34
stmt17_63_82
FAIL
548.13
sortnetsort10.AE.stepl.005
FAIL
552.13
stmt22_73_311
FAIL
556.13
stmt21_84_364
FAIL
564.13
stmt28_68_69
FAIL
565.04
stmt2_976_999
FAIL
570.44
stmt22_92_263
FAIL
577.65
stmt19_352_359
FAIL
579.85
eequery_query64_1344n
FAIL
581.84
stmt22_311_370
FAIL
585.73
stmt17_62_78
FAIL
587.13
stmt19_180_352
FAIL
590.53
stmt21_262_319
FAIL
591.54
stmt44_41_288
FAIL
593.94
stmt21_319_418
FAIL
594.33
stmt21_70_369
FAIL
596.03
sortnetsort9.AE.stepl.008
FAIL
598.13
stmt31_22_328
FAIL
599.12
stmt22_73_182
FAIL
599.12
query10_query34_1344n
FAIL
599.12
sortnetsort7.AE.stepl.003
FAIL
599.12
sortnetsort5.AE.stepl.006
FAIL
599.12
sortnetsort5.AE.stepl.007
FAIL
599.12
sortnetsort7.AE.stepl.004
FAIL
599.12
query42_query45_1344n
FAIL
599.12
stmt21_5_134
FAIL
599.12
sortnetsort6.AE.stepl.006
FAIL
599.12
nreachq_query11_1344n
FAIL
599.13
query42_query06_1344n
FAIL
599.13
query42_query60_1344n
FAIL
599.13
sortnetsort10.AE.stepl.006
FAIL
599.13
stmt21_71_354
FAIL
599.13
sortnetsort5.AE.stepl.005
FAIL
599.13
sortnetsort5.AE.stepl.003
FAIL
599.22
query21_query55_1344n
FAIL
599.22
stmt19_83_142
FAIL
599.22
stmt31_190_227
FAIL
599.22
stmt19_90_266
FAIL
599.22
query64_query11_1344n
FAIL
599.22
stmt29_226_376
FAIL
599.22
stmt19_66_214
FAIL
599.22
query50_query06_1344n
FAIL
599.22
stmt19_3_401
FAIL
599.22
stmt19_177_309
FAIL
599.22
query26_query34_1344n
FAIL
599.22
stmt27_16_224
FAIL
599.22
sortnetsort6.AE.stepl.005
FAIL
599.22
sortnetsort6.AE.stepl.004
FAIL
599.22
stmt50_205_293
FAIL
599.22
sortnetsort8.AE.stepl.007
FAIL
599.22
stmt21_71_413
FAIL
599.22
stmt21_143_403
FAIL
599.23
query51_query57_1344n
FAIL
599.23
sortnetsort8.AE.stepl.008
FAIL
599.23
query54_query58_1344n
FAIL
599.23
stmt27_16_149
FAIL
599.23
sortnetsort8.AE.stepl.003
FAIL
599.23
stmt19_133_217
FAIL
599.23
stmt21_138_304
FAIL
599.23
stmt23_72_76
FAIL
599.23
stmt19_64_99
FAIL
599.23
stmt46_111_238
FAIL
599.23
sortnetsort7.AE.stepl.005
FAIL
599.23
query10_query06_1344n
FAIL
599.23
stmt19_137_408
FAIL
599.23
query10_query45_1344n
FAIL
599.23
stmt19_3_214
FAIL
599.23
stmt19_90_408
FAIL
599.23
query26_query57_1344n
FAIL
599.23
stmt21_79_304
FAIL
599.23
sortnetsort10.AE.stepl.004
FAIL
599.23
query31_reachqu_1344n
FAIL
599.23
sortnetsort5.AE.stepl.004
FAIL
599.23
sortnetsort6.AE.stepl.003
FAIL
599.23
sortnetsort6.AE.stepl.007
FAIL
599.23
nreachq_query54_1344n
FAIL
599.23
stmt19_67_318
FAIL
599.32
Contact
|
Organization
|
Links
|
Citing QBFLIB