QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances solved by
qsts
QBFEVAL'16 - 2QBF Track.
Instance
Result
Time
stmt24_148_149
SAT
0
k_ph_n-1
SAT
0
tree-exa10-10
SAT
0
stmt1_20_21
SAT
0
tree-exa10-15
SAT
0
stmt1_145_146
SAT
0
stmt24_7_8
UNSAT
0
stmt44_107_108
SAT
0
mutex-2-s
SAT
0
mutex-16-s
SAT
0.01
mutex-4-s
SAT
0.01
stmt16_0_1
SAT
0.01
mutex-8-s
SAT
0.01
query02_query44_1344n
UNSAT
0.02
exquery_query04_1344n
UNSAT
0.02
qshifter_3
SAT
0.02
stmt21_181_218
UNSAT
0.03
tree-exa10-20
SAT
0.03
mutex-32-s
SAT
0.03
stmt31_190_227
UNSAT
0.03
query26_query34_1344n
UNSAT
0.03
stmt41_160_235
UNSAT
0.04
mutex-64-s
SAT
0.05
sortnetsort5.AE.stepl.003
SAT
0.05
axquery_query06_1344n
UNSAT
0.05
query26_query57_1344n
UNSAT
0.06
mutex-128-s
SAT
0.1
sortnetsort5.AE.stepl.005
UNSAT
0.1
sortnetsort6.AE.stepl.003
SAT
0.13
sortnetsort5.AE.stepl.007
UNSAT
0.15
tree-exa10-25
SAT
0.17
axquery_query44_1344n
UNSAT
0.17
sortnetsort5.AE.stepl.006
UNSAT
0.18
stmt41_37_108
UNSAT
0.2
stmt1_811_812
SAT
0.23
query21_query55_1344n
UNSAT
0.24
sortnetsort7.AE.stepl.003
SAT
0.24
query07_query64_1344n
UNSAT
0.31
sortnetsort5.AE.stepl.004
SAT
0.32
query07_query60_1344n
UNSAT
0.35
sortnetsort8.AE.stepl.003
SAT
0.57
stmt19_83_142
UNSAT
0.76
sortnetsort6.AE.stepl.004
SAT
1
sortnetsort6.AE.stepl.005
UNSAT
1.06
sortnetsort6.AE.stepl.007
UNSAT
1.19
sortnetsort7.AE.stepl.004
SAT
1.42
sortnetsort6.AE.stepl.006
UNSAT
1.71
tree-exa10-30
SAT
2.95
eequery_query04_1344n
SAT
3.07
sortnetsort9.AE.stepl.004
SAT
3.84
sortnetsort8.AE.stepl.004
SAT
4.07
query31_query26_1344n
SAT
4.43
query02_query58_1344n
UNSAT
4.75
stmt52_55_117
UNSAT
5.48
nxquery_query50_1344n
SAT
5.79
sortnetsort7.AE.stepl.009
UNSAT
7.87
sortnetsort10.AE.stepl.004
SAT
7.91
query33_query45_1344n
SAT
15.13
sortnetsort7.AE.stepl.008
UNSAT
15.18
sortnetsort7.AE.stepl.006
UNSAT
15.49
sortnetsort7.AE.stepl.005
SAT
19.48
sortnetsort7.AE.stepl.007
UNSAT
20.88
stmt27_16_97
UNSAT
26.06
sortnetsort8.AE.stepl.006
UNSAT
28.22
stmt27_16_149
UNSAT
29.85
query31_query50_1344n
SAT
32.57
stmt70_191_213
SAT
34.52
sortnetsort8.AE.stepl.005
SAT
38.59
stmt7_33_34
SAT
42.79
sortnetsort9.AE.stepl.005
SAT
63.61
query49_ntrivil_1344n
SAT
64.69
stmt22_73_182
UNSAT
75.78
stmt18_258_260
SAT
89.44
sortnetsort10.AE.stepl.005
SAT
89.74
query04_query25_1344n
SAT
93.33
sortnetsort8.AE.stepl.007
UNSAT
99.81
query48_exquery_1344n
SAT
107.08
qshifter_4
SAT
110.84
sortnetsort8.AE.stepl.008
UNSAT
146.95
sortnetsort8.AE.stepl.009
UNSAT
159.75
query31_reachqu_1344n
SAT
160.85
query31_eequery_1344n
SAT
169.16
query36_query25_1344n
SAT
169.29
query50_query06_1344n
SAT
170.75
query05_query31_1344n
SAT
190.91
query34_query11_1344n
SAT
193.35
stmt3_639_640
SAT
208.4
query60_query45_1344n
SAT
242.96
query52_query25_1344n
SAT
328.73
stmt22_6_72
UNSAT
340.72
stmt19_133_217
UNSAT
354.01
query33_query51_1344n
SAT
362.56
query33_query57_1344n
SAT
363.66
query51_query57_1344n
SAT
372.28
stmt22_92_263
UNSAT
388.64
stmt44_41_288
UNSAT
410.46
sortnetsort9.AE.stepl.008
UNSAT
430.28
rankfunc18_signed_32
FAIL
470.54
query64_query01_1344n
SAT
472.49
rankfunc42_signed_64
FAIL
487.43
rankfunc8_unsigned_64
FAIL
487.43
stmt21_143_403
FAIL
518.43
rankfunc60_signed_64
FAIL
519.93
rankfunc21_signed_32
FAIL
527.23
stmt9_350_351
SAT
568.8
rankfunc19_unsigned_64
FAIL
576.43
rankfunc16_signed_64
FAIL
583.73
rankfunc16_unsigned_64
FAIL
585.13
rankfunc22_unsigned_64
FAIL
588.73
qshifter_8
FAIL
599.53
stmt17_94_98
FAIL
599.61
stmt23_66_76
FAIL
599.61
stmt23_66_67
FAIL
599.62
stmt28_89_97
FAIL
599.62
stmt21_84_364
FAIL
599.71
query10_query06_1344n
FAIL
599.71
query42_query45_1344n
FAIL
599.71
query42_query60_1344n
FAIL
599.71
nreachq_query54_1344n
FAIL
599.71
stmt21_138_304
FAIL
599.71
query60_query44_1344n
FAIL
599.71
stmt19_217_309
FAIL
599.71
query60_query10_1344n
FAIL
599.71
rankfunc46_unsigned_64
FAIL
599.71
query10_query34_1344n
FAIL
599.71
stmt50_205_293
FAIL
599.71
stmt19_83_412
FAIL
599.71
stmt19_137_408
FAIL
599.71
stmt19_90_408
FAIL
599.71
stmt31_22_328
FAIL
599.71
stmt19_180_352
FAIL
599.71
stmt21_71_354
FAIL
599.71
query71_query36_1344n
FAIL
599.71
stmt21_262_319
FAIL
599.71
stmt21_354_403
FAIL
599.71
stmt21_178_258
FAIL
599.71
stmt46_111_238
FAIL
599.71
query71_query34_1344n
FAIL
599.71
rankfunc43_signed_64
FAIL
599.71
query71_query31_1344n
FAIL
599.71
query10_query45_1344n
FAIL
599.71
stmt27_16_224
FAIL
599.71
rankfunc45_unsigned_64
FAIL
599.71
rankfunc26_unsigned_64
FAIL
599.71
rankfunc15_signed_16
FAIL
599.71
rankfunc37_signed_16
FAIL
599.71
rankfunc3_unsigned_32
FAIL
599.71
rankfunc43_unsigned_32
FAIL
599.71
rankfunc16_signed_32
FAIL
599.71
eequery_query64_1344n
FAIL
599.71
rankfunc61_signed_32
FAIL
599.71
rankfunc33_unsigned_64
FAIL
599.71
rankfunc27_signed_16
FAIL
599.71
rankfunc1_unsigned_64
FAIL
599.71
rankfunc52_unsigned_32
FAIL
599.71
rankfunc25_signed_64
FAIL
599.71
rankfunc58_signed_32
FAIL
599.71
rankfunc60_signed_16
FAIL
599.71
rankfunc45_signed_64
FAIL
599.71
query64_query11_1344n
FAIL
599.71
rankfunc43_signed_16
FAIL
599.71
rankfunc45_unsigned_16
FAIL
599.71
rankfunc2_signed_16
FAIL
599.71
rankfunc56_unsigned_16
FAIL
599.71
rankfunc3_unsigned_64
FAIL
599.71
nreachq_query11_1344n
FAIL
599.71
rankfunc44_unsigned_64
FAIL
599.71
rankfunc17_unsigned_16
FAIL
599.71
query42_query06_1344n
FAIL
599.71
rankfunc45_signed_32
FAIL
599.71
rankfunc15_unsigned_16
FAIL
599.71
rankfunc55_signed_16
FAIL
599.71
rankfunc34_unsigned_32
FAIL
599.71
rankfunc22_signed_32
FAIL
599.71
rankfunc19_signed_16
FAIL
599.71
stmt44_554_604
FAIL
599.71
stmt19_71_95
FAIL
599.71
stmt17_63_82
FAIL
599.71
stmt17_74_78
FAIL
599.71
stmt17_82_86
FAIL
599.71
stmt17_70_90
FAIL
599.71
stmt23_66_96
FAIL
599.71
stmt17_62_78
FAIL
599.71
stmt19_75_95
FAIL
599.71
stmt17_74_90
FAIL
599.71
stmt19_65_87
FAIL
599.71
stmt28_68_69
FAIL
599.71
stmt17_70_82
FAIL
599.71
stmt19_83_91
FAIL
599.71
stmt38_943_942
FAIL
599.71
stmt70_495_501
FAIL
599.71
stmt44_435_436
FAIL
599.71
stmt1_787_788
FAIL
599.71
stmt16_818_819
FAIL
599.71
stmt17_70_78
FAIL
599.71
stmt23_67_92
FAIL
599.71
stmt19_64_91
FAIL
599.71
stmt17_86_98
FAIL
599.71
stmt23_92_96
FAIL
599.71
stmt17_63_70
FAIL
599.71
stmt28_68_81
FAIL
599.71
stmt17_82_94
FAIL
599.71
stmt28_73_85
FAIL
599.71
stmt19_79_83
FAIL
599.71
sortnetsort9.AE.stepl.012
FAIL
599.71
sortnetsort9.AE.stepl.010
FAIL
599.71
sortnetsort9.AE.stepl.009
FAIL
599.71
sortnetsort10.AE.stepl.012
FAIL
599.71
sortnetsort10.AE.stepl.011
FAIL
599.71
sortnetsort10.AE.stepl.010
FAIL
599.71
sortnetsort10.AE.stepl.009
FAIL
599.71
sortnetsort10.AE.stepl.008
FAIL
599.71
sortnetsort10.AE.stepl.007
FAIL
599.71
stmt28_68_73
FAIL
599.71
stmt17_78_98
FAIL
599.71
stmt17_78_94
FAIL
599.71
stmt28_73_97
FAIL
599.71
stmt23_72_76
FAIL
599.71
stmt19_87_95
FAIL
599.71
stmt19_65_95
FAIL
599.71
stmt17_78_90
FAIL
599.71
stmt17_70_98
FAIL
599.71
stmt17_62_98
FAIL
599.71
stmt17_63_78
FAIL
599.71
stmt19_79_87
FAIL
599.71
stmt17_70_86
FAIL
599.71
qshifter_6
FAIL
599.71
stmt32_570_572
FAIL
599.71
stmt82_224_225
FAIL
599.71
stmt44_40_387
FAIL
599.71
stmt11_643_645
FAIL
599.71
stmt19_66_214
FAIL
599.71
stmt27_584_603
FAIL
599.71
stmt21_5_134
FAIL
599.71
stmt2_649_776
FAIL
599.71
stmt24_765_766
FAIL
599.71
stmt1_629_630
FAIL
599.71
stmt41_118_131
FAIL
599.71
stmt22_311_370
FAIL
599.71
qshifter_7
FAIL
599.71
stmt19_90_266
FAIL
599.71
stmt37_941_942
FAIL
599.71
stmt16_285_286
FAIL
599.71
stmt2_649_723
FAIL
599.71
stmt86_889_890
FAIL
599.71
stmt29_226_376
FAIL
599.71
stmt27_296_297
FAIL
599.71
stmt124_966_965
FAIL
599.71
stmt2_976_999
FAIL
599.71
stmt21_70_369
FAIL
599.71
stmt19_3_401
FAIL
599.71
stmt39_107_197
FAIL
599.71
stmt21_71_413
FAIL
599.71
stmt21_319_418
FAIL
599.71
stmt1_919_920
FAIL
599.71
stmt21_326_327
FAIL
599.71
stmt19_75_83
FAIL
599.72
stmt21_79_304
FAIL
599.72
stmt27_946_955
FAIL
599.72
stmt41_738_737
FAIL
599.72
stmt21_84_215
FAIL
599.72
stmt19_3_214
FAIL
599.72
query54_query58_1344n
FAIL
599.72
stmt23_88_92
FAIL
599.72
stmt19_64_99
FAIL
599.72
query60_query33_1344n
FAIL
599.72
stmt19_217_302
FAIL
599.72
sortnetsort9.AE.stepl.007
FAIL
599.72
stmt19_177_309
FAIL
599.72
stmt19_352_359
FAIL
599.72
rankfunc36_signed_32
FAIL
599.72
rankfunc46_unsigned_16
FAIL
599.72
rankfunc5_unsigned_16
FAIL
599.72
stmt19_64_87
FAIL
599.72
rankfunc25_unsigned_16
FAIL
599.72
rankfunc28_signed_16
FAIL
599.72
rankfunc57_signed_16
FAIL
599.72
stmt41_566_580
FAIL
599.72
query44_query26_1344n
FAIL
599.72
stmt2_649_647
FAIL
599.72
stmt19_67_318
FAIL
599.72
stmt16_47_48
FAIL
599.72
stmt2_480_551
FAIL
599.72
stmt41_738_749
FAIL
599.72
stmt17_82_98
FAIL
599.72
rankfunc27_signed_32
FAIL
599.72
stmt72_696_721
FAIL
599.72
rankfunc58_unsigned_32
FAIL
599.72
stmt44_554_555
FAIL
599.72
stmt44_916_917
FAIL
599.81
rankfunc1_signed_32
FAIL
599.81
sortnetsort10.AE.stepl.006
FAIL
599.81
qshifter_5
FAIL
599.81
sortnetsort9.AE.stepl.011
FAIL
599.81
stmt16_950_951
FAIL
599.81
stmt1_60_61
FAIL
599.81
stmt22_73_311
FAIL
599.81
stmt24_292_293
FAIL
599.81
rankfunc57_signed_32
FAIL
599.81
stmt137_903_911
FAIL
599.81
stmt17_99_98
FAIL
599.81
sortnetsort9.AE.stepl.006
FAIL
599.81
stmt22_6_414
FAIL
599.82
stmt70_854_859
FAIL
599.82
stmt52_244_394
FAIL
599.82
Contact
|
Organization
|
Links
|
Citing QBFLIB