QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances solved by
aspQ
QBFEVAL'16 - 2QBF Track.
Instance
Result
Time
stmt44_107_108
SAT
0
tree-exa10-20
SAT
0
stmt24_7_8
SAT
0
qshifter_4
SAT
0
rankfunc37_signed_16
UNSAT
0
stmt1_145_146
SAT
0
stmt24_148_149
SAT
0
tree-exa10-10
SAT
0
mutex-2-s
SAT
0
stmt1_20_21
SAT
0
tree-exa10-30
SAT
0
tree-exa10-15
SAT
0
tree-exa10-25
SAT
0
qshifter_3
SAT
0
mutex-4-s
SAT
0
k_ph_n-1
SAT
0
stmt3_639_640
SAT
0.01
rankfunc60_signed_16
SAT
0.01
stmt27_296_297
SAT
0.01
stmt16_0_1
SAT
0.01
stmt11_643_645
SAT
0.01
stmt24_292_293
SAT
0.01
stmt2_649_723
SAT
0.01
stmt70_191_213
SAT
0.01
stmt1_811_812
SAT
0.01
stmt2_649_647
SAT
0.01
stmt16_818_819
SAT
0.01
rankfunc28_signed_16
SAT
0.01
stmt82_224_225
SAT
0.01
rankfunc15_signed_16
SAT
0.01
rankfunc36_signed_32
SAT
0.01
rankfunc27_signed_32
SAT
0.01
rankfunc17_unsigned_16
SAT
0.01
stmt9_350_351
SAT
0.01
rankfunc46_unsigned_16
SAT
0.01
rankfunc27_signed_16
SAT
0.01
rankfunc5_unsigned_16
SAT
0.01
stmt18_258_260
SAT
0.01
rankfunc43_signed_16
SAT
0.01
rankfunc25_unsigned_16
SAT
0.01
rankfunc45_unsigned_16
SAT
0.01
rankfunc56_unsigned_16
SAT
0.01
mutex-8-s
SAT
0.01
mutex-16-s
SAT
0.01
qshifter_5
SAT
0.01
stmt44_435_436
SAT
0.01
stmt70_854_859
SAT
0.02
stmt137_903_911
SAT
0.02
rankfunc34_unsigned_32
SAT
0.02
stmt70_495_501
SAT
0.02
stmt44_554_555
SAT
0.02
rankfunc19_signed_16
SAT
0.02
stmt21_326_327
SAT
0.02
stmt1_919_920
SAT
0.02
stmt44_554_604
SAT
0.02
stmt32_570_572
SAT
0.02
rankfunc15_unsigned_16
SAT
0.02
stmt44_916_917
SAT
0.02
stmt86_889_890
SAT
0.02
stmt72_696_721
SAT
0.02
stmt27_946_955
SAT
0.02
stmt41_738_737
SAT
0.02
stmt16_285_286
SAT
0.02
stmt124_966_965
SAT
0.02
stmt2_480_551
SAT
0.02
stmt27_584_603
SAT
0.02
rankfunc43_unsigned_32
SAT
0.02
stmt41_118_131
SAT
0.02
stmt2_649_776
SAT
0.02
stmt24_765_766
SAT
0.02
rankfunc52_unsigned_32
SAT
0.03
rankfunc22_signed_32
SAT
0.03
rankfunc61_signed_32
SAT
0.03
rankfunc44_unsigned_64
SAT
0.03
stmt7_33_34
SAT
0.03
rankfunc25_signed_64
SAT
0.03
stmt16_950_951
SAT
0.03
rankfunc1_signed_32
SAT
0.03
rankfunc45_signed_32
SAT
0.03
rankfunc58_unsigned_32
SAT
0.03
rankfunc55_signed_16
SAT
0.03
rankfunc18_signed_32
SAT
0.03
rankfunc57_signed_16
SAT
0.03
rankfunc58_signed_32
SAT
0.03
stmt1_629_630
SAT
0.04
rankfunc2_signed_16
SAT
0.04
rankfunc21_signed_32
SAT
0.04
qshifter_6
SAT
0.04
rankfunc16_signed_32
SAT
0.04
rankfunc33_unsigned_64
SAT
0.04
rankfunc43_signed_64
SAT
0.05
stmt41_566_580
SAT
0.05
rankfunc45_unsigned_64
SAT
0.05
rankfunc3_unsigned_32
SAT
0.05
rankfunc42_signed_64
SAT
0.05
stmt41_738_749
SAT
0.05
stmt1_787_788
SAT
0.05
mutex-32-s
SAT
0.06
rankfunc46_unsigned_64
SAT
0.06
stmt37_941_942
SAT
0.07
rankfunc22_unsigned_64
SAT
0.07
stmt1_60_61
SAT
0.07
rankfunc1_unsigned_64
SAT
0.07
stmt38_943_942
SAT
0.07
rankfunc45_signed_64
SAT
0.07
stmt16_47_48
SAT
0.08
rankfunc26_unsigned_64
SAT
0.08
stmt17_99_98
SAT
0.08
rankfunc16_signed_64
SAT
0.09
stmt22_6_72
UNSAT
0.09
rankfunc57_signed_32
SAT
0.09
rankfunc16_unsigned_64
SAT
0.09
rankfunc8_unsigned_64
SAT
0.09
rankfunc19_unsigned_64
SAT
0.1
rankfunc60_signed_64
SAT
0.1
rankfunc3_unsigned_64
SAT
0.11
mutex-64-s
SAT
0.11
stmt27_16_97
UNSAT
0.15
stmt27_16_149
UNSAT
0.2
mutex-128-s
SAT
0.21
stmt22_73_182
UNSAT
0.23
stmt52_55_117
UNSAT
0.25
stmt19_66_214
UNSAT
0.28
stmt39_107_197
UNSAT
0.29
query26_query34_1344n
UNSAT
0.32
qshifter_7
SAT
0.37
exquery_query04_1344n
UNSAT
0.38
axquery_query44_1344n
UNSAT
0.49
query26_query57_1344n
UNSAT
0.49
eequery_query04_1344n
SAT
0.58
query02_query58_1344n
UNSAT
0.6
stmt19_217_302
UNSAT
0.63
axquery_query06_1344n
UNSAT
0.65
query04_query25_1344n
SAT
0.66
query07_query64_1344n
UNSAT
0.69
stmt19_180_352
UNSAT
0.69
stmt41_37_108
UNSAT
0.7
query52_query25_1344n
SAT
0.78
query07_query60_1344n
UNSAT
0.8
stmt22_311_370
UNSAT
0.84
query02_query44_1344n
UNSAT
0.97
stmt19_217_309
UNSAT
0.98
stmt19_352_359
UNSAT
1.05
stmt19_3_214
UNSAT
1.13
query31_query26_1344n
SAT
1.19
stmt44_41_288
UNSAT
1.21
stmt19_75_95
FAIL
1.3
stmt17_70_98
FAIL
1.3
sortnetsort7.AE.stepl.008
FAIL
1.33
stmt19_71_95
FAIL
1.33
stmt19_83_91
FAIL
1.33
stmt2_976_999
FAIL
1.34
query36_query25_1344n
SAT
1.38
stmt19_87_95
FAIL
1.39
stmt17_82_98
FAIL
1.39
stmt17_78_98
FAIL
1.4
stmt23_88_92
FAIL
1.41
stmt17_82_94
FAIL
1.44
stmt23_92_96
FAIL
1.47
query44_query26_1344n
FAIL
1.48
sortnetsort8.AE.stepl.006
FAIL
1.52
stmt19_137_408
FAIL
1.52
query31_eequery_1344n
SAT
1.55
sortnetsort7.AE.stepl.009
FAIL
1.57
stmt17_86_98
FAIL
1.61
query10_query06_1344n
FAIL
1.62
stmt28_89_97
FAIL
1.65
nreachq_query11_1344n
FAIL
1.77
stmt19_90_266
UNSAT
1.8
query21_query55_1344n
UNSAT
1.95
stmt27_16_224
UNSAT
2.17
stmt50_205_293
UNSAT
2.49
sortnetsort10.AE.stepl.006
FAIL
2.57
sortnetsort10.AE.stepl.004
FAIL
2.59
sortnetsort8.AE.stepl.008
FAIL
2.61
sortnetsort5.AE.stepl.003
SAT
2.76
sortnetsort8.AE.stepl.003
FAIL
3.65
sortnetsort5.AE.stepl.006
UNSAT
3.99
sortnetsort5.AE.stepl.005
UNSAT
4.08
query10_query45_1344n
FAIL
4.15
nxquery_query50_1344n
SAT
4.19
stmt21_5_134
UNSAT
4.6
sortnetsort5.AE.stepl.007
UNSAT
4.64
sortnetsort9.AE.stepl.011
FAIL
4.81
sortnetsort10.AE.stepl.008
FAIL
5.09
sortnetsort8.AE.stepl.009
FAIL
5.13
sortnetsort5.AE.stepl.004
SAT
5.23
sortnetsort6.AE.stepl.004
SAT
5.45
qshifter_8
SAT
5.62
sortnetsort6.AE.stepl.003
SAT
5.63
sortnetsort9.AE.stepl.006
FAIL
5.82
sortnetsort6.AE.stepl.007
UNSAT
5.94
sortnetsort7.AE.stepl.004
SAT
6.07
sortnetsort7.AE.stepl.006
UNSAT
6.23
sortnetsort8.AE.stepl.004
SAT
6.39
sortnetsort7.AE.stepl.007
UNSAT
6.73
sortnetsort7.AE.stepl.005
FAIL
6.98
sortnetsort7.AE.stepl.003
SAT
7.78
sortnetsort6.AE.stepl.006
FAIL
8.15
query33_query45_1344n
SAT
8.87
query31_query50_1344n
SAT
9.31
sortnetsort6.AE.stepl.005
FAIL
9.37
query05_query31_1344n
SAT
9.96
stmt21_79_304
UNSAT
12.67
sortnetsort8.AE.stepl.007
UNSAT
17.07
stmt21_70_369
UNSAT
19.84
query49_ntrivil_1344n
SAT
20.03
sortnetsort9.AE.stepl.004
SAT
20.87
eequery_query64_1344n
SAT
28.62
stmt21_71_413
UNSAT
28.81
query31_reachqu_1344n
SAT
31.06
sortnetsort9.AE.stepl.009
UNSAT
34.54
sortnetsort8.AE.stepl.005
SAT
40.53
sortnetsort9.AE.stepl.012
UNSAT
41.9
stmt19_83_142
UNSAT
44.38
stmt29_226_376
UNSAT
44.56
query50_query06_1344n
SAT
46.97
stmt19_177_309
UNSAT
48.38
sortnetsort9.AE.stepl.010
UNSAT
51.93
query51_query57_1344n
FAIL
60.32
query54_query58_1344n
FAIL
60.32
query64_query01_1344n
FAIL
60.33
query34_query11_1344n
FAIL
60.36
query33_query51_1344n
FAIL
60.36
query33_query57_1344n
FAIL
60.36
query64_query11_1344n
FAIL
60.37
query71_query31_1344n
FAIL
60.46
stmt31_22_328
FAIL
60.47
stmt22_92_263
FAIL
60.5
query48_exquery_1344n
FAIL
60.52
query60_query10_1344n
FAIL
60.54
stmt21_84_215
FAIL
60.56
query71_query34_1344n
FAIL
60.56
stmt22_73_311
FAIL
60.58
query60_query33_1344n
FAIL
60.6
query71_query36_1344n
FAIL
60.62
stmt21_178_258
FAIL
60.64
query60_query44_1344n
FAIL
60.66
stmt28_68_69
FAIL
60.68
stmt21_262_319
FAIL
60.68
stmt21_71_354
FAIL
60.71
stmt52_244_394
FAIL
60.72
stmt21_138_304
FAIL
60.72
stmt17_63_78
FAIL
60.73
stmt28_68_73
FAIL
60.74
stmt21_181_218
FAIL
60.75
stmt19_133_217
FAIL
60.75
stmt17_63_82
FAIL
60.77
stmt23_72_76
FAIL
60.77
stmt31_190_227
FAIL
60.77
stmt44_40_387
FAIL
60.79
stmt19_83_412
FAIL
60.79
stmt21_84_364
FAIL
60.79
stmt17_62_78
FAIL
60.79
stmt19_64_87
FAIL
60.8
stmt19_67_318
FAIL
60.8
query60_query45_1344n
FAIL
60.81
stmt19_3_401
FAIL
60.81
stmt41_160_235
FAIL
60.82
stmt17_70_78
FAIL
60.82
stmt46_111_238
FAIL
60.82
stmt17_63_70
FAIL
60.83
stmt28_68_81
FAIL
60.84
stmt19_64_91
FAIL
60.86
stmt17_70_82
FAIL
60.87
stmt17_74_78
FAIL
60.87
stmt23_66_96
FAIL
60.88
stmt19_90_408
FAIL
60.88
stmt21_354_403
FAIL
60.88
stmt19_65_87
FAIL
60.88
stmt23_67_92
FAIL
60.89
stmt23_66_67
FAIL
60.89
stmt17_70_86
FAIL
60.9
stmt21_319_418
FAIL
60.9
stmt21_143_403
FAIL
60.91
stmt19_75_83
FAIL
60.92
stmt22_6_414
FAIL
60.95
stmt19_65_95
FAIL
60.95
stmt19_64_99
FAIL
60.96
stmt17_70_90
FAIL
60.96
stmt19_79_83
FAIL
60.96
stmt28_73_85
FAIL
60.97
stmt17_74_90
FAIL
60.99
stmt23_66_76
FAIL
60.99
stmt19_79_87
FAIL
61
stmt17_62_98
FAIL
61.03
stmt17_78_90
FAIL
61.05
stmt17_82_86
FAIL
61.06
stmt28_73_97
FAIL
61.08
stmt17_78_94
FAIL
61.08
sortnetsort9.AE.stepl.005
FAIL
61.26
stmt17_94_98
FAIL
61.31
nreachq_query54_1344n
FAIL
61.49
query42_query06_1344n
FAIL
61.58
query10_query34_1344n
FAIL
61.62
query42_query60_1344n
FAIL
61.65
query42_query45_1344n
FAIL
61.72
sortnetsort9.AE.stepl.008
FAIL
62.14
sortnetsort10.AE.stepl.011
UNSAT
62.87
sortnetsort9.AE.stepl.007
FAIL
63.04
sortnetsort10.AE.stepl.009
FAIL
63.64
sortnetsort10.AE.stepl.005
FAIL
63.91
sortnetsort10.AE.stepl.010
FAIL
69.3
sortnetsort10.AE.stepl.007
FAIL
70.4
sortnetsort10.AE.stepl.012
FAIL
72.57
Contact
|
Organization
|
Links
|
Citing QBFLIB