QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances solved by
areqs
QBFEVAL'16 - 2QBF Track.
Instance
Result
Time
qshifter_4
SAT
0
tree-exa10-20
SAT
0
k_ph_n-1
SAT
0
rankfunc27_signed_16
SAT
0
rankfunc5_unsigned_16
SAT
0
stmt24_148_149
SAT
0
stmt44_107_108
SAT
0
stmt1_811_812
SAT
0
stmt1_145_146
SAT
0
stmt16_0_1
SAT
0
stmt1_20_21
SAT
0
stmt24_7_8
SAT
0
mutex-8-s
SAT
0
qshifter_3
SAT
0
tree-exa10-25
SAT
0
tree-exa10-30
SAT
0
mutex-4-s
SAT
0
tree-exa10-10
SAT
0
mutex-2-s
SAT
0
tree-exa10-15
SAT
0
rankfunc37_signed_16
UNSAT
0
rankfunc43_signed_16
SAT
0.01
stmt11_643_645
SAT
0.01
rankfunc27_signed_32
SAT
0.01
rankfunc15_signed_16
SAT
0.01
stmt3_639_640
SAT
0.01
rankfunc45_unsigned_16
SAT
0.01
rankfunc36_signed_32
SAT
0.01
rankfunc46_unsigned_16
SAT
0.01
rankfunc25_unsigned_16
SAT
0.01
rankfunc56_unsigned_16
SAT
0.01
rankfunc28_signed_16
SAT
0.01
rankfunc15_unsigned_16
SAT
0.01
rankfunc34_unsigned_32
SAT
0.01
rankfunc17_unsigned_16
SAT
0.01
rankfunc60_signed_16
SAT
0.01
stmt21_326_327
SAT
0.01
mutex-16-s
SAT
0.01
qshifter_5
SAT
0.01
stmt9_350_351
SAT
0.01
stmt2_649_647
SAT
0.01
stmt44_435_436
SAT
0.01
stmt82_224_225
SAT
0.01
stmt16_818_819
SAT
0.01
stmt18_258_260
SAT
0.01
stmt70_191_213
SAT
0.01
stmt2_649_723
SAT
0.01
stmt27_296_297
SAT
0.01
stmt2_480_551
SAT
0.01
stmt24_292_293
SAT
0.01
stmt44_554_604
SAT
0.02
stmt44_916_917
SAT
0.02
stmt44_554_555
SAT
0.02
rankfunc22_signed_32
SAT
0.02
stmt1_919_920
SAT
0.02
stmt137_903_911
SAT
0.02
stmt70_495_501
SAT
0.02
stmt86_889_890
SAT
0.02
stmt70_854_859
SAT
0.02
stmt7_33_34
SAT
0.02
stmt16_950_951
SAT
0.02
stmt32_570_572
SAT
0.02
rankfunc44_unsigned_64
SAT
0.02
rankfunc55_signed_16
SAT
0.02
stmt2_649_776
SAT
0.02
rankfunc43_unsigned_32
SAT
0.02
stmt27_584_603
SAT
0.02
stmt24_765_766
SAT
0.02
stmt41_118_131
SAT
0.02
stmt124_966_965
SAT
0.02
stmt72_696_721
SAT
0.02
stmt27_946_955
SAT
0.02
stmt41_738_737
SAT
0.02
stmt16_285_286
SAT
0.02
rankfunc19_signed_16
SAT
0.02
rankfunc52_unsigned_32
SAT
0.03
rankfunc18_signed_32
SAT
0.03
rankfunc25_signed_64
SAT
0.03
rankfunc45_signed_32
SAT
0.03
rankfunc61_signed_32
SAT
0.03
rankfunc21_signed_32
SAT
0.03
rankfunc57_signed_16
SAT
0.03
rankfunc1_signed_32
SAT
0.03
rankfunc58_unsigned_32
SAT
0.03
rankfunc58_signed_32
SAT
0.03
rankfunc16_signed_32
SAT
0.04
stmt1_629_630
SAT
0.04
stmt41_738_749
SAT
0.04
rankfunc2_signed_16
SAT
0.04
qshifter_6
SAT
0.04
rankfunc3_unsigned_32
SAT
0.04
rankfunc33_unsigned_64
SAT
0.04
mutex-32-s
SAT
0.04
rankfunc43_signed_64
SAT
0.04
rankfunc45_unsigned_64
SAT
0.05
stmt41_566_580
SAT
0.05
stmt1_787_788
SAT
0.05
rankfunc42_signed_64
SAT
0.05
rankfunc46_unsigned_64
SAT
0.05
rankfunc1_unsigned_64
SAT
0.06
rankfunc45_signed_64
SAT
0.06
stmt16_47_48
SAT
0.07
rankfunc22_unsigned_64
SAT
0.07
rankfunc26_unsigned_64
SAT
0.07
stmt1_60_61
SAT
0.07
stmt37_941_942
SAT
0.07
stmt38_943_942
SAT
0.07
rankfunc16_unsigned_64
SAT
0.08
stmt17_99_98
SAT
0.08
rankfunc16_signed_64
SAT
0.08
rankfunc19_unsigned_64
SAT
0.09
rankfunc60_signed_64
SAT
0.09
rankfunc8_unsigned_64
SAT
0.09
rankfunc57_signed_32
SAT
0.09
stmt22_6_72
UNSAT
0.09
rankfunc3_unsigned_64
SAT
0.1
mutex-64-s
SAT
0.1
stmt27_16_97
UNSAT
0.14
exquery_query04_1344n
UNSAT
0.18
stmt27_16_149
UNSAT
0.2
mutex-128-s
SAT
0.2
stmt22_73_182
UNSAT
0.23
stmt52_55_117
UNSAT
0.25
stmt19_66_214
UNSAT
0.27
stmt39_107_197
UNSAT
0.28
qshifter_7
SAT
0.35
axquery_query44_1344n
UNSAT
0.47
query26_query34_1344n
UNSAT
0.53
query02_query44_1344n
UNSAT
0.62
stmt19_217_302
UNSAT
0.63
stmt19_180_352
UNSAT
0.69
axquery_query06_1344n
UNSAT
0.79
stmt22_311_370
UNSAT
0.84
query26_query57_1344n
UNSAT
1.04
query02_query58_1344n
UNSAT
1.2
stmt44_41_288
UNSAT
1.35
stmt22_92_263
UNSAT
1.39
stmt21_79_304
UNSAT
1.49
stmt19_3_401
UNSAT
1.52
stmt21_71_354
UNSAT
1.58
sortnetsort5.AE.stepl.003
SAT
1.72
stmt19_90_266
UNSAT
1.86
query21_query55_1344n
UNSAT
1.92
stmt19_67_318
UNSAT
1.99
stmt41_37_108
UNSAT
2.04
sortnetsort7.AE.stepl.006
UNSAT
2.3
stmt19_83_142
UNSAT
2.36
query07_query64_1344n
UNSAT
2.37
stmt44_40_387
UNSAT
2.55
stmt21_71_413
UNSAT
2.73
sortnetsort5.AE.stepl.006
UNSAT
2.82
sortnetsort5.AE.stepl.005
UNSAT
2.82
sortnetsort5.AE.stepl.004
SAT
2.87
sortnetsort5.AE.stepl.007
UNSAT
2.92
eequery_query04_1344n
SAT
3.57
sortnetsort6.AE.stepl.003
SAT
3.93
stmt50_205_293
UNSAT
4.09
sortnetsort6.AE.stepl.004
SAT
4.35
stmt22_73_311
UNSAT
4.52
sortnetsort6.AE.stepl.007
UNSAT
4.98
sortnetsort7.AE.stepl.003
SAT
5.41
stmt52_244_394
UNSAT
5.46
sortnetsort7.AE.stepl.007
UNSAT
5.57
stmt21_143_403
UNSAT
5.67
sortnetsort7.AE.stepl.008
UNSAT
5.74
qshifter_8
SAT
5.89
sortnetsort7.AE.stepl.009
UNSAT
6.02
query07_query60_1344n
UNSAT
6.27
stmt23_66_67
SAT
7.34
stmt17_63_70
SAT
8.35
stmt31_22_328
UNSAT
8.57
stmt28_68_69
SAT
8.64
sortnetsort6.AE.stepl.006
UNSAT
8.97
stmt2_976_999
SAT
8.98
stmt23_66_76
SAT
9.73
stmt28_68_73
SAT
10
sortnetsort6.AE.stepl.005
UNSAT
10.11
stmt23_72_76
SAT
10.13
stmt17_63_78
SAT
10.4
stmt17_62_78
SAT
10.66
sortnetsort7.AE.stepl.004
SAT
10.97
stmt17_70_78
SAT
11.2
stmt17_63_82
SAT
11.48
stmt19_90_408
UNSAT
12.02
stmt17_74_78
SAT
12.3
stmt19_64_87
SAT
12.32
stmt17_70_82
SAT
12.38
stmt28_68_81
SAT
12.51
stmt19_75_83
SAT
13.15
stmt19_65_87
SAT
13.45
query31_query26_1344n
SAT
13.7
stmt19_64_91
SAT
13.89
stmt23_67_92
SAT
14.25
stmt17_70_86
SAT
14.28
stmt19_79_83
SAT
14.68
stmt28_73_85
SAT
14.73
stmt17_70_90
SAT
15.04
stmt23_66_96
SAT
15.33
stmt17_82_86
SAT
15.4
stmt19_79_87
SAT
15.56
stmt19_65_95
SAT
15.65
stmt19_71_95
SAT
15.79
stmt17_74_90
SAT
16.16
stmt19_64_99
SAT
16.33
stmt17_78_90
SAT
16.35
stmt19_75_95
SAT
16.43
stmt17_62_98
SAT
17.13
stmt23_88_92
SAT
17.7
stmt19_83_91
SAT
17.72
stmt17_70_98
SAT
17.97
stmt28_73_97
SAT
18.06
stmt17_82_94
SAT
18.91
stmt17_78_98
SAT
19.14
stmt17_82_98
SAT
19.32
stmt17_78_94
SAT
19.5
stmt19_87_95
SAT
19.93
stmt23_92_96
SAT
20.42
stmt17_86_98
SAT
21.42
stmt17_94_98
SAT
21.97
sortnetsort8.AE.stepl.003
SAT
21.99
stmt28_89_97
SAT
22.22
query52_query25_1344n
SAT
39.5
sortnetsort9.AE.stepl.007
UNSAT
49.59
stmt21_138_304
UNSAT
51.9
sortnetsort8.AE.stepl.004
SAT
61.35
stmt21_70_369
UNSAT
68.41
sortnetsort8.AE.stepl.008
UNSAT
75.43
sortnetsort8.AE.stepl.007
UNSAT
85.74
sortnetsort8.AE.stepl.009
UNSAT
102.96
sortnetsort9.AE.stepl.010
UNSAT
115.62
sortnetsort8.AE.stepl.006
UNSAT
144.71
sortnetsort8.AE.stepl.005
SAT
145.81
sortnetsort7.AE.stepl.005
SAT
148.3
sortnetsort9.AE.stepl.004
SAT
457.23
sortnetsort9.AE.stepl.005
SAT
522.04
nreachq_query54_1344n
FAIL
599.52
query42_query06_1344n
FAIL
599.61
query42_query60_1344n
FAIL
599.61
nreachq_query11_1344n
FAIL
599.61
query10_query34_1344n
FAIL
599.61
query10_query06_1344n
FAIL
599.61
sortnetsort10.AE.stepl.010
FAIL
599.62
query10_query45_1344n
FAIL
599.71
query60_query33_1344n
FAIL
599.71
query60_query44_1344n
FAIL
599.71
sortnetsort10.AE.stepl.008
FAIL
599.71
sortnetsort10.AE.stepl.007
FAIL
599.71
query64_query01_1344n
FAIL
599.71
nxquery_query50_1344n
FAIL
599.71
query71_query31_1344n
FAIL
599.71
query71_query34_1344n
FAIL
599.71
query04_query25_1344n
FAIL
599.71
query54_query58_1344n
FAIL
599.71
query50_query06_1344n
FAIL
599.71
stmt21_319_418
FAIL
599.71
sortnetsort10.AE.stepl.006
FAIL
599.71
query31_eequery_1344n
FAIL
599.71
sortnetsort10.AE.stepl.004
FAIL
599.71
query33_query45_1344n
FAIL
599.71
query36_query25_1344n
FAIL
599.71
query42_query45_1344n
FAIL
599.71
query60_query45_1344n
FAIL
599.71
sortnetsort10.AE.stepl.009
FAIL
599.71
eequery_query64_1344n
FAIL
599.71
stmt21_181_218
FAIL
599.71
stmt27_16_224
FAIL
599.71
stmt19_137_408
FAIL
599.71
stmt19_3_214
FAIL
599.71
stmt41_160_235
FAIL
599.71
stmt21_354_403
FAIL
599.71
stmt21_178_258
FAIL
599.71
stmt21_84_215
FAIL
599.71
stmt19_83_412
FAIL
599.71
stmt21_5_134
FAIL
599.71
stmt19_133_217
FAIL
599.71
sortnetsort9.AE.stepl.012
FAIL
599.71
sortnetsort9.AE.stepl.011
FAIL
599.71
stmt19_217_309
FAIL
599.71
sortnetsort10.AE.stepl.011
FAIL
599.71
sortnetsort10.AE.stepl.012
FAIL
599.71
stmt29_226_376
FAIL
599.71
sortnetsort9.AE.stepl.009
FAIL
599.71
sortnetsort9.AE.stepl.006
FAIL
599.71
query44_query26_1344n
FAIL
599.71
stmt19_352_359
FAIL
599.71
query48_exquery_1344n
FAIL
599.72
query51_query57_1344n
FAIL
599.72
query60_query10_1344n
FAIL
599.81
stmt46_111_238
FAIL
599.81
stmt21_84_364
FAIL
599.81
query64_query11_1344n
FAIL
599.81
query33_query51_1344n
FAIL
599.81
query31_reachqu_1344n
FAIL
599.81
stmt22_6_414
FAIL
599.81
sortnetsort10.AE.stepl.005
FAIL
599.81
stmt31_190_227
FAIL
599.81
sortnetsort9.AE.stepl.008
FAIL
599.81
query31_query50_1344n
FAIL
599.81
query05_query31_1344n
FAIL
599.81
query33_query57_1344n
FAIL
599.81
query34_query11_1344n
FAIL
599.81
stmt21_262_319
FAIL
599.81
query49_ntrivil_1344n
FAIL
599.81
query71_query36_1344n
FAIL
599.81
stmt19_177_309
FAIL
599.82
Contact
|
Organization
|
Links
|
Citing QBFLIB