QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances solved by
GhostQ-PG_cegar
QBFEVAL'18 - Prenex 2QBF Track
Instance
Result
Time
itc-b13-fixpoint-1
UNSAT
0
stmt27_16_224
UNSAT
0
axquery_query42_1344n
UNSAT
0
small-synabs-fixpoint-3
UNSAT
0
stmt124_966_965
SAT
0
stmt9_445_446
SAT
0
stmt5_731_730
SAT
0
stmt16_818_819
SAT
0.17
query64_query01_1344n
SAT
0.27
query04_query25_1344n
SAT
0.27
stmt44_554_604
SAT
0.28
stmt25_597_598
SAT
0.29
stmt41_262_275
SAT
0.33
nxquery_query42_1344n
UNSAT
0.35
exquery_query42_1344n
UNSAT
0.36
query52_query25_1344n
SAT
0.36
query36_query25_1344n
SAT
0.41
query31_eequery_1344n
SAT
0.41
query02_query42_1344n
UNSAT
0.44
query05_query31_1344n
SAT
0.59
small-pipeline-fixpoint-1
UNSAT
0.59
rankfunc60_unsigned_32
SAT
0.61
stmt19_66_214
UNSAT
0.61
query04_query42_1344n
UNSAT
0.61
stmt19_133_217
UNSAT
0.64
stmt46_111_238
UNSAT
0.64
stmt1_79_80
SAT
0.69
stmt25_52_53
SAT
0.69
usb-phy-fixpoint-1
UNSAT
0.69
eequery_query64_1344n
SAT
0.76
stmt27_149_224
UNSAT
0.77
stmt27_93_98
SAT
0.79
rankfunc48_unsigned_16
SAT
0.8
query45_query42_1344n
SAT
0.8
stmt31_22_328
UNSAT
0.81
stmt41_160_235
UNSAT
0.84
stmt31_190_227
UNSAT
0.89
small-seq-fixpoint-1
UNSAT
0.9
itc-b13-fixpoint-2
UNSAT
0.91
stmt21_178_258
UNSAT
0.91
stmt21_71_354
UNSAT
0.92
query02_query44_1344n
UNSAT
0.95
stmt53_208_245
UNSAT
0.99
stmt44_40_387
UNSAT
1
stmt21_181_218
UNSAT
1
stmt21_70_369
UNSAT
1.01
stmt22_6_414
UNSAT
1.07
rankfunc56_unsigned_64
SAT
1.07
stmt21_71_413
UNSAT
1.08
stmt19_3_401
UNSAT
1.08
rankfunc56_signed_64
SAT
1.09
cache-coherence-3-fixpoint-1
UNSAT
1.09
stmt19_90_408
UNSAT
1.18
query26_query42_1344n
UNSAT
1.2
stmt21_181_369
UNSAT
1.2
stmt21_84_364
UNSAT
1.2
stmt19_83_412
UNSAT
1.2
small-synabs-fixpoint-10
UNSAT
1.22
query36_query42_1344n
SAT
1.26
stmt21_143_403
UNSAT
1.26
stmt19_137_408
UNSAT
1.3
rankfunc55_unsigned_64
SAT
1.31
stmt29_226_376
UNSAT
1.32
query31_query50_1344n
SAT
1.35
query25_query42_1344n
SAT
1.35
rankfunc2_unsigned_64
SAT
1.36
ethernet-fixpoint-1
UNSAT
1.37
trivial_query42_1344n
UNSAT
1.46
query50_query06_1344n
SAT
1.46
sdlx-fixpoint-3
UNSAT
1.51
ntrivil_query42_1344n
UNSAT
1.52
stmt31_276_328
UNSAT
1.55
query48_exquery_1344n
SAT
1.61
stmt22_311_370
UNSAT
1.64
stmt41_286_385
UNSAT
1.66
query27_query42_1344n
UNSAT
1.68
cache-coherence-2-fixpoint-2
UNSAT
1.69
stmt19_352_359
UNSAT
1.78
query33_query45_1344n
SAT
1.8
usb-phy-fixpoint-2
UNSAT
1.8
stmt47_340_389
UNSAT
1.83
query49_ntrivil_1344n
SAT
1.83
itc-b13-fixpoint-3
SAT
1.83
stmt50_343_392
UNSAT
1.84
small-pipeline-fixpoint-2
UNSAT
1.9
rankfunc49_unsigned_64
SAT
1.9
query31_reachqu_1344n
SAT
2.06
rankfunc49_signed_64
SAT
2.1
rankfunc57_unsigned_64
SAT
2.1
rankfunc53_signed_64
SAT
2.11
query54_query58_1344n
SAT
2.2
rankfunc53_unsigned_64
SAT
2.21
sdlx-fixpoint-4
UNSAT
2.39
rankfunc61_unsigned_64
SAT
2.39
nxquery_query50_1344n
SAT
2.46
query11_query42_1344n
SAT
2.46
cache-coherence-3-fixpoint-2
UNSAT
2.5
rankfunc51_signed_64
SAT
2.69
itc-b13-fixpoint-4
SAT
2.83
stmt19_313_412
UNSAT
2.89
usb-phy-fixpoint-3
UNSAT
2.89
rankfunc35_unsigned_64
SAT
2.89
query07_query42_1344n
UNSAT
2.98
sdlx-fixpoint-5
UNSAT
3
rankfunc52_unsigned_64
SAT
3.11
small-seq-fixpoint-2
UNSAT
3.19
rankfunc58_unsigned_64
SAT
3.2
rankfunc58_signed_64
SAT
3.27
rankfunc52_signed_64
SAT
3.29
small-pipeline-fixpoint-3
UNSAT
3.3
rankfunc54_signed_64
SAT
3.3
rankfunc51_unsigned_64
SAT
3.47
rankfunc48_unsigned_64
SAT
3.5
query50_query42_1344n
SAT
3.57
cache-coherence-2-fixpoint-4
UNSAT
3.59
rankfunc54_unsigned_64
SAT
3.63
rankfunc61_signed_64
SAT
3.63
query03_query42_1344n
UNSAT
3.77
query21_query58_1344n
UNSAT
3.79
itc-b13-fixpoint-5
SAT
3.8
cache-coherence-3-fixpoint-3
UNSAT
3.88
itc-b13-fixpoint-8
SAT
4.08
rankfunc59_signed_64
SAT
4.24
stmt21_310_360
UNSAT
4.38
rankfunc59_unsigned_64
SAT
4.55
cache-coherence-2-fixpoint-5
UNSAT
4.6
query34_query11_1344n
SAT
4.66
query21_query42_1344n
UNSAT
4.67
rankfunc31_signed_64
SAT
4.73
usb-phy-fixpoint-4
UNSAT
4.8
rankfunc35_signed_64
SAT
4.8
query31_query42_1344n
SAT
5.09
query33_query51_1344n
SAT
5.37
rankfunc48_signed_64
SAT
5.44
query05_query42_1344n
SAT
5.45
small-seq-fixpoint-3
UNSAT
5.51
sdlx-fixpoint-6
UNSAT
5.61
cache-coherence-2-fixpoint-6
UNSAT
5.62
stmt2_976_999
SAT
5.98
rankfunc31_unsigned_64
SAT
6
rankfunc41_signed_64
SAT
6.19
rankfunc41_unsigned_64
SAT
6.59
itc-b13-fixpoint-6
SAT
6.94
usb-phy-fixpoint-5
UNSAT
7.09
itc-b13-fixpoint-10
SAT
7.14
pi-bus-fixpoint-1
UNSAT
7.39
small-seq-fixpoint-4
UNSAT
7.9
ethernet-fixpoint-2
UNSAT
8.29
query55_query42_1344n
SAT
9.29
sdlx-fixpoint-7
SAT
9.84
sdlx-fixpoint-8
SAT
9.88
small-seq-fixpoint-5
UNSAT
10.51
stmt29_275_376
UNSAT
11.26
sdlx-fixpoint-9
SAT
11.58
query54_query42_1344n
SAT
11.78
itc-b13-fixpoint-7
SAT
12.08
itc-b13-fixpoint-9
SAT
13
small-seq-fixpoint-6
UNSAT
13.21
sdlx-fixpoint-10
SAT
13.98
small-seq-fixpoint-7
UNSAT
15.53
query51_query42_1344n
SAT
16.36
ethernet-fixpoint-3
UNSAT
16.39
query08_query42_1344n
UNSAT
16.49
pi-bus-fixpoint-2
UNSAT
19.42
query01_query42_1344n
SAT
19.71
small-seq-fixpoint-8
UNSAT
20.53
small-seq-fixpoint-9
UNSAT
20.68
query64_query11_1344n
SAT
21.36
stmt52_295_394
UNSAT
21.9
stmt46_289_388
UNSAT
22.22
query52_query42_1344n
SAT
22.66
small-seq-fixpoint-10
UNSAT
22.78
query44_query26_1344n
SAT
26.42
sortnetsort9.AE.stepl.012
UNSAT
26.84
AR-fixpoint-1
FAIL
28.56
pi-bus-fixpoint-3
UNSAT
28.74
query60_query45_1344n
SAT
28.89
query33_query42_1344n
SAT
33.46
stmt41_336_385
UNSAT
34.17
eequery_query42_1344n
SAT
35.29
ethernet-fixpoint-4
UNSAT
42.42
stmt23_66_67
SAT
44.46
query06_query42_1344n
UNSAT
46.76
query09_query42_1344n
UNSAT
46.92
query58_query42_1344n
UNSAT
47.49
stmt28_68_73
SAT
50.44
stmt28_68_69
SAT
56.16
query71_query31_1344n
SAT
59.57
query34_query42_1344n
SAT
60.19
stmt17_63_70
SAT
60.76
stmt23_66_76
SAT
61.76
sortnetsort7.AE.stepl.009
UNSAT
74.45
stmt17_62_78
SAT
74.58
stmt23_72_76
SAT
75.37
stmt17_74_78
SAT
76.57
stmt19_79_83
SAT
76.58
stmt17_70_78
SAT
76.8
stmt39_285_335
UNSAT
84.29
stmt23_88_92
SAT
84.48
stmt17_70_86
SAT
84.61
stmt19_79_87
SAT
87.67
stmt19_87_95
SAT
90.48
stmt17_70_82
SAT
90.54
stmt28_68_81
SAT
94.65
stmt23_92_96
SAT
96.1
stmt28_73_85
SAT
96.94
stmt17_63_82
SAT
97.24
stmt19_75_83
SAT
97.33
stmt19_83_91
SAT
100.16
stmt17_78_94
SAT
102.29
AR-fixpoint-2
FAIL
103.05
query33_query57_1344n
SAT
103.08
stmt17_74_90
SAT
105.76
stmt17_63_78
SAT
106.29
stmt17_78_98
SAT
108.78
stmt17_82_86
SAT
110.07
stmt23_67_92
SAT
110.81
stmt19_64_87
SAT
113.25
stmt17_86_98
SAT
113.4
query71_query36_1344n
UNSAT
113.58
stmt23_66_96
SAT
114.03
stmt19_65_87
SAT
116.67
stmt17_94_98
SAT
116.69
nreachq_query11_1344n
UNSAT
117.06
stmt19_71_95
SAT
117.55
stmt19_64_91
SAT
118.65
stmt17_62_98
SAT
119.23
stmt17_82_98
SAT
120.54
stmt19_64_99
SAT
124.58
stmt17_82_94
SAT
136.79
stmt28_89_97
SAT
142.19
stmt17_70_90
SAT
154.9
stmt19_75_95
SAT
154.93
stmt53_296_346
UNSAT
157.49
stmt47_290_340
UNSAT
157.98
stmt28_73_97
SAT
164.21
stmt32_329_378
UNSAT
168.27
query42_query06_1344n
UNSAT
172.23
stmt17_70_98
SAT
176.07
query51_query57_1344n
SAT
199.32
query64_query42_1344n
SAT
202.31
query42_query42_1344n
UNSAT
216.91
sortnetsort10.AE.stepl.012
UNSAT
218.45
stmt19_65_95
SAT
249.1
AR-fixpoint-4
FAIL
257.16
sortnetsort9.AE.stepl.011
UNSAT
264.94
stmt17_78_90
SAT
277.87
reachqu_query42_1344n
UNSAT
323.74
reachqu_query64_1344n
UNSAT
329.27
query60_query44_1344n
SAT
401.15
AR-fixpoint-6
FAIL
406.49
query42_query45_1344n
SAT
493.24
query48_query42_1344n
UNSAT
536.35
AR-fixpoint-8
FAIL
560.87
sortnetsort7.AE.stepl.008
UNSAT
605.76
nreachq_query54_1344n
SAT
625.83
AR-fixpoint-10
FAIL
711.28
sortnetsort7.AE.stepl.007
UNSAT
727.17
Q_2-3_v-80-100_r-13.4
UNSAT
762.14
sortnetsort10.AE.stepl.011
FAIL
900
Q_2-3_v-80-100_r-11.9
FAIL
900
ci.e#1.a#3.E#40.A#60.c#416.w#2.s#3.asp
FAIL
900
stay24n.sat
FAIL
900
stmt22_320_370
FAIL
900
driver_c9n.sat
FAIL
900
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#7.asp
FAIL
900.01
sortnetsort8.AE.stepl.009
FAIL
900.01
sortnetsort10.AE.stepl.005
FAIL
900.01
sortnetsort10.AE.stepl.004
FAIL
900.01
Q_2-3_v-80-100_r-13.6
FAIL
900.01
Q_2-3_v-80-100_r-13.8
FAIL
900.01
neclaftp4001
FAIL
900.01
stmt21_319_418
FAIL
900.01
ActivityService2
FAIL
900.01
amba3b5y.sat
FAIL
900.01
stmt85_300_399
FAIL
900.01
driver_a10y.sat
FAIL
900.01
mult_bool_matrix_12_13_11.sat
FAIL
900.01
ctrl.e#1.a#3.E#116.A#48.c#.w#7.s#56.asp
FAIL
900.01
bs128y.sat
FAIL
900.01
small-swap1-fixpoint-8
FAIL
900.01
Q_2-3_v-80-100_r-11.2
FAIL
900.01
Q_2-3_v-80-100_r-11.3
FAIL
900.01
small-swap1-fixpoint-4
FAIL
900.01
bs128n.sat
FAIL
900.01
neclaftp2002
FAIL
900.01
small-equiv-fixpoint-3
FAIL
900.01
mult_bool_matrix_dyn_9_5.sat
FAIL
900.01
add20y.sat
FAIL
900.02
cycle_sched_6_7_1.sat
FAIL
900.02
intermediate128
FAIL
900.02
cycle_sched_4_7_1.sat
FAIL
900.02
sortnetsort9.AE.stepl.008
FAIL
900.02
sortnetsort7.AE.stepl.006
FAIL
900.02
sortnetsort10.AE.stepl.009
FAIL
900.02
small-equiv-fixpoint-8
FAIL
900.02
Q_2-3_v-80-100_r-13.7
FAIL
900.02
Q_2-3_v-80-100_r-11.1
FAIL
900.02
Q_2-3_v-80-100_r-11.6
FAIL
900.02
ci.e#1.a#3.E#40.A#60.c#408.w#2.s#1.asp
FAIL
900.02
mult9.sat
FAIL
900.02
Q_2-3_v-80-100_r-13.2
FAIL
900.02
mult_bool_matrix_10_9_11.sat
FAIL
900.02
Q_2-3_v-80-100_r-13.9
FAIL
900.02
ctrl.e#1.a#3.E#128.A#48.c#.w#9.s#1.asp
FAIL
900.02
driver_b8n.sat
FAIL
900.02
ctrl.e#1.a#3.E#128.A#48.c#.w#3.s#26.asp
FAIL
900.03
ctrl.e#1.a#3.E#120.A#48.c#.w#3.s#3.asp
FAIL
900.03
NotificationServiceImpl2
FAIL
900.03
PhaseService
FAIL
900.03
ActivityService
FAIL
900.03
driver_c9y.sat
FAIL
900.03
ConcreteActivityService
FAIL
900.03
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#60.asp
FAIL
900.03
beemldelec4b1_c0to127.sat
FAIL
900.03
ctrl.e#1.a#3.E#118.A#48.c#.w#5.s#7.asp
FAIL
900.03
sortnetsort9.AE.stepl.009
FAIL
900.03
sortnetsort9.AE.stepl.007
FAIL
900.03
Q_2-3_v-80-100_r-11.8
FAIL
900.03
stmt19_302_352
FAIL
900.03
query10_query42_1344n
FAIL
900.03
sortnetsort8.AE.stepl.006
FAIL
900.03
intermediate256
FAIL
900.03
sortnetsort8.AE.stepl.004
FAIL
900.03
small-equiv-fixpoint-4
FAIL
900.03
cycle_sched_6_6_2.sat
FAIL
900.04
driver_d9y.sat
FAIL
900.04
IterationService
FAIL
900.04
floor128
FAIL
900.04
bobtuint31neg
FAIL
900.04
eijkbs3330
FAIL
900.04
kenflashp04
FAIL
900.04
IssueServiceImpl
FAIL
900.04
Q_2-3_v-80-100_r-11.5
FAIL
900.04
Q_2-3_v-80-100_r-11.4
FAIL
900.04
Q_2-3_v-80-100_r-11.0
FAIL
900.04
driver_a9n.sat
FAIL
900.04
floor256
FAIL
900.04
small-swap1-fixpoint-6
FAIL
900.04
small-swap1-fixpoint-10
FAIL
900.04
ltl2dba_C2-8_comp4_REAL.sat
FAIL
900.04
sortnetsort10.AE.stepl.010
FAIL
900.04
UserServiceImpl
FAIL
900.04
reachqu_query71_1344n
FAIL
900.04
pdtpmsrotate32
FAIL
900.05
small-swap1-fixpoint-5
FAIL
900.05
decomposition128
FAIL
900.05
ctrl.e#1.a#3.E#134.A#48.c#.w#9.s#40.asp
FAIL
900.05
GuidanceService2
FAIL
900.05
sortnetsort10.AE.stepl.008
FAIL
900.05
ctrl.e#1.a#3.E#124.A#48.c#.w#7.s#50.asp
FAIL
900.05
sortnetsort9.AE.stepl.010
FAIL
900.05
sortnetsort9.AE.stepl.005
FAIL
900.05
Q_2-3_v-80-100_r-13.0
FAIL
900.05
small-equiv-fixpoint-5
FAIL
900.05
stmt19_368_417
FAIL
900.05
Q_2-3_v-80-100_r-13.3
FAIL
900.05
Q_2-3_v-80-100_r-13.1
FAIL
900.05
eijkbs4863
FAIL
900.05
sortnetsort8.AE.stepl.005
FAIL
900.06
small-swap1-fixpoint-7
FAIL
900.06
query10_query45_1344n
FAIL
900.06
amba2c7n.sat
FAIL
900.06
small-swap1-fixpoint-9
FAIL
900.06
ctrl.e#1.a#3.E#128.A#48.c#.w#9.s#60.asp
FAIL
900.06
stmt21_354_403
FAIL
900.06
ci.e#1.a#3.E#40.A#60.c#400.w#2.s#1.asp
FAIL
900.06
ci.e#1.a#3.E#40.A#60.c#408.w#2.s#2.asp
FAIL
900.06
ltl2dba_C2-6_comp3_REAL.sat
FAIL
900.06
sortnetsort9.AE.stepl.004
FAIL
900.06
mult_bool_matrix_17_17_17.sat
FAIL
900.06
Q_2-3_v-80-100_r-13.5
FAIL
900.06
sortnetsort7.AE.stepl.005
FAIL
900.06
cycle_sched_4_4_2.sat
FAIL
900.07
mult_bool_matrix_18_18_18.sat
FAIL
900.07
decomposition256
FAIL
900.07
kenflashp12
FAIL
900.07
amba2f9n.sat
FAIL
900.07
6s289rb05233_c0to63.sat
FAIL
900.07
beemskbn1f1_c0to7.sat
FAIL
900.07
genbuf9b4n.sat
FAIL
900.07
ceiling128
FAIL
900.07
load_2c_comp_comp7_REAL.sat
FAIL
900.07
ci.e#1.a#3.E#40.A#60.c#288.w#6.s#2.asp
FAIL
900.07
GuidanceService
FAIL
900.07
ctrl.e#1.a#3.E#128.A#48.c#.w#5.s#60.asp
FAIL
900.07
Q_2-3_v-80-100_r-11.7
FAIL
900.07
ceiling256
FAIL
900.07
ctrl.e#1.a#3.E#128.A#48.c#.w#7.s#1.asp
FAIL
900.08
ltl2dpa_C26_comp2_REAL.sat
FAIL
900.08
cycle_sched_12_2_1.sat
FAIL
900.08
pdtpmsmiim
FAIL
900.08
cycle_sched_2_10_1.sat
FAIL
900.08
sortnetsort8.AE.stepl.008
FAIL
900.09
oski3ub5i_c0to63.sat
FAIL
900.09
small-equiv-fixpoint-2
FAIL
900.09
ctrl.e#1.a#3.E#112.A#48.c#.w#5.s#27.asp
FAIL
900.09
oski3ub5i_c0to255.sat
FAIL
900.09
ctrl.e#1.a#3.E#110.A#48.c#.w#9.s#13.asp
FAIL
900.09
small-equiv-fixpoint-1
FAIL
900.1
ci.e#1.a#3.E#40.A#60.c#384.w#6.s#8.asp
FAIL
900.1
oski3ub5i_c0to511.sat
FAIL
900.1
Contact
|
Organization
|
Links
|
Citing QBFLIB