QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances solved by
GhostQ___cegar_qcir_2019
QBFEVAL'19 - Prenex non-CNF Track
Instance
Result
Time
mvs2y.sat
SAT
0
k0225744.s.oe
FAIL
0
k0226271.connected.oe
FAIL
0
k0226271.s.oe
FAIL
0
k0248814.c.oe
FAIL
0
k0248814.h.oe
FAIL
0
k0248814.v.oe
FAIL
0
k0300663.c.oe
FAIL
0
k0300663.s.oe
FAIL
0
k0300663.v.oe
FAIL
0
k0225682.v.oe
FAIL
0
k0225418.v.oe
FAIL
0
k0225418.connected.oe
FAIL
0
trivial_query09_1344
SAT
0
k0201058.c.oe
FAIL
0
bs8y.unsat
UNSAT
0
k0201058.connected.oe
FAIL
0
k0201058.h.oe
FAIL
0
k0201058.v.oe
FAIL
0
k0206272.c.oe
FAIL
0
k0206272.h.oe
FAIL
0
k0206272.s.oe
FAIL
0
k0302060.connected.oe
FAIL
0
k0302060.h.oe
FAIL
0
k0302060.s.oe
FAIL
0
k0327620.h.oe
FAIL
0
query50_query06_1133
UNSAT
0
query25_query54_1133
SAT
0
query08_axquery_1133
SAT
0
falsequ_query11_1133
SAT
0
exquery_query60_1133
UNSAT
0
axquery_exquery_1133
UNSAT
0
k0327178.connected.oe
FAIL
0
axquery_axquery_1133
SAT
0
k0327178.c.oe
FAIL
0
k0326191.connected.oe
FAIL
0
k0325715.s.oe
FAIL
0
k0325261.connected.oe
FAIL
0
k0325261.h.oe
FAIL
0
k0325261.s.oe
FAIL
0
k0325624.connected.oe
FAIL
0
axquery_eequery_1133
UNSAT
0
k0325624.s.oe
FAIL
0
k0325624.v.oe
FAIL
0
k0325715.c.oe
FAIL
0
k0325715.connected.oe
FAIL
0
k0327694.v.oe
FAIL
0
eequery_query23_1344
UNSAT
0
mvs2y.unsat
UNSAT
0
mult4.unsat
UNSAT
0
mult2.unsat
UNSAT
0
cnt2n.unsat
UNSAT
0
cnt25n.unsat
UNSAT
0
cnt4y.sat
SAT
0
axquery_query02_1344
SAT
0
cnt2n.sat
SAT
0
add6n.sat
SAT
0
mvs8n.unsat
UNSAT
0
mvs8y.unsat
UNSAT
0
DWs-unsat-01-04-1
UNSAT
0
DWs-unsat-01-03-1
UNSAT
0
mult_bool_matrix_dyn_3_2.sat
SAT
0
bs16y.unsat
UNSAT
0
query04_query03_1133
UNSAT
0
stay16n.unsat
UNSAT
0
cnt3y.unsat
UNSAT
0
cnt10y.sat
SAT
0
DWs-sat-01-06-1
SAT
0
DWs-sat-01-05-1
SAT
0
k0026150.c.oe
FAIL
0
query07_falsequ_1344
UNSAT
0
query23_query06_1344
SAT
0
query49_query23_1344
UNSAT
0
k0026150.h.oe
FAIL
0
query55_query30_1344
UNSAT
0
eequery_query04_1133
UNSAT
0.07
cnt8n.sat
SAT
0.08
mult_bool_matrix_2_3_2.sat
SAT
0.08
exquery_query07_1344
UNSAT
0.09
query55_query10_1133
UNSAT
0.1
stay6y.unsat
UNSAT
0.1
exquery_query42_1133
UNSAT
0.1
eequery_query36_1133
UNSAT
0.1
query27_query03_1344
SAT
0.11
query26_query60_1133
UNSAT
0.11
genbuf1b4y.unsat
UNSAT
0.12
klieber2017q-048-12-eq
SAT
0.12
query04_query03_1344
UNSAT
0.12
klieber2017q-048-12-t1
UNSAT
0.13
axquery_query31_1344
SAT
0.14
klieber2017q-052-13-t1
UNSAT
0.14
axquery_query58_1344
SAT
0.15
k0206272.v.oe
FAIL
0.17
DWs-sat-02-07-1
SAT
0.25
DW-sat-01-10-1
SAT
0.25
k0326578.connected.oe
FAIL
0.26
trivial_query31_1344
SAT
0.38
query09_trivial_1344
SAT
0.64
klieber2017q-056-14-t1
UNSAT
0.7
DW-sat-02-11-1
SAT
0.72
bs128y.unsat
UNSAT
0.74
CM-sat-02-01-06-4
SAT
1.13
klieber2017q-066-16-t1
UNSAT
1.15
CM-sat-02-01-06-3
SAT
1.17
6s318r_c0to15.unsat
UNSAT
1.21
DWs-sat-03-11-1
SAT
1.23
klieber2017q-070-17-t1
UNSAT
1.26
klieber2017q-060-15-t1
UNSAT
1.55
nreachq_query02_1344
UNSAT
1.55
klieber2017q-056-14-eq
SAT
1.74
DWs-sat-04-11-1
SAT
2.2
klieber2017q-068-17-t1
UNSAT
2.29
DWs-sat-04-12-1
SAT
2.37
query08_query26_1344
SAT
2.49
ci.e#1.a#3.E#40.A#60.c#200.w#6.s#6.asp
SAT
2.52
klieber2017q-052-13-eq
SAT
2.72
query03_query57_1344
SAT
3.13
DWs-unsat-05-11-1
UNSAT
3.29
driver_a9y.unsat
UNSAT
3.44
DW-sat-04-16-1
SAT
3.62
JP-unsat-02-07-2
UNSAT
3.88
query11_query64_1344
UNSAT
4.21
DWs-unsat-05-12-1
UNSAT
4.4
klieber2017q-066-16-eq
SAT
4.7
query49_query64_1133
UNSAT
4.84
klieber2017q-060-15-eq
SAT
5.7
DWs-sat-05-15-1
SAT
5.75
klieber2017q-068-17-eq
SAT
5.84
JP-sat-02-07-3
SAT
6.28
klieber2017q-104-26-t1
UNSAT
6.33
klieber2017q-072-18-eq
SAT
6.33
jctc13-fail
UNSAT
6.42
jctc6-pass
SAT
6.44
klieber2017q-062-15-t1
UNSAT
6.6
klieber2017q-070-17-eq
SAT
6.79
query52_query36_1344
UNSAT
6.87
klieber2017q-078-19-eq
SAT
7.17
klieber2017q-076-19-eq
SAT
7.38
load_full_2_comp6_REAL.unsat
UNSAT
7.67
klieber2017q-108-27-t1
UNSAT
8.91
klieber2017q-076-19-t1
UNSAT
9.19
klieber2017q-064-16-t1
UNSAT
9.37
beemldelec4b1_c0to15.unsat
UNSAT
9.62
JP-sat-02-07-4
SAT
9.66
CM-sat-03-01-07-3
SAT
9.75
klieber2017q-082-20-t1
UNSAT
9.99
klieber2017q-074-18-t1
UNSAT
10.09
DWs-sat-06-17-1
SAT
10.36
klieber2017q-064-16-eq
SAT
10.8
driver_a8y.unsat
UNSAT
11.06
klieber2017q-074-18-eq
SAT
11.4
DW-unsat-06-16-1
UNSAT
11.44
klieber2017q-062-15-eq
SAT
11.49
query08_query64_1344
SAT
12.16
SR-sat-02-01-06-2
SAT
12.21
JP-sat-02-08-3
SAT
13.98
SR-sat-02-01-07-2
SAT
14.01
jctc16-vals-0,2-pass
SAT
15.75
klieber2017q-072-18-t1
UNSAT
15.76
klieber2017q-112-28-t1
UNSAT
16.38
amba2b9y.unsat
UNSAT
16.38
DW-sat-06-20-1
SAT
16.6
ci.e#1.a#3.E#40.A#60.c#432.w#2.s#1.asp
UNSAT
17.49
query51_query31_1344
UNSAT
17.57
klieber2017q-100-25-t1
UNSAT
20.44
jctc1-pass
SAT
20.59
oski3ub5i_c0to15.unsat
UNSAT
21.78
klieber2017q-084-21-eq
SAT
21.86
klieber2017q-080-20-t1
UNSAT
22.08
genbuf5b4n.unsat
UNSAT
22.56
DW-sat-07-20-1
SAT
22.74
6s216rb0_c0to7.unsat
UNSAT
23.22
DWs-unsat-07-16-1
UNSAT
23.24
CM-sat-03-01-06-4
SAT
23.79
CM-sat-04-01-06-3
SAT
26.1
jctc4-fail
UNSAT
26.78
SR-unsat-02-01-05-2
UNSAT
28.16
amba2f9n.unsat
UNSAT
30.48
klieber2017q-088-22-t1
UNSAT
35.08
DWs-unsat-08-17-1
UNSAT
36.89
eequery_reachqu_1344
UNSAT
39.34
SR-unsat-04-01-08-1
UNSAT
39.58
klieber2017q-078-19-t1
UNSAT
41.6
chess_solving_mate_in_2_2002_WCCC-OPEN-45_01
SAT
42.12
chess_solving_mate_in_2_2009_BEL-CH-17B_01
SAT
42.86
chess_solving_mate_in_2_2011_WCCC-OPEN-54_01
SAT
45.08
chess_solving_mate_in_2_2008_BEL-CH-16B_08
SAT
46.41
CM-sat-04-01-07-3
SAT
46.6
chess_solving_mate_in_2_1983_FIN-CH-4_01
SAT
52.42
jctc2-pass
SAT
52.57
ci.e#1.a#3.E#40.A#60.c#264.w#4.s#2.asp
SAT
54.6
DWs-unsat-08-18-1
UNSAT
58.36
chess_solving_mate_in_2_2002_MAC-CH-6_03
SAT
61.5
klieber2017q-086-21-t1
UNSAT
63.06
DW-sat-08-24-1
SAT
67.74
chess_solving_mate_in_2_2009_POL-CH-33_01
SAT
70.29
chess_solving_mate_in_2_1998_GBR-CH-19_01
SAT
72.36
klieber2017q-088-22-eq
SAT
73.08
chess_solving_mate_in_2_1987_FIN-CH-8_01
SAT
75.07
chess_solving_mate_in_2_2011_ISC-7B_01
SAT
75.63
DW-sat-08-22-1
SAT
83.3
chess_solving_mate_in_2_2005_POLTAVA-OPEN_01
SAT
84.29
chess_solving_mate_in_2_2014_NED-CH-20B_09
SAT
85.79
DW-sat-09-26-1
SAT
85.94
DWs-unsat-09-19-1
UNSAT
88.52
DW-sat-08-23-1
SAT
92.99
DWs-sat-10-25-1
SAT
95.08
query33_query71_1344
UNSAT
95.4
chess_solving_mate_in_2_2011_ROM-CH-W_02
SAT
99.82
chess_solving_mate_in_2_1996_FIN-CH-17_03
SAT
107.84
chess_solving_mate_in_2_2015_GBR-CH-36_02
SAT
108.48
CM-sat-04-01-06-4
SAT
108.83
jctc8-pass
SAT
126.24
CM-sat-07-01-06-3
SAT
154.59
oski3ub1i_c0to63.unsat
UNSAT
161.11
DW-unsat-09-22-1
UNSAT
168.33
klieber2017q-084-21-t1
UNSAT
171.81
chess_solving_mate_in_2_1982_WCSC-6_02
SAT
184.65
chess_solving_mate_in_2_2011_GBR-CH-32_03
SAT
194.41
chess_solving_mate_in_2_1997_WCCC-OPEN-40_03
SAT
199.89
DW-unsat-09-23-1
UNSAT
227.46
DWs-sat-10-24-1
SAT
228.74
chess_solving_mate_in_2_2012_GER-CH-36-19_03
SAT
243.82
chess_solving_mate_in_2_1991_GER-CH-15_01
SAT
265.6
genbuf9b4n.unsat
UNSAT
313.66
genbuf10b4y.unsat
UNSAT
329.5
DWs-unsat-10-22-1
UNSAT
368.37
jctc9-pass
SAT
368.44
DWs-sat-10-23-1
SAT
395.47
query64_query55_1344
UNSAT
424.18
gb_s2_r2_comp3_REAL.unsat
UNSAT
486.99
DW-unsat-10-25-1
UNSAT
504.73
ci.e#1.a#3.E#40.A#60.c#424.w#2.s#7.asp
UNSAT
511.88
SR-sat-02-01-06-3
SAT
520.39
DWs-unsat-11-23-1
UNSAT
539.12
ci.e#1.a#3.E#40.A#60.c#280.w#6.s#7.asp
SAT
559.3
CM-sat-07-01-06-4
SAT
609.12
CM-sat-07-01-07-3
SAT
734.19
DWs-unsat-11-24-1
UNSAT
847.04
add20y.unsat
FAIL
900
chess_composing_8_template_28
FAIL
900.01
chess_composing_8_template_39
FAIL
900.01
chess_composing_8_template_47
FAIL
900.01
chess_composing_8_template_11
FAIL
900.01
chess_solving_mate_in_3_2010_UKR-CH_04
FAIL
900.01
chess_composing_8_template_32
FAIL
900.01
chess_solving_mate_in_3_2008_ISC-4B_07
FAIL
900.01
chess_composing_8_template_27
FAIL
900.01
chess_composing_8_template_33
FAIL
900.01
chess_composing_6_template_03
FAIL
900.01
jctc5-fail
FAIL
900.01
ci.e#1.a#3.E#40.A#60.c#296.w#6.s#7.asp
FAIL
900.01
ci.e#1.a#3.E#40.A#60.c#296.w#4.s#7.asp
FAIL
900.01
amba2f9n.sat
FAIL
900.01
jctc3-vals-0,2-pass
FAIL
900.01
amba7c5y.unsat
FAIL
900.01
ci.e#1.a#3.E#40.A#60.c#376.w#4.s#6.asp
FAIL
900.01
ci.e#1.a#3.E#40.A#60.c#376.w#6.s#7.asp
FAIL
900.01
jctc14-unrolled-fail
FAIL
900.01
jctc10-fail
FAIL
900.01
chess_solving_mate_in_4_2008_UKR-CH-22_13
FAIL
900.01
chess_solving_mate_in_4_1985_WCSC-9_13
FAIL
900.01
chess_composing_8_template_17
FAIL
900.02
chess_composing_8_template_14
FAIL
900.02
chess_composing_8_template_40
FAIL
900.02
chess_composing_8_template_16
FAIL
900.02
6s389b02_c0to15.sat
FAIL
900.02
ci.e#1.a#3.E#40.A#60.c#376.w#4.s#1.asp
FAIL
900.02
chess_composing_8_template_12
FAIL
900.02
cycle_sched_4_7_2.sat
FAIL
900.02
ci.e#1.a#3.E#40.A#60.c#312.w#4.s#3.asp
FAIL
900.02
chess_composing_8_template_04
FAIL
900.02
ci.e#1.a#3.E#40.A#60.c#320.w#4.s#8.asp
FAIL
900.02
chess_composing_6_template_05
FAIL
900.02
ci.e#1.a#3.E#40.A#60.c#376.w#2.s#4.asp
FAIL
900.02
ci.e#1.a#3.E#40.A#60.c#400.w#6.s#4.asp
FAIL
900.02
ci.e#1.a#3.E#40.A#60.c#424.w#2.s#1.asp
FAIL
900.02
chess_composing_8_template_21
FAIL
900.02
DWs-unsat-17-35-1
FAIL
900.02
SR-sat-03-01-07-2
FAIL
900.02
chess_solving_mate_in_3_2003_UKR-CH_04
FAIL
900.02
jctc17-vals-0,2-pass
FAIL
900.02
chess_solving_mate_in_4_2008_ISR-CH_03
FAIL
900.02
jctc7-pass
FAIL
900.03
chess_composing_8_template_05
FAIL
900.03
ci.e#1.a#3.E#40.A#60.c#368.w#2.s#2.asp
FAIL
900.03
chess_solving_mate_in_4_2001_UKR-CH_13
FAIL
900.03
chess_composing_8_template_37
FAIL
900.03
chess_composing_8_template_25
FAIL
900.03
chess_composing_6_template_08
FAIL
900.03
chess_solving_mate_in_3_2012_NED-CH-18B_04
FAIL
900.03
chess_solving_mate_in_3_1978_WCSC-2_05
FAIL
900.03
mult_bool_matrix_8_10_6.sat
FAIL
900.04
chess_solving_mate_in_3_2011_UKR-OPEN-25_04
FAIL
900.04
chess_solving_mate_in_3_2001_UKR-CH_06
FAIL
900.04
chess_solving_mate_in_3_2012_GRE-CH-11_02
FAIL
900.04
ci.e#1.a#3.E#40.A#60.c#376.w#4.s#3.asp
FAIL
900.04
chess_composing_8_template_15
FAIL
900.04
CM-unsat-07-01-06-2
FAIL
900.04
ci.e#1.a#3.E#40.A#60.c#312.w#2.s#3.asp
FAIL
900.04
DW-unsat-14-33-1
FAIL
900.04
chess_composing_8_template_49
FAIL
900.04
jctc15-unrolled-fail
FAIL
900.05
chess_solving_mate_in_4_2012_URAL-PROBLEMIST-6_05
FAIL
900.05
chess_composing_8_template_07
FAIL
900.05
chess_composing_6_template_02
FAIL
900.05
chess_composing_6_template_07
FAIL
900.05
query42_query64_1344
FAIL
900.05
DWs-unsat-23-48-1
FAIL
900.05
chess_solving_mate_in_3_2000_CZE-CH_04
FAIL
900.05
chess_composing_8_template_01
FAIL
900.06
ci.e#1.a#3.E#40.A#60.c#288.w#4.s#8.asp
FAIL
900.06
ci.e#1.a#3.E#40.A#60.c#376.w#6.s#6.asp
FAIL
900.06
chess_composing_8_template_30
FAIL
900.06
chess_composing_8_template_35
FAIL
900.06
ci.e#1.a#3.E#40.A#60.c#400.w#2.s#4.asp
FAIL
900.06
jctc11-pass
FAIL
900.06
chess_composing_8_template_23
FAIL
900.06
chess_composing_8_template_20
FAIL
900.06
chess_composing_8_template_44
FAIL
900.06
JP-unsat-03-08-3
FAIL
900.06
ci.e#1.a#3.E#40.A#60.c#400.w#2.s#1.asp
FAIL
900.06
jctc18-vals-0,2-pass
FAIL
900.07
DWs-sat-12-28-1
FAIL
900.07
6s389b02_c0to0.sat
FAIL
900.07
JP-unsat-03-07-4
FAIL
900.07
chess_solving_mate_in_3_2014_FRA-CH_03
FAIL
900.07
amba3f9n.sat
FAIL
900.07
DW-unsat-11-26-1
FAIL
900.08
chess_composing_8_template_26
FAIL
900.08
chess_composing_8_template_50
FAIL
900.08
DW-unsat-21-47-1
FAIL
900.08
bs128n.sat
FAIL
900.08
ci.e#1.a#3.E#40.A#60.c#432.w#2.s#8.asp
FAIL
900.08
chess_composing_8_template_36
FAIL
900.08
chess_composing_8_template_08
FAIL
900.09
chess_composing_8_template_24
FAIL
900.09
SR-sat-03-01-08-2
FAIL
900.09
chess_solving_mate_in_3_1991_WCSC-15_05
FAIL
900.09
ci.e#1.a#3.E#40.A#60.c#416.w#2.s#3.asp
FAIL
900.09
ci.e#1.a#3.E#40.A#60.c#384.w#6.s#8.asp
FAIL
900.09
Contact
|
Organization
|
Links
|
Citing QBFLIB