QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances solved by
PortfolioGhostQQfunQuAbSQute___pf2
QBFEVAL'19 - Prenex non-CNF Track
Instance
Result
Time
query49_query23_1344
UNSAT
4.67
mult_bool_matrix_dyn_3_2.sat
SAT
4.68
eequery_query23_1344
UNSAT
4.68
cnt3y.unsat
UNSAT
4.69
mult2.unsat
UNSAT
4.69
query50_query06_1133
UNSAT
4.7
query55_query30_1344
UNSAT
4.71
eequery_query36_1133
UNSAT
4.71
axquery_exquery_1133
UNSAT
4.72
mvs8n.unsat
UNSAT
4.72
bs128y.unsat
UNSAT
4.72
query23_query06_1344
SAT
4.72
axquery_axquery_1133
SAT
4.73
add6n.sat
SAT
4.73
ci.e#1.a#3.E#40.A#60.c#432.w#2.s#1.asp
UNSAT
4.73
falsequ_query11_1133
SAT
4.73
mvs2y.unsat
UNSAT
4.73
axquery_eequery_1133
UNSAT
4.74
DWs-unsat-01-04-1
UNSAT
4.74
eequery_query04_1133
UNSAT
4.74
DWs-sat-02-07-1
SAT
4.75
k0206272.v.oe
FAIL
4.76
ci.e#1.a#3.E#40.A#60.c#200.w#6.s#6.asp
SAT
4.76
k0201058.c.oe
FAIL
4.76
DWs-unsat-01-03-1
UNSAT
4.76
DWs-sat-01-06-1
SAT
4.76
cnt2n.unsat
UNSAT
4.76
k0325715.c.oe
FAIL
4.76
query04_query03_1133
UNSAT
4.76
mult4.unsat
UNSAT
4.76
query08_axquery_1133
SAT
4.76
trivial_query09_1344
SAT
4.77
k0325624.v.oe
FAIL
4.77
mvs2y.sat
SAT
4.77
k0302060.s.oe
FAIL
4.77
mult_bool_matrix_2_3_2.sat
SAT
4.77
axquery_query58_1344
SAT
4.77
cnt4y.sat
SAT
4.77
bs16y.unsat
UNSAT
4.77
mvs8y.unsat
UNSAT
4.77
query27_query03_1344
SAT
4.78
cnt2n.sat
SAT
4.78
k0325624.s.oe
FAIL
4.78
k0226271.s.oe
FAIL
4.78
stay16n.unsat
UNSAT
4.78
k0325261.s.oe
FAIL
4.78
query07_falsequ_1344
UNSAT
4.78
cnt25n.unsat
UNSAT
4.78
k0206272.s.oe
FAIL
4.78
k0026150.c.oe
FAIL
4.79
stay6y.unsat
UNSAT
4.79
cnt8n.sat
SAT
4.79
k0302060.h.oe
FAIL
4.79
k0327178.c.oe
FAIL
4.8
query55_query10_1133
UNSAT
4.8
DW-sat-01-10-1
SAT
4.8
k0225682.v.oe
FAIL
4.8
k0206272.c.oe
FAIL
4.8
k0300663.v.oe
FAIL
4.8
ci.e#1.a#3.E#40.A#60.c#432.w#2.s#8.asp
UNSAT
4.8
DWs-sat-01-05-1
SAT
4.8
k0327620.h.oe
FAIL
4.8
bs8y.unsat
UNSAT
4.81
k0248814.c.oe
FAIL
4.81
k0325624.connected.oe
FAIL
4.81
exquery_query60_1133
UNSAT
4.81
k0327694.v.oe
FAIL
4.81
k0026150.h.oe
FAIL
4.82
axquery_query02_1344
SAT
4.82
DW-sat-02-11-1
SAT
4.82
query25_query54_1133
SAT
4.82
k0206272.h.oe
FAIL
4.82
exquery_query42_1133
UNSAT
4.82
k0248814.v.oe
FAIL
4.82
k0326578.connected.oe
FAIL
4.82
k0225744.s.oe
FAIL
4.82
trivial_query31_1344
SAT
4.83
k0325261.h.oe
FAIL
4.83
exquery_query07_1344
UNSAT
4.83
k0302060.connected.oe
FAIL
4.84
k0325715.connected.oe
FAIL
4.84
k0201058.h.oe
FAIL
4.84
k0225418.connected.oe
FAIL
4.84
k0225418.v.oe
FAIL
4.84
k0325715.s.oe
FAIL
4.84
k0201058.v.oe
FAIL
4.84
k0300663.s.oe
FAIL
4.84
query26_query60_1133
UNSAT
4.84
k0327178.connected.oe
FAIL
4.85
k0226271.connected.oe
FAIL
4.85
k0326191.connected.oe
FAIL
4.86
k0300663.c.oe
FAIL
4.86
k0325261.connected.oe
FAIL
4.86
cnt10y.sat
SAT
4.86
DWs-sat-03-11-1
SAT
4.87
k0248814.h.oe
FAIL
4.87
6s318r_c0to15.unsat
UNSAT
4.87
axquery_query31_1344
SAT
4.9
k0201058.connected.oe
FAIL
4.94
CM-sat-02-01-06-3
SAT
4.96
DWs-sat-04-11-1
SAT
5.02
CM-sat-02-01-06-4
SAT
5.04
ci.e#1.a#3.E#40.A#60.c#424.w#2.s#1.asp
UNSAT
5.15
JP-sat-02-08-3
SAT
5.16
driver_a9y.unsat
UNSAT
5.16
query04_query03_1344
UNSAT
5.22
DWs-sat-04-12-1
SAT
5.23
query08_query26_1344
SAT
5.24
DWs-sat-05-15-1
SAT
5.35
jctc6-pass
SAT
5.46
DWs-unsat-05-11-1
UNSAT
5.47
ci.e#1.a#3.E#40.A#60.c#424.w#2.s#7.asp
UNSAT
5.55
DW-sat-04-16-1
SAT
5.56
CM-sat-03-01-06-4
SAT
5.67
SR-sat-02-01-06-2
SAT
5.72
JP-unsat-02-07-2
UNSAT
5.75
genbuf1b4y.unsat
UNSAT
5.77
DWs-unsat-05-12-1
UNSAT
5.87
klieber2017q-112-28-t1
UNSAT
5.9
klieber2017q-056-14-t1
UNSAT
5.93
klieber2017q-088-22-t1
UNSAT
5.95
klieber2017q-082-20-t1
UNSAT
5.95
ci.e#1.a#3.E#40.A#60.c#264.w#4.s#2.asp
SAT
5.96
klieber2017q-078-19-t1
UNSAT
6.16
klieber2017q-052-13-t1
UNSAT
6.69
CM-sat-03-01-07-3
SAT
6.71
JP-sat-02-07-3
SAT
6.96
klieber2017q-070-17-t1
FAIL
6.99
klieber2017q-048-12-t1
FAIL
6.99
klieber2017q-076-19-eq
FAIL
7.01
klieber2017q-072-18-eq
FAIL
7.03
genbuf5b4n.unsat
FAIL
7.03
oski3ub1i_c0to63.unsat
FAIL
7.04
klieber2017q-062-15-t1
FAIL
7.04
amba2b9y.unsat
FAIL
7.04
nreachq_query02_1344
FAIL
7.05
klieber2017q-062-15-eq
FAIL
7.05
eequery_reachqu_1344
FAIL
7.05
klieber2017q-100-25-t1
FAIL
7.05
chess_solving_mate_in_2_2002_WCCC-OPEN-45_01
FAIL
7.05
query03_query57_1344
FAIL
7.06
jctc4-fail
FAIL
7.06
klieber2017q-108-27-t1
FAIL
7.06
add20y.unsat
FAIL
7.06
klieber2017q-078-19-eq
FAIL
7.07
klieber2017q-084-21-eq
FAIL
7.07
klieber2017q-052-13-eq
FAIL
7.07
amba3f9n.sat
FAIL
7.07
klieber2017q-060-15-t1
FAIL
7.07
klieber2017q-064-16-eq
FAIL
7.07
klieber2017q-066-16-eq
FAIL
7.07
klieber2017q-060-15-eq
FAIL
7.08
klieber2017q-068-17-t1
FAIL
7.08
chess_solving_mate_in_2_1987_FIN-CH-8_01
FAIL
7.08
bs128n.sat
FAIL
7.08
query51_query31_1344
FAIL
7.08
klieber2017q-064-16-t1
FAIL
7.08
amba2f9n.sat
FAIL
7.08
beemldelec4b1_c0to15.unsat
FAIL
7.09
genbuf9b4n.unsat
FAIL
7.09
klieber2017q-072-18-t1
FAIL
7.09
query64_query55_1344
FAIL
7.09
query33_query71_1344
FAIL
7.09
chess_solving_mate_in_2_1982_WCSC-6_02
FAIL
7.09
query09_trivial_1344
FAIL
7.09
chess_solving_mate_in_3_2010_UKR-CH_04
FAIL
7.09
amba7c5y.unsat
FAIL
7.1
chess_solving_mate_in_2_2002_MAC-CH-6_03
FAIL
7.1
driver_a8y.unsat
FAIL
7.1
klieber2017q-068-17-eq
FAIL
7.1
cycle_sched_4_7_2.sat
FAIL
7.1
jctc10-fail
FAIL
7.1
klieber2017q-074-18-eq
FAIL
7.1
jctc13-fail
FAIL
7.1
klieber2017q-086-21-t1
FAIL
7.11
klieber2017q-084-21-t1
FAIL
7.11
klieber2017q-088-22-eq
FAIL
7.11
klieber2017q-048-12-eq
FAIL
7.11
klieber2017q-070-17-eq
FAIL
7.11
jctc16-vals-0,2-pass
FAIL
7.11
genbuf10b4y.unsat
FAIL
7.11
mult_bool_matrix_8_10_6.sat
FAIL
7.11
chess_solving_mate_in_2_2011_GBR-CH-32_03
FAIL
7.11
klieber2017q-104-26-t1
FAIL
7.12
klieber2017q-056-14-eq
FAIL
7.12
query11_query64_1344
FAIL
7.12
chess_solving_mate_in_2_1996_FIN-CH-17_03
FAIL
7.12
load_full_2_comp6_REAL.unsat
FAIL
7.12
klieber2017q-076-19-t1
FAIL
7.12
query08_query64_1344
FAIL
7.12
chess_composing_8_template_05
FAIL
7.13
chess_solving_mate_in_2_2005_POLTAVA-OPEN_01
FAIL
7.13
klieber2017q-074-18-t1
FAIL
7.13
chess_solving_mate_in_2_2009_POL-CH-33_01
FAIL
7.14
query52_query36_1344
FAIL
7.14
jctc8-pass
FAIL
7.14
chess_solving_mate_in_3_2012_NED-CH-18B_04
FAIL
7.14
chess_composing_8_template_21
FAIL
7.14
klieber2017q-080-20-t1
FAIL
7.14
chess_solving_mate_in_2_2011_ROM-CH-W_02
FAIL
7.14
6s389b02_c0to0.sat
FAIL
7.15
gb_s2_r2_comp3_REAL.unsat
FAIL
7.15
klieber2017q-066-16-t1
FAIL
7.15
chess_composing_8_template_11
FAIL
7.15
chess_composing_8_template_08
FAIL
7.15
amba2f9n.unsat
FAIL
7.15
jctc9-pass
FAIL
7.15
chess_composing_6_template_03
FAIL
7.15
query42_query64_1344
FAIL
7.15
chess_solving_mate_in_2_2011_WCCC-OPEN-54_01
FAIL
7.16
jctc1-pass
FAIL
7.16
chess_solving_mate_in_2_2008_BEL-CH-16B_08
FAIL
7.16
chess_composing_8_template_26
FAIL
7.16
chess_composing_8_template_25
FAIL
7.16
chess_solving_mate_in_2_1998_GBR-CH-19_01
FAIL
7.17
chess_solving_mate_in_2_2014_NED-CH-20B_09
FAIL
7.17
chess_solving_mate_in_2_1983_FIN-CH-4_01
FAIL
7.17
oski3ub5i_c0to15.unsat
FAIL
7.17
chess_solving_mate_in_2_2015_GBR-CH-36_02
FAIL
7.17
chess_solving_mate_in_2_1991_GER-CH-15_01
FAIL
7.18
jctc7-pass
FAIL
7.18
chess_solving_mate_in_2_1997_WCCC-OPEN-40_03
FAIL
7.18
chess_solving_mate_in_3_1978_WCSC-2_05
FAIL
7.18
6s216rb0_c0to7.unsat
FAIL
7.18
6s389b02_c0to15.sat
FAIL
7.19
chess_composing_6_template_05
FAIL
7.19
chess_composing_8_template_37
FAIL
7.19
chess_solving_mate_in_4_2008_ISR-CH_03
FAIL
7.19
chess_solving_mate_in_3_1991_WCSC-15_05
FAIL
7.19
chess_solving_mate_in_4_2008_UKR-CH-22_13
FAIL
7.2
chess_solving_mate_in_3_2000_CZE-CH_04
FAIL
7.2
chess_solving_mate_in_3_2012_GRE-CH-11_02
FAIL
7.2
chess_solving_mate_in_2_2012_GER-CH-36-19_03
FAIL
7.2
chess_solving_mate_in_2_2011_ISC-7B_01
FAIL
7.2
chess_composing_6_template_08
FAIL
7.2
chess_composing_6_template_07
FAIL
7.2
chess_composing_8_template_35
FAIL
7.2
chess_composing_6_template_02
FAIL
7.2
chess_composing_8_template_40
FAIL
7.21
chess_composing_8_template_50
FAIL
7.21
chess_composing_8_template_27
FAIL
7.21
chess_solving_mate_in_3_2003_UKR-CH_04
FAIL
7.21
chess_solving_mate_in_3_2011_UKR-OPEN-25_04
FAIL
7.21
chess_solving_mate_in_2_2009_BEL-CH-17B_01
FAIL
7.21
chess_composing_8_template_28
FAIL
7.21
chess_composing_8_template_17
FAIL
7.21
chess_solving_mate_in_3_2001_UKR-CH_06
FAIL
7.21
jctc14-unrolled-fail
FAIL
7.22
chess_composing_8_template_01
FAIL
7.22
chess_composing_8_template_07
FAIL
7.22
chess_composing_8_template_16
FAIL
7.23
chess_composing_8_template_33
FAIL
7.23
chess_composing_8_template_04
FAIL
7.23
chess_solving_mate_in_4_2001_UKR-CH_13
FAIL
7.23
chess_composing_8_template_15
FAIL
7.24
chess_composing_8_template_14
FAIL
7.24
chess_composing_8_template_32
FAIL
7.24
chess_composing_8_template_39
FAIL
7.24
chess_composing_8_template_12
FAIL
7.24
chess_composing_8_template_36
FAIL
7.24
chess_composing_8_template_30
FAIL
7.24
chess_solving_mate_in_4_1985_WCSC-9_13
FAIL
7.24
chess_composing_8_template_24
FAIL
7.24
chess_solving_mate_in_4_2012_URAL-PROBLEMIST-6_05
FAIL
7.24
chess_composing_8_template_20
FAIL
7.24
jctc2-pass
FAIL
7.25
chess_composing_8_template_49
FAIL
7.25
chess_composing_8_template_23
FAIL
7.25
chess_composing_8_template_44
FAIL
7.26
jctc5-fail
FAIL
7.26
chess_solving_mate_in_3_2008_ISC-4B_07
FAIL
7.26
chess_composing_8_template_47
FAIL
7.28
chess_solving_mate_in_3_2014_FRA-CH_03
FAIL
7.3
jctc15-unrolled-fail
FAIL
7.39
jctc3-vals-0,2-pass
FAIL
7.44
jctc11-pass
FAIL
7.81
jctc18-vals-0,2-pass
FAIL
7.96
jctc17-vals-0,2-pass
FAIL
8.05
SR-sat-02-01-07-2
SAT
8.12
DWs-sat-06-17-1
SAT
8.26
DW-sat-06-20-1
SAT
8.7
CM-sat-04-01-06-3
SAT
8.85
DW-sat-07-20-1
SAT
8.89
JP-sat-02-07-4
SAT
10.03
SR-unsat-02-01-05-2
UNSAT
10.24
DW-sat-08-23-1
SAT
10.59
DW-sat-08-22-1
SAT
10.6
CM-sat-04-01-06-4
SAT
11.05
DW-unsat-06-16-1
UNSAT
12.03
DWs-sat-10-23-1
SAT
13.3
CM-sat-04-01-07-3
SAT
13.92
DWs-sat-10-25-1
SAT
15.03
DWs-unsat-07-16-1
UNSAT
15.05
SR-unsat-04-01-08-1
UNSAT
17.86
DWs-sat-12-28-1
SAT
20.9
DWs-unsat-08-17-1
UNSAT
21.05
DWs-unsat-08-18-1
UNSAT
23.68
DW-sat-08-24-1
SAT
24.43
query49_query64_1133
UNSAT
26.18
ci.e#1.a#3.E#40.A#60.c#288.w#4.s#8.asp
SAT
34.19
ci.e#1.a#3.E#40.A#60.c#400.w#2.s#1.asp
UNSAT
42.65
SR-sat-02-01-06-3
SAT
43.45
DWs-unsat-09-19-1
UNSAT
47.95
ci.e#1.a#3.E#40.A#60.c#296.w#6.s#7.asp
SAT
48.76
ci.e#1.a#3.E#40.A#60.c#320.w#4.s#8.asp
SAT
63.37
CM-sat-07-01-07-3
SAT
68.89
ci.e#1.a#3.E#40.A#60.c#400.w#2.s#4.asp
UNSAT
76.35
DW-sat-09-26-1
SAT
83
CM-sat-07-01-06-4
SAT
87.49
DWs-unsat-10-22-1
UNSAT
107.6
DW-unsat-09-23-1
UNSAT
115.25
DW-unsat-09-22-1
UNSAT
118.32
ci.e#1.a#3.E#40.A#60.c#312.w#2.s#3.asp
SAT
121.13
SR-sat-03-01-07-2
SAT
140.61
SR-sat-03-01-08-2
SAT
146.62
ci.e#1.a#3.E#40.A#60.c#296.w#4.s#7.asp
SAT
151.82
DWs-sat-10-24-1
SAT
155.84
ci.e#1.a#3.E#40.A#60.c#280.w#6.s#7.asp
SAT
160.75
JP-unsat-03-08-3
UNSAT
164.95
DWs-unsat-11-23-1
UNSAT
176.54
JP-unsat-03-07-4
UNSAT
210.43
CM-sat-07-01-06-3
SAT
212.33
CM-unsat-07-01-06-2
UNSAT
256.63
DW-unsat-10-25-1
UNSAT
263.85
DWs-unsat-11-24-1
UNSAT
274.07
ci.e#1.a#3.E#40.A#60.c#416.w#2.s#3.asp
UNSAT
310.87
ci.e#1.a#3.E#40.A#60.c#312.w#4.s#3.asp
SAT
474.84
DW-unsat-11-26-1
UNSAT
665.3
ci.e#1.a#3.E#40.A#60.c#376.w#6.s#6.asp
FAIL
900.02
ci.e#1.a#3.E#40.A#60.c#400.w#6.s#4.asp
FAIL
900.02
ci.e#1.a#3.E#40.A#60.c#376.w#2.s#4.asp
FAIL
900.03
DW-unsat-21-47-1
FAIL
900.04
ci.e#1.a#3.E#40.A#60.c#376.w#6.s#7.asp
FAIL
900.04
ci.e#1.a#3.E#40.A#60.c#368.w#2.s#2.asp
FAIL
900.05
ci.e#1.a#3.E#40.A#60.c#376.w#4.s#1.asp
FAIL
900.05
ci.e#1.a#3.E#40.A#60.c#376.w#4.s#6.asp
FAIL
900.08
DWs-unsat-23-48-1
FAIL
900.08
ci.e#1.a#3.E#40.A#60.c#384.w#6.s#8.asp
FAIL
900.08
ci.e#1.a#3.E#40.A#60.c#376.w#4.s#3.asp
FAIL
900.09
DW-unsat-14-33-1
FAIL
900.09
DWs-unsat-17-35-1
FAIL
900.11
Contact
|
Organization
|
Links
|
Citing QBFLIB