QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family CounterFactual solved by
SQBF
QBFEVAL'06
Instance
Result
Time
ncf_8_16_4_d.10
SAT
0
ncf_4_16_2_edau.2
SAT
0
ncf_8_16_4_d.1
SAT
0
ncf_16_32_2_u.9
UNSAT
0
ncf_8_16_4_edau.8
UNSAT
0
ncf_16_32_2_d.6
SAT
0
ncf_8_16_4_edau.6
UNSAT
0
ncf_4_8_4_u.2
UNSAT
0
ncf_8_16_4_u.1
SAT
0
ncf_4_16_2_d.2
SAT
0
ncf_4_8_2_euad.7
UNSAT
0
ncf_4_8_2_euad.8
SAT
0
ncf_4_8_2_u.7
UNSAT
0
ncf_4_8_4_euad.9
SAT
0
ncf_8_16_4_d.6
UNSAT
0
ncf_8_16_4_euad.1
SAT
0
ncf_8_16_4_u.2
UNSAT
0
ncf_8_16_4_euad.2
UNSAT
0
ncf_4_8_2_u.1
UNSAT
0.01
ncf_4_8_4_euad.2
UNSAT
0.01
ncf_16_32_4_edau.9
SAT
0.01
ncf_8_16_4_d.2
UNSAT
0.01
ncf_4_16_4_u.1
SAT
0.01
ncf_8_16_4_edau.2
UNSAT
0.01
ncf_4_16_2_d.9
SAT
0.01
ncf_4_8_2_euad.9
SAT
0.01
ncf_4_8_2_euad.1
UNSAT
0.01
ncf_4_8_4_u.9
SAT
0.01
ncf_4_16_2_edau.6
SAT
0.01
ncf_4_16_2_u.9
SAT
0.01
ncf_4_8_4_u.5
SAT
0.01
ncf_4_8_8_euad.9
UNSAT
0.01
ncf_4_16_2_euad.9
SAT
0.01
ncf_16_32_2_euad.9
UNSAT
0.01
ncf_4_8_2_u.8
SAT
0.01
ncf_16_32_2_d.9
UNSAT
0.01
ncf_4_8_8_edau.9
UNSAT
0.01
ncf_4_8_2_u.9
SAT
0.01
ncf_4_8_2_u.5
SAT
0.02
ncf_4_8_8_edau.5
UNSAT
0.02
ncf_4_8_2_euad.5
SAT
0.02
ncf_4_16_4_euad.8
SAT
0.02
ncf_4_16_2_euad.4
SAT
0.02
ncf_8_16_4_u.5
UNSAT
0.02
ncf_16_32_2_edau.6
SAT
0.02
ncf_4_8_8_u.9
UNSAT
0.02
ncf_4_16_4_edau.8
SAT
0.02
ncf_4_8_8_d.9
UNSAT
0.02
ncf_8_16_8_d.1
SAT
0.02
ncf_4_8_4_euad.5
SAT
0.02
ncf_8_16_4_d.8
UNSAT
0.02
ncf_4_16_2_euad.6
SAT
0.02
ncf_8_16_4_euad.5
UNSAT
0.02
ncf_8_16_4_edau.10
SAT
0.02
ncf_4_16_4_d.8
SAT
0.02
ncf_4_16_4_euad.1
SAT
0.02
ncf_4_16_2_edau.4
SAT
0.02
ncf_4_8_8_d.5
UNSAT
0.02
ncf_16_32_2_edau.9
UNSAT
0.02
ncf_4_16_2_u.6
SAT
0.02
ncf_8_16_8_euad.1
SAT
0.02
ncf_16_32_4_d.9
SAT
0.03
ncf_16_32_2_d.7
UNSAT
0.03
ncf_4_16_4_edau.1
SAT
0.03
ncf_8_16_4_edau.1
SAT
0.03
ncf_16_32_4_edau.7
UNSAT
0.03
ncf_4_16_2_edau.9
SAT
0.03
ncf_16_32_4_d.10
UNSAT
0.03
ncf_8_16_4_edau.5
UNSAT
0.03
ncf_4_8_2_u.4
UNSAT
0.03
ncf_16_32_4_edau.10
UNSAT
0.03
ncf_4_16_4_u.8
SAT
0.03
ncf_4_16_2_d.6
SAT
0.03
ncf_4_8_8_edau.8
SAT
0.03
ncf_4_16_4_d.1
SAT
0.03
ncf_8_16_8_edau.1
SAT
0.03
ncf_4_16_2_u.4
SAT
0.03
ncf_4_8_2_euad.6
SAT
0.04
ncf_16_32_4_d.7
UNSAT
0.04
ncf_8_16_4_d.5
UNSAT
0.04
ncf_4_8_8_d.8
SAT
0.04
ncf_4_8_2_u.10
SAT
0.04
ncf_4_8_2_euad.4
UNSAT
0.04
ncf_4_16_2_d.4
SAT
0.05
ncf_16_32_8_d.4
SAT
0.05
ncf_4_8_2_u.6
SAT
0.05
ncf_4_16_4_edau.5
SAT
0.06
ncf_4_8_8_d.3
SAT
0.06
ncf_4_32_2_edau.1
UNSAT
0.06
ncf_16_32_8_edau.4
SAT
0.07
ncf_4_8_8_edau.1
SAT
0.12
ncf_4_16_4_d.9
SAT
0.14
ncf_4_16_4_euad.5
SAT
0.17
ncf_4_8_8_edau.3
SAT
0.19
ncf_4_16_4_d.5
SAT
0.19
ncf_16_32_2_euad.7
UNSAT
0.19
ncf_4_8_8_euad.3
SAT
0.21
ncf_4_8_8_u.1
SAT
0.23
ncf_4_8_2_euad.10
SAT
0.26
ncf_4_8_8_u.3
SAT
0.26
ncf_4_8_8_d.1
SAT
0.33
ncf_4_16_2_edau.7
SAT
0.36
ncf_4_16_2_d.7
SAT
0.45
ncf_4_8_2_u.2
SAT
0.52
ncf_4_16_4_u.5
SAT
0.53
ncf_4_8_4_euad.8
UNSAT
0.59
ncf_4_16_2_u.2
SAT
0.67
ncf_4_16_2_euad.2
SAT
0.68
ncf_4_8_4_u.8
UNSAT
0.8
ncf_4_8_2_euad.2
SAT
0.81
ncf_4_16_4_euad.9
SAT
0.91
ncf_4_16_4_edau.9
SAT
1.15
ncf_16_32_2_edau.7
UNSAT
2.17
ncf_4_8_4_euad.10
SAT
2.26
ncf_4_16_4_u.9
SAT
2.48
ncf_16_32_4_edau.1
SAT
2.89
ncf_4_8_4_euad.6
SAT
3.31
ncf_4_8_4_u.10
SAT
3.44
ncf_8_16_8_edau.6
UNSAT
3.62
ncf_4_8_8_euad.1
SAT
7.39
ncf_4_8_4_u.6
SAT
8.63
ncf_16_32_4_u.9
SAT
20.61
ncf_8_16_4_euad.10
SAT
21.72
ncf_8_16_4_u.10
SAT
21.97
ncf_16_32_2_d.4
UNSAT
22.23
ncf_16_32_2_u.6
SAT
22.27
ncf_8_16_4_u.6
UNSAT
25.11
ncf_8_16_4_edau.4
SAT
30.09
ncf_16_32_4_euad.1
SAT
35.16
ncf_4_16_2_d.8
SAT
36.11
ncf_16_32_2_edau.10
UNSAT
37.18
ncf_4_8_2_u.3
UNSAT
39.72
ncf_16_32_4_d.1
SAT
41.64
ncf_4_8_4_euad.3
UNSAT
42.56
ncf_4_16_2_d.5
UNSAT
48.52
ncf_4_16_4_d.6
UNSAT
50.29
ncf_4_16_2_d.10
UNSAT
51.41
ncf_16_32_2_d.10
UNSAT
53.1
ncf_4_8_4_u.1
SAT
54.23
ncf_4_16_2_edau.1
UNSAT
78.29
ncf_4_16_2_u.10
UNSAT
109.06
ncf_4_8_4_euad.4
UNSAT
111.92
ncf_4_8_4_u.4
UNSAT
114.52
ncf_4_16_2_u.8
SAT
123.93
ncf_4_8_4_u.3
UNSAT
130.56
ncf_4_16_2_edau.5
UNSAT
147.84
ncf_4_8_2_euad.3
UNSAT
150
ncf_4_16_2_u.7
SAT
150.54
ncf_4_16_2_euad.7
SAT
151.36
ncf_4_16_2_edau.8
SAT
173.25
ncf_4_16_4_d.10
UNSAT
183.76
ncf_4_16_2_euad.8
SAT
219.53
ncf_4_16_2_d.1
UNSAT
231.17
ncf_4_8_4_u.7
UNSAT
265.13
ncf_4_16_2_euad.1
UNSAT
278.46
ncf_4_32_2_u.2
SAT
303.74
ncf_4_8_4_euad.1
SAT
312.29
ncf_4_32_2_edau.2
SAT
341.1
ncf_4_8_4_euad.7
FAIL
359.63
ncf_4_16_2_euad.5
UNSAT
380.61
ncf_4_16_2_edau.10
UNSAT
425.35
ncf_4_16_2_u.5
UNSAT
440.08
ncf_8_16_4_euad.4
FAIL
447.31
ncf_4_16_4_edau.10
FAIL
449.69
ncf_4_16_4_edau.7
FAIL
465.89
ncf_8_16_4_euad.6
FAIL
469.06
ncf_8_16_4_u.3
FAIL
475.54
ncf_8_16_4_edau.3
FAIL
502.3
ncf_8_16_4_euad.8
FAIL
504.94
ncf_8_16_4_d.4
FAIL
505.06
ncf_8_16_4_edau.9
FAIL
505.13
ncf_8_16_4_u.4
FAIL
506.43
ncf_8_16_4_d.7
FAIL
508.7
ncf_4_16_4_u.10
FAIL
508.74
ncf_8_16_4_u.9
FAIL
511.65
ncf_4_16_4_u.7
FAIL
515.99
ncf_4_16_4_d.7
FAIL
519.3
ncf_8_16_4_euad.3
FAIL
527.23
ncf_8_16_4_euad.9
FAIL
529.91
ncf_4_16_4_d.4
FAIL
531.91
ncf_4_32_2_edau.8
FAIL
536.69
ncf_4_16_4_edau.6
FAIL
539.01
ncf_4_16_4_u.2
FAIL
539.1
ncf_4_16_4_d.3
FAIL
540.13
ncf_8_16_4_u.7
FAIL
545.02
ncf_4_16_4_euad.2
FAIL
550.08
ncf_4_16_4_edau.4
FAIL
552.1
ncf_4_16_4_u.6
FAIL
553.59
ncf_8_16_4_u.8
FAIL
556.96
ncf_4_16_4_edau.2
FAIL
558.43
ncf_4_32_2_u.8
FAIL
560.61
ncf_4_16_4_edau.3
FAIL
563.33
ncf_8_16_4_edau.7
FAIL
568.15
ncf_4_16_4_euad.7
FAIL
568.29
ncf_4_16_4_u.4
FAIL
570.67
ncf_16_32_2_euad.10
FAIL
578.16
ncf_4_8_8_euad.4
FAIL
579.41
ncf_4_8_8_euad.8
FAIL
589.37
ncf_4_16_4_u.3
FAIL
595.22
ncf_16_32_2_euad.1
FAIL
597.58
ncf_8_16_4_euad.7
FAIL
602.05
ncf_16_32_2_edau.8
FAIL
603.5
ncf_4_16_4_euad.10
FAIL
611.63
ncf_4_16_4_euad.3
FAIL
617.33
ncf_4_8_8_edau.10
FAIL
624.14
ncf_4_8_8_euad.5
FAIL
624.25
ncf_16_32_2_u.10
FAIL
625.46
ncf_8_16_4_d.9
FAIL
629.92
ncf_4_8_8_u.8
FAIL
638.44
ncf_4_8_8_euad.6
FAIL
640.16
ncf_4_16_4_euad.6
FAIL
640.71
ncf_16_32_2_d.3
FAIL
642.06
ncf_4_16_4_euad.4
FAIL
654.03
ncf_4_8_8_d.2
FAIL
654.32
ncf_16_32_4_d.3
FAIL
662.32
ncf_4_8_8_d.7
FAIL
663.81
ncf_4_16_2_euad.10
UNSAT
668.83
ncf_16_32_2_edau.2
FAIL
677.33
ncf_16_32_2_u.3
FAIL
679.94
ncf_16_32_4_d.2
FAIL
680.84
ncf_16_32_2_euad.2
FAIL
683.65
ncf_8_16_4_d.3
FAIL
684
ncf_16_32_2_d.8
FAIL
688.12
ncf_16_32_2_u.5
FAIL
690.99
ncf_16_32_2_d.5
FAIL
695.57
ncf_16_32_2_u.4
FAIL
699.01
ncf_16_32_4_edau.3
FAIL
704.02
ncf_16_32_2_euad.8
FAIL
705.21
ncf_16_32_4_euad.2
FAIL
710.3
ncf_4_8_8_edau.7
FAIL
710.55
ncf_16_32_2_edau.3
FAIL
713
ncf_4_16_8_euad.7
FAIL
719.2
ncf_16_32_4_u.1
FAIL
719.46
ncf_4_32_2_edau.5
FAIL
720.95
ncf_4_8_8_euad.2
FAIL
721.81
ncf_4_16_4_d.2
FAIL
724.34
ncf_16_32_4_euad.5
FAIL
728.23
ncf_4_8_8_d.4
FAIL
729.9
ncf_16_32_2_edau.5
FAIL
732
ncf_16_32_2_d.2
FAIL
738.55
ncf_4_8_8_u.5
FAIL
743.56
ncf_16_32_4_euad.4
FAIL
746.25
ncf_4_8_8_u.7
FAIL
748.02
ncf_4_8_8_edau.6
FAIL
752.82
ncf_16_32_4_d.4
FAIL
755.27
ncf_4_8_8_u.2
FAIL
755.28
ncf_16_32_2_d.1
UNSAT
761
ncf_8_16_8_euad.8
FAIL
764.51
ncf_4_16_8_euad.10
FAIL
773.97
ncf_8_16_8_d.9
FAIL
775.24
ncf_4_16_8_u.6
FAIL
779.16
ncf_4_8_8_d.6
FAIL
784.69
ncf_16_32_4_euad.6
FAIL
787.38
ncf_8_16_8_d.3
FAIL
794.2
ncf_4_16_8_euad.4
FAIL
794.82
ncf_8_16_8_euad.10
FAIL
795.54
ncf_4_16_8_euad.8
FAIL
797.19
ncf_16_32_2_euad.6
FAIL
798.12
ncf_16_32_2_euad.5
FAIL
799.38
ncf_4_16_8_euad.5
FAIL
799.73
ncf_8_16_8_edau.9
FAIL
802.53
ncf_4_8_8_euad.7
FAIL
802.81
ncf_16_32_4_u.5
FAIL
803.35
ncf_4_8_8_u.6
FAIL
804.89
ncf_4_8_8_edau.4
FAIL
807.51
ncf_16_32_2_u.2
FAIL
808.96
ncf_8_16_8_euad.3
FAIL
810.89
ncf_16_32_4_d.6
FAIL
821.82
ncf_16_32_4_u.3
FAIL
825.4
ncf_16_32_4_u.10
FAIL
825.92
ncf_16_32_4_euad.8
FAIL
826.07
ncf_16_32_4_euad.7
FAIL
841.2
ncf_4_16_8_d.4
FAIL
846.79
ncf_4_8_8_edau.2
FAIL
847.71
ncf_16_32_4_edau.4
FAIL
854.29
ncf_4_16_8_d.3
FAIL
855.81
ncf_8_16_8_d.8
FAIL
858.79
ncf_16_32_2_u.1
FAIL
859.57
ncf_16_32_4_u.7
FAIL
862.92
ncf_16_32_4_d.8
FAIL
863.84
ncf_4_8_8_u.4
FAIL
865.23
ncf_8_16_8_euad.9
FAIL
872.58
ncf_16_32_8_edau.6
FAIL
874.38
ncf_16_32_4_edau.2
FAIL
888.44
ncf_8_16_8_d.10
FAIL
888.44
ncf_16_32_4_u.4
FAIL
889.18
ncf_4_8_8_d.10
FAIL
890.4
ncf_4_32_2_edau.6
FAIL
892.78
ncf_16_32_4_u.2
FAIL
893.38
ncf_4_16_8_euad.2
FAIL
902.96
ncf_4_8_8_euad.10
FAIL
906.35
ncf_4_16_8_euad.9
FAIL
908.52
ncf_4_16_8_d.9
FAIL
909.69
ncf_8_16_8_euad.2
FAIL
924.26
ncf_4_16_8_u.10
FAIL
926.06
ncf_16_32_4_euad.10
FAIL
926.29
ncf_4_16_8_d.8
FAIL
931.77
ncf_4_16_8_d.7
FAIL
931.88
ncf_4_32_2_edau.9
FAIL
932.11
ncf_4_16_8_d.2
FAIL
937.17
ncf_8_16_8_euad.6
FAIL
937.7
ncf_8_16_8_edau.2
FAIL
937.71
ncf_4_8_8_u.10
FAIL
938.98
ncf_4_32_2_u.3
FAIL
940.82
ncf_16_32_4_edau.8
FAIL
945.67
ncf_8_16_8_d.7
FAIL
945.79
ncf_8_16_8_euad.7
FAIL
952.36
ncf_16_32_4_edau.6
FAIL
953.05
ncf_8_16_8_d.4
FAIL
960
ncf_16_32_8_d.6
FAIL
970.72
ncf_8_16_8_edau.3
FAIL
978.48
ncf_16_32_4_euad.9
FAIL
980.29
ncf_8_16_8_d.2
FAIL
986.7
ncf_4_16_8_d.6
FAIL
996.62
ncf_8_16_8_euad.4
FAIL
997.22
ncf_4_16_8_u.7
FAIL
1004.39
ncf_8_16_8_d.5
FAIL
1006.06
ncf_16_32_4_d.5
FAIL
1010.03
ncf_16_32_4_u.6
FAIL
1016.58
ncf_4_16_8_euad.3
FAIL
1022.82
ncf_4_16_8_u.8
FAIL
1022.97
ncf_8_16_8_d.6
FAIL
1023.26
ncf_4_32_2_edau.4
FAIL
1041.1
ncf_16_32_4_euad.3
FAIL
1048.49
ncf_4_16_8_d.10
FAIL
1048.73
ncf_4_16_8_u.9
FAIL
1056.49
ncf_4_16_8_d.1
FAIL
1062.9
ncf_4_16_8_u.3
FAIL
1069.82
ncf_16_32_4_edau.5
FAIL
1074.45
ncf_4_16_8_euad.6
FAIL
1091.85
ncf_16_32_4_u.8
FAIL
1094.01
ncf_4_16_8_d.5
FAIL
1132.44
ncf_4_16_8_u.1
FAIL
1144.53
ncf_8_16_8_edau.4
FAIL
1154.28
ncf_8_16_8_euad.5
FAIL
1158.58
ncf_4_16_8_u.5
FAIL
1162.38
ncf_8_16_8_edau.8
FAIL
1185.17
ncf_4_32_2_u.5
FAIL
1194.49
ncf_8_16_8_edau.5
FAIL
1202.11
ncf_16_32_8_euad.6
FAIL
1210.86
ncf_16_32_8_euad.10
FAIL
1255.53
ncf_4_32_2_u.4
FAIL
1268.93
ncf_4_16_8_u.4
FAIL
1270.88
ncf_16_32_8_d.7
FAIL
1286.86
ncf_16_32_2_u.8
FAIL
1310.38
ncf_4_16_8_u.2
FAIL
1336.21
ncf_16_32_8_euad.4
FAIL
1367.57
ncf_8_16_8_edau.10
FAIL
1371.21
ncf_8_16_8_edau.7
FAIL
1382.6
ncf_16_32_8_d.2
FAIL
1422.53
ncf_16_32_8_d.8
FAIL
1449.05
ncf_16_32_8_euad.2
FAIL
1451.57
ncf_16_32_8_d.10
FAIL
1455.3
ncf_16_32_8_d.1
FAIL
1473.76
ncf_16_32_8_edau.3
FAIL
1491.43
ncf_16_32_8_euad.5
FAIL
1500.25
ncf_16_32_8_edau.7
FAIL
1505.29
ncf_4_32_2_u.9
FAIL
1514.48
ncf_16_32_8_u.9
FAIL
1527.29
ncf_16_32_8_edau.5
FAIL
1540.62
ncf_16_32_8_u.3
FAIL
1561.44
ncf_4_16_2_u.1
FAIL
1564.33
ncf_4_32_2_u.10
FAIL
1570.4
ncf_16_32_8_u.1
FAIL
1572.41
ncf_16_32_8_u.4
FAIL
1573.04
ncf_16_32_8_euad.7
FAIL
1607.55
ncf_16_32_8_edau.1
FAIL
1624.79
ncf_16_32_8_euad.1
FAIL
1663.19
ncf_16_32_8_euad.9
FAIL
1687.4
ncf_16_32_8_edau.2
FAIL
1701.03
ncf_16_32_8_edau.8
FAIL
1723.42
ncf_16_32_8_d.9
FAIL
1734.68
ncf_16_32_8_u.8
FAIL
1737.1
ncf_16_32_8_euad.8
FAIL
1752.48
ncf_4_32_2_edau.3
FAIL
1769.05
ncf_16_32_8_d.5
FAIL
1780.72
ncf_16_32_8_u.5
FAIL
1815.91
ncf_16_32_8_d.3
FAIL
1833.21
ncf_16_32_8_u.7
FAIL
1842.77
ncf_16_32_2_edau.4
FAIL
1895.64
ncf_4_16_8_euad.1
FAIL
1928.05
ncf_16_32_8_edau.9
FAIL
2004.18
ncf_4_16_2_d.3
UNSAT
2008.94
ncf_16_32_8_u.2
FAIL
2065.22
ncf_16_32_8_u.6
FAIL
2078.41
ncf_16_32_8_u.10
FAIL
2078.64
ncf_16_32_2_euad.3
FAIL
2097.1
ncf_4_32_2_u.6
FAIL
2097.49
ncf_16_32_8_edau.10
FAIL
2188.87
ncf_4_32_2_u.7
FAIL
2215.84
ncf_16_32_2_euad.4
FAIL
2414.57
ncf_4_16_2_u.3
FAIL
2417.73
ncf_16_32_8_euad.3
FAIL
2429.15
ncf_4_16_2_euad.3
FAIL
2661
ncf_4_16_2_edau.3
FAIL
2738.06
ncf_16_32_2_u.7
FAIL
2923.9
ncf_4_32_2_edau.7
FAIL
2929.31
ncf_4_32_2_edau.10
FAIL
3751.27
ncf_4_32_2_u.1
FAIL
4790.68
ncf_16_32_2_edau.1
UNSAT
5164.98
Contact
|
Organization
|
Links
|
Citing QBFLIB