QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family CounterFactual solved by
preQuantor
QBFEVAL'06
Instance
Result
Time
ncf_4_8_4_u.1
FAIL
0
ncf_4_16_2_u.6
FAIL
0
ncf_8_16_4_u.2
UNSAT
0
ncf_4_8_2_u.1
UNSAT
0
ncf_8_16_4_d.10
FAIL
0
ncf_4_16_4_d.2
FAIL
0
ncf_4_8_8_edau.3
FAIL
0
ncf_4_8_8_edau.10
FAIL
0
ncf_4_8_2_euad.6
FAIL
0
ncf_16_32_2_u.10
FAIL
0
ncf_4_16_8_d.9
FAIL
0
ncf_8_16_4_d.2
UNSAT
0
ncf_4_8_2_euad.10
FAIL
0
ncf_4_32_2_edau.9
FAIL
0
ncf_16_32_2_euad.1
FAIL
0
ncf_4_16_8_euad.8
FAIL
0
ncf_4_16_2_u.10
FAIL
0
ncf_16_32_4_d.1
FAIL
0
ncf_4_16_8_euad.3
FAIL
0
ncf_4_16_2_euad.4
FAIL
0
ncf_8_16_8_edau.7
FAIL
0
ncf_4_8_4_u.2
UNSAT
0
ncf_8_16_4_u.1
SAT
0
ncf_4_8_4_u.9
FAIL
0
ncf_4_16_4_edau.1
SAT
0
ncf_4_8_4_euad.5
SAT
0
ncf_4_8_8_d.6
FAIL
0
ncf_4_16_2_edau.6
SAT
0
ncf_16_32_4_euad.6
FAIL
0
ncf_4_8_2_u.10
FAIL
0
ncf_4_16_2_euad.6
FAIL
0
ncf_4_8_4_euad.9
SAT
0
ncf_4_16_4_edau.10
FAIL
0
ncf_4_16_2_euad.5
FAIL
0
ncf_4_32_2_edau.3
FAIL
0
ncf_4_8_8_u.10
FAIL
0
ncf_16_32_4_edau.6
FAIL
0
ncf_8_16_4_edau.10
FAIL
0
ncf_4_16_4_d.5
FAIL
0
ncf_8_16_4_d.6
FAIL
0
ncf_4_16_2_d.6
SAT
0
ncf_4_16_2_euad.9
FAIL
0
ncf_4_16_4_euad.10
FAIL
0
ncf_4_8_8_edau.9
FAIL
0
ncf_4_8_4_euad.3
FAIL
0
ncf_16_32_2_euad.3
FAIL
0
ncf_4_32_2_edau.1
FAIL
0
ncf_8_16_4_euad.1
SAT
0
ncf_8_16_8_euad.3
FAIL
0
ncf_4_16_4_euad.5
FAIL
0
ncf_16_32_2_edau.5
FAIL
0
ncf_4_32_2_u.3
FAIL
0
ncf_4_16_8_euad.6
FAIL
0.01
ncf_16_32_2_edau.9
UNSAT
0.01
ncf_16_32_2_u.8
FAIL
0.01
ncf_4_32_2_u.7
FAIL
0.01
ncf_16_32_8_d.7
FAIL
0.01
ncf_4_16_4_euad.1
SAT
0.01
ncf_8_16_4_euad.2
UNSAT
0.01
ncf_4_8_2_u.9
SAT
0.01
ncf_8_16_4_d.1
FAIL
0.01
ncf_4_8_4_euad.2
UNSAT
0.01
ncf_16_32_4_edau.9
FAIL
0.01
ncf_4_16_2_edau.2
SAT
0.01
ncf_8_16_4_euad.10
FAIL
0.01
ncf_4_16_2_d.9
SAT
0.01
ncf_16_32_2_edau.6
SAT
0.01
ncf_4_8_2_u.5
SAT
0.01
ncf_4_32_2_edau.8
FAIL
0.01
ncf_8_16_4_edau.2
UNSAT
0.01
ncf_4_8_2_euad.5
SAT
0.01
ncf_4_16_4_euad.8
SAT
0.01
ncf_8_16_4_edau.1
SAT
0.01
ncf_16_32_4_u.7
FAIL
0.01
ncf_8_16_4_edau.6
UNSAT
0.01
ncf_16_32_4_edau.2
FAIL
0.01
ncf_4_8_2_euad.1
UNSAT
0.01
ncf_16_32_4_d.10
FAIL
0.01
ncf_4_8_4_u.5
SAT
0.01
ncf_4_16_4_edau.5
FAIL
0.01
ncf_16_32_4_d.5
FAIL
0.01
ncf_4_8_2_euad.7
UNSAT
0.01
ncf_4_16_2_u.9
FAIL
0.01
ncf_4_8_2_u.4
FAIL
0.01
ncf_4_8_2_euad.8
FAIL
0.01
ncf_4_8_2_u.7
UNSAT
0.01
ncf_16_32_8_euad.9
FAIL
0.01
ncf_16_32_2_d.3
FAIL
0.01
ncf_16_32_4_d.2
FAIL
0.01
ncf_4_16_4_d.1
SAT
0.01
ncf_16_32_4_u.8
FAIL
0.01
ncf_8_16_8_d.2
FAIL
0.01
ncf_4_16_4_u.5
FAIL
0.01
ncf_4_8_2_u.8
SAT
0.01
ncf_4_8_4_u.8
FAIL
0.01
ncf_16_32_2_d.9
UNSAT
0.01
ncf_16_32_4_euad.9
FAIL
0.01
ncf_4_16_4_d.8
SAT
0.02
ncf_4_8_8_d.5
UNSAT
0.02
ncf_4_16_4_u.1
SAT
0.02
ncf_16_32_4_d.9
SAT
0.02
ncf_8_16_4_edau.8
UNSAT
0.02
ncf_16_32_2_d.6
SAT
0.02
ncf_4_8_8_edau.5
UNSAT
0.02
ncf_16_32_2_u.9
UNSAT
0.02
ncf_4_16_2_edau.9
FAIL
0.02
ncf_4_8_8_u.9
UNSAT
0.02
ncf_8_16_8_d.1
SAT
0.02
ncf_4_16_4_edau.8
SAT
0.02
ncf_4_16_2_d.2
SAT
0.02
ncf_4_8_8_d.9
UNSAT
0.02
ncf_4_16_4_u.8
SAT
0.02
ncf_8_16_4_d.8
UNSAT
0.02
ncf_8_16_4_edau.5
UNSAT
0.02
ncf_4_8_8_edau.8
SAT
0.02
ncf_16_32_2_euad.9
UNSAT
0.02
ncf_4_8_8_euad.9
UNSAT
0.02
ncf_8_16_4_euad.5
UNSAT
0.02
ncf_16_32_8_u.7
FAIL
0.02
ncf_4_16_2_u.4
SAT
0.03
ncf_4_16_2_edau.4
SAT
0.03
ncf_8_16_8_edau.1
SAT
0.03
ncf_8_16_4_u.5
UNSAT
0.03
ncf_4_16_2_d.4
SAT
0.03
ncf_16_32_2_d.7
UNSAT
0.03
ncf_16_32_4_edau.7
UNSAT
0.03
ncf_4_8_2_euad.9
SAT
0.03
ncf_8_16_4_d.5
UNSAT
0.03
ncf_4_8_8_d.8
SAT
0.03
ncf_16_32_4_edau.1
FAIL
0.03
ncf_4_8_2_euad.4
UNSAT
0.03
ncf_8_16_8_euad.1
SAT
0.04
ncf_16_32_4_d.7
UNSAT
0.04
ncf_16_32_4_edau.10
UNSAT
0.04
ncf_4_8_2_u.6
SAT
0.05
ncf_16_32_8_d.4
SAT
0.06
ncf_16_32_8_edau.4
SAT
0.07
ncf_4_8_8_d.3
SAT
0.09
ncf_4_8_8_edau.1
SAT
0.1
ncf_4_16_4_d.9
SAT
0.14
ncf_16_32_2_euad.7
UNSAT
0.18
ncf_4_8_8_euad.3
SAT
0.2
ncf_4_8_8_u.1
SAT
0.22
ncf_4_8_8_u.3
SAT
0.24
ncf_4_16_2_edau.7
SAT
0.36
ncf_4_8_8_d.1
SAT
0.36
ncf_4_16_2_d.7
SAT
0.41
ncf_4_8_2_u.2
SAT
0.53
ncf_4_8_4_euad.8
UNSAT
0.58
ncf_4_16_2_u.2
SAT
0.65
ncf_4_16_2_euad.2
SAT
0.66
ncf_4_8_2_euad.2
SAT
0.8
ncf_4_16_4_euad.9
SAT
0.93
ncf_4_16_4_edau.9
SAT
1.11
ncf_16_32_2_edau.7
UNSAT
2.16
ncf_4_8_4_euad.10
SAT
2.28
ncf_4_16_4_u.9
SAT
2.44
ncf_4_8_4_euad.6
SAT
3.29
ncf_4_8_4_u.10
SAT
3.41
ncf_8_16_8_edau.6
UNSAT
3.54
ncf_4_8_8_euad.1
SAT
7.37
ncf_4_8_4_u.6
SAT
8.56
ncf_4_8_8_u.2
FAIL
15.83
ncf_4_16_8_u.6
FAIL
16.56
ncf_4_32_2_edau.7
FAIL
16.76
ncf_4_16_8_u.2
FAIL
16.85
ncf_16_32_8_u.4
FAIL
17.09
ncf_16_32_4_d.6
FAIL
17.17
ncf_4_16_8_u.5
FAIL
17.24
ncf_8_16_8_edau.4
FAIL
17.44
ncf_16_32_4_u.1
FAIL
17.5
ncf_16_32_4_u.3
FAIL
17.56
ncf_16_32_4_euad.8
FAIL
17.6
ncf_4_8_8_u.6
FAIL
17.65
ncf_16_32_4_u.2
FAIL
17.66
ncf_8_16_4_edau.7
FAIL
17.69
ncf_8_16_4_u.7
FAIL
17.7
ncf_4_16_8_u.8
FAIL
17.81
ncf_4_32_2_edau.5
FAIL
17.87
ncf_16_32_8_edau.7
FAIL
17.89
ncf_16_32_8_edau.5
FAIL
17.93
ncf_4_16_8_d.1
FAIL
17.94
ncf_8_16_8_edau.2
FAIL
17.97
ncf_4_16_8_u.1
FAIL
18.01
ncf_8_16_4_euad.7
FAIL
18.12
ncf_16_32_8_u.5
FAIL
18.16
ncf_4_16_4_edau.2
FAIL
18.19
ncf_8_16_4_u.9
FAIL
18.26
ncf_16_32_2_edau.10
FAIL
18.28
ncf_16_32_8_u.6
FAIL
18.29
ncf_4_16_4_u.7
FAIL
18.3
ncf_16_32_4_euad.2
FAIL
18.31
ncf_4_8_8_u.7
FAIL
18.34
ncf_16_32_2_d.1
FAIL
18.36
ncf_16_32_8_u.8
FAIL
18.42
ncf_8_16_4_edau.9
FAIL
18.45
ncf_16_32_4_u.4
FAIL
18.46
ncf_4_16_8_u.9
FAIL
18.49
ncf_8_16_8_edau.5
FAIL
18.49
ncf_4_32_2_edau.4
FAIL
18.51
ncf_16_32_4_euad.5
FAIL
18.51
ncf_16_32_8_edau.9
FAIL
18.54
ncf_16_32_8_u.1
FAIL
18.58
ncf_4_16_8_d.6
FAIL
18.59
ncf_8_16_8_edau.10
FAIL
18.59
ncf_8_16_8_d.3
FAIL
18.62
ncf_4_16_4_u.2
FAIL
18.65
ncf_16_32_4_edau.3
FAIL
18.67
ncf_4_16_4_euad.7
FAIL
18.7
ncf_16_32_8_u.10
FAIL
18.71
ncf_8_16_8_d.4
FAIL
18.79
ncf_16_32_4_u.9
FAIL
18.83
ncf_4_16_8_euad.5
FAIL
18.85
ncf_8_16_4_u.4
FAIL
18.89
ncf_8_16_8_euad.2
FAIL
18.9
ncf_4_16_8_u.3
FAIL
18.92
ncf_16_32_4_u.10
FAIL
18.92
ncf_4_8_8_edau.7
FAIL
18.97
ncf_4_32_2_u.4
FAIL
18.97
ncf_4_16_4_euad.6
FAIL
18.97
ncf_16_32_8_d.10
FAIL
18.99
ncf_8_16_4_u.3
FAIL
19
ncf_16_32_2_edau.2
FAIL
19
ncf_4_16_4_d.6
FAIL
19
ncf_4_8_4_euad.7
FAIL
19
ncf_16_32_4_u.5
FAIL
19.05
ncf_4_16_8_d.4
FAIL
19.11
ncf_4_16_8_euad.1
FAIL
19.13
ncf_4_16_4_d.10
FAIL
19.15
ncf_4_16_4_edau.4
FAIL
19.17
ncf_8_16_4_d.7
FAIL
19.22
ncf_16_32_4_euad.1
FAIL
19.25
ncf_16_32_2_u.3
FAIL
19.28
ncf_16_32_8_edau.2
FAIL
19.28
ncf_4_16_8_u.4
FAIL
19.31
ncf_4_8_8_edau.2
FAIL
19.32
ncf_8_16_4_u.10
FAIL
19.4
ncf_4_16_4_euad.4
FAIL
19.41
ncf_16_32_4_edau.4
FAIL
19.43
ncf_16_32_2_u.5
FAIL
19.44
ncf_4_16_8_euad.10
FAIL
19.46
ncf_4_16_4_d.3
FAIL
19.47
ncf_16_32_2_d.2
FAIL
19.47
ncf_8_16_4_euad.9
FAIL
19.49
ncf_4_16_4_u.6
FAIL
19.49
ncf_4_16_8_d.10
FAIL
19.54
ncf_4_16_4_euad.3
FAIL
19.6
ncf_4_16_4_euad.2
FAIL
19.61
ncf_4_8_8_edau.6
FAIL
19.62
ncf_4_32_2_edau.6
FAIL
19.63
ncf_4_32_2_u.9
FAIL
19.64
ncf_16_32_4_euad.3
FAIL
19.68
ncf_16_32_8_u.9
FAIL
19.7
ncf_16_32_2_euad.5
FAIL
19.7
ncf_8_16_4_euad.3
FAIL
19.75
ncf_16_32_8_euad.3
FAIL
19.87
ncf_8_16_4_euad.4
FAIL
19.88
ncf_4_16_8_d.8
FAIL
19.93
ncf_4_16_4_d.4
FAIL
19.97
ncf_8_16_8_euad.10
FAIL
20.01
ncf_4_8_4_euad.1
FAIL
20.04
ncf_16_32_2_d.4
FAIL
20.04
ncf_4_16_4_edau.6
FAIL
20.08
ncf_16_32_8_d.1
FAIL
20.1
ncf_4_32_2_u.6
FAIL
20.1
ncf_8_16_8_euad.9
FAIL
20.12
ncf_16_32_8_edau.3
FAIL
20.13
ncf_4_8_8_u.8
FAIL
20.2
ncf_4_8_8_euad.10
FAIL
20.23
ncf_16_32_4_u.6
FAIL
20.23
ncf_8_16_4_d.3
FAIL
20.3
ncf_4_32_2_u.5
FAIL
20.3
ncf_4_8_8_euad.6
FAIL
20.33
ncf_16_32_8_euad.4
FAIL
20.35
ncf_16_32_4_d.4
FAIL
20.37
ncf_8_16_8_d.9
FAIL
20.38
ncf_16_32_8_u.2
FAIL
20.4
ncf_4_8_8_d.7
FAIL
20.41
ncf_16_32_8_euad.10
FAIL
20.44
ncf_4_16_8_euad.9
FAIL
20.45
ncf_16_32_2_edau.4
FAIL
20.46
ncf_16_32_2_edau.3
FAIL
20.47
ncf_16_32_8_d.2
FAIL
20.55
ncf_16_32_2_u.1
FAIL
20.56
ncf_16_32_2_euad.10
FAIL
20.69
ncf_16_32_8_d.5
FAIL
20.72
ncf_4_32_2_u.8
FAIL
20.73
ncf_16_32_2_edau.1
FAIL
20.75
ncf_16_32_8_edau.8
FAIL
20.77
ncf_16_32_8_euad.8
FAIL
20.86
ncf_8_16_8_d.6
FAIL
20.88
ncf_8_16_4_edau.3
FAIL
20.96
ncf_16_32_2_euad.6
FAIL
20.97
ncf_16_32_8_edau.10
FAIL
21.04
ncf_16_32_2_u.2
FAIL
21.16
ncf_16_32_8_edau.1
FAIL
21.17
ncf_8_16_8_euad.4
FAIL
21.22
ncf_16_32_2_euad.2
FAIL
21.23
ncf_4_8_8_d.10
FAIL
21.25
ncf_16_32_8_d.6
FAIL
21.28
ncf_16_32_2_d.10
FAIL
21.36
ncf_4_16_8_euad.2
FAIL
21.36
ncf_4_16_4_u.4
FAIL
21.39
ncf_4_16_2_euad.3
FAIL
21.42
ncf_4_32_2_u.10
FAIL
21.51
ncf_4_8_8_euad.8
FAIL
21.66
ncf_8_16_4_d.9
FAIL
21.67
ncf_16_32_8_edau.6
FAIL
21.67
ncf_16_32_2_euad.4
FAIL
21.7
ncf_16_32_4_d.3
FAIL
21.81
ncf_4_16_2_u.3
FAIL
21.84
ncf_4_16_4_edau.7
FAIL
21.99
ncf_4_16_2_edau.3
FAIL
22.01
ncf_8_16_8_edau.9
FAIL
22.02
ncf_16_32_8_d.9
FAIL
22.09
ncf_16_32_8_d.3
FAIL
22.1
ncf_8_16_4_euad.6
FAIL
22.15
ncf_16_32_2_d.8
FAIL
22.16
ncf_4_16_8_u.7
FAIL
22.23
ncf_16_32_8_euad.6
FAIL
22.24
ncf_4_16_4_u.3
FAIL
22.25
ncf_16_32_4_euad.7
FAIL
22.35
ncf_4_8_8_euad.4
FAIL
22.67
ncf_8_16_4_edau.4
FAIL
22.68
ncf_4_16_8_d.5
FAIL
22.78
ncf_4_16_8_euad.7
FAIL
22.78
ncf_4_16_4_u.10
FAIL
22.81
ncf_16_32_2_u.6
FAIL
22.86
ncf_16_32_8_euad.5
FAIL
22.97
ncf_4_16_8_u.10
FAIL
22.99
ncf_8_16_4_u.6
FAIL
23.03
ncf_8_16_8_euad.8
FAIL
23.06
ncf_16_32_4_euad.4
FAIL
23.17
ncf_4_32_2_edau.10
FAIL
23.21
ncf_4_16_2_edau.1
FAIL
23.24
ncf_16_32_4_edau.5
FAIL
23.28
ncf_4_16_2_d.1
FAIL
23.39
ncf_16_32_8_euad.7
FAIL
23.5
ncf_16_32_8_euad.2
FAIL
23.52
ncf_8_16_8_d.5
FAIL
23.53
ncf_4_16_2_euad.1
FAIL
23.55
ncf_4_16_4_edau.3
FAIL
23.88
ncf_4_8_8_euad.2
FAIL
23.98
ncf_16_32_4_euad.10
FAIL
24.22
ncf_4_16_2_d.3
FAIL
24.29
ncf_4_8_8_u.5
FAIL
24.33
ncf_16_32_8_euad.1
FAIL
24.36
ncf_4_8_8_u.4
FAIL
24.42
ncf_16_32_2_u.4
FAIL
24.44
ncf_4_8_8_euad.7
FAIL
24.47
ncf_16_32_2_d.5
FAIL
24.49
ncf_8_16_8_edau.3
FAIL
24.73
ncf_16_32_4_d.8
FAIL
24.91
ncf_8_16_4_euad.8
FAIL
25.06
ncf_16_32_2_edau.8
FAIL
25.34
ncf_4_8_4_u.4
FAIL
25.42
ncf_4_16_2_euad.10
FAIL
25.53
ncf_16_32_4_edau.8
FAIL
25.54
ncf_16_32_8_d.8
FAIL
25.63
ncf_8_16_8_euad.7
FAIL
25.63
ncf_4_16_4_d.7
FAIL
25.85
ncf_4_16_8_d.3
FAIL
25.99
ncf_8_16_8_d.7
FAIL
26.97
ncf_8_16_8_edau.8
FAIL
27.35
ncf_4_16_8_d.2
FAIL
27.95
ncf_4_16_2_u.8
FAIL
28.4
ncf_4_16_2_d.8
FAIL
28.73
ncf_4_8_8_d.2
FAIL
29.46
ncf_4_32_2_u.2
FAIL
29.5
ncf_4_16_2_u.5
FAIL
30.14
ncf_8_16_4_d.4
FAIL
30.14
ncf_4_16_2_d.10
FAIL
33.25
ncf_4_16_2_euad.8
FAIL
33.53
ncf_4_8_8_euad.5
FAIL
33.58
ncf_4_8_8_d.4
FAIL
33.88
ncf_4_16_8_euad.4
FAIL
34.62
ncf_8_16_8_euad.6
FAIL
37.05
ncf_4_8_4_u.7
FAIL
38.24
ncf_4_16_2_d.5
FAIL
39.07
ncf_8_16_8_euad.5
FAIL
40.94
ncf_4_8_2_u.3
FAIL
42.9
ncf_4_16_2_u.1
FAIL
44.69
ncf_4_8_4_u.3
FAIL
47.37
ncf_16_32_2_u.7
FAIL
49
ncf_16_32_8_u.3
FAIL
54.29
ncf_4_16_2_edau.10
FAIL
56.52
ncf_8_16_8_d.8
FAIL
60.74
ncf_8_16_8_d.10
FAIL
62.37
ncf_4_32_2_u.1
FAIL
62.57
ncf_4_8_8_edau.4
FAIL
69.71
ncf_8_16_4_u.8
FAIL
70.93
ncf_16_32_2_euad.8
FAIL
72.86
ncf_4_8_4_euad.4
FAIL
105.81
ncf_4_16_2_u.7
SAT
162.35
ncf_4_8_2_euad.3
UNSAT
204.6
ncf_4_16_2_edau.8
SAT
341.2
ncf_4_32_2_edau.2
SAT
518.3
ncf_4_16_2_euad.7
SAT
563.33
ncf_4_16_2_edau.5
FAIL
598.26
ncf_4_16_8_d.7
FAIL
951.24
Contact
|
Organization
|
Links
|
Citing QBFLIB