QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family CounterFactual solved by
QUANTOR
QBFEVAL'06
Instance
Result
Time
ncf_4_8_2_u.8
SAT
0
ncf_4_8_2_euad.4
UNSAT
0
ncf_16_32_2_d.9
UNSAT
0
ncf_8_16_4_euad.2
UNSAT
0
ncf_4_8_2_u.9
SAT
0
ncf_4_16_2_u.6
FAIL
0
ncf_8_16_4_u.2
UNSAT
0
ncf_8_16_4_d.2
UNSAT
0
ncf_4_16_2_edau.2
SAT
0
ncf_4_8_2_euad.10
FAIL
0
ncf_8_16_4_u.5
UNSAT
0
ncf_16_32_2_edau.6
SAT
0
ncf_4_8_2_u.5
FAIL
0
ncf_4_16_2_d.4
SAT
0
ncf_8_16_4_edau.2
UNSAT
0
ncf_16_32_4_d.1
FAIL
0
ncf_4_8_4_u.9
SAT
0
ncf_4_8_4_u.2
UNSAT
0
ncf_8_16_4_u.1
SAT
0
ncf_4_8_8_u.9
UNSAT
0
ncf_4_8_2_euad.1
UNSAT
0
ncf_4_16_2_u.9
SAT
0
ncf_4_8_4_u.5
SAT
0
ncf_4_8_4_euad.5
SAT
0
ncf_8_16_4_edau.5
UNSAT
0
ncf_4_8_2_u.4
UNSAT
0
ncf_4_8_2_u.10
SAT
0
ncf_4_16_2_euad.9
SAT
0
ncf_8_16_4_edau.10
SAT
0
ncf_4_16_2_d.6
SAT
0
ncf_4_8_8_euad.9
UNSAT
0
ncf_4_8_8_edau.9
UNSAT
0.01
ncf_4_16_4_u.5
FAIL
0.01
ncf_8_16_4_euad.1
SAT
0.01
ncf_4_16_4_euad.5
FAIL
0.01
ncf_16_32_2_edau.9
UNSAT
0.01
ncf_8_16_8_euad.1
SAT
0.01
ncf_4_16_2_u.4
SAT
0.01
ncf_4_16_4_d.8
SAT
0.01
ncf_4_16_4_euad.1
SAT
0.01
ncf_4_16_2_edau.4
SAT
0.01
ncf_16_32_4_d.9
SAT
0.01
ncf_4_16_4_u.1
SAT
0.01
ncf_8_16_4_d.1
SAT
0.01
ncf_4_8_2_u.1
UNSAT
0.01
ncf_4_8_4_euad.2
UNSAT
0.01
ncf_16_32_4_edau.9
SAT
0.01
ncf_4_16_2_d.9
SAT
0.01
ncf_16_32_2_d.6
SAT
0.01
ncf_4_8_2_euad.5
FAIL
0.01
ncf_4_16_4_euad.8
SAT
0.01
ncf_8_16_4_edau.1
SAT
0.01
ncf_4_16_2_edau.9
SAT
0.01
ncf_4_8_2_euad.9
SAT
0.01
ncf_4_16_2_edau.6
SAT
0.01
ncf_8_16_8_d.1
SAT
0.01
ncf_4_16_4_edau.5
SAT
0.01
ncf_8_16_4_d.5
UNSAT
0.01
ncf_4_16_4_edau.8
SAT
0.01
ncf_4_8_2_euad.7
UNSAT
0.01
ncf_4_8_8_d.9
UNSAT
0.01
ncf_4_16_2_euad.6
FAIL
0.01
ncf_4_16_4_u.8
SAT
0.01
ncf_4_8_2_u.7
UNSAT
0.01
ncf_4_8_4_euad.9
SAT
0.01
ncf_8_16_4_d.8
UNSAT
0.01
ncf_16_32_2_euad.9
UNSAT
0.01
ncf_4_16_4_d.5
SAT
0.01
ncf_8_16_4_d.6
UNSAT
0.01
ncf_8_16_4_euad.5
UNSAT
0.01
ncf_4_8_2_u.6
SAT
0.01
ncf_4_16_4_d.1
SAT
0.02
ncf_4_16_2_euad.2
SAT
0.02
ncf_4_8_8_d.5
UNSAT
0.02
ncf_8_16_4_d.10
SAT
0.02
ncf_4_8_2_euad.6
SAT
0.02
ncf_8_16_4_edau.8
UNSAT
0.02
ncf_4_16_2_u.2
SAT
0.02
ncf_4_8_8_edau.5
UNSAT
0.02
ncf_16_32_2_d.7
UNSAT
0.02
ncf_16_32_2_u.9
UNSAT
0.02
ncf_4_16_4_edau.1
SAT
0.02
ncf_8_16_4_edau.6
UNSAT
0.02
ncf_16_32_4_d.10
UNSAT
0.02
ncf_4_8_8_d.8
SAT
0.02
ncf_16_32_4_edau.10
UNSAT
0.02
ncf_4_8_2_euad.8
SAT
0.02
ncf_4_8_8_edau.8
SAT
0.02
ncf_8_16_8_edau.1
SAT
0.03
ncf_16_32_8_d.4
SAT
0.03
ncf_16_32_4_d.7
UNSAT
0.03
ncf_16_32_4_edau.7
UNSAT
0.03
ncf_4_16_2_d.2
SAT
0.03
ncf_16_32_8_edau.4
SAT
0.03
ncf_16_32_4_edau.1
FAIL
0.04
ncf_4_16_2_euad.4
SAT
0.05
ncf_4_32_2_edau.1
UNSAT
0.07
ncf_4_16_2_d.5
UNSAT
0.07
ncf_4_8_8_edau.1
SAT
0.11
ncf_4_8_8_d.3
SAT
0.12
ncf_4_16_2_d.7
SAT
0.15
ncf_4_16_2_edau.5
UNSAT
0.16
ncf_4_8_8_edau.3
SAT
0.18
ncf_4_16_4_d.9
SAT
0.19
ncf_4_8_8_u.3
SAT
0.24
ncf_4_8_8_u.1
SAT
0.24
ncf_4_16_2_edau.7
SAT
0.35
ncf_4_8_8_d.1
SAT
0.35
ncf_4_8_2_u.2
SAT
0.38
ncf_4_8_8_euad.3
SAT
0.57
ncf_4_8_2_euad.2
SAT
0.97
ncf_4_16_4_edau.9
SAT
1.06
ncf_4_8_4_u.8
UNSAT
1.11
ncf_16_32_2_euad.7
UNSAT
1.36
ncf_4_16_4_euad.9
SAT
1.64
ncf_4_8_4_u.6
SAT
1.97
ncf_4_16_4_u.9
SAT
2.63
ncf_16_32_2_edau.7
UNSAT
2.8
ncf_4_8_4_u.10
SAT
3.42
ncf_4_8_4_euad.6
SAT
4.01
ncf_4_8_4_euad.10
SAT
4.8
ncf_8_16_8_edau.6
UNSAT
7.7
ncf_8_16_4_edau.7
FAIL
13.54
ncf_8_16_4_d.7
FAIL
15.61
ncf_8_16_4_u.7
FAIL
15.85
ncf_4_32_2_edau.9
FAIL
16.06
ncf_4_8_4_euad.8
UNSAT
16.25
ncf_4_16_8_u.6
FAIL
16.53
ncf_4_16_2_u.5
FAIL
16.54
ncf_4_32_2_edau.7
FAIL
16.56
ncf_4_32_2_edau.3
FAIL
16.58
ncf_4_32_2_edau.8
FAIL
16.6
ncf_16_32_2_edau.2
FAIL
16.72
ncf_4_16_8_u.9
FAIL
16.99
ncf_4_16_8_d.9
FAIL
17.06
ncf_4_16_8_u.1
FAIL
17.12
ncf_16_32_4_edau.3
FAIL
17.37
ncf_4_16_4_u.4
FAIL
17.4
ncf_4_32_2_u.6
FAIL
17.42
ncf_4_16_2_edau.3
FAIL
17.45
ncf_16_32_8_euad.3
FAIL
17.53
ncf_8_16_8_d.4
FAIL
17.6
ncf_4_8_8_u.10
FAIL
17.6
ncf_4_16_4_euad.2
FAIL
17.66
ncf_4_16_4_edau.3
FAIL
17.73
ncf_4_32_2_edau.10
FAIL
17.75
ncf_8_16_8_edau.2
FAIL
17.81
ncf_4_16_4_edau.6
FAIL
17.84
ncf_4_16_8_u.8
FAIL
17.84
ncf_4_16_4_euad.4
FAIL
17.85
ncf_16_32_8_u.2
FAIL
17.91
ncf_4_32_2_u.10
FAIL
17.92
ncf_4_16_4_u.6
FAIL
17.94
ncf_16_32_8_edau.8
FAIL
17.95
ncf_4_32_2_edau.4
FAIL
17.96
ncf_8_16_4_u.4
FAIL
17.99
ncf_16_32_4_euad.8
FAIL
18.01
ncf_4_16_4_edau.4
FAIL
18.03
ncf_16_32_8_u.4
FAIL
18.04
ncf_4_8_8_edau.10
FAIL
18.05
ncf_4_16_8_u.3
FAIL
18.05
ncf_16_32_8_u.10
FAIL
18.08
ncf_16_32_8_u.5
FAIL
18.12
ncf_4_8_4_euad.3
FAIL
18.13
ncf_4_8_8_edau.2
FAIL
18.17
ncf_4_16_8_euad.1
FAIL
18.2
ncf_8_16_8_euad.9
FAIL
18.21
ncf_8_16_4_d.3
FAIL
18.22
ncf_4_32_2_u.5
FAIL
18.22
ncf_16_32_4_u.9
FAIL
18.24
ncf_16_32_4_u.8
FAIL
18.27
ncf_4_8_8_u.2
FAIL
18.27
ncf_4_32_2_u.3
FAIL
18.3
ncf_16_32_8_u.3
FAIL
18.32
ncf_4_16_8_euad.9
FAIL
18.39
ncf_4_16_4_euad.3
FAIL
18.39
ncf_16_32_8_u.1
FAIL
18.41
ncf_4_16_2_euad.5
FAIL
18.41
ncf_4_16_4_u.2
FAIL
18.45
ncf_16_32_4_edau.6
FAIL
18.45
ncf_16_32_8_u.7
FAIL
18.53
ncf_8_16_4_u.10
FAIL
18.56
ncf_8_16_4_euad.7
FAIL
18.58
ncf_16_32_4_u.10
FAIL
18.59
ncf_16_32_4_u.1
FAIL
18.61
ncf_16_32_8_edau.2
FAIL
18.61
ncf_4_32_2_u.8
FAIL
18.63
ncf_8_16_4_euad.4
FAIL
18.64
ncf_4_16_8_d.6
FAIL
18.7
ncf_16_32_4_u.2
FAIL
18.7
ncf_16_32_2_u.4
FAIL
18.72
ncf_16_32_2_d.1
FAIL
18.73
ncf_4_16_8_u.5
FAIL
18.75
ncf_8_16_4_euad.3
FAIL
18.76
ncf_16_32_4_u.5
FAIL
18.77
ncf_4_16_8_u.2
FAIL
18.81
ncf_4_8_8_u.6
FAIL
18.87
ncf_8_16_4_u.3
FAIL
18.89
ncf_4_8_4_euad.1
FAIL
18.9
ncf_4_32_2_u.2
FAIL
18.91
ncf_4_32_2_u.7
FAIL
18.99
ncf_16_32_8_u.6
FAIL
19
ncf_4_16_2_d.3
FAIL
19.05
ncf_8_16_4_u.9
FAIL
19.07
ncf_4_8_8_d.7
FAIL
19.08
ncf_4_16_8_euad.7
FAIL
19.08
ncf_4_8_8_edau.7
FAIL
19.11
ncf_4_16_4_d.10
FAIL
19.13
ncf_16_32_8_edau.3
FAIL
19.13
ncf_4_8_8_d.10
FAIL
19.14
ncf_4_16_8_u.4
FAIL
19.15
ncf_16_32_2_u.10
FAIL
19.16
ncf_16_32_4_d.6
FAIL
19.16
ncf_4_8_8_u.8
FAIL
19.22
ncf_16_32_2_u.2
FAIL
19.24
ncf_16_32_4_edau.2
FAIL
19.24
ncf_16_32_2_euad.8
FAIL
19.25
ncf_4_16_4_edau.10
FAIL
19.27
ncf_16_32_4_d.5
FAIL
19.28
ncf_4_16_4_euad.6
FAIL
19.29
ncf_16_32_4_euad.4
FAIL
19.31
ncf_4_16_4_u.7
FAIL
19.31
ncf_16_32_4_euad.9
FAIL
19.33
ncf_16_32_4_euad.2
FAIL
19.36
ncf_16_32_8_edau.9
FAIL
19.37
ncf_16_32_8_u.9
FAIL
19.44
ncf_16_32_4_u.3
FAIL
19.45
ncf_16_32_2_u.6
FAIL
19.5
ncf_8_16_8_euad.2
FAIL
19.52
ncf_16_32_4_d.4
FAIL
19.58
ncf_16_32_8_edau.1
FAIL
19.59
ncf_8_16_8_edau.9
FAIL
19.68
ncf_8_16_4_euad.8
FAIL
19.71
ncf_16_32_2_edau.4
FAIL
19.73
ncf_4_16_4_edau.7
FAIL
19.75
ncf_16_32_4_u.6
FAIL
19.8
ncf_16_32_8_u.8
FAIL
19.84
ncf_4_16_8_d.10
FAIL
19.87
ncf_16_32_2_euad.1
FAIL
19.94
ncf_16_32_2_euad.3
FAIL
19.95
ncf_4_8_8_d.6
FAIL
19.97
ncf_4_16_8_euad.6
FAIL
19.99
ncf_8_16_8_edau.4
FAIL
19.99
ncf_16_32_2_u.5
FAIL
20.03
ncf_16_32_4_d.3
FAIL
20.03
ncf_16_32_2_u.1
FAIL
20.07
ncf_4_16_2_edau.8
FAIL
20.09
ncf_16_32_2_euad.4
FAIL
20.17
ncf_16_32_4_euad.10
FAIL
20.23
ncf_16_32_4_euad.3
FAIL
20.27
ncf_4_16_4_euad.7
FAIL
20.33
ncf_16_32_4_u.7
FAIL
20.35
ncf_16_32_2_d.2
FAIL
20.4
ncf_16_32_2_d.4
FAIL
20.41
ncf_4_16_4_euad.10
FAIL
20.44
ncf_4_32_2_edau.5
FAIL
20.45
ncf_8_16_8_edau.10
FAIL
20.46
ncf_4_16_8_u.7
FAIL
20.47
ncf_4_16_4_d.6
FAIL
20.5
ncf_8_16_8_d.9
FAIL
20.51
ncf_16_32_2_euad.6
FAIL
20.51
ncf_8_16_8_edau.5
FAIL
20.64
ncf_4_8_8_euad.7
FAIL
20.68
ncf_8_16_4_edau.3
FAIL
20.73
ncf_4_32_2_u.4
FAIL
20.81
ncf_4_16_2_edau.1
FAIL
20.83
ncf_16_32_8_edau.7
FAIL
20.84
ncf_16_32_8_euad.7
FAIL
20.92
ncf_4_16_4_u.10
FAIL
21
ncf_4_16_4_d.2
FAIL
21.02
ncf_8_16_4_d.9
FAIL
21.04
ncf_4_16_8_euad.10
FAIL
21.07
ncf_8_16_8_d.10
FAIL
21.14
ncf_8_16_8_d.2
FAIL
21.18
ncf_16_32_2_euad.2
FAIL
21.19
ncf_16_32_8_euad.4
FAIL
21.21
ncf_4_8_8_u.4
FAIL
21.32
ncf_16_32_8_edau.5
FAIL
21.39
ncf_4_8_8_u.7
FAIL
21.4
ncf_16_32_4_edau.4
FAIL
21.41
ncf_8_16_8_euad.10
FAIL
21.43
ncf_16_32_2_euad.5
FAIL
21.44
ncf_8_16_8_edau.7
FAIL
21.46
ncf_4_8_8_edau.6
FAIL
21.46
ncf_16_32_8_d.8
FAIL
21.47
ncf_4_8_2_u.3
FAIL
21.52
ncf_16_32_4_euad.1
FAIL
21.62
ncf_16_32_8_d.9
FAIL
21.63
ncf_4_8_8_euad.10
FAIL
21.64
ncf_8_16_4_euad.10
FAIL
21.66
ncf_4_8_8_edau.4
FAIL
21.77
ncf_16_32_4_euad.6
FAIL
21.8
ncf_8_16_8_euad.3
FAIL
21.82
ncf_8_16_4_u.8
FAIL
21.82
ncf_16_32_2_u.8
FAIL
21.99
ncf_16_32_2_edau.10
FAIL
22.05
ncf_4_8_8_euad.8
FAIL
22.15
ncf_16_32_2_edau.8
FAIL
22.2
ncf_16_32_2_edau.5
FAIL
22.22
ncf_16_32_8_edau.10
FAIL
22.25
ncf_16_32_8_euad.2
FAIL
22.31
ncf_8_16_4_euad.9
FAIL
22.47
ncf_8_16_8_euad.7
FAIL
22.48
ncf_4_8_8_euad.6
FAIL
22.49
ncf_4_16_4_d.3
FAIL
22.54
ncf_8_16_4_d.4
FAIL
22.55
ncf_4_16_8_d.5
FAIL
22.67
ncf_8_16_4_euad.6
FAIL
22.67
ncf_4_16_4_d.7
FAIL
22.7
ncf_16_32_2_d.10
FAIL
22.76
ncf_16_32_8_d.10
FAIL
22.96
ncf_16_32_8_d.5
FAIL
23.02
ncf_16_32_4_u.4
FAIL
23.02
ncf_4_16_8_euad.5
FAIL
23.06
ncf_16_32_8_euad.10
FAIL
23.08
ncf_16_32_2_d.5
FAIL
23.09
ncf_16_32_2_u.3
FAIL
23.11
ncf_4_16_8_d.1
FAIL
23.19
ncf_4_16_4_d.4
FAIL
23.21
ncf_16_32_8_euad.9
FAIL
23.21
ncf_4_8_4_u.3
FAIL
23.3
ncf_16_32_8_euad.8
FAIL
23.34
ncf_16_32_8_d.1
FAIL
23.39
ncf_4_16_4_u.3
FAIL
23.4
ncf_16_32_4_euad.7
FAIL
23.41
ncf_16_32_8_euad.5
FAIL
23.46
ncf_8_16_8_d.5
FAIL
23.51
ncf_16_32_4_edau.8
FAIL
23.78
ncf_8_16_8_euad.4
FAIL
23.79
ncf_4_16_2_euad.1
FAIL
23.8
ncf_16_32_2_euad.10
FAIL
23.84
ncf_4_16_8_d.3
FAIL
23.88
ncf_4_8_4_u.7
FAIL
23.96
ncf_4_16_8_d.8
FAIL
24.14
ncf_4_16_2_euad.3
FAIL
24.23
ncf_16_32_8_d.7
FAIL
24.26
ncf_16_32_8_euad.6
FAIL
24.34
ncf_16_32_8_edau.6
FAIL
24.36
ncf_8_16_4_edau.4
FAIL
24.42
ncf_4_32_2_edau.6
FAIL
24.47
ncf_16_32_8_d.2
FAIL
24.55
ncf_4_16_2_d.1
FAIL
24.57
ncf_8_16_8_euad.5
FAIL
24.58
ncf_16_32_4_d.2
FAIL
24.65
ncf_16_32_2_edau.1
FAIL
24.88
ncf_8_16_4_u.6
FAIL
24.91
ncf_8_16_8_edau.3
FAIL
24.93
ncf_4_16_2_u.1
FAIL
24.98
ncf_4_8_4_euad.7
FAIL
25.36
ncf_4_16_8_euad.2
FAIL
25.55
ncf_4_16_4_edau.2
FAIL
25.61
ncf_8_16_8_d.3
FAIL
25.62
ncf_4_16_8_u.10
FAIL
25.64
ncf_16_32_8_euad.1
FAIL
25.95
ncf_4_16_8_d.2
FAIL
26.03
ncf_4_16_2_u.10
FAIL
26.17
ncf_16_32_4_d.8
FAIL
26.21
ncf_4_16_8_euad.3
FAIL
26.34
ncf_16_32_4_edau.5
FAIL
26.5
ncf_4_16_8_euad.8
FAIL
26.65
ncf_4_8_4_euad.4
FAIL
27
ncf_8_16_8_edau.8
FAIL
27.09
ncf_4_16_2_u.3
FAIL
27.5
ncf_16_32_2_d.8
FAIL
27.92
ncf_4_16_2_edau.10
FAIL
28.14
ncf_8_16_8_euad.8
FAIL
28.59
ncf_4_16_8_d.4
FAIL
28.7
ncf_8_16_8_d.8
FAIL
29.14
ncf_4_8_8_euad.2
FAIL
29.33
ncf_4_16_2_euad.10
FAIL
29.4
ncf_4_16_2_u.8
FAIL
29.87
ncf_4_16_2_euad.8
FAIL
30.84
ncf_4_8_4_u.1
FAIL
30.88
ncf_16_32_8_d.3
FAIL
31.06
ncf_4_8_8_u.5
FAIL
32.15
ncf_4_16_8_euad.4
FAIL
32.17
ncf_8_16_8_d.6
FAIL
32.63
ncf_4_16_2_d.8
FAIL
32.75
ncf_16_32_2_u.7
UNSAT
33.03
ncf_8_16_8_d.7
FAIL
33.69
ncf_8_16_4_edau.9
FAIL
34.07
ncf_16_32_4_euad.5
FAIL
34.32
ncf_4_8_4_u.4
FAIL
34.35
ncf_4_16_2_d.10
FAIL
36.72
ncf_16_32_2_edau.3
FAIL
39.67
ncf_16_32_2_d.3
FAIL
39.96
ncf_4_8_8_euad.1
SAT
40.58
ncf_4_32_2_u.1
FAIL
42.61
ncf_4_8_8_euad.4
FAIL
48.62
ncf_4_8_8_d.2
FAIL
52.28
ncf_16_32_8_d.6
FAIL
56.54
ncf_8_16_8_euad.6
FAIL
62.08
ncf_4_32_2_u.9
FAIL
63.01
ncf_4_8_8_euad.5
FAIL
95.2
ncf_4_8_8_d.4
FAIL
188.53
ncf_4_16_2_u.7
SAT
232.99
ncf_4_32_2_edau.2
SAT
253.13
ncf_4_8_2_euad.3
FAIL
302.75
ncf_4_16_2_euad.7
SAT
700.15
ncf_4_16_8_d.7
FAIL
868.72
Contact
|
Organization
|
Links
|
Citing QBFLIB