QBF Solver Evaluation Portal
Home
QBFLIB
QBFGALLERY'23
QBFEVALs
2022
2020
2019
2018
2017
2016
2010
2008
2007
2006
2005
2004
QBF GALLERIES
QBF Gallery 2014
QBF Gallery 2013
DOWNLOADS
Download the QBFEVAL'22 dataset
Download the QBFEVAL'20 dataset
Download the QBFEVAL'19 dataset and raw results
Download the QBFEVAL'18 dataset and raw results
Download the QBFEVAL'17 dataset and raw results
Download the QBFEVAL'16 dataset
Download the QBFEVAL'10 dataset
Download the QBFEVAL'08 dataset
Download the non-prenex non-cnf track dataset
Download the QBFEVAL'07 dataset
Download the QBFEVAL'06 dataset
Download the QDIMACS to QPRO converter
Download the QDIMACS to QBF1.0 converter
qbflib.org
Instances of family CounterFactual solved by
QUANTOR_hc
QBFEVAL'06
Instance
Result
Time
ncf_4_8_4_euad.5
SAT
0
ncf_4_16_4_edau.5
SAT
0
ncf_8_16_4_d.5
UNSAT
0
ncf_4_16_2_d.2
SAT
0
ncf_4_16_2_edau.6
SAT
0
ncf_4_8_2_u.10
SAT
0
ncf_4_16_2_euad.6
FAIL
0
ncf_4_8_2_euad.8
SAT
0
ncf_8_16_4_edau.5
UNSAT
0
ncf_16_32_2_euad.9
UNSAT
0
ncf_8_16_4_euad.5
UNSAT
0
ncf_4_16_2_euad.9
SAT
0
ncf_4_8_2_euad.4
UNSAT
0
ncf_4_16_4_d.1
SAT
0
ncf_4_16_2_edau.4
SAT
0
ncf_16_32_2_edau.9
UNSAT
0
ncf_8_16_4_d.1
SAT
0
ncf_4_8_2_u.1
UNSAT
0
ncf_8_16_4_d.10
SAT
0
ncf_4_8_4_euad.2
UNSAT
0
ncf_4_16_2_edau.2
SAT
0
ncf_4_8_2_euad.10
FAIL
0
ncf_4_16_2_d.9
SAT
0
ncf_16_32_2_edau.6
SAT
0
ncf_8_16_4_edau.2
UNSAT
0
ncf_4_8_2_euad.5
FAIL
0
ncf_4_8_2_euad.1
UNSAT
0
ncf_4_8_4_u.5
SAT
0.01
ncf_4_16_4_edau.8
SAT
0.01
ncf_4_8_8_d.9
UNSAT
0.01
ncf_4_16_2_u.9
SAT
0.01
ncf_4_8_2_u.4
UNSAT
0.01
ncf_4_16_4_u.8
SAT
0.01
ncf_4_8_2_u.7
UNSAT
0.01
ncf_4_8_4_euad.9
SAT
0.01
ncf_8_16_4_d.8
UNSAT
0.01
ncf_8_16_4_edau.10
SAT
0.01
ncf_4_16_4_d.5
SAT
0.01
ncf_8_16_4_d.6
UNSAT
0.01
ncf_4_16_2_d.6
SAT
0.01
ncf_4_8_8_euad.9
UNSAT
0.01
ncf_4_8_2_u.8
SAT
0.01
ncf_16_32_2_d.9
UNSAT
0.01
ncf_4_16_2_u.6
FAIL
0.01
ncf_4_16_4_d.8
SAT
0.01
ncf_4_16_4_euad.1
SAT
0.01
ncf_8_16_4_u.2
UNSAT
0.01
ncf_4_8_2_u.9
SAT
0.01
ncf_4_8_2_euad.6
SAT
0.01
ncf_8_16_4_u.5
UNSAT
0.01
ncf_4_16_2_d.4
SAT
0.01
ncf_16_32_2_u.9
UNSAT
0.01
ncf_4_16_4_euad.8
SAT
0.01
ncf_4_8_4_u.2
UNSAT
0.01
ncf_8_16_4_edau.1
SAT
0.01
ncf_4_16_2_edau.9
SAT
0.01
ncf_8_16_4_u.1
SAT
0.01
ncf_8_16_4_edau.6
UNSAT
0.01
ncf_4_8_8_u.9
UNSAT
0.01
ncf_4_8_4_u.9
SAT
0.01
ncf_4_8_8_d.8
SAT
0.02
ncf_4_8_2_euad.7
UNSAT
0.02
ncf_4_8_8_edau.8
SAT
0.02
ncf_16_32_4_edau.1
FAIL
0.02
ncf_4_8_2_u.6
SAT
0.02
ncf_4_16_4_u.5
FAIL
0.02
ncf_8_16_4_euad.1
SAT
0.02
ncf_4_16_4_euad.5
FAIL
0.02
ncf_4_8_8_edau.9
UNSAT
0.02
ncf_8_16_8_euad.1
SAT
0.02
ncf_4_16_2_u.4
SAT
0.02
ncf_8_16_8_edau.1
SAT
0.02
ncf_8_16_4_euad.2
UNSAT
0.02
ncf_4_16_4_u.1
SAT
0.02
ncf_16_32_4_edau.9
SAT
0.02
ncf_16_32_4_d.9
SAT
0.02
ncf_8_16_4_d.2
UNSAT
0.02
ncf_16_32_2_d.6
SAT
0.02
ncf_4_8_2_u.5
FAIL
0.02
ncf_4_8_8_edau.5
UNSAT
0.02
ncf_8_16_4_edau.8
UNSAT
0.02
ncf_4_8_2_euad.9
SAT
0.02
ncf_4_16_4_edau.1
SAT
0.02
ncf_16_32_4_d.10
UNSAT
0.03
ncf_8_16_8_d.1
SAT
0.03
ncf_4_16_2_euad.2
SAT
0.03
ncf_16_32_4_edau.10
UNSAT
0.04
ncf_4_8_8_d.5
UNSAT
0.04
ncf_16_32_2_d.7
UNSAT
0.04
ncf_16_32_4_d.1
FAIL
0.04
ncf_16_32_8_d.4
SAT
0.04
ncf_4_16_2_u.2
SAT
0.04
ncf_16_32_8_edau.4
SAT
0.05
ncf_16_32_4_d.7
UNSAT
0.05
ncf_4_16_2_euad.4
SAT
0.05
ncf_16_32_4_edau.7
UNSAT
0.05
ncf_4_32_2_edau.1
UNSAT
0.07
ncf_4_16_2_d.5
UNSAT
0.09
ncf_4_8_8_edau.1
SAT
0.1
ncf_4_8_8_d.3
SAT
0.12
ncf_4_16_2_d.7
SAT
0.15
ncf_4_16_4_d.9
SAT
0.16
ncf_4_16_2_edau.5
UNSAT
0.17
ncf_4_8_8_edau.3
SAT
0.18
ncf_4_8_8_u.3
SAT
0.25
ncf_4_8_8_u.1
SAT
0.26
ncf_4_8_8_d.1
SAT
0.37
ncf_4_16_2_edau.7
SAT
0.37
ncf_4_8_2_u.2
SAT
0.4
ncf_4_8_8_euad.3
SAT
0.59
ncf_4_8_2_euad.2
SAT
0.96
ncf_4_16_4_edau.9
SAT
1.09
ncf_4_8_4_u.8
UNSAT
1.1
ncf_16_32_2_euad.7
UNSAT
1.41
ncf_4_16_4_euad.9
SAT
1.72
ncf_4_8_4_u.6
SAT
1.97
ncf_4_16_4_u.9
SAT
2.69
ncf_16_32_2_edau.7
UNSAT
2.85
ncf_4_8_4_u.10
SAT
3.43
ncf_4_8_4_euad.6
SAT
4.05
ncf_4_8_4_euad.10
SAT
4.81
ncf_8_16_8_edau.6
UNSAT
7.76
ncf_8_16_4_edau.7
FAIL
13.8
ncf_8_16_4_u.7
FAIL
15.82
ncf_4_32_2_edau.3
FAIL
16.25
ncf_4_16_2_u.5
FAIL
16.26
ncf_4_8_4_euad.8
UNSAT
16.48
ncf_8_16_4_d.7
FAIL
16.5
ncf_4_8_8_u.7
FAIL
16.69
ncf_4_32_2_u.6
FAIL
16.98
ncf_4_16_8_u.6
FAIL
16.98
ncf_8_16_4_d.3
FAIL
17
ncf_4_16_8_u.1
FAIL
17.09
ncf_4_16_4_edau.3
FAIL
17.12
ncf_4_16_4_u.6
FAIL
17.15
ncf_8_16_8_edau.2
FAIL
17.21
ncf_4_16_8_u.3
FAIL
17.26
ncf_4_8_8_u.2
FAIL
17.27
ncf_4_32_2_edau.7
FAIL
17.43
ncf_4_16_8_u.4
FAIL
17.44
ncf_4_16_8_u.9
FAIL
17.47
ncf_4_16_4_u.2
FAIL
17.54
ncf_4_32_2_edau.10
FAIL
17.54
ncf_16_32_2_edau.2
FAIL
17.55
ncf_4_8_8_edau.10
FAIL
17.57
ncf_4_16_4_u.4
FAIL
17.61
ncf_16_32_8_euad.3
FAIL
17.65
ncf_8_16_4_u.3
FAIL
17.66
ncf_4_16_4_edau.4
FAIL
17.81
ncf_4_32_2_edau.9
FAIL
17.81
ncf_16_32_8_u.10
FAIL
17.85
ncf_4_16_8_euad.1
FAIL
17.87
ncf_4_32_2_edau.5
FAIL
17.88
ncf_4_16_4_euad.4
FAIL
17.88
ncf_4_16_2_edau.3
FAIL
17.94
ncf_4_32_2_u.2
FAIL
17.97
ncf_4_8_8_u.10
FAIL
17.98
ncf_16_32_4_d.6
FAIL
18.01
ncf_8_16_4_u.4
FAIL
18.07
ncf_4_16_4_d.10
FAIL
18.07
ncf_16_32_4_u.9
FAIL
18.08
ncf_8_16_8_d.4
FAIL
18.09
ncf_4_8_8_edau.7
FAIL
18.1
ncf_16_32_8_u.3
FAIL
18.11
ncf_4_32_2_u.10
FAIL
18.12
ncf_16_32_4_edau.6
FAIL
18.13
ncf_8_16_4_u.9
FAIL
18.19
ncf_4_16_4_euad.2
FAIL
18.19
ncf_16_32_4_edau.3
FAIL
18.25
ncf_4_32_2_u.8
FAIL
18.25
ncf_4_8_8_edau.2
FAIL
18.27
ncf_16_32_8_u.5
FAIL
18.29
ncf_4_16_8_u.2
FAIL
18.3
ncf_8_16_4_euad.7
FAIL
18.33
ncf_16_32_2_u.2
FAIL
18.35
ncf_8_16_8_euad.9
FAIL
18.35
ncf_4_32_2_edau.8
FAIL
18.37
ncf_4_16_8_u.8
FAIL
18.38
ncf_16_32_2_d.4
FAIL
18.4
ncf_8_16_4_u.10
FAIL
18.44
ncf_16_32_8_u.6
FAIL
18.46
ncf_4_8_4_euad.3
FAIL
18.52
ncf_4_32_2_u.5
FAIL
18.54
ncf_16_32_8_edau.2
FAIL
18.6
ncf_4_16_8_d.9
FAIL
18.6
ncf_4_32_2_edau.4
FAIL
18.62
ncf_8_16_4_euad.4
FAIL
18.65
ncf_16_32_8_u.4
FAIL
18.7
ncf_4_8_4_euad.1
FAIL
18.72
ncf_4_16_8_euad.9
FAIL
18.74
ncf_8_16_4_euad.3
FAIL
18.74
ncf_4_16_4_edau.6
FAIL
18.74
ncf_4_32_2_u.3
FAIL
18.75
ncf_16_32_8_edau.8
FAIL
18.77
ncf_16_32_4_u.1
FAIL
18.78
ncf_16_32_2_euad.8
FAIL
18.78
ncf_16_32_4_euad.9
FAIL
18.87
ncf_4_16_4_euad.6
FAIL
18.93
ncf_4_8_8_u.6
FAIL
18.97
ncf_4_16_2_euad.5
FAIL
19.03
ncf_4_16_8_euad.6
FAIL
19.03
ncf_16_32_8_u.9
FAIL
19.06
ncf_4_8_8_d.10
FAIL
19.08
ncf_16_32_4_u.2
FAIL
19.08
ncf_16_32_4_d.5
FAIL
19.11
ncf_16_32_8_u.1
FAIL
19.11
ncf_16_32_4_euad.8
FAIL
19.13
ncf_4_16_4_d.4
FAIL
19.16
ncf_16_32_4_euad.4
FAIL
19.17
ncf_4_16_8_euad.7
FAIL
19.28
ncf_4_16_8_u.5
FAIL
19.29
ncf_4_16_2_d.3
FAIL
19.29
ncf_16_32_4_u.8
FAIL
19.3
ncf_4_8_8_u.8
FAIL
19.3
ncf_16_32_4_u.10
FAIL
19.31
ncf_16_32_4_u.3
FAIL
19.31
ncf_4_16_4_edau.7
FAIL
19.33
ncf_16_32_8_edau.9
FAIL
19.34
ncf_16_32_8_u.7
FAIL
19.36
ncf_4_8_8_d.7
FAIL
19.37
ncf_16_32_2_u.10
FAIL
19.37
ncf_16_32_8_u.8
FAIL
19.4
ncf_16_32_4_d.4
FAIL
19.41
ncf_16_32_2_d.1
FAIL
19.46
ncf_8_16_4_d.9
FAIL
19.48
ncf_16_32_4_euad.2
FAIL
19.49
ncf_4_16_4_euad.10
FAIL
19.53
ncf_16_32_8_edau.7
FAIL
19.59
ncf_16_32_2_u.4
FAIL
19.63
ncf_16_32_2_d.2
FAIL
19.67
ncf_16_32_4_u.7
FAIL
19.67
ncf_16_32_8_u.2
FAIL
19.68
ncf_16_32_4_u.5
FAIL
19.74
ncf_4_16_8_d.6
FAIL
19.74
ncf_4_16_4_euad.3
FAIL
19.75
ncf_4_8_8_d.6
FAIL
19.77
ncf_16_32_2_u.5
FAIL
19.79
ncf_16_32_4_edau.2
FAIL
19.81
ncf_4_16_8_d.10
FAIL
19.85
ncf_16_32_2_edau.4
FAIL
19.86
ncf_8_16_8_euad.2
FAIL
19.87
ncf_4_16_4_edau.10
FAIL
19.89
ncf_4_32_2_u.4
FAIL
19.89
ncf_8_16_8_edau.9
FAIL
19.92
ncf_8_16_4_euad.8
FAIL
19.94
ncf_4_32_2_u.7
FAIL
19.97
ncf_16_32_2_u.1
FAIL
20.04
ncf_16_32_2_u.6
FAIL
20.04
ncf_4_16_4_u.7
FAIL
20.05
ncf_16_32_4_d.3
FAIL
20.11
ncf_16_32_2_euad.3
FAIL
20.12
ncf_4_16_4_euad.7
FAIL
20.27
ncf_8_16_4_euad.10
FAIL
20.3
ncf_4_8_8_euad.7
FAIL
20.34
ncf_16_32_4_euad.10
FAIL
20.36
ncf_16_32_4_euad.3
FAIL
20.36
ncf_16_32_2_euad.6
FAIL
20.38
ncf_8_16_4_edau.3
FAIL
20.4
ncf_4_16_8_euad.10
FAIL
20.4
ncf_16_32_8_euad.4
FAIL
20.6
ncf_4_16_4_d.6
FAIL
20.61
ncf_4_16_8_euad.3
FAIL
20.63
ncf_16_32_2_euad.2
FAIL
20.64
ncf_16_32_2_euad.1
FAIL
20.64
ncf_16_32_8_edau.1
FAIL
20.64
ncf_4_16_2_edau.8
FAIL
20.66
ncf_16_32_8_d.9
FAIL
20.74
ncf_8_16_8_d.2
FAIL
20.75
ncf_4_16_4_d.2
FAIL
20.77
ncf_8_16_8_edau.10
FAIL
20.82
ncf_16_32_2_u.3
FAIL
20.9
ncf_4_16_8_u.7
FAIL
20.94
ncf_16_32_4_u.6
FAIL
20.98
ncf_8_16_8_edau.4
FAIL
21.02
ncf_8_16_4_u.8
FAIL
21.03
ncf_8_16_4_euad.9
FAIL
21.13
ncf_8_16_8_d.10
FAIL
21.15
ncf_16_32_2_euad.4
FAIL
21.19
ncf_16_32_8_d.8
FAIL
21.23
ncf_4_8_8_edau.4
FAIL
21.24
ncf_4_16_2_edau.1
FAIL
21.33
ncf_8_16_8_edau.7
FAIL
21.33
ncf_4_8_8_u.4
FAIL
21.35
ncf_16_32_8_edau.3
FAIL
21.37
ncf_16_32_4_euad.1
FAIL
21.37
ncf_8_16_8_d.9
FAIL
21.4
ncf_16_32_4_edau.4
FAIL
21.45
ncf_8_16_8_edau.5
FAIL
21.61
ncf_16_32_4_u.4
FAIL
21.62
ncf_16_32_8_edau.5
FAIL
21.69
ncf_16_32_8_euad.10
FAIL
21.81
ncf_4_8_8_euad.10
FAIL
21.84
ncf_16_32_8_euad.7
FAIL
21.84
ncf_4_16_4_u.10
FAIL
21.95
ncf_16_32_4_euad.6
FAIL
22.01
ncf_16_32_2_edau.8
FAIL
22.04
ncf_4_8_2_u.3
FAIL
22.12
ncf_16_32_4_euad.7
FAIL
22.18
ncf_16_32_2_euad.5
FAIL
22.27
ncf_4_8_8_edau.6
FAIL
22.31
ncf_8_16_8_euad.3
FAIL
22.32
ncf_16_32_2_euad.10
FAIL
22.35
ncf_16_32_8_d.5
FAIL
22.38
ncf_16_32_8_euad.2
FAIL
22.47
ncf_16_32_2_edau.5
FAIL
22.47
ncf_4_16_4_u.3
FAIL
22.48
ncf_8_16_8_euad.10
FAIL
22.55
ncf_8_16_8_euad.7
FAIL
22.72
ncf_4_16_4_d.3
FAIL
22.74
ncf_16_32_8_edau.10
FAIL
22.75
ncf_16_32_2_d.5
FAIL
22.83
ncf_16_32_8_euad.5
FAIL
22.85
ncf_4_16_8_d.1
FAIL
22.88
ncf_8_16_4_d.4
FAIL
22.89
ncf_16_32_2_edau.1
FAIL
22.91
ncf_8_16_4_euad.6
FAIL
22.99
ncf_4_16_8_d.5
FAIL
23.01
ncf_4_16_2_d.1
FAIL
23.08
ncf_4_16_4_d.7
FAIL
23.08
ncf_16_32_2_u.8
FAIL
23.09
ncf_4_8_8_euad.8
FAIL
23.17
ncf_4_16_8_euad.5
FAIL
23.31
ncf_4_8_8_euad.6
FAIL
23.34
ncf_4_16_2_euad.1
FAIL
23.43
ncf_4_8_4_u.3
FAIL
23.52
ncf_16_32_8_euad.9
FAIL
23.53
ncf_16_32_8_d.2
FAIL
23.57
ncf_16_32_8_edau.6
FAIL
23.64
ncf_4_16_8_d.8
FAIL
23.66
ncf_4_8_4_u.7
FAIL
23.69
ncf_16_32_2_d.10
FAIL
23.71
ncf_16_32_8_euad.8
FAIL
23.72
ncf_8_16_8_d.5
FAIL
23.95
ncf_16_32_4_d.2
FAIL
24.09
ncf_16_32_8_d.10
FAIL
24.1
ncf_16_32_2_edau.10
FAIL
24.12
ncf_4_32_2_edau.6
FAIL
24.17
ncf_16_32_4_edau.8
FAIL
24.18
ncf_16_32_8_euad.6
FAIL
24.25
ncf_8_16_8_euad.5
FAIL
24.28
ncf_16_32_8_d.7
FAIL
24.29
ncf_4_16_8_d.3
FAIL
24.46
ncf_16_32_4_euad.5
FAIL
24.52
ncf_8_16_8_euad.4
FAIL
24.53
ncf_16_32_8_d.1
FAIL
24.54
ncf_8_16_4_edau.4
FAIL
24.57
ncf_16_32_2_d.8
FAIL
24.65
ncf_8_16_8_edau.3
FAIL
24.81
ncf_4_16_2_u.1
FAIL
25.11
ncf_4_16_2_euad.3
FAIL
25.12
ncf_4_16_8_u.10
FAIL
25.16
ncf_4_16_4_edau.2
FAIL
25.37
ncf_8_16_8_d.3
FAIL
25.38
ncf_4_8_4_euad.7
FAIL
25.58
ncf_4_16_2_u.10
FAIL
25.67
ncf_16_32_8_euad.1
FAIL
25.85
ncf_8_16_4_u.6
FAIL
26.06
ncf_16_32_4_edau.5
FAIL
26.49
ncf_16_32_4_d.8
FAIL
26.61
ncf_4_8_4_euad.4
FAIL
26.81
ncf_4_16_8_d.2
FAIL
26.83
ncf_4_16_8_euad.2
FAIL
26.85
ncf_8_16_8_d.7
FAIL
27.42
ncf_4_16_8_euad.8
FAIL
27.44
ncf_8_16_8_edau.8
FAIL
27.53
ncf_4_16_2_u.3
FAIL
28
ncf_8_16_8_d.8
FAIL
28.35
ncf_4_16_8_d.4
FAIL
28.48
ncf_4_16_2_euad.10
FAIL
28.54
ncf_4_16_2_edau.10
FAIL
28.56
ncf_4_8_8_euad.2
FAIL
29.06
ncf_8_16_8_euad.8
FAIL
29.08
ncf_4_16_2_u.8
FAIL
30.28
ncf_4_8_4_u.1
FAIL
31.5
ncf_16_32_8_d.3
FAIL
31.73
ncf_4_8_8_u.5
FAIL
31.9
ncf_8_16_8_d.6
FAIL
32.18
ncf_16_32_2_u.7
UNSAT
32.94
ncf_8_16_4_edau.9
FAIL
33
ncf_4_16_8_euad.4
FAIL
33.44
ncf_4_16_2_euad.8
FAIL
33.67
ncf_4_16_2_d.8
FAIL
34.75
ncf_4_8_8_euad.4
FAIL
35.38
ncf_4_8_4_u.4
FAIL
36.13
ncf_4_16_2_d.10
FAIL
37.03
ncf_16_32_2_d.3
FAIL
37.59
ncf_16_32_2_edau.3
FAIL
40.6
ncf_4_8_8_euad.1
SAT
40.89
ncf_4_32_2_u.1
FAIL
42.61
ncf_16_32_8_d.6
FAIL
50.62
ncf_4_8_8_d.2
FAIL
53.72
ncf_8_16_8_euad.6
FAIL
57.83
ncf_4_32_2_u.9
FAIL
63.51
ncf_4_8_8_euad.5
FAIL
92.65
ncf_4_8_8_d.4
FAIL
188.05
ncf_4_16_2_u.7
SAT
234.32
ncf_4_32_2_edau.2
SAT
248.02
ncf_4_8_2_euad.3
FAIL
297.64
ncf_4_16_2_euad.7
FAIL
600.29
ncf_4_16_8_d.7
FAIL
600.34
Contact
|
Organization
|
Links
|
Citing QBFLIB