Mixed-integer derivative-free optimization comparison table

This page is part of the Comparison of mixed-integer derivative-free optimization algorithms by Nikolaos Ploskas and Nikolaos V. Sahinidis

Complete list of test problems and model statistics

  problem size type variables solution
1 4stufen small pure-integer, non-binary 6 3.271227e+03
2 alan small pure-integer, non-binary 3 0.000000e+00
3 arki0003 large pure-integer, non-binary 62 -1.315841e+05
4 arki0015 large pure-integer, non-binary 253 -7.738940e+04
5 autocorr_bern20-03 medium pure-integer, binary 20 -7.200000e+01
6 autocorr_bern20-05 medium pure-integer, binary 20 -4.160000e+02
7 autocorr_bern20-10 medium pure-integer, binary 20 -2.936000e+03
8 autocorr_bern20-15 medium pure-integer, binary 20 -5.960000e+03
9 autocorr_bern25-03 medium pure-integer, binary 25 -9.200000e+01
10 autocorr_bern25-06 medium pure-integer, binary 25 -9.600000e+02
11 autocorr_bern25-13 medium pure-integer, binary 25 -8.148000e+03
12 autocorr_bern30-04 medium pure-integer, binary 30 -3.240000e+02
13 autocorr_bern30-08 medium pure-integer, binary 30 -2.952000e+03
14 autocorr_bern35-04 medium pure-integer, binary 35 -3.840000e+02
15 autocorr_bern40-05 medium pure-integer, binary 40 -9.360000e+02
16 batch0812 medium pure-integer, non-binary 24 2.269091e+05
17 batchs101006m medium pure-integer, non-binary 39 1.079420e+05
18 bayes2_10 medium pure-integer, non-binary 20 0.000000e+00
19 bayes2_30 medium pure-integer, non-binary 20 0.000000e+00
20 bayes2_50 medium pure-integer, non-binary 20 0.000000e+00
21 blend029 large mixed-integer 72 -1.421100e+02
22 blend146 large mixed-integer 174 -2.921100e+02
23 blend480 large mixed-integer 248 -1.300000e+02
24 blend531 large mixed-integer 208 -1.630800e+02
25 blend718 large mixed-integer 174 -2.297700e+02
26 blend721 large mixed-integer 174 -1.216500e+02
27 blend852 large mixed-integer 240 -3.890400e+02
28 cardqp_inlp medium pure-integer, binary 50 0.000000e+00
29 cardqp_iqp medium pure-integer, binary 50 0.000000e+00
30 carton9 medium pure-integer, binary 32 0.000000e+00
31 chp_shorttermplan1b medium pure-integer, non-binary 48 -8.100000e+01
32 chp_shorttermplan2b medium pure-integer, non-binary 48 -4.800000e+05
33 clay0203h small pure-integer, non-binary 6 0.000000e+00
34 clay0204hfsg medium pure-integer, non-binary 12 0.000000e+00
35 clay0205m medium pure-integer, non-binary 20 0.000000e+00
36 clay0303h small pure-integer, non-binary 6 0.000000e+00
37 crossdock_15x7 large pure-integer, binary 210 0.000000e+00
38 crossdock_15x8 large pure-integer, binary 240 0.000000e+00
39 crudeoil_lee1_05 medium pure-integer, non-binary 40 0.000000e+00
40 crudeoil_lee1_07 large pure-integer, non-binary 56 0.000000e+00
41 crudeoil_lee1_09 large pure-integer, non-binary 72 0.000000e+00
42 crudeoil_lee3_06 large pure-integer, non-binary 168 0.000000e+00
43 crudeoil_li05 large pure-integer, binary 153 -2.606000e+04
44 crudeoil_li21 large pure-integer, binary 160 -1.001100e+05
45 deb10 medium mixed-integer 33 0.000000e+00
46 deb6 medium mixed-integer 40 0.000000e+00
47 dispatch small pure-integer, non-binary 3 2.157856e+03
48 dosemin2d large pure-integer, non-binary 117 -1.700000e+02
49 edgecross10-010 medium pure-integer, binary 29 1.000000e+00
50 edgecross10-020 large pure-integer, binary 66 1.100000e+01
51 edgecross10-030 large pure-integer, binary 89 5.200000e+01
52 edgecross10-040 large pure-integer, binary 90 1.420000e+02
53 edgecross10-050 large pure-integer, binary 90 2.760000e+02
54 edgecross10-060 large mixed-integer 90 4.590000e+02
55 edgecross10-070 large pure-integer, binary 90 7.170000e+02
56 edgecross10-080 large mixed-integer 90 1.037000e+03
57 edgecross10-090 large pure-integer, binary 90 1.387000e+03
58 edgecross14-019 large pure-integer, binary 97 4.000000e+00
59 edgecross14-039 large mixed-integer 157 1.090000e+02
60 edgecross14-058 large pure-integer, binary 157 3.530000e+02
61 edgecross14-176 large pure-integer, binary 173 5.875000e+03
62 edgecross20-040 large pure-integer, binary 306 5.700000e+01
63 edgecross22-048 large pure-integer, binary 381 8.400000e+01
64 elf medium pure-integer, non-binary 24 0.000000e+00
65 emfl050_5_5 large pure-integer, non-binary 470 0.000000e+00
66 emfl100_3_3 large pure-integer, non-binary 316 0.000000e+00
67 enpro48pb medium pure-integer, binary 25 1.329180e+05
68 enpro56pb medium pure-integer, binary 19 5.672473e+04
69 eq6_1 medium pure-integer, non-binary 16 0.000000e+00
70 etamac small pure-integer, non-binary 9 -6.940842e+01
71 ex1221 small mixed-integer 5 -5.000000e-01
72 ex1222 small mixed-integer 2 1.000000e-01
73 ex1223a small mixed-integer 7 3.068528e-01
74 ex1223b small mixed-integer 7 3.068528e-01
75 ex1233 medium mixed-integer 40 0.000000e+00
76 ex1243 large mixed-integer 52 0.000000e+00
77 ex1244 large mixed-integer 75 0.000000e+00
78 ex1252 medium pure-integer, binary 12 0.000000e+00
79 ex1252a medium mixed-integer 12 0.000000e+00
80 ex1263 small mixed-integer 8 0.000000e+00
81 ex1263a small pure-integer, binary 8 0.000000e+00
82 ex1264 small mixed-integer 8 0.000000e+00
83 ex1264a small pure-integer, binary 8 0.000000e+00
84 ex1265 small mixed-integer 10 0.000000e+00
85 ex1265a small pure-integer, binary 10 0.000000e+00
86 ex1266 medium mixed-integer 11 0.000000e+00
87 ex1266a medium pure-integer, binary 12 0.000000e+00
88 ex2_1_3 medium pure-integer, binary 13 -3.000600e+04
89 ex2_1_8 medium pure-integer, non-binary 24 -1.212000e+06
90 ex3pb medium mixed-integer 22 -2.061300e+04
91 ex4 medium mixed-integer 36 -2.130000e+01
92 ex8_4_2 medium pure-integer, binary 20 0.000000e+00
93 fac1 medium mixed-integer 18 0.000000e+00
94 fac2 large mixed-integer 57 0.000000e+00
95 fac3 large mixed-integer 57 0.000000e+00
96 faclay20h large pure-integer, binary 190 1.554900e+04
97 fin2bb medium pure-integer, non-binary 21 0.000000e+00
98 fo7_ar2_1 medium pure-integer, non-binary 12 -1.200000e+05
99 fo9 medium pure-integer, non-binary 16 -1.600000e+05
100 fo9_ar2_1 medium pure-integer, non-binary 16 -1.600000e+05
101 fo9_ar5_1 medium pure-integer, non-binary 16 -1.600000e+05
102 forest small pure-integer, non-binary 6 -6.000000e+04
103 gams01 small pure-integer, non-binary 10 0.000000e+00
104 gasprod_sarawak01 medium mixed-integer 37 -1.448967e+05
105 gastrans small pure-integer, binary 5 5.412000e+01
106 gbd small mixed-integer 4 2.000000e-01
107 genpooling_lee1 medium mixed-integer 41 -3.156840e+04
108 genpooling_lee2 medium mixed-integer 41 -3.156840e+04
109 genpooling_meyer04 large mixed-integer 106 0.000000e+00
110 genpooling_meyer10 large mixed-integer 364 0.000000e+00
111 ghg_1veh medium mixed-integer 22 0.000000e+00
112 gkocis small mixed-integer 8 -1.100000e+01
113 graphpart_2g-0055-0062 large pure-integer, binary 75 -3.205074e+06
114 graphpart_2g-0066-0066 large pure-integer, binary 108 -6.782949e+06
115 graphpart_2g-0077-0077 large pure-integer, binary 147 -7.360455e+06
116 graphpart_2g-0088-0088 large pure-integer, binary 192 -1.519691e+07
117 graphpart_2g-0099-9211 large pure-integer, binary 243 -1.109237e+07
118 graphpart_2g-1010-0824 large pure-integer, binary 300 -1.601239e+07
119 graphpart_2pm-0044-0044 medium pure-integer, binary 48 -2.400000e+01
120 graphpart_2pm-0055-0055 large pure-integer, binary 75 -4.200000e+01
121 graphpart_2pm-0066-0066 large pure-integer, binary 108 -6.900000e+01
122 graphpart_2pm-0077-0777 large pure-integer, binary 147 -8.100000e+01
123 graphpart_2pm-0088-0888 large pure-integer, binary 192 -1.230000e+02
124 graphpart_2pm-0099-0999 large pure-integer, binary 243 -1.410000e+02
125 graphpart_3g-0234-0234 large pure-integer, binary 72 -4.418466e+06
126 graphpart_3g-0244-0244 large pure-integer, binary 96 -5.480655e+06
127 graphpart_3g-0333-0333 large pure-integer, binary 81 -4.097814e+06
128 graphpart_3g-0334-0334 large pure-integer, binary 108 -7.194828e+06
129 graphpart_3g-0344-0344 large pure-integer, binary 144 -1.327018e+07
130 graphpart_3g-0444-0444 large pure-integer, binary 192 -1.796690e+07
131 graphpart_3pm-0234-0234 large pure-integer, binary 72 -4.500000e+01
132 graphpart_3pm-0244-0244 large pure-integer, binary 96 -5.700000e+01
133 graphpart_3pm-0333-0333 large pure-integer, binary 81 -5.400000e+01
134 graphpart_3pm-0334-0334 large pure-integer, binary 108 -7.500000e+01
135 graphpart_3pm-0344-0344 large pure-integer, binary 144 -9.600000e+01
136 graphpart_3pm-0444-0444 large pure-integer, binary 192 -1.320000e+02
137 graphpart_clique-20 large pure-integer, binary 60 0.000000e+00
138 graphpart_clique-30 large pure-integer, binary 90 0.000000e+00
139 graphpart_clique-40 large pure-integer, binary 120 0.000000e+00
140 graphpart_clique-50 large pure-integer, binary 150 0.000000e+00
141 graphpart_clique-60 large pure-integer, binary 180 0.000000e+00
142 graphpart_clique-70 large pure-integer, binary 210 0.000000e+00
143 harker medium pure-integer, non-binary 20 -3.885250e+04
144 heatexch_gen1 medium mixed-integer 32 0.000000e+00
145 heatexch_gen2 medium mixed-integer 43 1.590013e+03
146 heatexch_spec1 medium mixed-integer 44 2.400070e-03
147 heatexch_spec2 large mixed-integer 58 6.329954e+00
148 heatexch_spec3 large mixed-integer 230 3.030207e+00
149 himmel16 small pure-integer, non-binary 6 -6.000000e+04
150 hmittelman medium pure-integer, binary 15 0.000000e+00
151 hvb11 medium pure-integer, non-binary 38 -1.638840e+09
152 hybriddynamic_fixed medium pure-integer, non-binary 11 1.111111e-01
153 hydroenergy1 large mixed-integer 96 -7.982468e+05
154 hydroenergy2 large mixed-integer 192 -1.260033e+06
155 immun small pure-integer, non-binary 6 5.649000e+09
156 inscribedsquare01 small pure-integer, non-binary 2 0.000000e+00
157 inscribedsquare02 small pure-integer, non-binary 2 0.000000e+00
158 lakes large pure-integer, non-binary 60 6.696919e+08
159 linear medium pure-integer, non-binary 20 0.000000e+00
160 meanvarxsc small pure-integer, non-binary 7 0.000000e+00
161 multiplants_stg1a large mixed-integer 182 -1.520050e+04
162 multiplants_stg1c large mixed-integer 203 -2.932440e+04
163 multiplants_stg5 large mixed-integer 185 -1.064194e+05
164 netmod_dol1 medium pure-integer, non-binary 12 -2.362205e+02
165 netmod_dol2 medium pure-integer, non-binary 12 -2.362205e+02
166 no7_ar4_1 medium pure-integer, non-binary 18 -4.000000e+05
167 nous1 medium mixed-integer 12 -1.717221e+00
168 nous2 medium mixed-integer 12 -1.717221e+00
169 o7_ar4_1 medium pure-integer, non-binary 20 -4.800000e+05
170 p_ball_10b_5p_3d_m medium pure-integer, non-binary 30 0.000000e+00
171 p_ball_20b_5p_2d_m medium pure-integer, non-binary 20 0.000000e+00
172 p_ball_30b_5p_2d_m medium pure-integer, non-binary 20 0.000000e+00
173 pooling_adhya2stp medium pure-integer, non-binary 19 -4.650000e+03
174 pooling_adhya2tp medium pure-integer, non-binary 19 -4.650000e+03
175 pooling_epa1 medium pure-integer, binary 14 -4.280000e+03
176 pooling_haverly3stp small pure-integer, non-binary 6 -3.500000e+03
177 popdynm100 large pure-integer, non-binary 184 3.322760e+05
178 powerflow0009r small pure-integer, non-binary 3 1.085000e+03
179 prob07 small pure-integer, non-binary 8 3.615817e+04
180 procsel small mixed-integer 9 -1.100000e+01
181 qap large pure-integer, binary 225 0.000000e+00
182 qp4 medium pure-integer, non-binary 29 0.000000e+00
183 ramsey medium pure-integer, non-binary 11 -1.749965e+02
184 routingdelay_bigm large pure-integer, non-binary 331 -9.201400e+04
185 sep1 small mixed-integer 10 -3.250000e+03
186 sporttournament06 medium pure-integer, binary 15 -1.200000e+01
187 sporttournament08 medium pure-integer, binary 28 -2.400000e+01
188 sporttournament10 medium pure-integer, binary 45 -4.400000e+01
189 sporttournament12 large pure-integer, binary 66 -6.800000e+01
190 sporttournament14 large mixed-integer 91 -9.600000e+01
191 sporttournament16 large pure-integer, binary 120 -1.300000e+02
192 sporttournament18 large pure-integer, binary 153 -1.600000e+02
193 sporttournament20 large pure-integer, binary 190 -1.920000e+02
194 sporttournament22 large pure-integer, binary 231 -2.340000e+02
195 spring small mixed-integer 3 4.179768e-02
196 squfl010-025 large mixed-integer 260 0.000000e+00
197 squfl010-040 large mixed-integer 410 0.000000e+00
198 sssd08-04 medium mixed-integer 48 0.000000e+00
199 sssd12-05 large mixed-integer 80 0.000000e+00
200 sssd15-04 large mixed-integer 76 0.000000e+00
201 sssd15-06 large mixed-integer 114 0.000000e+00
202 sssd15-08 large mixed-integer 152 0.000000e+00
203 sssd16-07 large mixed-integer 140 0.000000e+00
204 sssd18-06 large mixed-integer 132 0.000000e+00
205 sssd18-08 large mixed-integer 176 0.000000e+00
206 sssd20-04 large mixed-integer 96 0.000000e+00
207 sssd20-08 large mixed-integer 192 0.000000e+00
208 sssd22-08 large mixed-integer 208 0.000000e+00
209 sssd25-04 large mixed-integer 116 0.000000e+00
210 sssd25-08 large mixed-integer 232 0.000000e+00
211 st_bpv1 small pure-integer, non-binary 4 0.000000e+00
212 st_e13 small mixed-integer 2 0.000000e+00
213 st_e15 small mixed-integer 5 -5.000000e-01
214 st_e27 small mixed-integer 4 -2.500000e+01
215 st_e35 medium mixed-integer 23 0.000000e+00
216 st_e36 small mixed-integer 2 -3.045000e+02
217 st_e38 small mixed-integer 4 3.422675e+03
218 st_e40 small pure-integer, non-binary 3 4.414213e+00
219 st_miqp2 small pure-integer, binary 4 -1.200000e+01
220 st_miqp4 small mixed-integer 6 -6.254000e+03
221 st_test2 small pure-integer, binary 6 -1.025000e+01
222 st_test5 small pure-integer, binary 10 -2.900000e+02
223 st_test6 small pure-integer, binary 10 0.000000e+00
224 st_test8 medium pure-integer, non-binary 24 -4.706600e+04
225 st_testgr1 small pure-integer, non-binary 10 -1.479890e+01
226 st_testgr3 medium pure-integer, non-binary 20 -6.050025e+01
227 st_testph4 small pure-integer, non-binary 3 -8.750000e+01
228 supplychain medium mixed-integer 27 0.000000e+00
229 supplychainp1_020306 large mixed-integer 66 4.434034e+01
230 supplychainp1_030510 large mixed-integer 220 1.266562e+02
231 supplychainr1_020306 medium mixed-integer 36 4.931065e+04
232 supplychainr1_030510 large mixed-integer 85 1.256749e+05
233 synheat medium mixed-integer 44 2.400070e-03
234 synthes1 small mixed-integer 6 -2.904803e+00
235 synthes2 medium mixed-integer 11 -8.141086e+01
236 synthes3 medium mixed-integer 17 -2.023804e+02
237 tln12 medium pure-integer, binary 24 0.000000e+00
238 tln2 small pure-integer, binary 4 0.000000e+00
239 tln4 small pure-integer, binary 8 0.000000e+00
240 tln5 small pure-integer, binary 10 0.000000e+00
241 tln6 medium pure-integer, binary 12 0.000000e+00
242 tln7 medium pure-integer, binary 14 0.000000e+00
243 tloss medium pure-integer, binary 12 0.000000e+00
244 tls2 medium pure-integer, binary 17 0.000000e+00
245 tls4 medium pure-integer, binary 25 0.000000e+00
246 tls5 medium pure-integer, binary 31 0.000000e+00
247 tls6 large pure-integer, binary 53 0.000000e+00
248 tls7 large pure-integer, binary 72 0.000000e+00
249 tltr medium pure-integer, binary 11 0.000000e+00
250 transswitch2736spp large pure-integer, non-binary 66 -5.788540e+09
251 tspn05 medium mixed-integer 20 0.000000e+00
252 tspn08 medium mixed-integer 44 0.000000e+00
253 tspn10 large mixed-integer 65 0.000000e+00
254 tspn12 large mixed-integer 90 0.000000e+00
255 tspn15 large mixed-integer 135 0.000000e+00
256 util medium pure-integer, non-binary 17 0.000000e+00
257 wastewater12m2 small pure-integer, non-binary 10 0.000000e+00
258 waternd1 medium mixed-integer 43 3.200265e+05
259 waternd2 large mixed-integer 148 3.200423e+05
260 waternd_hanoi large pure-integer, binary 204 0.000000e+00
261 waternd_shamir large pure-integer, binary 112 0.000000e+00
262 waterno1_01 medium pure-integer, non-binary 12 0.000000e+00
263 waterno1_04 large pure-integer, binary 84 0.000000e+00
264 waterund17 medium pure-integer, non-binary 15 0.000000e+00
265 waterund36 medium pure-integer, non-binary 39 0.000000e+00
266 windfac small pure-integer, non-binary 2 0.000000e+00
267 worst medium pure-integer, non-binary 13 -1.079317e+09