Mixed-integer derivative-free optimization comparison table
This page is part of the Comparison of mixed-integer derivative-free optimization algorithms by Nikolaos Ploskas and Nikolaos V. Sahinidis
Complete list of test problems and model statistics
problem | size | type | variables | solution | |
---|---|---|---|---|---|
1 | 4stufen | small | pure-integer, non-binary | 6 | 3.271227e+03 |
2 | alan | small | pure-integer, non-binary | 3 | 0.000000e+00 |
3 | arki0003 | large | pure-integer, non-binary | 62 | -1.315841e+05 |
4 | arki0015 | large | pure-integer, non-binary | 253 | -7.738940e+04 |
5 | autocorr_bern20-03 | medium | pure-integer, binary | 20 | -7.200000e+01 |
6 | autocorr_bern20-05 | medium | pure-integer, binary | 20 | -4.160000e+02 |
7 | autocorr_bern20-10 | medium | pure-integer, binary | 20 | -2.936000e+03 |
8 | autocorr_bern20-15 | medium | pure-integer, binary | 20 | -5.960000e+03 |
9 | autocorr_bern25-03 | medium | pure-integer, binary | 25 | -9.200000e+01 |
10 | autocorr_bern25-06 | medium | pure-integer, binary | 25 | -9.600000e+02 |
11 | autocorr_bern25-13 | medium | pure-integer, binary | 25 | -8.148000e+03 |
12 | autocorr_bern30-04 | medium | pure-integer, binary | 30 | -3.240000e+02 |
13 | autocorr_bern30-08 | medium | pure-integer, binary | 30 | -2.952000e+03 |
14 | autocorr_bern35-04 | medium | pure-integer, binary | 35 | -3.840000e+02 |
15 | autocorr_bern40-05 | medium | pure-integer, binary | 40 | -9.360000e+02 |
16 | batch0812 | medium | pure-integer, non-binary | 24 | 2.269091e+05 |
17 | batchs101006m | medium | pure-integer, non-binary | 39 | 1.079420e+05 |
18 | bayes2_10 | medium | pure-integer, non-binary | 20 | 0.000000e+00 |
19 | bayes2_30 | medium | pure-integer, non-binary | 20 | 0.000000e+00 |
20 | bayes2_50 | medium | pure-integer, non-binary | 20 | 0.000000e+00 |
21 | blend029 | large | mixed-integer | 72 | -1.421100e+02 |
22 | blend146 | large | mixed-integer | 174 | -2.921100e+02 |
23 | blend480 | large | mixed-integer | 248 | -1.300000e+02 |
24 | blend531 | large | mixed-integer | 208 | -1.630800e+02 |
25 | blend718 | large | mixed-integer | 174 | -2.297700e+02 |
26 | blend721 | large | mixed-integer | 174 | -1.216500e+02 |
27 | blend852 | large | mixed-integer | 240 | -3.890400e+02 |
28 | cardqp_inlp | medium | pure-integer, binary | 50 | 0.000000e+00 |
29 | cardqp_iqp | medium | pure-integer, binary | 50 | 0.000000e+00 |
30 | carton9 | medium | pure-integer, binary | 32 | 0.000000e+00 |
31 | chp_shorttermplan1b | medium | pure-integer, non-binary | 48 | -8.100000e+01 |
32 | chp_shorttermplan2b | medium | pure-integer, non-binary | 48 | -4.800000e+05 |
33 | clay0203h | small | pure-integer, non-binary | 6 | 0.000000e+00 |
34 | clay0204hfsg | medium | pure-integer, non-binary | 12 | 0.000000e+00 |
35 | clay0205m | medium | pure-integer, non-binary | 20 | 0.000000e+00 |
36 | clay0303h | small | pure-integer, non-binary | 6 | 0.000000e+00 |
37 | crossdock_15x7 | large | pure-integer, binary | 210 | 0.000000e+00 |
38 | crossdock_15x8 | large | pure-integer, binary | 240 | 0.000000e+00 |
39 | crudeoil_lee1_05 | medium | pure-integer, non-binary | 40 | 0.000000e+00 |
40 | crudeoil_lee1_07 | large | pure-integer, non-binary | 56 | 0.000000e+00 |
41 | crudeoil_lee1_09 | large | pure-integer, non-binary | 72 | 0.000000e+00 |
42 | crudeoil_lee3_06 | large | pure-integer, non-binary | 168 | 0.000000e+00 |
43 | crudeoil_li05 | large | pure-integer, binary | 153 | -2.606000e+04 |
44 | crudeoil_li21 | large | pure-integer, binary | 160 | -1.001100e+05 |
45 | deb10 | medium | mixed-integer | 33 | 0.000000e+00 |
46 | deb6 | medium | mixed-integer | 40 | 0.000000e+00 |
47 | dispatch | small | pure-integer, non-binary | 3 | 2.157856e+03 |
48 | dosemin2d | large | pure-integer, non-binary | 117 | -1.700000e+02 |
49 | edgecross10-010 | medium | pure-integer, binary | 29 | 1.000000e+00 |
50 | edgecross10-020 | large | pure-integer, binary | 66 | 1.100000e+01 |
51 | edgecross10-030 | large | pure-integer, binary | 89 | 5.200000e+01 |
52 | edgecross10-040 | large | pure-integer, binary | 90 | 1.420000e+02 |
53 | edgecross10-050 | large | pure-integer, binary | 90 | 2.760000e+02 |
54 | edgecross10-060 | large | mixed-integer | 90 | 4.590000e+02 |
55 | edgecross10-070 | large | pure-integer, binary | 90 | 7.170000e+02 |
56 | edgecross10-080 | large | mixed-integer | 90 | 1.037000e+03 |
57 | edgecross10-090 | large | pure-integer, binary | 90 | 1.387000e+03 |
58 | edgecross14-019 | large | pure-integer, binary | 97 | 4.000000e+00 |
59 | edgecross14-039 | large | mixed-integer | 157 | 1.090000e+02 |
60 | edgecross14-058 | large | pure-integer, binary | 157 | 3.530000e+02 |
61 | edgecross14-176 | large | pure-integer, binary | 173 | 5.875000e+03 |
62 | edgecross20-040 | large | pure-integer, binary | 306 | 5.700000e+01 |
63 | edgecross22-048 | large | pure-integer, binary | 381 | 8.400000e+01 |
64 | elf | medium | pure-integer, non-binary | 24 | 0.000000e+00 |
65 | emfl050_5_5 | large | pure-integer, non-binary | 470 | 0.000000e+00 |
66 | emfl100_3_3 | large | pure-integer, non-binary | 316 | 0.000000e+00 |
67 | enpro48pb | medium | pure-integer, binary | 25 | 1.329180e+05 |
68 | enpro56pb | medium | pure-integer, binary | 19 | 5.672473e+04 |
69 | eq6_1 | medium | pure-integer, non-binary | 16 | 0.000000e+00 |
70 | etamac | small | pure-integer, non-binary | 9 | -6.940842e+01 |
71 | ex1221 | small | mixed-integer | 5 | -5.000000e-01 |
72 | ex1222 | small | mixed-integer | 2 | 1.000000e-01 |
73 | ex1223a | small | mixed-integer | 7 | 3.068528e-01 |
74 | ex1223b | small | mixed-integer | 7 | 3.068528e-01 |
75 | ex1233 | medium | mixed-integer | 40 | 0.000000e+00 |
76 | ex1243 | large | mixed-integer | 52 | 0.000000e+00 |
77 | ex1244 | large | mixed-integer | 75 | 0.000000e+00 |
78 | ex1252 | medium | pure-integer, binary | 12 | 0.000000e+00 |
79 | ex1252a | medium | mixed-integer | 12 | 0.000000e+00 |
80 | ex1263 | small | mixed-integer | 8 | 0.000000e+00 |
81 | ex1263a | small | pure-integer, binary | 8 | 0.000000e+00 |
82 | ex1264 | small | mixed-integer | 8 | 0.000000e+00 |
83 | ex1264a | small | pure-integer, binary | 8 | 0.000000e+00 |
84 | ex1265 | small | mixed-integer | 10 | 0.000000e+00 |
85 | ex1265a | small | pure-integer, binary | 10 | 0.000000e+00 |
86 | ex1266 | medium | mixed-integer | 11 | 0.000000e+00 |
87 | ex1266a | medium | pure-integer, binary | 12 | 0.000000e+00 |
88 | ex2_1_3 | medium | pure-integer, binary | 13 | -3.000600e+04 |
89 | ex2_1_8 | medium | pure-integer, non-binary | 24 | -1.212000e+06 |
90 | ex3pb | medium | mixed-integer | 22 | -2.061300e+04 |
91 | ex4 | medium | mixed-integer | 36 | -2.130000e+01 |
92 | ex8_4_2 | medium | pure-integer, binary | 20 | 0.000000e+00 |
93 | fac1 | medium | mixed-integer | 18 | 0.000000e+00 |
94 | fac2 | large | mixed-integer | 57 | 0.000000e+00 |
95 | fac3 | large | mixed-integer | 57 | 0.000000e+00 |
96 | faclay20h | large | pure-integer, binary | 190 | 1.554900e+04 |
97 | fin2bb | medium | pure-integer, non-binary | 21 | 0.000000e+00 |
98 | fo7_ar2_1 | medium | pure-integer, non-binary | 12 | -1.200000e+05 |
99 | fo9 | medium | pure-integer, non-binary | 16 | -1.600000e+05 |
100 | fo9_ar2_1 | medium | pure-integer, non-binary | 16 | -1.600000e+05 |
101 | fo9_ar5_1 | medium | pure-integer, non-binary | 16 | -1.600000e+05 |
102 | forest | small | pure-integer, non-binary | 6 | -6.000000e+04 |
103 | gams01 | small | pure-integer, non-binary | 10 | 0.000000e+00 |
104 | gasprod_sarawak01 | medium | mixed-integer | 37 | -1.448967e+05 |
105 | gastrans | small | pure-integer, binary | 5 | 5.412000e+01 |
106 | gbd | small | mixed-integer | 4 | 2.000000e-01 |
107 | genpooling_lee1 | medium | mixed-integer | 41 | -3.156840e+04 |
108 | genpooling_lee2 | medium | mixed-integer | 41 | -3.156840e+04 |
109 | genpooling_meyer04 | large | mixed-integer | 106 | 0.000000e+00 |
110 | genpooling_meyer10 | large | mixed-integer | 364 | 0.000000e+00 |
111 | ghg_1veh | medium | mixed-integer | 22 | 0.000000e+00 |
112 | gkocis | small | mixed-integer | 8 | -1.100000e+01 |
113 | graphpart_2g-0055-0062 | large | pure-integer, binary | 75 | -3.205074e+06 |
114 | graphpart_2g-0066-0066 | large | pure-integer, binary | 108 | -6.782949e+06 |
115 | graphpart_2g-0077-0077 | large | pure-integer, binary | 147 | -7.360455e+06 |
116 | graphpart_2g-0088-0088 | large | pure-integer, binary | 192 | -1.519691e+07 |
117 | graphpart_2g-0099-9211 | large | pure-integer, binary | 243 | -1.109237e+07 |
118 | graphpart_2g-1010-0824 | large | pure-integer, binary | 300 | -1.601239e+07 |
119 | graphpart_2pm-0044-0044 | medium | pure-integer, binary | 48 | -2.400000e+01 |
120 | graphpart_2pm-0055-0055 | large | pure-integer, binary | 75 | -4.200000e+01 |
121 | graphpart_2pm-0066-0066 | large | pure-integer, binary | 108 | -6.900000e+01 |
122 | graphpart_2pm-0077-0777 | large | pure-integer, binary | 147 | -8.100000e+01 |
123 | graphpart_2pm-0088-0888 | large | pure-integer, binary | 192 | -1.230000e+02 |
124 | graphpart_2pm-0099-0999 | large | pure-integer, binary | 243 | -1.410000e+02 |
125 | graphpart_3g-0234-0234 | large | pure-integer, binary | 72 | -4.418466e+06 |
126 | graphpart_3g-0244-0244 | large | pure-integer, binary | 96 | -5.480655e+06 |
127 | graphpart_3g-0333-0333 | large | pure-integer, binary | 81 | -4.097814e+06 |
128 | graphpart_3g-0334-0334 | large | pure-integer, binary | 108 | -7.194828e+06 |
129 | graphpart_3g-0344-0344 | large | pure-integer, binary | 144 | -1.327018e+07 |
130 | graphpart_3g-0444-0444 | large | pure-integer, binary | 192 | -1.796690e+07 |
131 | graphpart_3pm-0234-0234 | large | pure-integer, binary | 72 | -4.500000e+01 |
132 | graphpart_3pm-0244-0244 | large | pure-integer, binary | 96 | -5.700000e+01 |
133 | graphpart_3pm-0333-0333 | large | pure-integer, binary | 81 | -5.400000e+01 |
134 | graphpart_3pm-0334-0334 | large | pure-integer, binary | 108 | -7.500000e+01 |
135 | graphpart_3pm-0344-0344 | large | pure-integer, binary | 144 | -9.600000e+01 |
136 | graphpart_3pm-0444-0444 | large | pure-integer, binary | 192 | -1.320000e+02 |
137 | graphpart_clique-20 | large | pure-integer, binary | 60 | 0.000000e+00 |
138 | graphpart_clique-30 | large | pure-integer, binary | 90 | 0.000000e+00 |
139 | graphpart_clique-40 | large | pure-integer, binary | 120 | 0.000000e+00 |
140 | graphpart_clique-50 | large | pure-integer, binary | 150 | 0.000000e+00 |
141 | graphpart_clique-60 | large | pure-integer, binary | 180 | 0.000000e+00 |
142 | graphpart_clique-70 | large | pure-integer, binary | 210 | 0.000000e+00 |
143 | harker | medium | pure-integer, non-binary | 20 | -3.885250e+04 |
144 | heatexch_gen1 | medium | mixed-integer | 32 | 0.000000e+00 |
145 | heatexch_gen2 | medium | mixed-integer | 43 | 1.590013e+03 |
146 | heatexch_spec1 | medium | mixed-integer | 44 | 2.400070e-03 |
147 | heatexch_spec2 | large | mixed-integer | 58 | 6.329954e+00 |
148 | heatexch_spec3 | large | mixed-integer | 230 | 3.030207e+00 |
149 | himmel16 | small | pure-integer, non-binary | 6 | -6.000000e+04 |
150 | hmittelman | medium | pure-integer, binary | 15 | 0.000000e+00 |
151 | hvb11 | medium | pure-integer, non-binary | 38 | -1.638840e+09 |
152 | hybriddynamic_fixed | medium | pure-integer, non-binary | 11 | 1.111111e-01 |
153 | hydroenergy1 | large | mixed-integer | 96 | -7.982468e+05 |
154 | hydroenergy2 | large | mixed-integer | 192 | -1.260033e+06 |
155 | immun | small | pure-integer, non-binary | 6 | 5.649000e+09 |
156 | inscribedsquare01 | small | pure-integer, non-binary | 2 | 0.000000e+00 |
157 | inscribedsquare02 | small | pure-integer, non-binary | 2 | 0.000000e+00 |
158 | lakes | large | pure-integer, non-binary | 60 | 6.696919e+08 |
159 | linear | medium | pure-integer, non-binary | 20 | 0.000000e+00 |
160 | meanvarxsc | small | pure-integer, non-binary | 7 | 0.000000e+00 |
161 | multiplants_stg1a | large | mixed-integer | 182 | -1.520050e+04 |
162 | multiplants_stg1c | large | mixed-integer | 203 | -2.932440e+04 |
163 | multiplants_stg5 | large | mixed-integer | 185 | -1.064194e+05 |
164 | netmod_dol1 | medium | pure-integer, non-binary | 12 | -2.362205e+02 |
165 | netmod_dol2 | medium | pure-integer, non-binary | 12 | -2.362205e+02 |
166 | no7_ar4_1 | medium | pure-integer, non-binary | 18 | -4.000000e+05 |
167 | nous1 | medium | mixed-integer | 12 | -1.717221e+00 |
168 | nous2 | medium | mixed-integer | 12 | -1.717221e+00 |
169 | o7_ar4_1 | medium | pure-integer, non-binary | 20 | -4.800000e+05 |
170 | p_ball_10b_5p_3d_m | medium | pure-integer, non-binary | 30 | 0.000000e+00 |
171 | p_ball_20b_5p_2d_m | medium | pure-integer, non-binary | 20 | 0.000000e+00 |
172 | p_ball_30b_5p_2d_m | medium | pure-integer, non-binary | 20 | 0.000000e+00 |
173 | pooling_adhya2stp | medium | pure-integer, non-binary | 19 | -4.650000e+03 |
174 | pooling_adhya2tp | medium | pure-integer, non-binary | 19 | -4.650000e+03 |
175 | pooling_epa1 | medium | pure-integer, binary | 14 | -4.280000e+03 |
176 | pooling_haverly3stp | small | pure-integer, non-binary | 6 | -3.500000e+03 |
177 | popdynm100 | large | pure-integer, non-binary | 184 | 3.322760e+05 |
178 | powerflow0009r | small | pure-integer, non-binary | 3 | 1.085000e+03 |
179 | prob07 | small | pure-integer, non-binary | 8 | 3.615817e+04 |
180 | procsel | small | mixed-integer | 9 | -1.100000e+01 |
181 | qap | large | pure-integer, binary | 225 | 0.000000e+00 |
182 | qp4 | medium | pure-integer, non-binary | 29 | 0.000000e+00 |
183 | ramsey | medium | pure-integer, non-binary | 11 | -1.749965e+02 |
184 | routingdelay_bigm | large | pure-integer, non-binary | 331 | -9.201400e+04 |
185 | sep1 | small | mixed-integer | 10 | -3.250000e+03 |
186 | sporttournament06 | medium | pure-integer, binary | 15 | -1.200000e+01 |
187 | sporttournament08 | medium | pure-integer, binary | 28 | -2.400000e+01 |
188 | sporttournament10 | medium | pure-integer, binary | 45 | -4.400000e+01 |
189 | sporttournament12 | large | pure-integer, binary | 66 | -6.800000e+01 |
190 | sporttournament14 | large | mixed-integer | 91 | -9.600000e+01 |
191 | sporttournament16 | large | pure-integer, binary | 120 | -1.300000e+02 |
192 | sporttournament18 | large | pure-integer, binary | 153 | -1.600000e+02 |
193 | sporttournament20 | large | pure-integer, binary | 190 | -1.920000e+02 |
194 | sporttournament22 | large | pure-integer, binary | 231 | -2.340000e+02 |
195 | spring | small | mixed-integer | 3 | 4.179768e-02 |
196 | squfl010-025 | large | mixed-integer | 260 | 0.000000e+00 |
197 | squfl010-040 | large | mixed-integer | 410 | 0.000000e+00 |
198 | sssd08-04 | medium | mixed-integer | 48 | 0.000000e+00 |
199 | sssd12-05 | large | mixed-integer | 80 | 0.000000e+00 |
200 | sssd15-04 | large | mixed-integer | 76 | 0.000000e+00 |
201 | sssd15-06 | large | mixed-integer | 114 | 0.000000e+00 |
202 | sssd15-08 | large | mixed-integer | 152 | 0.000000e+00 |
203 | sssd16-07 | large | mixed-integer | 140 | 0.000000e+00 |
204 | sssd18-06 | large | mixed-integer | 132 | 0.000000e+00 |
205 | sssd18-08 | large | mixed-integer | 176 | 0.000000e+00 |
206 | sssd20-04 | large | mixed-integer | 96 | 0.000000e+00 |
207 | sssd20-08 | large | mixed-integer | 192 | 0.000000e+00 |
208 | sssd22-08 | large | mixed-integer | 208 | 0.000000e+00 |
209 | sssd25-04 | large | mixed-integer | 116 | 0.000000e+00 |
210 | sssd25-08 | large | mixed-integer | 232 | 0.000000e+00 |
211 | st_bpv1 | small | pure-integer, non-binary | 4 | 0.000000e+00 |
212 | st_e13 | small | mixed-integer | 2 | 0.000000e+00 |
213 | st_e15 | small | mixed-integer | 5 | -5.000000e-01 |
214 | st_e27 | small | mixed-integer | 4 | -2.500000e+01 |
215 | st_e35 | medium | mixed-integer | 23 | 0.000000e+00 |
216 | st_e36 | small | mixed-integer | 2 | -3.045000e+02 |
217 | st_e38 | small | mixed-integer | 4 | 3.422675e+03 |
218 | st_e40 | small | pure-integer, non-binary | 3 | 4.414213e+00 |
219 | st_miqp2 | small | pure-integer, binary | 4 | -1.200000e+01 |
220 | st_miqp4 | small | mixed-integer | 6 | -6.254000e+03 |
221 | st_test2 | small | pure-integer, binary | 6 | -1.025000e+01 |
222 | st_test5 | small | pure-integer, binary | 10 | -2.900000e+02 |
223 | st_test6 | small | pure-integer, binary | 10 | 0.000000e+00 |
224 | st_test8 | medium | pure-integer, non-binary | 24 | -4.706600e+04 |
225 | st_testgr1 | small | pure-integer, non-binary | 10 | -1.479890e+01 |
226 | st_testgr3 | medium | pure-integer, non-binary | 20 | -6.050025e+01 |
227 | st_testph4 | small | pure-integer, non-binary | 3 | -8.750000e+01 |
228 | supplychain | medium | mixed-integer | 27 | 0.000000e+00 |
229 | supplychainp1_020306 | large | mixed-integer | 66 | 4.434034e+01 |
230 | supplychainp1_030510 | large | mixed-integer | 220 | 1.266562e+02 |
231 | supplychainr1_020306 | medium | mixed-integer | 36 | 4.931065e+04 |
232 | supplychainr1_030510 | large | mixed-integer | 85 | 1.256749e+05 |
233 | synheat | medium | mixed-integer | 44 | 2.400070e-03 |
234 | synthes1 | small | mixed-integer | 6 | -2.904803e+00 |
235 | synthes2 | medium | mixed-integer | 11 | -8.141086e+01 |
236 | synthes3 | medium | mixed-integer | 17 | -2.023804e+02 |
237 | tln12 | medium | pure-integer, binary | 24 | 0.000000e+00 |
238 | tln2 | small | pure-integer, binary | 4 | 0.000000e+00 |
239 | tln4 | small | pure-integer, binary | 8 | 0.000000e+00 |
240 | tln5 | small | pure-integer, binary | 10 | 0.000000e+00 |
241 | tln6 | medium | pure-integer, binary | 12 | 0.000000e+00 |
242 | tln7 | medium | pure-integer, binary | 14 | 0.000000e+00 |
243 | tloss | medium | pure-integer, binary | 12 | 0.000000e+00 |
244 | tls2 | medium | pure-integer, binary | 17 | 0.000000e+00 |
245 | tls4 | medium | pure-integer, binary | 25 | 0.000000e+00 |
246 | tls5 | medium | pure-integer, binary | 31 | 0.000000e+00 |
247 | tls6 | large | pure-integer, binary | 53 | 0.000000e+00 |
248 | tls7 | large | pure-integer, binary | 72 | 0.000000e+00 |
249 | tltr | medium | pure-integer, binary | 11 | 0.000000e+00 |
250 | transswitch2736spp | large | pure-integer, non-binary | 66 | -5.788540e+09 |
251 | tspn05 | medium | mixed-integer | 20 | 0.000000e+00 |
252 | tspn08 | medium | mixed-integer | 44 | 0.000000e+00 |
253 | tspn10 | large | mixed-integer | 65 | 0.000000e+00 |
254 | tspn12 | large | mixed-integer | 90 | 0.000000e+00 |
255 | tspn15 | large | mixed-integer | 135 | 0.000000e+00 |
256 | util | medium | pure-integer, non-binary | 17 | 0.000000e+00 |
257 | wastewater12m2 | small | pure-integer, non-binary | 10 | 0.000000e+00 |
258 | waternd1 | medium | mixed-integer | 43 | 3.200265e+05 |
259 | waternd2 | large | mixed-integer | 148 | 3.200423e+05 |
260 | waternd_hanoi | large | pure-integer, binary | 204 | 0.000000e+00 |
261 | waternd_shamir | large | pure-integer, binary | 112 | 0.000000e+00 |
262 | waterno1_01 | medium | pure-integer, non-binary | 12 | 0.000000e+00 |
263 | waterno1_04 | large | pure-integer, binary | 84 | 0.000000e+00 |
264 | waterund17 | medium | pure-integer, non-binary | 15 | 0.000000e+00 |
265 | waterund36 | medium | pure-integer, non-binary | 39 | 0.000000e+00 |
266 | windfac | small | pure-integer, non-binary | 2 | 0.000000e+00 |
267 | worst | medium | pure-integer, non-binary | 13 | -1.079317e+09 |