Which optimization can I use: Hill climbing, simulated annealing, or ant colony algorithms?












1












$begingroup$


I plan to make program to carry out optimization. In my optimization problem, there are three parameters, for instance $X$, $Y$, $Z$, that must be optimized (or minimized in this case since all the values of $X$, $Y$, $Z$ must be as low as possible). And another information is that each parameter has constraint. For instance: $X leq 10$, $Y leq 25$, $Z leq 2000$.
My question is, which of the following algorithms that is best to use in solving my problem:




  • a) Hill climbing

  • b) Simulated annealing

  • c) Ant Colony


If I can use all the three algorithms to solve my problem, how can I compare the quality of the results outputted by those three algorithms?



Note: I do not want to use Genetic Algorithm since this algorithm has already been used to solve my problem.



Thanks in advance.



Sorry for not explaining my problem. Here is my optimization problem:
I have 13 parameters. In the application, the user must input the values for all 13 parameters. The values inputted by the user is called initial design. And this initial design has certain total cost and total performance value.
The duty of my application is to find alternative design that is better than the initial design. Better here means that it has lower total cost and/or lower total performance value.



For your information that, for instance, when the user input a parameter with material whose performance value is 0.9 and whose cost is US Dollar 50, there will be several alternative materials with lower performance value and/or lower cost. If you have 13 parameters then you will have very huge combination. So, this is my problem, that is to find the best alternative design from this huge combination. Note that in finding the alternative design, there are constraints in the total cost and total performance value allowed. For instance, the total cost must be less than or equal to X and total performance value must less than or equal to Y.
The alternative design proposed by my application can be more than one.



Hope my explanation is clear.










share|cite|improve this question











$endgroup$












  • $begingroup$
    Please write more about your optimization problem. Otherwise it is impossible to give you advice.
    $endgroup$
    – The Pheromone Kid
    Jun 2 '14 at 14:22










  • $begingroup$
    @Ert, I have described my problem in the revised question. Thanks.
    $endgroup$
    – user1221330
    Jun 3 '14 at 16:54










  • $begingroup$
    Let me formulate the optimization problem: You want to minimize the cost $C$ under the constraint that the performance $P$ is greater than some minimum performance $P_{min}$? Both $P$ and $C$ are functions of the parameter choices?
    $endgroup$
    – The Pheromone Kid
    Jun 5 '14 at 7:34










  • $begingroup$
    If you can properly formulate your problem (at least I cannot see any from your description), I think all these heuristics are fine.
    $endgroup$
    – Liäm
    Nov 28 '17 at 8:16
















1












$begingroup$


I plan to make program to carry out optimization. In my optimization problem, there are three parameters, for instance $X$, $Y$, $Z$, that must be optimized (or minimized in this case since all the values of $X$, $Y$, $Z$ must be as low as possible). And another information is that each parameter has constraint. For instance: $X leq 10$, $Y leq 25$, $Z leq 2000$.
My question is, which of the following algorithms that is best to use in solving my problem:




  • a) Hill climbing

  • b) Simulated annealing

  • c) Ant Colony


If I can use all the three algorithms to solve my problem, how can I compare the quality of the results outputted by those three algorithms?



Note: I do not want to use Genetic Algorithm since this algorithm has already been used to solve my problem.



Thanks in advance.



Sorry for not explaining my problem. Here is my optimization problem:
I have 13 parameters. In the application, the user must input the values for all 13 parameters. The values inputted by the user is called initial design. And this initial design has certain total cost and total performance value.
The duty of my application is to find alternative design that is better than the initial design. Better here means that it has lower total cost and/or lower total performance value.



For your information that, for instance, when the user input a parameter with material whose performance value is 0.9 and whose cost is US Dollar 50, there will be several alternative materials with lower performance value and/or lower cost. If you have 13 parameters then you will have very huge combination. So, this is my problem, that is to find the best alternative design from this huge combination. Note that in finding the alternative design, there are constraints in the total cost and total performance value allowed. For instance, the total cost must be less than or equal to X and total performance value must less than or equal to Y.
The alternative design proposed by my application can be more than one.



Hope my explanation is clear.










share|cite|improve this question











$endgroup$












  • $begingroup$
    Please write more about your optimization problem. Otherwise it is impossible to give you advice.
    $endgroup$
    – The Pheromone Kid
    Jun 2 '14 at 14:22










  • $begingroup$
    @Ert, I have described my problem in the revised question. Thanks.
    $endgroup$
    – user1221330
    Jun 3 '14 at 16:54










  • $begingroup$
    Let me formulate the optimization problem: You want to minimize the cost $C$ under the constraint that the performance $P$ is greater than some minimum performance $P_{min}$? Both $P$ and $C$ are functions of the parameter choices?
    $endgroup$
    – The Pheromone Kid
    Jun 5 '14 at 7:34










  • $begingroup$
    If you can properly formulate your problem (at least I cannot see any from your description), I think all these heuristics are fine.
    $endgroup$
    – Liäm
    Nov 28 '17 at 8:16














1












1








1





$begingroup$


I plan to make program to carry out optimization. In my optimization problem, there are three parameters, for instance $X$, $Y$, $Z$, that must be optimized (or minimized in this case since all the values of $X$, $Y$, $Z$ must be as low as possible). And another information is that each parameter has constraint. For instance: $X leq 10$, $Y leq 25$, $Z leq 2000$.
My question is, which of the following algorithms that is best to use in solving my problem:




  • a) Hill climbing

  • b) Simulated annealing

  • c) Ant Colony


If I can use all the three algorithms to solve my problem, how can I compare the quality of the results outputted by those three algorithms?



Note: I do not want to use Genetic Algorithm since this algorithm has already been used to solve my problem.



Thanks in advance.



Sorry for not explaining my problem. Here is my optimization problem:
I have 13 parameters. In the application, the user must input the values for all 13 parameters. The values inputted by the user is called initial design. And this initial design has certain total cost and total performance value.
The duty of my application is to find alternative design that is better than the initial design. Better here means that it has lower total cost and/or lower total performance value.



For your information that, for instance, when the user input a parameter with material whose performance value is 0.9 and whose cost is US Dollar 50, there will be several alternative materials with lower performance value and/or lower cost. If you have 13 parameters then you will have very huge combination. So, this is my problem, that is to find the best alternative design from this huge combination. Note that in finding the alternative design, there are constraints in the total cost and total performance value allowed. For instance, the total cost must be less than or equal to X and total performance value must less than or equal to Y.
The alternative design proposed by my application can be more than one.



Hope my explanation is clear.










share|cite|improve this question











$endgroup$




I plan to make program to carry out optimization. In my optimization problem, there are three parameters, for instance $X$, $Y$, $Z$, that must be optimized (or minimized in this case since all the values of $X$, $Y$, $Z$ must be as low as possible). And another information is that each parameter has constraint. For instance: $X leq 10$, $Y leq 25$, $Z leq 2000$.
My question is, which of the following algorithms that is best to use in solving my problem:




  • a) Hill climbing

  • b) Simulated annealing

  • c) Ant Colony


If I can use all the three algorithms to solve my problem, how can I compare the quality of the results outputted by those three algorithms?



Note: I do not want to use Genetic Algorithm since this algorithm has already been used to solve my problem.



Thanks in advance.



Sorry for not explaining my problem. Here is my optimization problem:
I have 13 parameters. In the application, the user must input the values for all 13 parameters. The values inputted by the user is called initial design. And this initial design has certain total cost and total performance value.
The duty of my application is to find alternative design that is better than the initial design. Better here means that it has lower total cost and/or lower total performance value.



For your information that, for instance, when the user input a parameter with material whose performance value is 0.9 and whose cost is US Dollar 50, there will be several alternative materials with lower performance value and/or lower cost. If you have 13 parameters then you will have very huge combination. So, this is my problem, that is to find the best alternative design from this huge combination. Note that in finding the alternative design, there are constraints in the total cost and total performance value allowed. For instance, the total cost must be less than or equal to X and total performance value must less than or equal to Y.
The alternative design proposed by my application can be more than one.



Hope my explanation is clear.







optimization






share|cite|improve this question















share|cite|improve this question













share|cite|improve this question




share|cite|improve this question








edited Jun 3 '14 at 10:47







user1221330

















asked Jun 2 '14 at 11:37









user1221330user1221330

62




62












  • $begingroup$
    Please write more about your optimization problem. Otherwise it is impossible to give you advice.
    $endgroup$
    – The Pheromone Kid
    Jun 2 '14 at 14:22










  • $begingroup$
    @Ert, I have described my problem in the revised question. Thanks.
    $endgroup$
    – user1221330
    Jun 3 '14 at 16:54










  • $begingroup$
    Let me formulate the optimization problem: You want to minimize the cost $C$ under the constraint that the performance $P$ is greater than some minimum performance $P_{min}$? Both $P$ and $C$ are functions of the parameter choices?
    $endgroup$
    – The Pheromone Kid
    Jun 5 '14 at 7:34










  • $begingroup$
    If you can properly formulate your problem (at least I cannot see any from your description), I think all these heuristics are fine.
    $endgroup$
    – Liäm
    Nov 28 '17 at 8:16


















  • $begingroup$
    Please write more about your optimization problem. Otherwise it is impossible to give you advice.
    $endgroup$
    – The Pheromone Kid
    Jun 2 '14 at 14:22










  • $begingroup$
    @Ert, I have described my problem in the revised question. Thanks.
    $endgroup$
    – user1221330
    Jun 3 '14 at 16:54










  • $begingroup$
    Let me formulate the optimization problem: You want to minimize the cost $C$ under the constraint that the performance $P$ is greater than some minimum performance $P_{min}$? Both $P$ and $C$ are functions of the parameter choices?
    $endgroup$
    – The Pheromone Kid
    Jun 5 '14 at 7:34










  • $begingroup$
    If you can properly formulate your problem (at least I cannot see any from your description), I think all these heuristics are fine.
    $endgroup$
    – Liäm
    Nov 28 '17 at 8:16
















$begingroup$
Please write more about your optimization problem. Otherwise it is impossible to give you advice.
$endgroup$
– The Pheromone Kid
Jun 2 '14 at 14:22




$begingroup$
Please write more about your optimization problem. Otherwise it is impossible to give you advice.
$endgroup$
– The Pheromone Kid
Jun 2 '14 at 14:22












$begingroup$
@Ert, I have described my problem in the revised question. Thanks.
$endgroup$
– user1221330
Jun 3 '14 at 16:54




$begingroup$
@Ert, I have described my problem in the revised question. Thanks.
$endgroup$
– user1221330
Jun 3 '14 at 16:54












$begingroup$
Let me formulate the optimization problem: You want to minimize the cost $C$ under the constraint that the performance $P$ is greater than some minimum performance $P_{min}$? Both $P$ and $C$ are functions of the parameter choices?
$endgroup$
– The Pheromone Kid
Jun 5 '14 at 7:34




$begingroup$
Let me formulate the optimization problem: You want to minimize the cost $C$ under the constraint that the performance $P$ is greater than some minimum performance $P_{min}$? Both $P$ and $C$ are functions of the parameter choices?
$endgroup$
– The Pheromone Kid
Jun 5 '14 at 7:34












$begingroup$
If you can properly formulate your problem (at least I cannot see any from your description), I think all these heuristics are fine.
$endgroup$
– Liäm
Nov 28 '17 at 8:16




$begingroup$
If you can properly formulate your problem (at least I cannot see any from your description), I think all these heuristics are fine.
$endgroup$
– Liäm
Nov 28 '17 at 8:16










1 Answer
1






active

oldest

votes


















0












$begingroup$

It depends on the optimization problem that you are facing. If it is discrete, continuous, large (has a large number of inputs), $cdots$. You have to read about the three algorithms you mentioned and compare them to select the one suitable for your problem. As far as I know, Hill climbing, uses local search technique hence you face a problem of local optima. For the other two algorithms, they are suitable for a discrete optimization problem especially Ant colony since it is based on a population techniques.



I repeat, it mainly depends on the optimization problem that you have in hand. Maybe if you give us more details, it will be good for you and for us to figure something out.






share|cite|improve this answer









$endgroup$













  • $begingroup$
    Jika, I have described my problem in the revised question. Thanks.
    $endgroup$
    – user1221330
    Jun 3 '14 at 16:55













Your Answer





StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});














draft saved

draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f818027%2fwhich-optimization-can-i-use-hill-climbing-simulated-annealing-or-ant-colony%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown

























1 Answer
1






active

oldest

votes








1 Answer
1






active

oldest

votes









active

oldest

votes






active

oldest

votes









0












$begingroup$

It depends on the optimization problem that you are facing. If it is discrete, continuous, large (has a large number of inputs), $cdots$. You have to read about the three algorithms you mentioned and compare them to select the one suitable for your problem. As far as I know, Hill climbing, uses local search technique hence you face a problem of local optima. For the other two algorithms, they are suitable for a discrete optimization problem especially Ant colony since it is based on a population techniques.



I repeat, it mainly depends on the optimization problem that you have in hand. Maybe if you give us more details, it will be good for you and for us to figure something out.






share|cite|improve this answer









$endgroup$













  • $begingroup$
    Jika, I have described my problem in the revised question. Thanks.
    $endgroup$
    – user1221330
    Jun 3 '14 at 16:55


















0












$begingroup$

It depends on the optimization problem that you are facing. If it is discrete, continuous, large (has a large number of inputs), $cdots$. You have to read about the three algorithms you mentioned and compare them to select the one suitable for your problem. As far as I know, Hill climbing, uses local search technique hence you face a problem of local optima. For the other two algorithms, they are suitable for a discrete optimization problem especially Ant colony since it is based on a population techniques.



I repeat, it mainly depends on the optimization problem that you have in hand. Maybe if you give us more details, it will be good for you and for us to figure something out.






share|cite|improve this answer









$endgroup$













  • $begingroup$
    Jika, I have described my problem in the revised question. Thanks.
    $endgroup$
    – user1221330
    Jun 3 '14 at 16:55
















0












0








0





$begingroup$

It depends on the optimization problem that you are facing. If it is discrete, continuous, large (has a large number of inputs), $cdots$. You have to read about the three algorithms you mentioned and compare them to select the one suitable for your problem. As far as I know, Hill climbing, uses local search technique hence you face a problem of local optima. For the other two algorithms, they are suitable for a discrete optimization problem especially Ant colony since it is based on a population techniques.



I repeat, it mainly depends on the optimization problem that you have in hand. Maybe if you give us more details, it will be good for you and for us to figure something out.






share|cite|improve this answer









$endgroup$



It depends on the optimization problem that you are facing. If it is discrete, continuous, large (has a large number of inputs), $cdots$. You have to read about the three algorithms you mentioned and compare them to select the one suitable for your problem. As far as I know, Hill climbing, uses local search technique hence you face a problem of local optima. For the other two algorithms, they are suitable for a discrete optimization problem especially Ant colony since it is based on a population techniques.



I repeat, it mainly depends on the optimization problem that you have in hand. Maybe if you give us more details, it will be good for you and for us to figure something out.







share|cite|improve this answer












share|cite|improve this answer



share|cite|improve this answer










answered Jun 2 '14 at 14:27









JikaJika

2,348818




2,348818












  • $begingroup$
    Jika, I have described my problem in the revised question. Thanks.
    $endgroup$
    – user1221330
    Jun 3 '14 at 16:55




















  • $begingroup$
    Jika, I have described my problem in the revised question. Thanks.
    $endgroup$
    – user1221330
    Jun 3 '14 at 16:55


















$begingroup$
Jika, I have described my problem in the revised question. Thanks.
$endgroup$
– user1221330
Jun 3 '14 at 16:55






$begingroup$
Jika, I have described my problem in the revised question. Thanks.
$endgroup$
– user1221330
Jun 3 '14 at 16:55




















draft saved

draft discarded




















































Thanks for contributing an answer to Mathematics Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f818027%2fwhich-optimization-can-i-use-hill-climbing-simulated-annealing-or-ant-colony%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Can a sorcerer learn a 5th-level spell early by creating spell slots using the Font of Magic feature?

Does disintegrating a polymorphed enemy still kill it after the 2018 errata?

A Topological Invariant for $pi_3(U(n))$