SlideShare a Scribd company logo
2
Most read
3
Most read
4
Most read
Introduction to Optimization
Module 1
What is Optimization?
• The process of finding the best values for the
variables of a particular problem to minimize or
maximize an objective function
• The action of making the best or most effective use
of given situation - (Google dictionary)
• It is a technique of squeezing best performance out
of provided current state of model
Components of an Optimization Problem
• Objective function
An objective function express performance of a system, need
to be minimized or maximized
• Variable (Design or Decision Variable)
A set of unknowns, define the objective function and
constraints, can be continuous, discrete or boolean
• Constraints
They are conditions, allows the unknowns to take on certain
values but exclude others to render the design to be feasible
Components of an Optimization Problem
Optimization
Problem
Variables
Continuous Discrete
Constraints
Constrained Unconstrained
Objective
Function
Single Multi
Objective function
𝟏 𝟏 𝟐
𝐟 𝐱 , 𝐱𝟐 = 𝐱𝟐+𝟐𝐱𝟐-0.3cos(3 𝛑𝐱𝟏)( 4 𝛑𝐱𝟐)+0.3
𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧 𝐦𝐢𝐧(𝐟)
𝐯𝐚𝐫𝐢𝐚𝐛𝐥𝐞𝐬 ∈ [𝟏𝟎, −𝟏𝟎]
𝐔𝐧𝐜𝐨𝐧𝐬𝐭𝐫𝐚𝐢𝐧𝐞𝐝 𝐏𝐫𝐨𝐛𝐥𝐞𝐦
𝐀𝐧 𝐞𝐱𝐚𝐦𝐩𝐥𝐞 ∶ 𝐬𝐢𝐧𝐠𝐥𝐞 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧
Objective function
𝐀𝐧 𝐞𝐱𝐚𝐦𝐩𝐥𝐞 ∶ 𝐬𝐢𝐧𝐠𝐥𝐞 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭
𝐢𝐨𝐧
Min f(z1, z2, z3) = (-100-(z1-5)2 - (z2-5)2 +(z3-5)2)/100
Subject to;
h(z1, z2, z3) = (z1 - 3)2 + (z2 - 2)2 + (z3 - 5)2 – 0.0625 ≤ 0
where;
0 ≤ zi ≤ 10;
𝐂𝐨𝐧𝐬𝐭𝐫𝐚𝐢𝐧𝐞𝐝 𝐏𝐫𝐨𝐛𝐥𝐞𝐦
Objective function
𝐀𝐧 𝐞𝐱𝐚𝐦𝐩𝐥𝐞 ∶ 𝐌𝐮𝐥𝐭𝐢 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧
𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧 𝐦𝐢𝐧(𝐟𝟏 ) & 𝐦𝐢𝐧(𝐟𝟐 ) & 𝐦𝐢𝐧(𝐟𝟑 )
𝐔𝐧𝐜𝐨𝐧𝐬𝐭𝐫𝐚𝐢𝐧𝐞𝐝 𝐏𝐫𝐨𝐛𝐥𝐞𝐦
𝐀𝐧 𝐞𝐱𝐚𝐦𝐩𝐥𝐞 ∶ 𝐌𝐮𝐥𝐭𝐢 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧
𝒎𝒊𝒏 =
𝐬𝐮𝐛𝐣𝐞𝐜𝐭 𝐭𝐨;
𝐂𝐨𝐧𝐬𝐭𝐫𝐚𝐢𝐧𝐞𝐝 𝐏𝐫𝐨𝐛𝐥𝐞𝐦
Objective function
{
Type of Optimization Techniques
Optimization
Technique
Conventional
Mathematical
Programming
Calculus
Methods
Network
Methods
Nonconventional Meta-heuristic
algorithms
Meta-heuristicAlgorithms
• Meta-heuristic is a general algorithmic framework
which can be applied to different optimization
problems with relatively few modifications to make
them adapted to a specific problem.
Meta-heuristicAlgorithms
Meta-heuristic
algorithms
Evolutionary
algorithms
GA GP
Physics-based
algorithms
CSS SA
Swarm-based
algorithms
Whale Ant
Colony
Human-based
algorithms
TLBO EMA
Genetic Algorithm (GA) Genetic Programming (GP) Charged System Search (CSS)
Simulated Annealing(SA) Teaching Learning Based Optimization(TLBO) Exchange Market Algorithm (EMA)
An Example : Whale optimization algorithm
1 Encircling prey
2 Bubble-net attacking method (exploitation phase)
3 Search for prey (exploration phase)
Behavior of Whale
An Example : Whale optimization algorithm
Mathematical Model
1- Encircling prey
Where t is the current iteration, A and C are coefficient vectors, X* is the
position vector of the best solution, and X indicates the position vector of a
solution, | | is the absolute value.
An Example : Whale optimization algorithm
Where components of a are linearly decreased from 2 to 0 over the course of
iterations and r is random vector in [0; 1]
Mathematical Model (cont.)
The vectors A and C are calculated asfollows:
An Example : Whale optimization algorithm
Mathematical Model (cont.)
2- Bubble-net mechanism (exploitationphase)
Where the value of A is a random value in interval [-a, a] and the value of a is
decreased from 2 to 0 , D’ =| X*(t) - X(t) | is the distance between the prey (best
solution) and the ith whale, b is a constant, l is a random number in [-1; 1], and p is a
random number in [0; 1]
An Example : Whale optimization algorithm
Mathematical Model (cont.)
3- search for prey (exploration phase)
In order to force the search agent to move
far a way from reference whale, we use the A with
values > 1 or < 1
Where Xrand is a random position vector chosen from the current population.
Module 1: Introduction to Optimization
• END OF CONTENT MODULE

More Related Content

PDF
PPTX
Optmization techniques
PPTX
Introduction to optimization technique
PPTX
Optimization problems and algorithms
PDF
Metaheuristic Algorithms: A Critical Analysis
PPTX
Mathematical Optimisation - Fundamentals and Applications
PPT
Optimization techniques
PPTX
Metaheuristics
Optmization techniques
Introduction to optimization technique
Optimization problems and algorithms
Metaheuristic Algorithms: A Critical Analysis
Mathematical Optimisation - Fundamentals and Applications
Optimization techniques
Metaheuristics

What's hot (20)

PPTX
Dynamic Programming
PPTX
Integer Linear Programming
PPTX
Optimization tutorial
PDF
Classification of optimization Techniques
PPTX
Transportation problems
POT
Multi Objective Optimization
PPT
Transportation and Assignment
PPTX
graphical method
PPTX
Simplex method concept,
PPSX
Linear programing
PPT
simplex method
PPT
Simplex Method
PPTX
Monte Carlo Simulation
PPT
Optimization Methods
PPTX
Introduction to optimization
PDF
Metaheuristic Optimization: Algorithm Analysis and Open Problems
PPTX
NON LINEAR PROGRAMMING
PPTX
newton raphson method
PDF
Monte carlo simulation
PDF
Big m method
Dynamic Programming
Integer Linear Programming
Optimization tutorial
Classification of optimization Techniques
Transportation problems
Multi Objective Optimization
Transportation and Assignment
graphical method
Simplex method concept,
Linear programing
simplex method
Simplex Method
Monte Carlo Simulation
Optimization Methods
Introduction to optimization
Metaheuristic Optimization: Algorithm Analysis and Open Problems
NON LINEAR PROGRAMMING
newton raphson method
Monte carlo simulation
Big m method
Ad

Similar to Introduction to Optimization.ppt (20)

PPT
introduction to optimizationkajsytdjrfh.ppt
PDF
swarm pso and gray wolf Optimization.pdf
PDF
Cuckoo Search: Recent Advances and Applications
PPT
lecture.ppt
PPTX
Optimization Using Evolutionary Computing Techniques
PPTX
Optimization and particle swarm optimization (O & PSO)
PDF
Paper Study: Melding the data decision pipeline
PDF
Applications and Analysis of Bio-Inspired Eagle Strategy for Engineering Opti...
PDF
Accelerated Particle Swarm Optimization and Support Vector Machine for Busine...
PPTX
Trajectory Transformer.pptx
PDF
ecml15-tutorial_automation in machine learning
PDF
optmizationtechniques.pdf
PDF
4optmizationtechniques-150308051251-conversion-gate01.pdf
PDF
Sparsenet
PPTX
variBAD, A Very Good Method for Bayes-Adaptive Deep RL via Meta-Learning.pptx
PPT
PSO and Its application in Engineering
PPTX
MACHINE LEARNING NEURAL NETWORK PPT UNIT 4
PDF
Gradient Boosted Regression Trees in Scikit Learn by Gilles Louppe & Peter Pr...
PDF
AUTOMATIC TRANSFER RATE ADJUSTMENT FOR TRANSFER REINFORCEMENT LEARNING
PPT
Design and analysis of algorithm in Computer Science
introduction to optimizationkajsytdjrfh.ppt
swarm pso and gray wolf Optimization.pdf
Cuckoo Search: Recent Advances and Applications
lecture.ppt
Optimization Using Evolutionary Computing Techniques
Optimization and particle swarm optimization (O & PSO)
Paper Study: Melding the data decision pipeline
Applications and Analysis of Bio-Inspired Eagle Strategy for Engineering Opti...
Accelerated Particle Swarm Optimization and Support Vector Machine for Busine...
Trajectory Transformer.pptx
ecml15-tutorial_automation in machine learning
optmizationtechniques.pdf
4optmizationtechniques-150308051251-conversion-gate01.pdf
Sparsenet
variBAD, A Very Good Method for Bayes-Adaptive Deep RL via Meta-Learning.pptx
PSO and Its application in Engineering
MACHINE LEARNING NEURAL NETWORK PPT UNIT 4
Gradient Boosted Regression Trees in Scikit Learn by Gilles Louppe & Peter Pr...
AUTOMATIC TRANSFER RATE ADJUSTMENT FOR TRANSFER REINFORCEMENT LEARNING
Design and analysis of algorithm in Computer Science
Ad

Recently uploaded (20)

PDF
PPT on Performance Review to get promotions
PDF
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
PDF
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
PPTX
CH1 Production IntroductoryConcepts.pptx
PDF
Embodied AI: Ushering in the Next Era of Intelligent Systems
PPTX
Foundation to blockchain - A guide to Blockchain Tech
PPTX
bas. eng. economics group 4 presentation 1.pptx
PPTX
IOT PPTs Week 10 Lecture Material.pptx of NPTEL Smart Cities contd
PPTX
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
PPT
CRASH COURSE IN ALTERNATIVE PLUMBING CLASS
PPTX
web development for engineering and engineering
PDF
Model Code of Practice - Construction Work - 21102022 .pdf
PDF
TFEC-4-2020-Design-Guide-for-Timber-Roof-Trusses.pdf
PDF
Automation-in-Manufacturing-Chapter-Introduction.pdf
PDF
composite construction of structures.pdf
PPTX
additive manufacturing of ss316l using mig welding
PDF
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
PPTX
KTU 2019 -S7-MCN 401 MODULE 2-VINAY.pptx
PDF
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
PDF
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
PPT on Performance Review to get promotions
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
CH1 Production IntroductoryConcepts.pptx
Embodied AI: Ushering in the Next Era of Intelligent Systems
Foundation to blockchain - A guide to Blockchain Tech
bas. eng. economics group 4 presentation 1.pptx
IOT PPTs Week 10 Lecture Material.pptx of NPTEL Smart Cities contd
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
CRASH COURSE IN ALTERNATIVE PLUMBING CLASS
web development for engineering and engineering
Model Code of Practice - Construction Work - 21102022 .pdf
TFEC-4-2020-Design-Guide-for-Timber-Roof-Trusses.pdf
Automation-in-Manufacturing-Chapter-Introduction.pdf
composite construction of structures.pdf
additive manufacturing of ss316l using mig welding
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
KTU 2019 -S7-MCN 401 MODULE 2-VINAY.pptx
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf

Introduction to Optimization.ppt

  • 2. What is Optimization? • The process of finding the best values for the variables of a particular problem to minimize or maximize an objective function • The action of making the best or most effective use of given situation - (Google dictionary) • It is a technique of squeezing best performance out of provided current state of model
  • 3. Components of an Optimization Problem • Objective function An objective function express performance of a system, need to be minimized or maximized • Variable (Design or Decision Variable) A set of unknowns, define the objective function and constraints, can be continuous, discrete or boolean • Constraints They are conditions, allows the unknowns to take on certain values but exclude others to render the design to be feasible
  • 4. Components of an Optimization Problem Optimization Problem Variables Continuous Discrete Constraints Constrained Unconstrained Objective Function Single Multi
  • 5. Objective function 𝟏 𝟏 𝟐 𝐟 𝐱 , 𝐱𝟐 = 𝐱𝟐+𝟐𝐱𝟐-0.3cos(3 𝛑𝐱𝟏)( 4 𝛑𝐱𝟐)+0.3 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧 𝐦𝐢𝐧(𝐟) 𝐯𝐚𝐫𝐢𝐚𝐛𝐥𝐞𝐬 ∈ [𝟏𝟎, −𝟏𝟎] 𝐔𝐧𝐜𝐨𝐧𝐬𝐭𝐫𝐚𝐢𝐧𝐞𝐝 𝐏𝐫𝐨𝐛𝐥𝐞𝐦 𝐀𝐧 𝐞𝐱𝐚𝐦𝐩𝐥𝐞 ∶ 𝐬𝐢𝐧𝐠𝐥𝐞 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧
  • 6. Objective function 𝐀𝐧 𝐞𝐱𝐚𝐦𝐩𝐥𝐞 ∶ 𝐬𝐢𝐧𝐠𝐥𝐞 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭 𝐢𝐨𝐧 Min f(z1, z2, z3) = (-100-(z1-5)2 - (z2-5)2 +(z3-5)2)/100 Subject to; h(z1, z2, z3) = (z1 - 3)2 + (z2 - 2)2 + (z3 - 5)2 – 0.0625 ≤ 0 where; 0 ≤ zi ≤ 10; 𝐂𝐨𝐧𝐬𝐭𝐫𝐚𝐢𝐧𝐞𝐝 𝐏𝐫𝐨𝐛𝐥𝐞𝐦
  • 7. Objective function 𝐀𝐧 𝐞𝐱𝐚𝐦𝐩𝐥𝐞 ∶ 𝐌𝐮𝐥𝐭𝐢 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧 𝐦𝐢𝐧(𝐟𝟏 ) & 𝐦𝐢𝐧(𝐟𝟐 ) & 𝐦𝐢𝐧(𝐟𝟑 ) 𝐔𝐧𝐜𝐨𝐧𝐬𝐭𝐫𝐚𝐢𝐧𝐞𝐝 𝐏𝐫𝐨𝐛𝐥𝐞𝐦
  • 8. 𝐀𝐧 𝐞𝐱𝐚𝐦𝐩𝐥𝐞 ∶ 𝐌𝐮𝐥𝐭𝐢 𝐨𝐛𝐣𝐞𝐜𝐭𝐢𝐯𝐞 𝐟𝐮𝐧𝐜𝐭𝐢𝐨𝐧 𝒎𝒊𝒏 = 𝐬𝐮𝐛𝐣𝐞𝐜𝐭 𝐭𝐨; 𝐂𝐨𝐧𝐬𝐭𝐫𝐚𝐢𝐧𝐞𝐝 𝐏𝐫𝐨𝐛𝐥𝐞𝐦 Objective function {
  • 9. Type of Optimization Techniques Optimization Technique Conventional Mathematical Programming Calculus Methods Network Methods Nonconventional Meta-heuristic algorithms
  • 10. Meta-heuristicAlgorithms • Meta-heuristic is a general algorithmic framework which can be applied to different optimization problems with relatively few modifications to make them adapted to a specific problem.
  • 11. Meta-heuristicAlgorithms Meta-heuristic algorithms Evolutionary algorithms GA GP Physics-based algorithms CSS SA Swarm-based algorithms Whale Ant Colony Human-based algorithms TLBO EMA Genetic Algorithm (GA) Genetic Programming (GP) Charged System Search (CSS) Simulated Annealing(SA) Teaching Learning Based Optimization(TLBO) Exchange Market Algorithm (EMA)
  • 12. An Example : Whale optimization algorithm 1 Encircling prey 2 Bubble-net attacking method (exploitation phase) 3 Search for prey (exploration phase) Behavior of Whale
  • 13. An Example : Whale optimization algorithm Mathematical Model 1- Encircling prey Where t is the current iteration, A and C are coefficient vectors, X* is the position vector of the best solution, and X indicates the position vector of a solution, | | is the absolute value.
  • 14. An Example : Whale optimization algorithm Where components of a are linearly decreased from 2 to 0 over the course of iterations and r is random vector in [0; 1] Mathematical Model (cont.) The vectors A and C are calculated asfollows:
  • 15. An Example : Whale optimization algorithm Mathematical Model (cont.) 2- Bubble-net mechanism (exploitationphase) Where the value of A is a random value in interval [-a, a] and the value of a is decreased from 2 to 0 , D’ =| X*(t) - X(t) | is the distance between the prey (best solution) and the ith whale, b is a constant, l is a random number in [-1; 1], and p is a random number in [0; 1]
  • 16. An Example : Whale optimization algorithm Mathematical Model (cont.) 3- search for prey (exploration phase) In order to force the search agent to move far a way from reference whale, we use the A with values > 1 or < 1 Where Xrand is a random position vector chosen from the current population.
  • 17. Module 1: Introduction to Optimization • END OF CONTENT MODULE