Theory of Optimization by Ma'am Iqra Razzaq

These notes are provided and composed by Mr. Muzammil Tanveer. We are really very thankful to him for providing these notes and appreciates his effort to publish these notes on MathCity.org. Thease notes are based on the lectures by Ma'am Iqra Razzaq.

• Introduction
• Formal definition
• Status of Optimization
• Flow chart of Modeling process
• Requirement of Optimization Algorithm
• Types of Optimization
• Constraints
• Convex Function
• Convex Optimization Problem
• Matrix form of equations
• Hessian matrix method
• Unconstraint Optimization problems
• Principle minor diagonal
• Newton Raphson Method (For unconstraint’s Optimization)
• Non-linear programming
• Local and Global optima
• Results from Calculus
• Three-point interval search
• Fibonacci Search method
• Mean Search or Golden Mean search or Golden section search method
• The method of steepest Ascent
• Nelder Mead Method
• Fletcher-Powell Method
• Lagrange Multiplier Method
• Single Constraint
• Multiple Constraints
• Newton Raphson’s Method of constraint optimization (for equally constraints)
• Karush-Kuhn-Tucker Method

Please click on View Online to see inside the PDF.

• Advanced Analysis: Handwritten Notes
• Algebra II by Syed Sheraz Asghar
• Complex Analysis (Easy Notes of Complex Analysis)
• Complex Analysis (Quick Review)
• Differential Geometry by M Usman Hamid
• Differential Geometry by Syed Hassan Waqas
• Differential Geometry: Handwritten Notes
• Fluid Mechanics I by Dr Rao Muzamal Hussain
• Fluid Mechanics II by Dr Rao Muzamal Hussain
• Functional Analysis by Mr. Tahir Hussain Jaffery
• Functional Analysis by Prof Mumtaz Ahmad
• Fundamental of Complex Analysis (Solutions of Some Exercises)
• General Topology by Raheel Ahmad
• Group Theory: Important Definitions and Results
• Groups (Handwritten notes)
• Linear Algebra: Important Definitions and Results
• Mathematical Method by Sir Muhammad Awais Aun
• Mathematical Statistics I by Muzammil Tanveer
• Mathematical Statistics II by Sir Haidar Ali
• Measure Theory Notes by Anwar Khan
• Mechanics (Easy Notes of Mechanics)
• Mechanics by Sir Nouman Siddique
• Metric Spaces (Notes)
• Number Theory by Dr Muhammad Umer Shuaib
• Number Theory: Handwritten Notes
• Number Theory: Notes by Anwar Khan
• Numerical Analysis by M Usman Hamid
• Numerical Analysis II
• Operation Research by Sir Haidar Ali
• Operation Research: Handwritten Notes
• Partial Differential Equations
• Real Analysis (Notes by Prof. Syed Gul Shah)
• Ring (Notes) by Prof. M. Dabeer Mughal
• Rings (Handwritten notes)
• Special Functions by Dr. Muhey-U-Din
• Theory of Optimization by Ma'am Iqra Razzaq
• Theory of Relativity & Analytic Dynamics: Handwritten Notes
• Topology Notes by Azhar Hussain
• Topology: Handwritten Notes
• Vector Spaces (Handwritten notes)