Day One: Derivatives, Optimization, and...
Transcript of Day One: Derivatives, Optimization, and...
![Page 1: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/1.jpg)
Day One: Derivatives, Optimization, and Integrals
SOC Methods Camp
September 3rd, 2019
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 1 / 1
![Page 2: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/2.jpg)
Outline
Review and application of derivatives
I Chain ruleI Derivatives of logs/exponentsI Two tools important for optimization
F Higher-order derivativesF Partial derivatives
I Basic optimizationReview and application of integrals
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 2 / 1
![Page 3: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/3.jpg)
Outline
Review and application of derivativesI Chain rule
I Derivatives of logs/exponentsI Two tools important for optimization
F Higher-order derivativesF Partial derivatives
I Basic optimizationReview and application of integrals
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 2 / 1
![Page 4: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/4.jpg)
Outline
Review and application of derivativesI Chain ruleI Derivatives of logs/exponents
I Two tools important for optimization
F Higher-order derivativesF Partial derivatives
I Basic optimizationReview and application of integrals
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 2 / 1
![Page 5: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/5.jpg)
Outline
Review and application of derivativesI Chain ruleI Derivatives of logs/exponentsI Two tools important for optimization
F Higher-order derivativesF Partial derivatives
I Basic optimizationReview and application of integrals
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 2 / 1
![Page 6: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/6.jpg)
Outline
Review and application of derivativesI Chain ruleI Derivatives of logs/exponentsI Two tools important for optimization
F Higher-order derivatives
F Partial derivativesI Basic optimization
Review and application of integrals
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 2 / 1
![Page 7: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/7.jpg)
Outline
Review and application of derivativesI Chain ruleI Derivatives of logs/exponentsI Two tools important for optimization
F Higher-order derivativesF Partial derivatives
I Basic optimizationReview and application of integrals
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 2 / 1
![Page 8: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/8.jpg)
Outline
Review and application of derivativesI Chain ruleI Derivatives of logs/exponentsI Two tools important for optimization
F Higher-order derivativesF Partial derivatives
I Basic optimization
Review and application of integrals
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 2 / 1
![Page 9: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/9.jpg)
Outline
Review and application of derivativesI Chain ruleI Derivatives of logs/exponentsI Two tools important for optimization
F Higher-order derivativesF Partial derivatives
I Basic optimizationReview and application of integrals
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 2 / 1
![Page 10: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/10.jpg)
Review of topics covered in summer assignment
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 3 / 1
![Page 11: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/11.jpg)
Interval notation, domain, and range
An interval is a connected subset of the real number line. There areinfnite real numbers that exist between two points on the number line(say, between 0 and 15) so really, what’s relevant for our descriptionare these two end points.
If we use intervals to describe the range of a variable in a dataset, it isokay if the interval encompasses values that don’t actually exist in thedataset.The domain and range of functions are often expressed in intervalnotation. These important intervals represent the range of possiblevalues that x or y can take on.Some common sets for domain/range in interval notation:
I all real numbers (the entire number line): (−∞,∞)I all real numbers except 0: (−∞, 0) ∪ (0,∞)
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 4 / 1
![Page 12: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/12.jpg)
Interval notation, domain, and range
An interval is a connected subset of the real number line. There areinfnite real numbers that exist between two points on the number line(say, between 0 and 15) so really, what’s relevant for our descriptionare these two end points.If we use intervals to describe the range of a variable in a dataset, it isokay if the interval encompasses values that don’t actually exist in thedataset.
The domain and range of functions are often expressed in intervalnotation. These important intervals represent the range of possiblevalues that x or y can take on.Some common sets for domain/range in interval notation:
I all real numbers (the entire number line): (−∞,∞)I all real numbers except 0: (−∞, 0) ∪ (0,∞)
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 4 / 1
![Page 13: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/13.jpg)
Interval notation, domain, and range
An interval is a connected subset of the real number line. There areinfnite real numbers that exist between two points on the number line(say, between 0 and 15) so really, what’s relevant for our descriptionare these two end points.If we use intervals to describe the range of a variable in a dataset, it isokay if the interval encompasses values that don’t actually exist in thedataset.The domain and range of functions are often expressed in intervalnotation. These important intervals represent the range of possiblevalues that x or y can take on.
Some common sets for domain/range in interval notation:
I all real numbers (the entire number line): (−∞,∞)I all real numbers except 0: (−∞, 0) ∪ (0,∞)
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 4 / 1
![Page 14: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/14.jpg)
Interval notation, domain, and range
An interval is a connected subset of the real number line. There areinfnite real numbers that exist between two points on the number line(say, between 0 and 15) so really, what’s relevant for our descriptionare these two end points.If we use intervals to describe the range of a variable in a dataset, it isokay if the interval encompasses values that don’t actually exist in thedataset.The domain and range of functions are often expressed in intervalnotation. These important intervals represent the range of possiblevalues that x or y can take on.Some common sets for domain/range in interval notation:
I all real numbers (the entire number line): (−∞,∞)I all real numbers except 0: (−∞, 0) ∪ (0,∞)
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 4 / 1
![Page 15: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/15.jpg)
Interval notation, domain, and range
An interval is a connected subset of the real number line. There areinfnite real numbers that exist between two points on the number line(say, between 0 and 15) so really, what’s relevant for our descriptionare these two end points.If we use intervals to describe the range of a variable in a dataset, it isokay if the interval encompasses values that don’t actually exist in thedataset.The domain and range of functions are often expressed in intervalnotation. These important intervals represent the range of possiblevalues that x or y can take on.Some common sets for domain/range in interval notation:
I all real numbers (the entire number line): (−∞,∞)
I all real numbers except 0: (−∞, 0) ∪ (0,∞)
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 4 / 1
![Page 16: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/16.jpg)
Interval notation, domain, and range
An interval is a connected subset of the real number line. There areinfnite real numbers that exist between two points on the number line(say, between 0 and 15) so really, what’s relevant for our descriptionare these two end points.If we use intervals to describe the range of a variable in a dataset, it isokay if the interval encompasses values that don’t actually exist in thedataset.The domain and range of functions are often expressed in intervalnotation. These important intervals represent the range of possiblevalues that x or y can take on.Some common sets for domain/range in interval notation:
I all real numbers (the entire number line): (−∞,∞)I all real numbers except 0: (−∞, 0) ∪ (0,∞)
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 4 / 1
![Page 17: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/17.jpg)
Why derivatives?
Derivatives might seem like a relic from our high school days withunclear relevance for statistics
But consider the following very applied (stylized) cases
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 5 / 1
![Page 18: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/18.jpg)
Why derivatives?
Derivatives might seem like a relic from our high school days withunclear relevance for statisticsBut consider the following very applied (stylized) cases
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 5 / 1
![Page 19: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/19.jpg)
Application one: investigating rates of change underdifferent conditions
Scenario: You want to construct a formal model, similar to the blackversus white population change model we reviewed in the summerassignment, where:
the x axis represents the number of an individual’s friends who havejoined a protestthe y axis represents an individual’s probability of joining the protest.
You want to see how the rate at which the individual’s probability of joiningthe protest changes (the slope of the curve) at varying number of friendsunder different assumptions about the strength of influence friends have onprotesting
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 6 / 1
![Page 20: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/20.jpg)
Application one: investigating rates of change underdifferent conditions
Weaker social influence
Stronger social influence
0.5
0.6
0.7
0.8
0.9
1.0
0 50 100 150 200Number of friends at protest
Pro
babi
lity
of p
rote
stin
g
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 7 / 1
![Page 21: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/21.jpg)
Application two: inferring unobserved weights thatgenerate observed patternsScenario: You’re fitting a model to assign weights to different variables(e.g., education; rural versus urban residence) in predicting whether or not aperson will develop an opioid addiction (1 = yes; 0 = no). You have a setof data on who developed addiction and their demographic characteristics,and want to find weights for each characteristic in a way that maximizes theprobability of observing the correct pattern of 1’s and 0’s in the addictionvariable.
This is basically what you’re trying to do when you run a regression:assign weights to variables to maximize the likelihood of predicting(using the regression model) your observed outcomes given your knowninputs.Derivatives help us with maximum likelihood estimation byallowing us to find critical points.
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 8 / 1
![Page 22: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/22.jpg)
Why focus on chain rule and logs/exponents?
Chain rule: real-world processes and functions that describe them arecomplex; chain rule provides some tools for breaking down functionsinto composite parts to more easily find the derivative
Logs/exponents: ex and log(x) (which unless otherwise specified,refers to the natural log) each have simple derivatives; so a frequentapproach is to:
1 Take a function that has a lot of products/things that make derivativedifficult
2 Take the log of that function, remembering rules of logs/exponents andthat the log of a product is the sum of its logs (which all of you ablyshowed in the summer assignment!)
3 Find the derivative more easily!
For steps two and three, practice with derivatives of logs/exponents isimportant
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 9 / 1
![Page 23: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/23.jpg)
Why focus on chain rule and logs/exponents?
Chain rule: real-world processes and functions that describe them arecomplex; chain rule provides some tools for breaking down functionsinto composite parts to more easily find the derivativeLogs/exponents: ex and log(x) (which unless otherwise specified,refers to the natural log) each have simple derivatives; so a frequentapproach is to:
1 Take a function that has a lot of products/things that make derivativedifficult
2 Take the log of that function, remembering rules of logs/exponents andthat the log of a product is the sum of its logs (which all of you ablyshowed in the summer assignment!)
3 Find the derivative more easily!For steps two and three, practice with derivatives of logs/exponents isimportant
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 9 / 1
![Page 24: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/24.jpg)
Why focus on chain rule and logs/exponents?
Chain rule: real-world processes and functions that describe them arecomplex; chain rule provides some tools for breaking down functionsinto composite parts to more easily find the derivativeLogs/exponents: ex and log(x) (which unless otherwise specified,refers to the natural log) each have simple derivatives; so a frequentapproach is to:
1 Take a function that has a lot of products/things that make derivativedifficult
2 Take the log of that function, remembering rules of logs/exponents andthat the log of a product is the sum of its logs (which all of you ablyshowed in the summer assignment!)
3 Find the derivative more easily!For steps two and three, practice with derivatives of logs/exponents isimportant
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 9 / 1
![Page 25: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/25.jpg)
Why focus on chain rule and logs/exponents?
Chain rule: real-world processes and functions that describe them arecomplex; chain rule provides some tools for breaking down functionsinto composite parts to more easily find the derivativeLogs/exponents: ex and log(x) (which unless otherwise specified,refers to the natural log) each have simple derivatives; so a frequentapproach is to:
1 Take a function that has a lot of products/things that make derivativedifficult
2 Take the log of that function, remembering rules of logs/exponents andthat the log of a product is the sum of its logs (which all of you ablyshowed in the summer assignment!)
3 Find the derivative more easily!For steps two and three, practice with derivatives of logs/exponents isimportant
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 9 / 1
![Page 26: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/26.jpg)
Why focus on chain rule and logs/exponents?
Chain rule: real-world processes and functions that describe them arecomplex; chain rule provides some tools for breaking down functionsinto composite parts to more easily find the derivativeLogs/exponents: ex and log(x) (which unless otherwise specified,refers to the natural log) each have simple derivatives; so a frequentapproach is to:
1 Take a function that has a lot of products/things that make derivativedifficult
2 Take the log of that function, remembering rules of logs/exponents andthat the log of a product is the sum of its logs (which all of you ablyshowed in the summer assignment!)
3 Find the derivative more easily!
For steps two and three, practice with derivatives of logs/exponents isimportant
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 9 / 1
![Page 27: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/27.jpg)
Why focus on chain rule and logs/exponents?
Chain rule: real-world processes and functions that describe them arecomplex; chain rule provides some tools for breaking down functionsinto composite parts to more easily find the derivativeLogs/exponents: ex and log(x) (which unless otherwise specified,refers to the natural log) each have simple derivatives; so a frequentapproach is to:
1 Take a function that has a lot of products/things that make derivativedifficult
2 Take the log of that function, remembering rules of logs/exponents andthat the log of a product is the sum of its logs (which all of you ablyshowed in the summer assignment!)
3 Find the derivative more easily!For steps two and three, practice with derivatives of logs/exponents isimportant
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 9 / 1
![Page 28: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/28.jpg)
Chain rule: mechanics
When do we use the chain rule? When we have what’s called acomposite function- e.g., a function nested inside another function
Notation:
I (f ◦ g) = f (g(x))I Chain rule = ∂
∂x f (g(x)) = f ′(g(x)) ∗ g ′(x)
More colloquial: think about...
1 Take the derivative of the "outer layer" of the function (f (x)) whilekeeping the inner layer (g(x)) constant while you take the derivative
2 Then take the derivative of the "inner layer" of the function (g(x))3 Then multiply the results from step 1 and step 2 and simplify as needed
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 10 / 1
![Page 29: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/29.jpg)
Chain rule: mechanics
When do we use the chain rule? When we have what’s called acomposite function- e.g., a function nested inside another functionNotation:
I (f ◦ g) = f (g(x))I Chain rule = ∂
∂x f (g(x)) = f ′(g(x)) ∗ g ′(x)
More colloquial: think about...
1 Take the derivative of the "outer layer" of the function (f (x)) whilekeeping the inner layer (g(x)) constant while you take the derivative
2 Then take the derivative of the "inner layer" of the function (g(x))3 Then multiply the results from step 1 and step 2 and simplify as needed
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 10 / 1
![Page 30: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/30.jpg)
Chain rule: mechanics
When do we use the chain rule? When we have what’s called acomposite function- e.g., a function nested inside another functionNotation:
I (f ◦ g) = f (g(x))
I Chain rule = ∂∂x f (g(x)) = f ′(g(x)) ∗ g ′(x)
More colloquial: think about...
1 Take the derivative of the "outer layer" of the function (f (x)) whilekeeping the inner layer (g(x)) constant while you take the derivative
2 Then take the derivative of the "inner layer" of the function (g(x))3 Then multiply the results from step 1 and step 2 and simplify as needed
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 10 / 1
![Page 31: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/31.jpg)
Chain rule: mechanics
When do we use the chain rule? When we have what’s called acomposite function- e.g., a function nested inside another functionNotation:
I (f ◦ g) = f (g(x))I Chain rule = ∂
∂x f (g(x)) = f ′(g(x)) ∗ g ′(x)
More colloquial: think about...
1 Take the derivative of the "outer layer" of the function (f (x)) whilekeeping the inner layer (g(x)) constant while you take the derivative
2 Then take the derivative of the "inner layer" of the function (g(x))3 Then multiply the results from step 1 and step 2 and simplify as needed
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 10 / 1
![Page 32: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/32.jpg)
Chain rule: mechanics
When do we use the chain rule? When we have what’s called acomposite function- e.g., a function nested inside another functionNotation:
I (f ◦ g) = f (g(x))I Chain rule = ∂
∂x f (g(x)) = f ′(g(x)) ∗ g ′(x)
More colloquial: think about...
1 Take the derivative of the "outer layer" of the function (f (x)) whilekeeping the inner layer (g(x)) constant while you take the derivative
2 Then take the derivative of the "inner layer" of the function (g(x))3 Then multiply the results from step 1 and step 2 and simplify as needed
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 10 / 1
![Page 33: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/33.jpg)
Chain rule: mechanics
When do we use the chain rule? When we have what’s called acomposite function- e.g., a function nested inside another functionNotation:
I (f ◦ g) = f (g(x))I Chain rule = ∂
∂x f (g(x)) = f ′(g(x)) ∗ g ′(x)
More colloquial: think about...1 Take the derivative of the "outer layer" of the function (f (x)) while
keeping the inner layer (g(x)) constant while you take the derivative
2 Then take the derivative of the "inner layer" of the function (g(x))3 Then multiply the results from step 1 and step 2 and simplify as needed
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 10 / 1
![Page 34: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/34.jpg)
Chain rule: mechanics
When do we use the chain rule? When we have what’s called acomposite function- e.g., a function nested inside another functionNotation:
I (f ◦ g) = f (g(x))I Chain rule = ∂
∂x f (g(x)) = f ′(g(x)) ∗ g ′(x)
More colloquial: think about...1 Take the derivative of the "outer layer" of the function (f (x)) while
keeping the inner layer (g(x)) constant while you take the derivative2 Then take the derivative of the "inner layer" of the function (g(x))
3 Then multiply the results from step 1 and step 2 and simplify as needed
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 10 / 1
![Page 35: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/35.jpg)
Chain rule: mechanics
When do we use the chain rule? When we have what’s called acomposite function- e.g., a function nested inside another functionNotation:
I (f ◦ g) = f (g(x))I Chain rule = ∂
∂x f (g(x)) = f ′(g(x)) ∗ g ′(x)
More colloquial: think about...1 Take the derivative of the "outer layer" of the function (f (x)) while
keeping the inner layer (g(x)) constant while you take the derivative2 Then take the derivative of the "inner layer" of the function (g(x))3 Then multiply the results from step 1 and step 2 and simplify as needed
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 10 / 1
![Page 36: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/36.jpg)
Chain rule practice
1 f (g(x)) =√3x4
2 f (g(x)) = x ∗√1− x2
Try these on your own and then we’ll review as a group...
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 11 / 1
![Page 37: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/37.jpg)
Chain rule practice: solution one1 Step one: take the derivative of the "outer layer" of the function (f (x))
while keeping the inner layer constant while you take the derivative
I Outer layer: f (x) =√u = u 1
2
I Derivative of outer layer while keeping inner layer constant:
f ′(g(x)) = 12 (3x4)− 1
2
I Rearrange derivative of outer layer to make more readable:
f ′(g(x)) = 12 ∗
1√3x4
2 Step two: take the derivative of the "inner layer" of the function
I Inner layer: g(x) = 3x4
I Derivative of inner layer: g ′(x) = 12x3
3 Step three: multiply results from steps one and two: 12 ∗
12x3√
3x4 = 6x3√
3x4
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 12 / 1
![Page 38: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/38.jpg)
Chain rule practice: solution one1 Step one: take the derivative of the "outer layer" of the function (f (x))
while keeping the inner layer constant while you take the derivative
I Outer layer: f (x) =√u = u 1
2
I Derivative of outer layer while keeping inner layer constant:
f ′(g(x)) = 12 (3x4)− 1
2
I Rearrange derivative of outer layer to make more readable:
f ′(g(x)) = 12 ∗
1√3x4
2 Step two: take the derivative of the "inner layer" of the function
I Inner layer: g(x) = 3x4
I Derivative of inner layer: g ′(x) = 12x3
3 Step three: multiply results from steps one and two: 12 ∗
12x3√
3x4 = 6x3√
3x4
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 12 / 1
![Page 39: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/39.jpg)
Chain rule practice: solution one1 Step one: take the derivative of the "outer layer" of the function (f (x))
while keeping the inner layer constant while you take the derivative
I Outer layer: f (x) =√u = u 1
2
I Derivative of outer layer while keeping inner layer constant:
f ′(g(x)) = 12 (3x4)− 1
2
I Rearrange derivative of outer layer to make more readable:
f ′(g(x)) = 12 ∗
1√3x4
2 Step two: take the derivative of the "inner layer" of the function
I Inner layer: g(x) = 3x4
I Derivative of inner layer: g ′(x) = 12x3
3 Step three: multiply results from steps one and two: 12 ∗
12x3√
3x4 = 6x3√
3x4
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 12 / 1
![Page 40: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/40.jpg)
Chain rule practice: solution one1 Step one: take the derivative of the "outer layer" of the function (f (x))
while keeping the inner layer constant while you take the derivative
I Outer layer: f (x) =√u = u 1
2
I Derivative of outer layer while keeping inner layer constant:
f ′(g(x)) = 12 (3x4)− 1
2
I Rearrange derivative of outer layer to make more readable:
f ′(g(x)) = 12 ∗
1√3x4
2 Step two: take the derivative of the "inner layer" of the function
I Inner layer: g(x) = 3x4
I Derivative of inner layer: g ′(x) = 12x3
3 Step three: multiply results from steps one and two: 12 ∗
12x3√
3x4 = 6x3√
3x4
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 12 / 1
![Page 41: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/41.jpg)
Chain rule practice: solution one1 Step one: take the derivative of the "outer layer" of the function (f (x))
while keeping the inner layer constant while you take the derivative
I Outer layer: f (x) =√u = u 1
2
I Derivative of outer layer while keeping inner layer constant:
f ′(g(x)) = 12 (3x4)− 1
2
I Rearrange derivative of outer layer to make more readable:
f ′(g(x)) = 12 ∗
1√3x4
2 Step two: take the derivative of the "inner layer" of the function
I Inner layer: g(x) = 3x4
I Derivative of inner layer: g ′(x) = 12x3
3 Step three: multiply results from steps one and two: 12 ∗
12x3√
3x4 = 6x3√
3x4
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 12 / 1
![Page 42: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/42.jpg)
Chain rule practice: solution one1 Step one: take the derivative of the "outer layer" of the function (f (x))
while keeping the inner layer constant while you take the derivative
I Outer layer: f (x) =√u = u 1
2
I Derivative of outer layer while keeping inner layer constant:
f ′(g(x)) = 12 (3x4)− 1
2
I Rearrange derivative of outer layer to make more readable:
f ′(g(x)) = 12 ∗
1√3x4
2 Step two: take the derivative of the "inner layer" of the function
I Inner layer: g(x) = 3x4
I Derivative of inner layer: g ′(x) = 12x3
3 Step three: multiply results from steps one and two: 12 ∗
12x3√
3x4 = 6x3√
3x4
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 12 / 1
![Page 43: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/43.jpg)
Chain rule practice: solution one1 Step one: take the derivative of the "outer layer" of the function (f (x))
while keeping the inner layer constant while you take the derivative
I Outer layer: f (x) =√u = u 1
2
I Derivative of outer layer while keeping inner layer constant:
f ′(g(x)) = 12 (3x4)− 1
2
I Rearrange derivative of outer layer to make more readable:
f ′(g(x)) = 12 ∗
1√3x4
2 Step two: take the derivative of the "inner layer" of the function
I Inner layer: g(x) = 3x4
I Derivative of inner layer: g ′(x) = 12x3
3 Step three: multiply results from steps one and two: 12 ∗
12x3√
3x4 = 6x3√
3x4
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 12 / 1
![Page 44: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/44.jpg)
Chain rule practice: solution one1 Step one: take the derivative of the "outer layer" of the function (f (x))
while keeping the inner layer constant while you take the derivative
I Outer layer: f (x) =√u = u 1
2
I Derivative of outer layer while keeping inner layer constant:
f ′(g(x)) = 12 (3x4)− 1
2
I Rearrange derivative of outer layer to make more readable:
f ′(g(x)) = 12 ∗
1√3x4
2 Step two: take the derivative of the "inner layer" of the function
I Inner layer: g(x) = 3x4
I Derivative of inner layer: g ′(x) = 12x3
3 Step three: multiply results from steps one and two: 12 ∗
12x3√
3x4 = 6x3√
3x4
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 12 / 1
![Page 45: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/45.jpg)
Chain rule practice: solution one4 Step four: Simplify (could have also simplified at an earlier step by
taking the constant out of the original equation)
Break out the x4 from the square root in the denominator and divide itinto the numerator:
6x3√3x4
= 6x√3
Multiply both numerator and denominator by√3:
6x√3∗√3√3
= 6x√3
3
Simplify:6x√3
3 = 2x√3
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 13 / 1
![Page 46: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/46.jpg)
Chain rule practice: solution one4 Step four: Simplify (could have also simplified at an earlier step by
taking the constant out of the original equation)
Break out the x4 from the square root in the denominator and divide itinto the numerator:
6x3√3x4
= 6x√3
Multiply both numerator and denominator by√3:
6x√3∗√3√3
= 6x√3
3
Simplify:6x√3
3 = 2x√3
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 13 / 1
![Page 47: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/47.jpg)
Chain rule practice: solution one4 Step four: Simplify (could have also simplified at an earlier step by
taking the constant out of the original equation)
Break out the x4 from the square root in the denominator and divide itinto the numerator:
6x3√3x4
= 6x√3
Multiply both numerator and denominator by√3:
6x√3∗√3√3
= 6x√3
3
Simplify:6x√3
3 = 2x√3
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 13 / 1
![Page 48: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/48.jpg)
Chain rule practice: solution two
f (g(x)) = x ∗√1− x2
Use the product rule ∂∂x f (x) ∗ g(x) = f ′(x) ∗ g(x) + f (x) ∗ g ′(x):
x ∗ (√1− x2)′ + 1 ∗
√1− x2
We’re going to be using the chain rule on (√1− x2)′
Take the derivative of the "outer layer" of the function (f (x)) whilekeeping the inner layer constant while you take the derivative
I Outer layer:√u
I Derivative of outer layer while keeping inner layer constant: 12 ∗
1√1−x2
I Take the derivative of the "inner layer" of the function: g(x) = 1− x2;g ′(x) = −2x
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 14 / 1
![Page 49: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/49.jpg)
Chain rule practice: solution two
f (g(x)) = x ∗√1− x2
Use the product rule ∂∂x f (x) ∗ g(x) = f ′(x) ∗ g(x) + f (x) ∗ g ′(x):
x ∗ (√1− x2)′ + 1 ∗
√1− x2
We’re going to be using the chain rule on (√1− x2)′
Take the derivative of the "outer layer" of the function (f (x)) whilekeeping the inner layer constant while you take the derivative
I Outer layer:√u
I Derivative of outer layer while keeping inner layer constant: 12 ∗
1√1−x2
I Take the derivative of the "inner layer" of the function: g(x) = 1− x2;g ′(x) = −2x
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 14 / 1
![Page 50: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/50.jpg)
Chain rule practice: solution two
f (g(x)) = x ∗√1− x2
Use the product rule ∂∂x f (x) ∗ g(x) = f ′(x) ∗ g(x) + f (x) ∗ g ′(x):
x ∗ (√1− x2)′ + 1 ∗
√1− x2
We’re going to be using the chain rule on (√1− x2)′
Take the derivative of the "outer layer" of the function (f (x)) whilekeeping the inner layer constant while you take the derivative
I Outer layer:√u
I Derivative of outer layer while keeping inner layer constant: 12 ∗
1√1−x2
I Take the derivative of the "inner layer" of the function: g(x) = 1− x2;g ′(x) = −2x
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 14 / 1
![Page 51: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/51.jpg)
Chain rule practice: solution two
f (g(x)) = x ∗√1− x2
Use the product rule ∂∂x f (x) ∗ g(x) = f ′(x) ∗ g(x) + f (x) ∗ g ′(x):
x ∗ (√1− x2)′ + 1 ∗
√1− x2
We’re going to be using the chain rule on (√1− x2)′
Take the derivative of the "outer layer" of the function (f (x)) whilekeeping the inner layer constant while you take the derivative
I Outer layer:√u
I Derivative of outer layer while keeping inner layer constant: 12 ∗
1√1−x2
I Take the derivative of the "inner layer" of the function: g(x) = 1− x2;g ′(x) = −2x
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 14 / 1
![Page 52: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/52.jpg)
Chain rule practice: solution two
f (g(x)) = x ∗√1− x2
Use the product rule ∂∂x f (x) ∗ g(x) = f ′(x) ∗ g(x) + f (x) ∗ g ′(x):
x ∗ (√1− x2)′ + 1 ∗
√1− x2
We’re going to be using the chain rule on (√1− x2)′
Take the derivative of the "outer layer" of the function (f (x)) whilekeeping the inner layer constant while you take the derivative
I Outer layer:√u
I Derivative of outer layer while keeping inner layer constant: 12 ∗
1√1−x2
I Take the derivative of the "inner layer" of the function: g(x) = 1− x2;g ′(x) = −2x
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 14 / 1
![Page 53: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/53.jpg)
Chain rule practice: solution two
f (g(x)) = x ∗√1− x2
Use the product rule ∂∂x f (x) ∗ g(x) = f ′(x) ∗ g(x) + f (x) ∗ g ′(x):
x ∗ (√1− x2)′ + 1 ∗
√1− x2
We’re going to be using the chain rule on (√1− x2)′
Take the derivative of the "outer layer" of the function (f (x)) whilekeeping the inner layer constant while you take the derivative
I Outer layer:√u
I Derivative of outer layer while keeping inner layer constant: 12 ∗
1√1−x2
I Take the derivative of the "inner layer" of the function: g(x) = 1− x2;g ′(x) = −2x
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 14 / 1
![Page 54: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/54.jpg)
Chain rule practice: solution two
Multiply inner and outer layer from previous step and simplify:
12 ∗
−2x√1− x2
= −x√1− x2
Plug back into original product rule equation and simplify:
x ∗−x
√1− x2
+√
1− x2 =−x2√
1− x2+
√1− x2
=−x2√
1− x2+√
1− x2√
1− x2√
1− x2
=−x2 +
√1− x2
√1− x2
√1− x2
=1− 2x2√
1− x2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 15 / 1
![Page 55: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/55.jpg)
Chain rule practice: solution two
Multiply inner and outer layer from previous step and simplify:
12 ∗
−2x√1− x2
= −x√1− x2
Plug back into original product rule equation and simplify:
x ∗−x
√1− x2
+√
1− x2 =−x2√
1− x2+
√1− x2
=−x2√
1− x2+√
1− x2√
1− x2√
1− x2
=−x2 +
√1− x2
√1− x2
√1− x2
=1− 2x2√
1− x2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 15 / 1
![Page 56: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/56.jpg)
Why start with chain rule?
The chain rule is often used with derivatives of logs and exponents, whichare important tools for making functions easier to work with in maximum
likelihood estimation.
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 16 / 1
![Page 57: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/57.jpg)
Derivatives of logs and exponents
Derivatives:
∂∂x ln(x) = 1
x
∂∂x e
x = ex
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 17 / 1
![Page 58: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/58.jpg)
Derivatives of logs and exponents
Derivatives:
∂∂x ln(x) = 1
x∂
∂x ex = ex
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 17 / 1
![Page 59: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/59.jpg)
Derivatives of logs and exponents
Derivatives:
∂∂x ln(x) = 1
x∂
∂x ex = ex
Some examples to practice on your worksheet
1 ∂∂x ln(x5)
2 ∂∂x ln(x2 + 3)
3 ∂∂x e
5x+2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 18 / 1
![Page 60: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/60.jpg)
Derivatives of logs and exponents: solutions
Some examples to practice on your worksheet
1 ∂∂x ln(x5) = ∂
∂x 5 ∗ ln(x) = 5x
2 ∂∂x ln(x2 + 3)
I Outer layer derivative: 1x2+3
I Inner layer derivative: 2xI Multiply: 2x
x2+3
3 ∂∂x e
5x+2
I Outer layer derivative: e5x+2
I Inner layer derivative: 5I Multiply: 5e5x+2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 19 / 1
![Page 61: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/61.jpg)
Derivatives of logs and exponents: solutions
Some examples to practice on your worksheet
1 ∂∂x ln(x5) = ∂
∂x 5 ∗ ln(x) = 5x
2 ∂∂x ln(x2 + 3)
I Outer layer derivative: 1x2+3
I Inner layer derivative: 2xI Multiply: 2x
x2+3
3 ∂∂x e
5x+2
I Outer layer derivative: e5x+2
I Inner layer derivative: 5I Multiply: 5e5x+2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 19 / 1
![Page 62: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/62.jpg)
Derivatives of logs and exponents: solutions
Some examples to practice on your worksheet
1 ∂∂x ln(x5) = ∂
∂x 5 ∗ ln(x) = 5x
2 ∂∂x ln(x2 + 3)
I Outer layer derivative: 1x2+3
I Inner layer derivative: 2xI Multiply: 2x
x2+3
3 ∂∂x e
5x+2
I Outer layer derivative: e5x+2
I Inner layer derivative: 5I Multiply: 5e5x+2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 19 / 1
![Page 63: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/63.jpg)
Derivatives of logs and exponents: solutions
Some examples to practice on your worksheet
1 ∂∂x ln(x5) = ∂
∂x 5 ∗ ln(x) = 5x
2 ∂∂x ln(x2 + 3)
I Outer layer derivative: 1x2+3
I Inner layer derivative: 2x
I Multiply: 2xx2+3
3 ∂∂x e
5x+2
I Outer layer derivative: e5x+2
I Inner layer derivative: 5I Multiply: 5e5x+2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 19 / 1
![Page 64: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/64.jpg)
Derivatives of logs and exponents: solutions
Some examples to practice on your worksheet
1 ∂∂x ln(x5) = ∂
∂x 5 ∗ ln(x) = 5x
2 ∂∂x ln(x2 + 3)
I Outer layer derivative: 1x2+3
I Inner layer derivative: 2xI Multiply: 2x
x2+3
3 ∂∂x e
5x+2
I Outer layer derivative: e5x+2
I Inner layer derivative: 5I Multiply: 5e5x+2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 19 / 1
![Page 65: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/65.jpg)
Derivatives of logs and exponents: solutions
Some examples to practice on your worksheet
1 ∂∂x ln(x5) = ∂
∂x 5 ∗ ln(x) = 5x
2 ∂∂x ln(x2 + 3)
I Outer layer derivative: 1x2+3
I Inner layer derivative: 2xI Multiply: 2x
x2+3
3 ∂∂x e
5x+2
I Outer layer derivative: e5x+2
I Inner layer derivative: 5I Multiply: 5e5x+2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 19 / 1
![Page 66: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/66.jpg)
Derivatives of logs and exponents: solutions
Some examples to practice on your worksheet
1 ∂∂x ln(x5) = ∂
∂x 5 ∗ ln(x) = 5x
2 ∂∂x ln(x2 + 3)
I Outer layer derivative: 1x2+3
I Inner layer derivative: 2xI Multiply: 2x
x2+3
3 ∂∂x e
5x+2
I Outer layer derivative: e5x+2
I Inner layer derivative: 5I Multiply: 5e5x+2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 19 / 1
![Page 67: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/67.jpg)
Derivatives of logs and exponents: solutions
Some examples to practice on your worksheet
1 ∂∂x ln(x5) = ∂
∂x 5 ∗ ln(x) = 5x
2 ∂∂x ln(x2 + 3)
I Outer layer derivative: 1x2+3
I Inner layer derivative: 2xI Multiply: 2x
x2+3
3 ∂∂x e
5x+2
I Outer layer derivative: e5x+2
I Inner layer derivative: 5
I Multiply: 5e5x+2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 19 / 1
![Page 68: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/68.jpg)
Derivatives of logs and exponents: solutions
Some examples to practice on your worksheet
1 ∂∂x ln(x5) = ∂
∂x 5 ∗ ln(x) = 5x
2 ∂∂x ln(x2 + 3)
I Outer layer derivative: 1x2+3
I Inner layer derivative: 2xI Multiply: 2x
x2+3
3 ∂∂x e
5x+2
I Outer layer derivative: e5x+2
I Inner layer derivative: 5I Multiply: 5e5x+2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 19 / 1
![Page 69: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/69.jpg)
Two useful tools for optimization
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 20 / 1
![Page 70: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/70.jpg)
Why tools for optimization?We’ve practiced finding the derivative of various functions
Optimization involves finding the set of points at which the derivativeis equal to zero (critical points), which since the derivative is the slopeof the function, is the point at which this slope equals zero:
−2000
0
2000
4000
0 5000 10000 15000 20000healthnav
acae
nrol
l
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 21 / 1
![Page 71: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/71.jpg)
Why tools for optimization?We’ve practiced finding the derivative of various functionsOptimization involves finding the set of points at which the derivativeis equal to zero (critical points), which since the derivative is the slopeof the function, is the point at which this slope equals zero:
−2000
0
2000
4000
0 5000 10000 15000 20000healthnav
acae
nrol
l
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 21 / 1
![Page 72: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/72.jpg)
Why tools for optimization?
Sometimes we can find these points by actually finding the derivativeand setting it equal to zero (analytic optimization: our focus today)
Other times, an analytic solution is impossible so we instead rely onalgorithms that help us "climb the hill" of a curve or jump around thespace a function covers to find these points (numerical optimization)For both forms of optimization, we need additional tools, which is thefocus of the next section
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 22 / 1
![Page 73: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/73.jpg)
Why tools for optimization?
Sometimes we can find these points by actually finding the derivativeand setting it equal to zero (analytic optimization: our focus today)Other times, an analytic solution is impossible so we instead rely onalgorithms that help us "climb the hill" of a curve or jump around thespace a function covers to find these points (numerical optimization)
For both forms of optimization, we need additional tools, which is thefocus of the next section
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 22 / 1
![Page 74: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/74.jpg)
Why tools for optimization?
Sometimes we can find these points by actually finding the derivativeand setting it equal to zero (analytic optimization: our focus today)Other times, an analytic solution is impossible so we instead rely onalgorithms that help us "climb the hill" of a curve or jump around thespace a function covers to find these points (numerical optimization)For both forms of optimization, we need additional tools, which is thefocus of the next section
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 22 / 1
![Page 75: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/75.jpg)
Two useful tools
1 Tool one: higher-order derivatives (derivatives of derivatives...adinfinitum)
2 Tool two: partial derivatives (derivatives for functions with more thanone variable)
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 23 / 1
![Page 76: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/76.jpg)
Two useful tools
1 Tool one: higher-order derivatives (derivatives of derivatives...adinfinitum)
2 Tool two: partial derivatives (derivatives for functions with more thanone variable)
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 23 / 1
![Page 77: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/77.jpg)
Tool one: higher order derivatives
−2000
0
2000
4000
0 5000 10000 15000 20000healthnav
acae
nrol
l
On the function to the left,which we’ll review in greaterdetail later, we can use the firstderivative to find where theslope of the curve equals zero
From visualizing the function,we can clearly see that it’s amaximum
But in order to confirm that, weuse higher-order derivatives tohelp us check how the slopechanges on either side of thatflat point on the curve to assesswhether it’s a maximum,minimum, or neither
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 24 / 1
![Page 78: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/78.jpg)
Tool one: higher order derivatives
−2000
0
2000
4000
0 5000 10000 15000 20000healthnav
acae
nrol
l
On the function to the left,which we’ll review in greaterdetail later, we can use the firstderivative to find where theslope of the curve equals zero
From visualizing the function,we can clearly see that it’s amaximum
But in order to confirm that, weuse higher-order derivatives tohelp us check how the slopechanges on either side of thatflat point on the curve to assesswhether it’s a maximum,minimum, or neither
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 24 / 1
![Page 79: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/79.jpg)
Tool one: higher order derivatives
−2000
0
2000
4000
0 5000 10000 15000 20000healthnav
acae
nrol
l
On the function to the left,which we’ll review in greaterdetail later, we can use the firstderivative to find where theslope of the curve equals zero
From visualizing the function,we can clearly see that it’s amaximum
But in order to confirm that, weuse higher-order derivatives tohelp us check how the slopechanges on either side of thatflat point on the curve to assesswhether it’s a maximum,minimum, or neither
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 24 / 1
![Page 80: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/80.jpg)
Tool one: higher order derivatives
Not much to learn...but in addition to the first derivatives we’ve beenfinding, you should be familiar with:
I Second derivative: f ′′(x) = ∂2f (x)dx2 = ∂
∂x ( ∂∂x f (x))
I Third derivative: f ′′′(x) = ∂3f (x)dx3
I Etc. until there remains nothing left in the function of which to take thederivative (that is, all constants)
Example:
I f (x) = 5x3 + 3x2
I ∂f (x)∂x = 15x2 + 6x
I ∂2f (x)dx2 = 30x + 6
I ∂3f (x)dx3 = 30
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 25 / 1
![Page 81: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/81.jpg)
Tool one: higher order derivatives
Not much to learn...but in addition to the first derivatives we’ve beenfinding, you should be familiar with:
I Second derivative: f ′′(x) = ∂2f (x)dx2 = ∂
∂x ( ∂∂x f (x))
I Third derivative: f ′′′(x) = ∂3f (x)dx3
I Etc. until there remains nothing left in the function of which to take thederivative (that is, all constants)
Example:
I f (x) = 5x3 + 3x2
I ∂f (x)∂x = 15x2 + 6x
I ∂2f (x)dx2 = 30x + 6
I ∂3f (x)dx3 = 30
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 25 / 1
![Page 82: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/82.jpg)
Tool one: higher order derivatives
Not much to learn...but in addition to the first derivatives we’ve beenfinding, you should be familiar with:
I Second derivative: f ′′(x) = ∂2f (x)dx2 = ∂
∂x ( ∂∂x f (x))
I Third derivative: f ′′′(x) = ∂3f (x)dx3
I Etc. until there remains nothing left in the function of which to take thederivative (that is, all constants)
Example:
I f (x) = 5x3 + 3x2
I ∂f (x)∂x = 15x2 + 6x
I ∂2f (x)dx2 = 30x + 6
I ∂3f (x)dx3 = 30
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 25 / 1
![Page 83: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/83.jpg)
Tool one: higher order derivatives
Not much to learn...but in addition to the first derivatives we’ve beenfinding, you should be familiar with:
I Second derivative: f ′′(x) = ∂2f (x)dx2 = ∂
∂x ( ∂∂x f (x))
I Third derivative: f ′′′(x) = ∂3f (x)dx3
I Etc. until there remains nothing left in the function of which to take thederivative (that is, all constants)
Example:
I f (x) = 5x3 + 3x2
I ∂f (x)∂x = 15x2 + 6x
I ∂2f (x)dx2 = 30x + 6
I ∂3f (x)dx3 = 30
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 25 / 1
![Page 84: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/84.jpg)
Tool one: higher order derivatives
Not much to learn...but in addition to the first derivatives we’ve beenfinding, you should be familiar with:
I Second derivative: f ′′(x) = ∂2f (x)dx2 = ∂
∂x ( ∂∂x f (x))
I Third derivative: f ′′′(x) = ∂3f (x)dx3
I Etc. until there remains nothing left in the function of which to take thederivative (that is, all constants)
Example:
I f (x) = 5x3 + 3x2
I ∂f (x)∂x = 15x2 + 6x
I ∂2f (x)dx2 = 30x + 6
I ∂3f (x)dx3 = 30
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 25 / 1
![Page 85: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/85.jpg)
Tool one: higher order derivatives
Not much to learn...but in addition to the first derivatives we’ve beenfinding, you should be familiar with:
I Second derivative: f ′′(x) = ∂2f (x)dx2 = ∂
∂x ( ∂∂x f (x))
I Third derivative: f ′′′(x) = ∂3f (x)dx3
I Etc. until there remains nothing left in the function of which to take thederivative (that is, all constants)
Example:I f (x) = 5x3 + 3x2
I ∂f (x)∂x = 15x2 + 6x
I ∂2f (x)dx2 = 30x + 6
I ∂3f (x)dx3 = 30
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 25 / 1
![Page 86: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/86.jpg)
Tool one: higher order derivatives
Not much to learn...but in addition to the first derivatives we’ve beenfinding, you should be familiar with:
I Second derivative: f ′′(x) = ∂2f (x)dx2 = ∂
∂x ( ∂∂x f (x))
I Third derivative: f ′′′(x) = ∂3f (x)dx3
I Etc. until there remains nothing left in the function of which to take thederivative (that is, all constants)
Example:I f (x) = 5x3 + 3x2
I ∂f (x)∂x = 15x2 + 6x
I ∂2f (x)dx2 = 30x + 6
I ∂3f (x)dx3 = 30
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 25 / 1
![Page 87: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/87.jpg)
Tool one: higher order derivatives
Not much to learn...but in addition to the first derivatives we’ve beenfinding, you should be familiar with:
I Second derivative: f ′′(x) = ∂2f (x)dx2 = ∂
∂x ( ∂∂x f (x))
I Third derivative: f ′′′(x) = ∂3f (x)dx3
I Etc. until there remains nothing left in the function of which to take thederivative (that is, all constants)
Example:I f (x) = 5x3 + 3x2
I ∂f (x)∂x = 15x2 + 6x
I ∂2f (x)dx2 = 30x + 6
I ∂3f (x)dx3 = 30
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 25 / 1
![Page 88: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/88.jpg)
Tool one: higher order derivatives
Not much to learn...but in addition to the first derivatives we’ve beenfinding, you should be familiar with:
I Second derivative: f ′′(x) = ∂2f (x)dx2 = ∂
∂x ( ∂∂x f (x))
I Third derivative: f ′′′(x) = ∂3f (x)dx3
I Etc. until there remains nothing left in the function of which to take thederivative (that is, all constants)
Example:I f (x) = 5x3 + 3x2
I ∂f (x)∂x = 15x2 + 6x
I ∂2f (x)dx2 = 30x + 6
I ∂3f (x)dx3 = 30
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 25 / 1
![Page 89: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/89.jpg)
Tool two: partial derivatives
What is a partial derivative? Derivative of a function that has twoor more variables with respect to one of those variables
I What we’ve been doing : f (x) = x2...f ′(x) = 2xI When we’d use partial derivative: f (x , y) = x2 + 5y4
Notation:
I ∂f (x ,y)∂x : partial derivative of f (x , y) with respect to (w.r.t.) x
I ∂f (x ,y)∂y : partial derivative of f (x , y) with respect to (w.r.t.) y
How do we find?
I ∂f (x ,y)∂x : take derivative of function but treat y as a constant
I ∂f (x ,y)∂y : take derivative of function but treat x as a constant
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 26 / 1
![Page 90: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/90.jpg)
Tool two: partial derivatives
What is a partial derivative? Derivative of a function that has twoor more variables with respect to one of those variables
I What we’ve been doing : f (x) = x2...f ′(x) = 2x
I When we’d use partial derivative: f (x , y) = x2 + 5y4
Notation:
I ∂f (x ,y)∂x : partial derivative of f (x , y) with respect to (w.r.t.) x
I ∂f (x ,y)∂y : partial derivative of f (x , y) with respect to (w.r.t.) y
How do we find?
I ∂f (x ,y)∂x : take derivative of function but treat y as a constant
I ∂f (x ,y)∂y : take derivative of function but treat x as a constant
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 26 / 1
![Page 91: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/91.jpg)
Tool two: partial derivatives
What is a partial derivative? Derivative of a function that has twoor more variables with respect to one of those variables
I What we’ve been doing : f (x) = x2...f ′(x) = 2xI When we’d use partial derivative: f (x , y) = x2 + 5y4
Notation:
I ∂f (x ,y)∂x : partial derivative of f (x , y) with respect to (w.r.t.) x
I ∂f (x ,y)∂y : partial derivative of f (x , y) with respect to (w.r.t.) y
How do we find?
I ∂f (x ,y)∂x : take derivative of function but treat y as a constant
I ∂f (x ,y)∂y : take derivative of function but treat x as a constant
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 26 / 1
![Page 92: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/92.jpg)
Tool two: partial derivatives
What is a partial derivative? Derivative of a function that has twoor more variables with respect to one of those variables
I What we’ve been doing : f (x) = x2...f ′(x) = 2xI When we’d use partial derivative: f (x , y) = x2 + 5y4
Notation:
I ∂f (x ,y)∂x : partial derivative of f (x , y) with respect to (w.r.t.) x
I ∂f (x ,y)∂y : partial derivative of f (x , y) with respect to (w.r.t.) y
How do we find?
I ∂f (x ,y)∂x : take derivative of function but treat y as a constant
I ∂f (x ,y)∂y : take derivative of function but treat x as a constant
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 26 / 1
![Page 93: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/93.jpg)
Tool two: partial derivatives
What is a partial derivative? Derivative of a function that has twoor more variables with respect to one of those variables
I What we’ve been doing : f (x) = x2...f ′(x) = 2xI When we’d use partial derivative: f (x , y) = x2 + 5y4
Notation:I ∂f (x ,y)
∂x : partial derivative of f (x , y) with respect to (w.r.t.) x
I ∂f (x ,y)∂y : partial derivative of f (x , y) with respect to (w.r.t.) y
How do we find?
I ∂f (x ,y)∂x : take derivative of function but treat y as a constant
I ∂f (x ,y)∂y : take derivative of function but treat x as a constant
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 26 / 1
![Page 94: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/94.jpg)
Tool two: partial derivatives
What is a partial derivative? Derivative of a function that has twoor more variables with respect to one of those variables
I What we’ve been doing : f (x) = x2...f ′(x) = 2xI When we’d use partial derivative: f (x , y) = x2 + 5y4
Notation:I ∂f (x ,y)
∂x : partial derivative of f (x , y) with respect to (w.r.t.) xI ∂f (x ,y)
∂y : partial derivative of f (x , y) with respect to (w.r.t.) y
How do we find?
I ∂f (x ,y)∂x : take derivative of function but treat y as a constant
I ∂f (x ,y)∂y : take derivative of function but treat x as a constant
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 26 / 1
![Page 95: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/95.jpg)
Tool two: partial derivatives
What is a partial derivative? Derivative of a function that has twoor more variables with respect to one of those variables
I What we’ve been doing : f (x) = x2...f ′(x) = 2xI When we’d use partial derivative: f (x , y) = x2 + 5y4
Notation:I ∂f (x ,y)
∂x : partial derivative of f (x , y) with respect to (w.r.t.) xI ∂f (x ,y)
∂y : partial derivative of f (x , y) with respect to (w.r.t.) yHow do we find?
I ∂f (x ,y)∂x : take derivative of function but treat y as a constant
I ∂f (x ,y)∂y : take derivative of function but treat x as a constant
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 26 / 1
![Page 96: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/96.jpg)
Tool two: partial derivatives
What is a partial derivative? Derivative of a function that has twoor more variables with respect to one of those variables
I What we’ve been doing : f (x) = x2...f ′(x) = 2xI When we’d use partial derivative: f (x , y) = x2 + 5y4
Notation:I ∂f (x ,y)
∂x : partial derivative of f (x , y) with respect to (w.r.t.) xI ∂f (x ,y)
∂y : partial derivative of f (x , y) with respect to (w.r.t.) yHow do we find?
I ∂f (x ,y)∂x : take derivative of function but treat y as a constant
I ∂f (x ,y)∂y : take derivative of function but treat x as a constant
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 26 / 1
![Page 97: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/97.jpg)
Tool two: partial derivatives
What is a partial derivative? Derivative of a function that has twoor more variables with respect to one of those variables
I What we’ve been doing : f (x) = x2...f ′(x) = 2xI When we’d use partial derivative: f (x , y) = x2 + 5y4
Notation:I ∂f (x ,y)
∂x : partial derivative of f (x , y) with respect to (w.r.t.) xI ∂f (x ,y)
∂y : partial derivative of f (x , y) with respect to (w.r.t.) yHow do we find?
I ∂f (x ,y)∂x : take derivative of function but treat y as a constant
I ∂f (x ,y)∂y : take derivative of function but treat x as a constant
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 26 / 1
![Page 98: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/98.jpg)
Tool two: partial derivatives
f (x , y) = x2y5 + ey + ln(x)
Find the following on your own:
1 ∂f (x ,y)∂x
2 ∂f (x ,y)∂y
3 ∂2f (x ,y)∂x∂y
4 ∂2f (x ,y)∂x2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 27 / 1
![Page 99: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/99.jpg)
Tool two: partial derivatives solutions
f (x , y) = x2y5 + ey + ln(x)
Find (green = take derivative; gray = treat as constant):
1 ∂f (x ,y)∂x : x2y5 + ey + ln(x) = 2xy5 + 1
x
2 ∂f (x ,y)∂y : x2y5 + ey + ln(x) = 5x2y4 + ey
3 ∂2f (x ,y)∂x∂y : can do in two steps
1∂f (x ,y)
∂x = 2xy5 + 1x
2 ∂∂y (2xy5 + 1
x ) = 10xy4
4 ∂2f (x ,y)∂x2 : again, two steps
1∂f (x ,y)
∂x = 2xy5 + 1x
2 ∂∂x (2xy5 + 1
x ) = 2y5 − 1x2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 28 / 1
![Page 100: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/100.jpg)
Tool two: partial derivatives solutions
f (x , y) = x2y5 + ey + ln(x)
Find (green = take derivative; gray = treat as constant):
1 ∂f (x ,y)∂x : x2y5 + ey + ln(x) = 2xy5 + 1
x2 ∂f (x ,y)
∂y : x2y5 + ey + ln(x) = 5x2y4 + ey
3 ∂2f (x ,y)∂x∂y : can do in two steps
1∂f (x ,y)
∂x = 2xy5 + 1x
2 ∂∂y (2xy5 + 1
x ) = 10xy4
4 ∂2f (x ,y)∂x2 : again, two steps
1∂f (x ,y)
∂x = 2xy5 + 1x
2 ∂∂x (2xy5 + 1
x ) = 2y5 − 1x2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 28 / 1
![Page 101: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/101.jpg)
Tool two: partial derivatives solutions
f (x , y) = x2y5 + ey + ln(x)
Find (green = take derivative; gray = treat as constant):
1 ∂f (x ,y)∂x : x2y5 + ey + ln(x) = 2xy5 + 1
x2 ∂f (x ,y)
∂y : x2y5 + ey + ln(x) = 5x2y4 + ey
3 ∂2f (x ,y)∂x∂y : can do in two steps
1∂f (x ,y)
∂x = 2xy5 + 1x
2 ∂∂y (2xy5 + 1
x ) = 10xy4
4 ∂2f (x ,y)∂x2 : again, two steps
1∂f (x ,y)
∂x = 2xy5 + 1x
2 ∂∂x (2xy5 + 1
x ) = 2y5 − 1x2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 28 / 1
![Page 102: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/102.jpg)
Tool two: partial derivatives solutions
f (x , y) = x2y5 + ey + ln(x)
Find (green = take derivative; gray = treat as constant):
1 ∂f (x ,y)∂x : x2y5 + ey + ln(x) = 2xy5 + 1
x2 ∂f (x ,y)
∂y : x2y5 + ey + ln(x) = 5x2y4 + ey
3 ∂2f (x ,y)∂x∂y : can do in two steps1
∂f (x ,y)∂x = 2xy5 + 1
x
2 ∂∂y (2xy5 + 1
x ) = 10xy4
4 ∂2f (x ,y)∂x2 : again, two steps
1∂f (x ,y)
∂x = 2xy5 + 1x
2 ∂∂x (2xy5 + 1
x ) = 2y5 − 1x2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 28 / 1
![Page 103: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/103.jpg)
Tool two: partial derivatives solutions
f (x , y) = x2y5 + ey + ln(x)
Find (green = take derivative; gray = treat as constant):
1 ∂f (x ,y)∂x : x2y5 + ey + ln(x) = 2xy5 + 1
x2 ∂f (x ,y)
∂y : x2y5 + ey + ln(x) = 5x2y4 + ey
3 ∂2f (x ,y)∂x∂y : can do in two steps1
∂f (x ,y)∂x = 2xy5 + 1
x2 ∂
∂y (2xy5 + 1x ) = 10xy4
4 ∂2f (x ,y)∂x2 : again, two steps
1∂f (x ,y)
∂x = 2xy5 + 1x
2 ∂∂x (2xy5 + 1
x ) = 2y5 − 1x2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 28 / 1
![Page 104: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/104.jpg)
Tool two: partial derivatives solutions
f (x , y) = x2y5 + ey + ln(x)
Find (green = take derivative; gray = treat as constant):
1 ∂f (x ,y)∂x : x2y5 + ey + ln(x) = 2xy5 + 1
x2 ∂f (x ,y)
∂y : x2y5 + ey + ln(x) = 5x2y4 + ey
3 ∂2f (x ,y)∂x∂y : can do in two steps1
∂f (x ,y)∂x = 2xy5 + 1
x2 ∂
∂y (2xy5 + 1x ) = 10xy4
4 ∂2f (x ,y)∂x2 : again, two steps
1∂f (x ,y)
∂x = 2xy5 + 1x
2 ∂∂x (2xy5 + 1
x ) = 2y5 − 1x2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 28 / 1
![Page 105: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/105.jpg)
Tool two: partial derivatives solutions
f (x , y) = x2y5 + ey + ln(x)
Find (green = take derivative; gray = treat as constant):
1 ∂f (x ,y)∂x : x2y5 + ey + ln(x) = 2xy5 + 1
x2 ∂f (x ,y)
∂y : x2y5 + ey + ln(x) = 5x2y4 + ey
3 ∂2f (x ,y)∂x∂y : can do in two steps1
∂f (x ,y)∂x = 2xy5 + 1
x2 ∂
∂y (2xy5 + 1x ) = 10xy4
4 ∂2f (x ,y)∂x2 : again, two steps1
∂f (x ,y)∂x = 2xy5 + 1
x
2 ∂∂x (2xy5 + 1
x ) = 2y5 − 1x2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 28 / 1
![Page 106: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/106.jpg)
Tool two: partial derivatives solutions
f (x , y) = x2y5 + ey + ln(x)
Find (green = take derivative; gray = treat as constant):
1 ∂f (x ,y)∂x : x2y5 + ey + ln(x) = 2xy5 + 1
x2 ∂f (x ,y)
∂y : x2y5 + ey + ln(x) = 5x2y4 + ey
3 ∂2f (x ,y)∂x∂y : can do in two steps1
∂f (x ,y)∂x = 2xy5 + 1
x2 ∂
∂y (2xy5 + 1x ) = 10xy4
4 ∂2f (x ,y)∂x2 : again, two steps1
∂f (x ,y)∂x = 2xy5 + 1
x2 ∂
∂x (2xy5 + 1x ) = 2y5 − 1
x2
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 28 / 1
![Page 107: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/107.jpg)
Summing up
What we’ve done:
I Reviewed how to find the derivatives of various functionsI Reviewed two tools useful for optimization: higher-order derivatives and
partial derivativesWhere we’re going next:
I Simple case: optimizing a function with one variable and with astraightforward solution
F Stylized example: finding the number of health navigators to maximizeACA enrollment
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 29 / 1
![Page 108: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/108.jpg)
Summing up
What we’ve done:I Reviewed how to find the derivatives of various functions
I Reviewed two tools useful for optimization: higher-order derivatives andpartial derivatives
Where we’re going next:
I Simple case: optimizing a function with one variable and with astraightforward solution
F Stylized example: finding the number of health navigators to maximizeACA enrollment
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 29 / 1
![Page 109: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/109.jpg)
Summing up
What we’ve done:I Reviewed how to find the derivatives of various functionsI Reviewed two tools useful for optimization: higher-order derivatives and
partial derivatives
Where we’re going next:
I Simple case: optimizing a function with one variable and with astraightforward solution
F Stylized example: finding the number of health navigators to maximizeACA enrollment
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 29 / 1
![Page 110: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/110.jpg)
Summing up
What we’ve done:I Reviewed how to find the derivatives of various functionsI Reviewed two tools useful for optimization: higher-order derivatives and
partial derivativesWhere we’re going next:
I Simple case: optimizing a function with one variable and with astraightforward solution
F Stylized example: finding the number of health navigators to maximizeACA enrollment
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 29 / 1
![Page 111: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/111.jpg)
Summing up
What we’ve done:I Reviewed how to find the derivatives of various functionsI Reviewed two tools useful for optimization: higher-order derivatives and
partial derivativesWhere we’re going next:
I Simple case: optimizing a function with one variable and with astraightforward solution
F Stylized example: finding the number of health navigators to maximizeACA enrollment
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 29 / 1
![Page 112: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/112.jpg)
Summing up
What we’ve done:I Reviewed how to find the derivatives of various functionsI Reviewed two tools useful for optimization: higher-order derivatives and
partial derivativesWhere we’re going next:
I Simple case: optimizing a function with one variable and with astraightforward solution
F Stylized example: finding the number of health navigators to maximizeACA enrollment
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 29 / 1
![Page 113: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/113.jpg)
Simple case of univariate optimization
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 30 / 1
![Page 114: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/114.jpg)
Example 1: Health navigatorsSuppose a community health center is interested in hiring health navigators to helpenroll patients into the ACA. They want to maximize the number of patients theyenroll, and are aware that the following relationships hold, letting h = healthnavigator.
Productivity of each health navigator = 50h 23
Cost that detracts from other efforts at ACA enrollment = 2hPutting them together, and letting A = patients enrolled in ACA:
A(h) = 50h23 − 2h
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 31 / 1
![Page 115: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/115.jpg)
Example 1: Health navigatorsSuppose a community health center is interested in hiring health navigators to helpenroll patients into the ACA. They want to maximize the number of patients theyenroll, and are aware that the following relationships hold, letting h = healthnavigator.
Productivity of each health navigator = 50h 23
Cost that detracts from other efforts at ACA enrollment = 2h
Putting them together, and letting A = patients enrolled in ACA:
A(h) = 50h23 − 2h
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 31 / 1
![Page 116: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/116.jpg)
Example 1: Health navigatorsSuppose a community health center is interested in hiring health navigators to helpenroll patients into the ACA. They want to maximize the number of patients theyenroll, and are aware that the following relationships hold, letting h = healthnavigator.
Productivity of each health navigator = 50h 23
Cost that detracts from other efforts at ACA enrollment = 2hPutting them together, and letting A = patients enrolled in ACA:
A(h) = 50h23 − 2h
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 31 / 1
![Page 117: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/117.jpg)
Visualizing the function
−2000
0
2000
4000
0 5000 10000 15000 20000healthnav
acae
nrol
l
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 32 / 1
![Page 118: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/118.jpg)
Example 1: why use optimization?
We can see that. . .
The curve flattens out a little before 5000 navigators
That flat point appears to be a maximumHow do we formally (i.e. mathematically) demonstrate theseobservations?
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 33 / 1
![Page 119: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/119.jpg)
Example 1: why use optimization?
We can see that. . .
The curve flattens out a little before 5000 navigatorsThat flat point appears to be a maximum
How do we formally (i.e. mathematically) demonstrate theseobservations?
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 33 / 1
![Page 120: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/120.jpg)
Example 1: why use optimization?
We can see that. . .
The curve flattens out a little before 5000 navigatorsThat flat point appears to be a maximumHow do we formally (i.e. mathematically) demonstrate theseobservations?
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 33 / 1
![Page 121: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/121.jpg)
Example 1: finding the critical point(s)
1 Define the domain of interest: in this case, it is where h ≥ 0 andA(h) ≥ 0 (we don’t want there to be fewer ACA enrollees as a result ofthe health navigators)
I For this particular equation, 0 = 50h 23 − 2h =⇒ h = 15625
I Domain of interest: h = [0, 15625]2 Find the critical point(s) of the function: we find the critical
point(s) by setting the derivative of the function equal to zero andsolving for the number of health navigators:
Solve for critical point(s) on your worksheet
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 34 / 1
![Page 122: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/122.jpg)
Example 1: finding the critical point(s)
1 Define the domain of interest: in this case, it is where h ≥ 0 andA(h) ≥ 0 (we don’t want there to be fewer ACA enrollees as a result ofthe health navigators)
I For this particular equation, 0 = 50h 23 − 2h =⇒ h = 15625
I Domain of interest: h = [0, 15625]2 Find the critical point(s) of the function: we find the critical
point(s) by setting the derivative of the function equal to zero andsolving for the number of health navigators:
Solve for critical point(s) on your worksheet
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 34 / 1
![Page 123: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/123.jpg)
Example 1: finding the critical point(s)
1 Define the domain of interest: in this case, it is where h ≥ 0 andA(h) ≥ 0 (we don’t want there to be fewer ACA enrollees as a result ofthe health navigators)
I For this particular equation, 0 = 50h 23 − 2h =⇒ h = 15625
I Domain of interest: h = [0, 15625]
2 Find the critical point(s) of the function: we find the criticalpoint(s) by setting the derivative of the function equal to zero andsolving for the number of health navigators:
Solve for critical point(s) on your worksheet
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 34 / 1
![Page 124: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/124.jpg)
Example 1: finding the critical point(s)
1 Define the domain of interest: in this case, it is where h ≥ 0 andA(h) ≥ 0 (we don’t want there to be fewer ACA enrollees as a result ofthe health navigators)
I For this particular equation, 0 = 50h 23 − 2h =⇒ h = 15625
I Domain of interest: h = [0, 15625]2 Find the critical point(s) of the function: we find the critical
point(s) by setting the derivative of the function equal to zero andsolving for the number of health navigators:
Solve for critical point(s) on your worksheet
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 34 / 1
![Page 125: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/125.jpg)
Example 1: finding the critical point(s)1 Define the domain of interest: in this case, it is where h ≥ 0 and
A(h) ≥ 0 (we don’t want there to be fewer ACA enrollees as a result ofthe health navigators)
I For this particular equation, 0 = 50h 23 − 2h =⇒ h = 15625
I Domain of interest: h = [0, 15625]2 Find the critical point(s) of the function: we find the critical
point(s) by setting the derivative of the function equal to zero andsolving for the number of health navigators:
Solve for critical point(s) on your worksheet
A(h) = 50h23 − 2h
A′(h) =100
3h13− 2 = 0
2 =100
3h13
h13 =
1006
=503
(h13 )3 =
503
33 =125000
27= 4629.23
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 35 / 1
![Page 126: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/126.jpg)
Example 1: why do we need a second derivative?
−2000
0
2000
4000
0 5000 10000 15000 20000healthnav
acae
nrol
l
Now we’ve been able toformalize the intuition thatthe slope flattens a littlebefore 5000 navigators, bysolving for h ≈ 4629
How do we formalize (i.e.mathematically demonstrate)that this is indeed a localmax and not a local min?
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 36 / 1
![Page 127: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/127.jpg)
Example 1: why do we need a second derivative?
−2000
0
2000
4000
0 5000 10000 15000 20000healthnav
acae
nrol
l
Now we’ve been able toformalize the intuition thatthe slope flattens a littlebefore 5000 navigators, bysolving for h ≈ 4629How do we formalize (i.e.mathematically demonstrate)that this is indeed a localmax and not a local min?
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 36 / 1
![Page 128: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/128.jpg)
Example 1: using the second derivative1 Second derivative test: We found the critical point(s), but how to
make sure that it’s a maximum rather than a minimum (if we didn’thave the useful graph...)
1 Take second derivative of original function:
A′(h) = 1003h 1
3− 2
A′′(h) = − 1009h 4
3
2 Evaluate the second derivative at each critical point (in this case, onlyone) to check its sign
A′′(h) = − 1009 ∗ (4629) 4
3= −0.00014
3 Signs of second derivativef ′(x) f ′′(x) Classification
0 > 0 local min0 < 0 local max0 0 local min, local max, or inflection
point (where f(x) changes concavity)
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 37 / 1
![Page 129: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/129.jpg)
Example 1: using the second derivative1 Second derivative test: We found the critical point(s), but how to
make sure that it’s a maximum rather than a minimum (if we didn’thave the useful graph...)
1 Take second derivative of original function:
A′(h) = 1003h 1
3− 2
A′′(h) = − 1009h 4
3
2 Evaluate the second derivative at each critical point (in this case, onlyone) to check its sign
A′′(h) = − 1009 ∗ (4629) 4
3= −0.00014
3 Signs of second derivativef ′(x) f ′′(x) Classification
0 > 0 local min0 < 0 local max0 0 local min, local max, or inflection
point (where f(x) changes concavity)
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 37 / 1
![Page 130: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/130.jpg)
Example 1: using the second derivative1 Second derivative test: We found the critical point(s), but how to
make sure that it’s a maximum rather than a minimum (if we didn’thave the useful graph...)
1 Take second derivative of original function:
A′(h) = 1003h 1
3− 2
A′′(h) = − 1009h 4
3
2 Evaluate the second derivative at each critical point (in this case, onlyone) to check its sign
A′′(h) = − 1009 ∗ (4629) 4
3= −0.00014
3 Signs of second derivativef ′(x) f ′′(x) Classification
0 > 0 local min0 < 0 local max0 0 local min, local max, or inflection
point (where f(x) changes concavity)
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 37 / 1
![Page 131: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/131.jpg)
Example 1: using the second derivative1 Second derivative test: We found the critical point(s), but how to
make sure that it’s a maximum rather than a minimum (if we didn’thave the useful graph...)
1 Take second derivative of original function:
A′(h) = 1003h 1
3− 2
A′′(h) = − 1009h 4
3
2 Evaluate the second derivative at each critical point (in this case, onlyone) to check its sign
A′′(h) = − 1009 ∗ (4629) 4
3= −0.00014
3 Signs of second derivativef ′(x) f ′′(x) Classification
0 > 0 local min0 < 0 local max0 0 local min, local max, or inflection
point (where f(x) changes concavity)SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 37 / 1
![Page 132: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/132.jpg)
Graphical represenation
Basic idea: as we approach the maximum, the slope of the curve (firstderivative) becomes less and less positive. Because the slope is going, forinstance, from 0.937 around health navigators = 1000 to 0.463 aroundhealth navigators = 2000 to 0.199 around health navigators = 3000, theslope of that slope (the second derivative) is negative
To illustrate graphically. . .
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 38 / 1
![Page 133: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/133.jpg)
Graphical represenation
−2000
0
2000
4000
0 5000 10000 15000 20000healthnav
acae
nrol
l
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 39 / 1
![Page 134: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/134.jpg)
Graphical represenation
−2000
0
2000
4000
0 5000 10000 15000 20000healthnav
acae
nrol
l
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 40 / 1
![Page 135: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/135.jpg)
Graphical representation
−2000
0
2000
4000
0 5000 10000 15000 20000healthnav
acae
nrol
l
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 41 / 1
![Page 136: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/136.jpg)
Review and application of integrals
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 42 / 1
![Page 137: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/137.jpg)
What is an integral?
We use integrals to find the area under a curve.
Integrals are sometimes called called antiderivates, because integrationand derivation are opposite procedures.
I For example, if f (x) = 13x
3, the derivative is x2. The antiderivative ofx2 is f (x) = 1
3x3.
The integral of a function f(x) is written as:
F (x) =∫f (x) dx
The integral of a function over a set interval [a,b] is called a definiteintegral and is denoted as follows:
F (x) =∫ b
af (x) dx = F (b)− F (a)
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 43 / 1
![Page 138: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/138.jpg)
What is an integral?
We use integrals to find the area under a curve.Integrals are sometimes called called antiderivates, because integrationand derivation are opposite procedures.
I For example, if f (x) = 13x
3, the derivative is x2. The antiderivative ofx2 is f (x) = 1
3x3.
The integral of a function f(x) is written as:
F (x) =∫f (x) dx
The integral of a function over a set interval [a,b] is called a definiteintegral and is denoted as follows:
F (x) =∫ b
af (x) dx = F (b)− F (a)
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 43 / 1
![Page 139: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/139.jpg)
What is an integral?
We use integrals to find the area under a curve.Integrals are sometimes called called antiderivates, because integrationand derivation are opposite procedures.
I For example, if f (x) = 13x
3, the derivative is x2. The antiderivative ofx2 is f (x) = 1
3x3.
The integral of a function f(x) is written as:
F (x) =∫f (x) dx
The integral of a function over a set interval [a,b] is called a definiteintegral and is denoted as follows:
F (x) =∫ b
af (x) dx = F (b)− F (a)
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 43 / 1
![Page 140: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/140.jpg)
What is an integral?
We use integrals to find the area under a curve.Integrals are sometimes called called antiderivates, because integrationand derivation are opposite procedures.
I For example, if f (x) = 13x
3, the derivative is x2. The antiderivative ofx2 is f (x) = 1
3x3.
The integral of a function f(x) is written as:
F (x) =∫f (x) dx
The integral of a function over a set interval [a,b] is called a definiteintegral and is denoted as follows:
F (x) =∫ b
af (x) dx = F (b)− F (a)
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 43 / 1
![Page 141: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/141.jpg)
What is an integral?
We use integrals to find the area under a curve.Integrals are sometimes called called antiderivates, because integrationand derivation are opposite procedures.
I For example, if f (x) = 13x
3, the derivative is x2. The antiderivative ofx2 is f (x) = 1
3x3.
The integral of a function f(x) is written as:
F (x) =∫f (x) dx
The integral of a function over a set interval [a,b] is called a definiteintegral and is denoted as follows:
F (x) =∫ b
af (x) dx = F (b)− F (a)
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 43 / 1
![Page 142: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/142.jpg)
Properties of definite integrals
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 44 / 1
![Page 143: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/143.jpg)
Antiderivatives of common functions
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 45 / 1
![Page 144: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/144.jpg)
Integration by Parts
Integration by parts allows us to solve integrals in which two functionsare multiplied together.
The rule for integration by parts is:∫uv dx = u
∫v dx −
∫u′ (
∫v dx)dx
Or, another way of looking at it:∫uv ′ = uv −
∫vu′
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 46 / 1
![Page 145: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/145.jpg)
Integration by Parts
Integration by parts allows us to solve integrals in which two functionsare multiplied together.The rule for integration by parts is:
∫uv dx = u
∫v dx −
∫u′ (
∫v dx)dx
Or, another way of looking at it:∫uv ′ = uv −
∫vu′
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 46 / 1
![Page 146: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/146.jpg)
Integration by Parts
Integration by parts allows us to solve integrals in which two functionsare multiplied together.The rule for integration by parts is:
∫uv dx = u
∫v dx −
∫u′ (
∫v dx)dx
Or, another way of looking at it:∫uv ′ = uv −
∫vu′
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 46 / 1
![Page 147: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/147.jpg)
Integration by Parts
Let’s do some practice. Try to solve these examples on scrap paper:∫exx dx∫ex sin(x) dx
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 47 / 1
![Page 148: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/148.jpg)
Integration by Parts: SolutionsFor the first problem, let u = x and v ′ = ex . We know that u’ = 1 and∫ex dx = v = ex . So using our rule for integration by parts, we get:
xex − ex
ex (x + 1) + C
For the second problem, we will let u = sin(x) and v ′ = ex . We then canfind that:
u′ = cos(x)∫ex dx = ex
Putting that together, we get:∫ex sin(x) dx = sin(x)ex −
∫cos(x)ex dx
While this may look more complicated, we can actually use integration byparts again to get to the solution we need.
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 48 / 1
![Page 149: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/149.jpg)
Solution continuedSo, let u = cos(x) and v ′ = ex . Then:
u′ = −sin(x)∫ex dx = ex
Using our intergration by parts rule, we get:
∫ex sin(x) dx = sin(x)ex − (cos(x)ex −
∫−sin(x)ex dx)∫
ex sin(x) dx = ex sin(x)− excos(x)−∫ex sin(x) dx
2∫ex sin(x) dx = ex sin(x)− excos(x)∫ex sin(x) dx = ex sin(x)− excos(x)
2 + C
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 49 / 1
![Page 150: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/150.jpg)
Why do we care about integrals in statistics?
Integrals help us find the probability of continuous events. You will learn alot more about this in the stats sequence next year, but for now just takeour word on this:
There are things called probability density functions.
The areas under these functions help us figure out the probability ofgiven events.
And, as we said at the start, integrals can be used to find the areas under acurve!
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 50 / 1
![Page 151: Day One: Derivatives, Optimization, and Integralspusocmethodscamp.org/download/day1/DayOneSlideshow... · DayOne: Derivatives,Optimization,andIntegrals SOCMethodsCamp September3rd,2019](https://reader033.fdocuments.in/reader033/viewer/2022052022/60374fe294b6a67656354fe7/html5/thumbnails/151.jpg)
Why do we care about integrals in statistics?
Integrals help us find the probability of continuous events. You will learn alot more about this in the stats sequence next year, but for now just takeour word on this:
There are things called probability density functions.The areas under these functions help us figure out the probability ofgiven events.
And, as we said at the start, integrals can be used to find the areas under acurve!
SOC Methods Camp Day One: Derivatives, Optimization, and Integrals September 3rd, 2019 50 / 1