Practical concerns in predicting structures...Practical concerns in predicting ... – We want to...

15
CS 6961: Structured Prediction Spring 2017 Practical concerns in predicting structures 1

Transcript of Practical concerns in predicting structures...Practical concerns in predicting ... – We want to...

Page 1: Practical concerns in predicting structures...Practical concerns in predicting ... – We want to convert some input to an output – Model the conditional distribution of the output

CS6961:StructuredPredictionSpring2017

Practicalconcernsinpredictingstructures

1

Page 2: Practical concerns in predicting structures...Practical concerns in predicting ... – We want to convert some input to an output – Model the conditional distribution of the output

Sofar…

• Whatarestructures?– Agraph– Acollectionofpartsthatarelabeledjointly– Acollectionofinterconnecteddecisions

• Conditionalmodels– Wewanttoconvertsomeinputtoanoutput– Modeltheconditionaldistributionoftheoutput– Scoregroupsofinter-connectedvariables

• Algorithmsforlearning– Localvs.globallearning– Differentalgorithms

• Inferencealgorithms– Predictingthefinaloutput– Differentalgorithms,tradeoffs

2

Page 3: Practical concerns in predicting structures...Practical concerns in predicting ... – We want to convert some input to an output – Model the conditional distribution of the output

Usingthetools:Practicalconcerns

• Whatarestructures?– Agraph– Acollectionofpartsthatarelabeledjointly– Acollectionofinterconnecteddecisions

• Conditionalmodels– Wewanttoconvertsomeinputtoanoutput– Modeltheconditionaldistributionoftheoutput– Scoregroupsofinter-connectedvariables

• Algorithmsforlearning– Localvs.globallearning– Differentalgorithms

• Inferencealgorithms– Predictingthefinaloutput– Differentalgorithms,tradeoffs

3

Thislecture:

• Wewanttosolveatask.• Fornow,fullysupervised• Manychoicesahead!

Whatisthegraph?

Thebestwaytolearn?

• Modelingourproblem?• Identifyingvariables?• Identifyinggroupsthatare

scoredtogether?(factors)• Whatarefeatures?

Whatinferencealgorithm?

DoingeverythinginprogramminglanguageX

Page 4: Practical concerns in predicting structures...Practical concerns in predicting ... – We want to convert some input to an output – Model the conditional distribution of the output

Modelingyourproblem

• Understandtheproblem:Whatshouldyourprogramproduce?– Istheredata?Veryoften,theanswerisno.L

• Whatarethedecisions/randomvariablesthatconstitutetheoutput?

• Howdotheyinteract?Identifyingfactors/parts– Someinteractionsarenatural,somearespurious(specifictoyoursmallcollectionofdata)– Someinteractionsmakeinferenceimpossibleforcomputationalreasons– Whatarethefeaturerepresentations?

• Learning– Shouldeveryscoringfunctionbejointlylearned?– Perhaps,learnsub-sectionsindependentlyandputthemtogetherwithinferenceattheend– Whichlearningalgorithm?

• Inference– Whatalgorithm?Howexpensiveisit?– Exactorapproximate?

4

Page 5: Practical concerns in predicting structures...Practical concerns in predicting ... – We want to convert some input to an output – Model the conditional distribution of the output

Example0:NamedEntityRecognition

Goal:Toidentifypersons,locationsandorganizationsintext

B-org O B-per I-per O O

Facebook CEOMarkZuckerberg announcednewO O O O O O B-loc I-loc

privacy featuresintheconferenceinSanFrancisco

5

ObservationsStates

B-org=StartoforganizationB-per=StartofpersonI-per=Inperson

B-loc =StartoflocationI-loc =InlocationO=Notanamedentity

Page 6: Practical concerns in predicting structures...Practical concerns in predicting ... – We want to convert some input to an output – Model the conditional distribution of the output

Example0:NamedEntityRecognition

Goal:Toidentifypersons,locationsandorganizationsintext

B-org O B-per I-per O O

Facebook CEOMarkZuckerberg announcednewO O O O O O B-loc I-loc

privacy featuresintheconferenceinSanFrancisco

6

ObservationsStates

Let’sdiscussthechoiceswehave:1. Whatarethesetofdecisionsthepredictorneedstomake?2. Howdothesedecisionsinteract?Factors?3. Features?4. Learning?Inference?

Page 7: Practical concerns in predicting structures...Practical concerns in predicting ... – We want to convert some input to an output – Model the conditional distribution of the output

Example1:Detectingobjectsandparts

7[Farhadi,etal]

Let’sdiscussthechoiceswehave:1. Whatarethesetofdecisionsthepredictorneedstomake?2. Howdothesedecisionsinteract?Factors?3. Features?4. Learning?Inference?

Page 8: Practical concerns in predicting structures...Practical concerns in predicting ... – We want to convert some input to an output – Model the conditional distribution of the output

Example2:Informationextraction

PhilaeisaroboticEuropeanSpaceAgencylanderthataccompaniedtheRosettaspacecraftuntilitsdesignatedlandingonComet67P/Churyumov–Gerasimenko (67P),morethantenyearsafterdepartingEarth.On12November2014,thelanderachievedthefirst-evercontrolledtouchdownonacometnucleus.Itsinstrumentsareexpectedtoobtainthefirstimagesfromacomet'ssurfaceandmakethefirstinsituanalysistodetermineitscomposition.PhilaeistrackedandoperatedfromtheEuropeanSpaceOperationsCentre(ESOC)atDarmstadt,Germany.

8

Page 9: Practical concerns in predicting structures...Practical concerns in predicting ... – We want to convert some input to an output – Model the conditional distribution of the output

Example2:Informationextraction

Philae isaroboticEuropeanSpaceAgencylanderthataccompaniedtheRosettaspacecraftuntilits designatedlandingonComet67P/Churyumov–Gerasimenko (67P),morethantenyearsafterdepartingEarth.On12November2014,thelander achievedthefirst-evercontrolledtouchdownonacometnucleus.Its instrumentsareexpectedtoobtainthefirstimagesfromacomet'ssurfaceandmakethefirstinsituanalysistodetermineitscomposition.Philae istrackedandoperatedfromtheEuropeanSpaceOperationsCentre(ESOC)atDarmstadt,Germany.

9

Howdowemodelthisproblem?

TouchdownLander PhilaeDestination Comet 67PWhen? 12November2014

Page 10: Practical concerns in predicting structures...Practical concerns in predicting ... – We want to convert some input to an output – Model the conditional distribution of the output

Example2:Informationextraction

Philae isaroboticEuropeanSpaceAgencylanderthataccompaniedtheRosettaspacecraftuntilits designatedlandingonComet67P/Churyumov–Gerasimenko (67P),morethantenyearsafterdepartingEarth.On12November2014,thelander achievedthefirst-evercontrolledtouchdownonacometnucleus.Its instrumentsareexpectedtoobtainthefirstimagesfromacomet'ssurfaceandmakethefirstinsituanalysistodetermineitscomposition.Philae istrackedandoperatedfromtheEuropeanSpaceOperationsCentre(ESOC)atDarmstadt,Germany.

10

Philae

Page 11: Practical concerns in predicting structures...Practical concerns in predicting ... – We want to convert some input to an output – Model the conditional distribution of the output

Example2:Informationextraction

Philae isaroboticEuropeanSpaceAgencylanderthataccompaniedtheRosettaspacecraftuntilits designatedlandingonComet67P/Churyumov–Gerasimenko (67P),morethantenyearsafterdepartingEarth.On12November2014,thelander achievedthefirst-evercontrolledtouchdownonacometnucleus.Its instrumentsareexpectedtoobtainthefirstimagesfromacomet'ssurfaceandmakethefirstinsituanalysistodetermineitscomposition.Philae istrackedandoperatedfromtheEuropeanSpaceOperationsCentre(ESOC)atDarmstadt,Germany.

11

Philae Comet 67P

Page 12: Practical concerns in predicting structures...Practical concerns in predicting ... – We want to convert some input to an output – Model the conditional distribution of the output

Example2:Informationextraction

Philae isaroboticEuropeanSpaceAgencylanderthataccompaniedtheRosettaspacecraftuntilits designatedlandingonComet67P/Churyumov–Gerasimenko (67P),morethantenyearsafterdepartingEarth.On12November2014,thelander achievedthefirst-evercontrolledtouchdownonacometnucleus.Its instrumentsareexpectedtoobtainthefirstimagesfromacomet'ssurfaceandmakethefirstinsituanalysistodetermineitscomposition.Philae istrackedandoperatedfromtheEuropeanSpaceOperationsCentre(ESOC)atDarmstadt,Germany.

12

Philae Comet 67P

Touchdown

12 November 2014

Lander Dest. When

Page 13: Practical concerns in predicting structures...Practical concerns in predicting ... – We want to convert some input to an output – Model the conditional distribution of the output

Example2:Informationextraction

Philae isaroboticEuropeanSpaceAgencylanderthataccompaniedtheRosettaspacecraftuntilits designatedlandingonComet67P/Churyumov–Gerasimenko (67P),morethantenyearsafterdepartingEarth.On12November2014,thelander achievedthefirst-evercontrolledtouchdownonacometnucleus.Its instrumentsareexpectedtoobtainthefirstimagesfromacomet'ssurfaceandmakethefirstinsituanalysistodetermineitscomposition.Philae istrackedandoperatedfromtheEuropeanSpaceOperationsCentre(ESOC)atDarmstadt,Germany.

13

Howdowemodelthisproblem?

Philae Comet 67P

Touchdown

12 November 2014

Lander Dest. When

Page 14: Practical concerns in predicting structures...Practical concerns in predicting ... – We want to convert some input to an output – Model the conditional distribution of the output

Example2:Informationextraction

Philae isaroboticEuropeanSpaceAgencylanderthataccompaniedtheRosettaspacecraftuntilits designatedlandingonComet67P/Churyumov–Gerasimenko (67P),morethantenyearsafterdepartingEarth.On12November2014,thelander achievedthefirst-evercontrolledtouchdownonacometnucleus.Its instrumentsareexpectedtoobtainthefirstimagesfromacomet'ssurfaceandmakethefirstinsituanalysistodetermineitscomposition.Philae istrackedandoperatedfromtheEuropeanSpaceOperationsCentre(ESOC)atDarmstadt,Germany.

14

Philae Comet 67P

Touchdown

12 November 2014

Lander Dest. When Let’sdiscussthechoiceswehave:1. Whatarethesetofdecisionsthepredictor

needstomake?2. Howdothesedecisionsinteract?Factors?3. Features?4. Learning?Inference?

Page 15: Practical concerns in predicting structures...Practical concerns in predicting ... – We want to convert some input to an output – Model the conditional distribution of the output

Modelingyourproblem

• Understandtheproblem:Whatshouldyourprogramproduce?– Istheredata?Veryoften,theanswerisno.L

• Whatarethedecisions/randomvariablesthatconstitutetheoutput?

• Howdotheyinteract?Identifyingfactors/parts– Someinteractionsarenatural,somearespurious(specifictoyoursmallcollectionofdata)– Someinteractionsmakeinferenceimpossibleforcomputationalreasons– Whatarethefeaturerepresentations?

• Learning– Shouldeveryscoringfunctionbejointlylearned?– Perhaps,learnsub-sectionsindependentlyandputthemtogetherwithinferenceattheend– Whichlearningalgorithm?

• Inference– Whatalgorithm?Howexpensiveisit?– Exactorapproximate?

15


Ch. 12: Perfect Competition. Selection of price and output Shut down decision in short run. Entry and exit behavior. Predicting the effects of.

Ch. 12: Perfect Competition. Selection of price and output Shut down decision in short run. Entry and exit behavior. Predicting the effects of.

Predicting Program Properties from “Big Code” · with the combination of unrestricted network structure and massive number of possible predictions per element). Finally, we output

Predicting Program Properties from “Big Code” · with the combination of unrestricted network structure and massive number of possible predictions per element). Finally, we output

Charles Sturt University Research Output · Predicting Organisational Citizenship Behaviour ii Table of Contents Table of Contents

Charles Sturt University Research Output · Predicting Organisational Citizenship Behaviour ii Table of Contents Table of Contents

Predicting Porosity through Simulating Sandstone ...carbcap.geos.ed.ac.uk/rsh-journal-downloads/Predicting-Porosity... · Predicting Porosity through Simulating Sandstone Compaction

Predicting Porosity through Simulating Sandstone ...carbcap.geos.ed.ac.uk/rsh-journal-downloads/Predicting-Porosity... · Predicting Porosity through Simulating Sandstone Compaction

Predicting Dangerousness

Predicting Dangerousness

Predicting and Confirming the Effectiveness of Systems ... · regulations in response to these concerns, such as Seveso (EU) and CIMAH (UK), ... in 1996. At the time these regulatory

Predicting and Confirming the Effectiveness of Systems ... · regulations in response to these concerns, such as Seveso (EU) and CIMAH (UK), ... in 1996. At the time these regulatory

Running head: PREDICTING ACADEMIC SUCCESS PREDICTING ...

Running head: PREDICTING ACADEMIC SUCCESS PREDICTING ...

James A. Dungan1, Liane Young2, Adam Waytz3€¦ · The Power of Moral Concerns in Predicting Whistleblowing Decisions James A. Dungan1, Liane Young2, Adam Waytz3 1Booth School of

James A. Dungan1, Liane Young2, Adam Waytz3€¦ · The Power of Moral Concerns in Predicting Whistleblowing Decisions James A. Dungan1, Liane Young2, Adam Waytz3 1Booth School of

Predicting the Power Output of Distributed Renewable ... · – The MLP training used the back propagation learning algorithm with the batch method and uniform learning – Overfitting

Predicting the Power Output of Distributed Renewable ... · – The MLP training used the back propagation learning algorithm with the batch method and uniform learning – Overfitting

Logistic Regression: Predicting Countsfletcher/SUPER/chap21.pdf · 2013. 8. 23. · Chapter 21 Logistic Regression: Predicting Counts For the most part, this book concerns itself

Logistic Regression: Predicting Countsfletcher/SUPER/chap21.pdf · 2013. 8. 23. · Chapter 21 Logistic Regression: Predicting Counts For the most part, this book concerns itself

Reading Predicting

Reading Predicting

Newark Greenhouse Capstone Project · PDF file5.2.4 Output Formula ... Notes from Meeting with Patrick McKee of Finger Lakes Fresh ... additional packaging and traceability concerns,

Newark Greenhouse Capstone Project · PDF file5.2.4 Output Formula ... Notes from Meeting with Patrick McKee of Finger Lakes Fresh ... additional packaging and traceability concerns,

Predicting Output Using the Entire Yield Curve/media/richmondfedorg/banking/... · Predicting Output Using the Entire Yield Curve ... the predictive power of the yield curve for output

Predicting Output Using the Entire Yield Curve/media/richmondfedorg/banking/... · Predicting Output Using the Entire Yield Curve ... the predictive power of the yield curve for output

Predicting Reactions

Predicting Reactions

Max AFR and Output and Relevant OH&S Concerns

Max AFR and Output and Relevant OH&S Concerns

Predicting Pharmacology

Predicting Pharmacology

PREDICTING PREDICTABILITY

PREDICTING PREDICTABILITY

Predicting Expedia Hotel Cluster Groupings with User ...cs229.stanford.edu/proj2016spr/poster/065.pdf · Expedia.com • Output: Hotel cluster booking • Hidden test data on Kaggle

Predicting Expedia Hotel Cluster Groupings with User ...cs229.stanford.edu/proj2016spr/poster/065.pdf · Expedia.com • Output: Hotel cluster booking • Hidden test data on Kaggle

Predicting FTEs

Predicting FTEs

La modélisation hydrologique et la gestion de l'eau · La modélisation hydrologique et la gestion de l'eau J. P. Villeneuve, ... Increasing concerns in predicting the impacts of

La modélisation hydrologique et la gestion de l'eau · La modélisation hydrologique et la gestion de l'eau J. P. Villeneuve, ... Increasing concerns in predicting the impacts of