Topic Tagging with Watson by Ken Goldberg, UC Berkeley
-
Upload
diannepatricia -
Category
Technology
-
view
416 -
download
1
Transcript of Topic Tagging with Watson by Ken Goldberg, UC Berkeley
![Page 1: Topic Tagging with Watson by Ken Goldberg, UC Berkeley](https://reader031.fdocuments.in/reader031/viewer/2022030307/58e6086a1a28ab44778b5015/html5/thumbnails/1.jpg)
M-CAFETopicTaggingWithWatson
![Page 2: Topic Tagging with Watson by Ken Goldberg, UC Berkeley](https://reader031.fdocuments.in/reader031/viewer/2022030307/58e6086a1a28ab44778b5015/html5/thumbnails/2.jpg)
Dataset§ M-CAFEforIEOR115:16
weeksin Aug - Dec,2015• Studentcount:115• Ideacount:106
§ 106ideaswithtagsaresplitrandomlyintotrain(86ideas)andtest(20ideas).
![Page 3: Topic Tagging with Watson by Ken Goldberg, UC Berkeley](https://reader031.fdocuments.in/reader031/viewer/2022030307/58e6086a1a28ab44778b5015/html5/thumbnails/3.jpg)
WatsonNaturalLanguageClassifier
![Page 4: Topic Tagging with Watson by Ken Goldberg, UC Berkeley](https://reader031.fdocuments.in/reader031/viewer/2022030307/58e6086a1a28ab44778b5015/html5/thumbnails/4.jpg)
![Page 5: Topic Tagging with Watson by Ken Goldberg, UC Berkeley](https://reader031.fdocuments.in/reader031/viewer/2022030307/58e6086a1a28ab44778b5015/html5/thumbnails/5.jpg)
Train&Test Sets• Train:86 ideaswith topicstagged.• Test:20ideaswithouttopicstagged.
Screencaptureofthe.csvfilefortrainingset
![Page 6: Topic Tagging with Watson by Ken Goldberg, UC Berkeley](https://reader031.fdocuments.in/reader031/viewer/2022030307/58e6086a1a28ab44778b5015/html5/thumbnails/6.jpg)
Code• curl-i -u"896090f0-631f-4745-b02a-47b6417140d6":"xuDyj6lD9USr"-Ftraining_data=@/Users/apple/Desktop/mcafe_watson_train.csv -Ftraining_metadata="{\"language\":\"en\",\"name\":\"McafeClassifier\"}""https://gateway.watsonplatform.net/natural-language-classifier/api/v1/classifiers"
• curl-G-u"896090f0-631f-4745-b02a-47b6417140d6":"xuDyj6lD9USr""https://gateway.watsonplatform.net/natural-language-classifier/api/v1/classifiers/3AE103x13-nlc-1276/classify"--data-urlencode "text=testData"
![Page 7: Topic Tagging with Watson by Ken Goldberg, UC Berkeley](https://reader031.fdocuments.in/reader031/viewer/2022030307/58e6086a1a28ab44778b5015/html5/thumbnails/7.jpg)
TestResult:80%Accuracy!Outofthe20testsamples,16werecorrectedclassified.
![Page 8: Topic Tagging with Watson by Ken Goldberg, UC Berkeley](https://reader031.fdocuments.in/reader031/viewer/2022030307/58e6086a1a28ab44778b5015/html5/thumbnails/8.jpg)
Idea TopicSlowerpace. Lectures
AddLectureoverview ResourcesIwantmorepracticewithRelationalAlgebraandeventuallySQL. HomeworkThelastfewlectureshavebeenverymathematicallyprecisein
notationwhichcanmakeitabittrickytowrapyourheadaround.Specificquestions/examples(likewhatmightbeonhw)wouldbegreattohelpusmakesureweunderstanditmovingforward.
Lectures
Theprojectseemsalittlestopandgo.Wehaven'tbeenabletoworkonitforaweekorsobutIfeellikewe'llsoonbeexpectedtodoabunchofworkforDP2.Itwouldbehelpfulifwecouldhavethetoolstohaveamoreconstantlevelofworkonthe
project.
Projects
Pleasetryandpostthelabsearliersothatwecangetaheadstartreadingandunderstandingthem. Labs
Homework2onlyhasdatabasequestions,maybeputsomeconnectives? Homework
Incorporateashortquestionandanswerperiodmidwayoflecturetoassessparticipatingstudents'understandingofthe
lecture/topicsbeingpresented.Lectures
Examplesofideaswhicharecorrectlyclassified:
![Page 9: Topic Tagging with Watson by Ken Goldberg, UC Berkeley](https://reader031.fdocuments.in/reader031/viewer/2022030307/58e6086a1a28ab44778b5015/html5/thumbnails/9.jpg)
Misclassifications• Thetruetagisamongthetoptwotagssuggestedbytheclassifier.• Misclassificationoccurswhenanideaisarbitrarilytaggedorwithlackofcontext.
Idea TrueTag Pred Tag Confidence
1.slowdownalittlebit Lectures Resources Resources:0.288;Lectures:0.224
2.Itwouldbegreatifyoucouldprovide
outsideresourcesonrulesandguidelinesforthingslikeERdiagramsthatyouthinkareworth
ourtime.
Resources Lectures Lectures:0.879;Resources:0.130
![Page 10: Topic Tagging with Watson by Ken Goldberg, UC Berkeley](https://reader031.fdocuments.in/reader031/viewer/2022030307/58e6086a1a28ab44778b5015/html5/thumbnails/10.jpg)
Idea TrueTag Pred Tag Confidence
3.Iwouldlikehavesomeimplantationproblems
usingSQLHomework NewTopics
NewTopics:0.803;
Homework:0.076
4.MorehandsonexperiencesonDatabases Homework NewTopics
NewTopics:0.786;
Homework:0.117
MisclassificationsContd…• Thetruetagisamongthetoptwotagssuggestedbytheclassifier.• Misclassificationoccurswhenanideaisarbitrarilytaggedorwithlackofcontext.
![Page 11: Topic Tagging with Watson by Ken Goldberg, UC Berkeley](https://reader031.fdocuments.in/reader031/viewer/2022030307/58e6086a1a28ab44778b5015/html5/thumbnails/11.jpg)
QuestionsforIBM• 1.Howistheclassifiertrained?Whatistheclassificationmethod?• 2.Isthereaversionoftheclassifierthatcanreturnthepredictedtopicforthetestset?• 3.Thisessentiallyasupervisedclassificationproblem,doesWatsonhaveanunsupervisedversionavailable,justproviderawtextanditwouldassigntags?