A Case Study for Evaluating Feature Location Techniques Meghan Revelle Nov. 20, 2008.

13
A Case Study for Evaluating Feature Location Techniques Meghan Revelle Nov. 20, 2008
  • date post

    21-Dec-2015
  • Category

    Documents

  • view

    214
  • download

    1

Transcript of A Case Study for Evaluating Feature Location Techniques Meghan Revelle Nov. 20, 2008.

Page 1: A Case Study for Evaluating Feature Location Techniques Meghan Revelle Nov. 20, 2008.

A Case Study for Evaluating Feature Location Techniques

Meghan Revelle

Nov. 20, 2008

Page 2: A Case Study for Evaluating Feature Location Techniques Meghan Revelle Nov. 20, 2008.

How can we locate features? Textual similarity

Dynamically

Statically

Combinations of the three IR + static IR + dynamic Static + dynamic IR + dynamic + static …

Page 3: A Case Study for Evaluating Feature Location Techniques Meghan Revelle Nov. 20, 2008.

Evaluation Approaches Precision and recall

Position of first relevant method on ranked list

Compare with methods in a patch

Programmer agreement This is where you come into the picture

Page 4: A Case Study for Evaluating Feature Location Techniques Meghan Revelle Nov. 20, 2008.

Example System

Eclipse

Feature Add files and folders to UnifiedTree

Page 5: A Case Study for Evaluating Feature Location Techniques Meghan Revelle Nov. 20, 2008.

Classifying Methods

List 1 RelevantSomewhat

RelevantNot

Relevant

org.eclipse.core.internal.localstore.UnifiedTree.addChildrenFromFileSystem X

org.eclipse.core.internal.dtree.AbstractDataTreeNode.childAtOrNull X

org.eclipse.core.internal.localstore.UnifiedTreeNode.reuse X

org.eclipse.core.internal.localstore.UnifiedTree.createNode X

org.eclipse.core.internal.localstore.UnifiedTreeNode.getLocalLocation X

org.eclipse.core.internal.localstore.RefreshLocalVisitor.visit X

org.eclipse.core.internal.localstore.RefreshLocalVisitor.synchronizeExistence

X

org.eclipse.core.internal.localstore.UnifiedTree.addRootToQueue X

org.eclipse.core.internal.dtree.DeltaDataTree.getChildNodes X

org.eclipse.core.internal.localstore.UnifiedTreeNode.existsInFileSystem X

Page 6: A Case Study for Evaluating Feature Location Techniques Meghan Revelle Nov. 20, 2008.

Is this method relevant?

Page 7: A Case Study for Evaluating Feature Location Techniques Meghan Revelle Nov. 20, 2008.

Is this method relevant?

Page 8: A Case Study for Evaluating Feature Location Techniques Meghan Revelle Nov. 20, 2008.

Is this method relevant?

Page 9: A Case Study for Evaluating Feature Location Techniques Meghan Revelle Nov. 20, 2008.

We need your help Evaluate our feature location technique against

others

Classify methods from 10 lists

System jEdit

Feature Configurable thick cursor option

Page 10: A Case Study for Evaluating Feature Location Techniques Meghan Revelle Nov. 20, 2008.

jEdit in action…

Page 11: A Case Study for Evaluating Feature Location Techniques Meghan Revelle Nov. 20, 2008.

Thick Caret Option

Page 12: A Case Study for Evaluating Feature Location Techniques Meghan Revelle Nov. 20, 2008.

Can you spot the difference?

Page 13: A Case Study for Evaluating Feature Location Techniques Meghan Revelle Nov. 20, 2008.

In Summary Task

Determine relevance of methods to a feature

Time commitment 1-2 hours

Incentive Extra points Cookies and brownies