How to Overcome Change Blindness in Testing

12
- Poornima Sarangapani QA, Thoughtworks How to overcome Change Blindness in Testing ThoughtWorks, http://twchennai.github.io/VODQA-Chennai/

Transcript of How to Overcome Change Blindness in Testing

Page 1: How to Overcome Change Blindness in Testing

- Poornima Sarangapani QA, Thoughtworks

How to overcome Change Blindness in Testing

ThoughtWorks, http://twchennai.github.io/VODQA-Chennai/

Page 2: How to Overcome Change Blindness in Testing

• Unable to notice visual changes• Brain cannot possibly process every element of an

experience• Fail to notice a major change - focused on another

task• Selects certain things to focus - filters out anything

that is unrelated

What

ThoughtWorks, http://twchennai.github.io/VODQA-Chennai/

Page 3: How to Overcome Change Blindness in Testing

• We concentrate on how does the feature work more compared to how does the feature looks.

• One pixel difference can make a vast difference• Other elements will get affected

Why is it important

ThoughtWorks, http://twchennai.github.io/VODQA-Chennai/

Page 5: How to Overcome Change Blindness in Testing

Figure the differenceFigure the difference

ThoughtWorks, http://twchennai.github.io/VODQA-Chennai/

Page 8: How to Overcome Change Blindness in Testing

• Pretty terrible at spotting changes in visual stimuli

• Very difficult to do for a bigger application

• Focus shifts on non testable stuffs

• Repetitive

• Different responsive layout

Manual Cons

ThoughtWorks, http://twchennai.github.io/VODQA-Chennai/

Page 9: How to Overcome Change Blindness in Testing

• Wraith

• Lineup

• Applitool eyes

• BackstopJS

• BackTrac

• csscritic

• Diff.io

• Dpxdt

• Galen Framework

• Gemini

• Ghost Inspector

• Hardy

• haunterjs

• PhantomCSS

• Rockcss

• SiteEffect

• Screenster

• Huxley

• Kobold

• Argus Eyes

• mirror-mirror

• Ocularjs

• Percy.io

• reg-cli

• Spectre

• VisualReview

Tools available

ThoughtWorks, http://twchennai.github.io/VODQA-Chennai/

Page 11: How to Overcome Change Blindness in Testing

• Visual regression tests are not a replacement for good development practices and a good CSS architecture.

• capture screenshots for small modules or components - image comparison is faster

• Integrate your visual tests with some continuous integration platform

Good Practices

ThoughtWorks, http://twchennai.github.io/VODQA-Chennai/