Going beyond unit tests - WordCamp London 2015

COMPANY NAME PRESENTATION TITLE 12 - 12 - 2012TimNash.co.uk @tnash

Because we all love to test right?

Going beyond unit tests…


Once upon a time…


MEWebsite Twitter


Most people don’t write tests


Testing should be fun?

Otherwise we won’t test our side projects


Unit tests scare folks…


So let’s not talk about them…


This is not a talk about BDD, DDD, ATDD or TDD Though you should check them out


Tools, Concepts not methodology


So what’s Testing then?


Dear client… To Test: Go to /form/ Enter Form Details Click Submit & the form should submit !

Any problems let me know!


Dear Developer…

It doesn’t work!


Dear client…

Did you try to clear your cache?


So what’s Testing then really?


Codeception BDD style testing framework


Unit Testing, Mocking, Functional, Acceptance Testing, Regression Testing and other stuff


Acceptance Testing


Acceptance TestingCodebase independent

Tests what client expectsBreaks things like a client

Easy to read and writeCan start straight away

Slow to runNeeds “live” end points

Infrastructure dependent


Dear client… To Test: Go to /form/ Enter Form Details Click Submit & the form should submit !

Any problems let me know!


<?php $I = new AcceptanceTester($scenario); $I->wantTo('Fill in a form'); $I->amOnPage('/form/'); $I->see('This is a form'); $I->fillField('event', 'WordCamp London'); $I->fillField('date', '22 March 2015'); $I->fillField('where', 'London Metropolitan University'); $I->click('Save'); $I->see('Form Submitted');


Dear client… To Test login into the WordPress Dashboard: Go to /wp-login.php Enter your username and your password Click Login & you should be redirected to the dashboard !


<?php $I = new AcceptanceTester($scenario); $I->wantTo('Login to WordPress Admin'); $I->amOnPage('/wp-login.php'); $I->fillField('Username', 'admin'); $I->fillField('Password','password'); $I->click('Log In'); $I->see('Dashboard');


Trying to Login to WordPress Admin (LoginCept) Scenario: * I am on page "/wp-login.php" * I fill field "Username","admin" * I fill field "Password","password" * I click "Log In" * I see "Dashboard" * I click "Posts" PASSED

php codecept.phar run acceptance --steps


Reporting in console, html, xml


WebDriver, Selenium, PhatomJS


Webdriver Pretty fast Headless CURL based solution Doesn’t support javascript User agent not always recognised Often caught in WAFs Enabled by default


Selenium Browser Automation Supports Firefox and Chrome Used in multiple frameworks Can operate headless with virtual frame buffer Bit of a pig to set up Codeception support a Docker container to ease setup


PhantomJS Headless Supports Javascript User agent not always recognised Often caught in WAFs


Functional Testing


Functional Testing Like Acceptance Testing Push data into end point Directly call AJAX end points No browser emulation so simple web driver Unlike unit testing not done in isolation


Test REST like APIs…WP-API Endpoints


<?php $I = new ApiTester($scenario); $I->wantTo(‘Return all posts’); $I->sendGet(‘posts’); $I->seeResponseCodeIs(200); $I->seeResponseIsJson(); $I->seeResponseContains(“content”);


Test REST like APIs…RSS, ATOM Feeds


<?php $I = new ApiTester($scenario); $I->wantTo(‘Return full Feed’); $I->sendGet(‘feed’); $I->seeResponseCodeIs(200); $I->seeResponseIsXml(); $I->seeResponseContains(“channel”);


Test cli…WP-CLI Commands


<?php $I = new CliTester($scenario); $I->runShellCommand(‘wp example'); $I->seeInShellOutput(‘Example List');


Test Email…wp_mail();


MailCatcher + APITester<?php $I = new ApiTester($scenario); $I->wantTo(‘Return all emails’); $I->sendGet(‘messages’); $I->seeResponseCodeIs(200); $I->seeResponseIsJson();


Test XML-RPC…Really???Well yes you can!


<?php $I = new ApiTester($scenario); $I->wantTo(‘Return XML-RPC ’); $I->sendXMLRPCMethodCall(‘posts’); $I->seeResponseIsXMLRPC(); $I->seeResponseContains(“posts”);


DBs, Factories and tearing down


WP-Browserhttps://github.com/lucatume/wp-browser

https://github.com/lucatume/wp-browser


<?php $I = new AcceptanceTester($scenario); $I->wantTo('create and check for a user'); // create a subscriber user with user login and id $I->haveUserInDatabase('rincewind', 100); // check for created user $I->seeUserInDatabase(array('user_login' => 'rincewind', 'ID' => 100));


WP-CLI is your friend


Wait this is all PHP…


Class based Test Suites :)


<?php class exampleCEST { /** * @before addPost * @after checkFrontpage */ public function checkLogin(\AcceptanceTester $I) { … } }


PageObjects & StepObjects


<?php class loginPage { public static $URL = ‘/wp-login.php’; public static $usernameField = "Username"; public static $passwordField = "Password"; public static $submitButton = “Login in"; }


<?php $I = new AcceptanceTester($scenario); $I->wantTo('Login to WordPress Admin'); $I->amOnPage(loginPage::URL); $I->fillField(loginPage::usernameField, 'admin'); $I->fillField(loginPage::passwordField,'password'); $I->click(loginPage::submitButton); $I->see('Dashboard');


Helpers, modules & Addons


<?php namespace Codeception\Module; use Codeception\Module; class MailCatcher extends Module { protected $mailcatcher; protected $config = array('url', 'port'); !

public function _initialize() { $url = trim($this->config['url'], '/') . ':' . $this->config['port']; $this->mailcatcher = new \Guzzle\Http\Client($url); } } ....

.... /** * Messages * * Get an array of all the message objects * * @return array * @author Jordan Eldredge <[email protected]> **/ protected function messages() { $response = $this->mailcatcher->get('/messages')->send(); $messages = $response->json(); usort($messages, array($this, 'messageSortCompare')); return $messages;

MailCatcher Module


Debuging


codeception run --debug !

$u = $foobard->haveUserInDatabase('rincewind', 100); $this->debugSection(‘User Creation', $u);


Alternatives?


Multiple Test solutions out there

PHPUnit + Selenium Behat & Mink Mocha Fitness

!

many many more…


Testing is not just for development


Automated Testing of Backups


So about those unit tests…


My Stuff aka Plugs: My Site: timnash.co.uk My Patreon Page: patreon.com/tnash

http://patreon.com/tnash

Going beyond unit tests - WordCamp London 2015

Technology

Transcript of Going beyond unit tests - WordCamp London 2015