DSLs and OPE - staff.um.edu.mtstaff.um.edu.mt/__data/assets/pdf_file/0011/348986/dslsandOPE.pdf•...

DSLsandOPEChristianColombo(workwithMarkMicallefandGordonPace)

DSLs

DSLsforTesting

CNLsforMonitoring

DSLsfortesting•  AgiledevelopmentèTestautomation

DSLsfortesting•  AgiledevelopmentèTestautomation

Theneedfortestautomation

Existingtechnology:GherkinGiven I am a premium user When I place a bet on a football match And I win the bet Then I will win 10% more than the advertised odds for the match

Testautomation–2challenges•  Nonskilledtesters(fortestautomation)•  Timepressure

Proposedsolution:• MorestructuredDSL•  Easyfornonskilledtesters•  Savestime

Manytestingdomains•  E-commerce(cart,stock,item,buy,sell,etc)•  Games(bonus,points,bet,win,lose,etc)•  GUIapps(button,progressbar,label,tap,swipe,etc)

DSLsfortesting

Well-DefinedDomains

UndefinedDomains

AndroidGUIApplications

E-CommerceApplications

GraphicalGames

DSLsfortesting

GenerictestingDSL

ECommerceexample

StructuredDSLsvsGherkin1. Theapproachworksonceagrammarisinplace

a.  (Automaticallygenerated)CodehelpersinIDEb.  Consistentscripts

2. Morecumbersometoaddnewlanguagefeaturesa.  Newfeaturesrequiregrammarmodificationb.  Notionoftagging@manualtestslost

3. Specialisedskillsneededforgrammardefinitionandcompilation

4. Wecannot“fudge”anymore(isthisgoodorbad?)

DefinedvsUndefineddomains1. Easytoreachastablelanguagequicklywithwell-defineddomains

2. Youcanquicklygodowntotheleafnodeofthedomainhierarchy

Questions:• Whocurates/ownsthelanguage?• Whateffectwillachangeonthelanguagehaveonexistingscripts?•  Howistheprocessoflanguageevolutioncontrolled?• Whomaintainscodegeneratorsandhow?

•  Importanttohavemanagementonboard

DSLs

DSLsforTesting

CNLsforMonitoring

CNLsfordataprocessing•  Non-technicalpeopleneedtoprocessdatabasedontheirexpertise•  Theycannotprogram–evenDSLsmightstillfeeltootechnical

CNLsfordataprocessing•  Non-technicalpeopleneedtoprocessdatabasedontheirexpertise•  Theycannotprogram–evenDSLsmightstillfeeltootechnical

•  Examples:•  Businessintelligence

BusinessIntelligence•  ThebusinessFacebookpage•  Fastresponseexpected•  “Alertmewhenacustomerhaspostedaquestiononmypageandhasnotbeenansweredinanhour”


•  Reviewers’pages•  Badreviewsneedtobedamagecontrolled•  “Alertmewhenapostonareviewpagementionsmybusinessandgetsmorethan5likes”



•  Advertisingpages•  Competitorsarecontinuallyposting•  “AlertmewhenacompetitorpostsonanadvertisingpageandIhavenotpostedanythingtoday”



•  Advertisingpages•  Competitorsarecontinuallyposting•  “AlertmewhenacompetitorpostsonanadvertisingpageandIhavenotpostedanythingtoday”

Offtheshelfsolutionsarenotso

flexible

Customsolutionsareexpensive

CNLsformonitoring•  Non-technicalpeoplewanttocreatemonitorsbasedontheirexpertise•  DSLsmightstillfeeltootechnical

•  Examples:•  Businessintelligence•  Taxfraud

TaxfraudAuditor

“Findindividualswhodeclaredanaverageincomeoflessthan€3000

forany3sequentialyears”

Taxfraud1.Describearule

2.RuleInterpretation

3.Code

4.Reportfoundcases

5.Reviewfoundcases

DeveloperAuditor



3.Code

4.Reportfoundcases

5.Reviewfoundcases

DeveloperAuditor

Repeatuntilthefraudexpertissatisfied!



3.Code

4.Reportfoundcases

5.Reviewfoundcases

DeveloperAuditor

Repeatuntilthefraudexpertissatisfied!

Manyplaceswherethiscangowrong


5.Reviewfoundcases

Auditor

Automatic

Solution?•  CNLfordomainexpert

Approach:BI

CNLspecification

BIexpert

FBeventstream

Approach:BI

CNLspecification CNL-to-Monitortool

LARVAspecification Larva

BIexpert

FBeventstream

Approach:BI



BusinessIntelligenceDashboard

BIexpert

FBeventstream

TaxfraudAuditor



Spreadsheetwithsuspiciouscases

Taxdatastream

TaxdatastreamTaxfraudAuditor



Spreadsheetwithsuspiciouscases

Inthelongtermmonitoringisfasterthandatabasequery

Lessonslearnt•  UsersfounditquiteeasytoexpressthemselvesinCNL•  Someexampleswereenoughtogetthemgoing

•  GoodUIsupportmakesagreatdifference

•  Taxfrauddomainwasmuchmoredifficulttocapture•  Containsmorejargon•  Canexpress(very)complexrules

OpenPaymentsEcosystemHorizon2020projectShaunAzzopardi,ChristianColombo,GordonJPace,andBrianVella

TravelAgency

TravelAgentCorporateCustomers

Airlines,Hotels,etc

TravelAgency

TravelAgentCorporateCustomers

Airlines,Hotels,etc

Pay-ments

Usingcorporatecreditcards

Flights

Hotel

Transport

Usingcorporatecreditcards

Flights

Hotel

Transport

Reconciliation

One-shotcards

Flights

One-shotcards

Flights

Easyreconciliation

Paymentprogrammesetupcosts

•  Implementingcardprocesses•  Agreementwithbank•  Compliancetolegislation•  Auditing•  Disputeresolution•  ...

Buildingapaymentapplication

TravelAgent


Paymentapplication

TravelAgent


Developer

Paymentapplication

TravelAgent


Serviceprovider(Bank)

Developer

Paymentapplication

TravelAgent


Serviceprovider(Bank)

Developer

Paymentapplication

Programme

(Application)

manager

TravelAgent

OpenPaymentsEcosystem

Serviceprovider

s

Developers

Paymentapplications

Programme

managers

Corporate

customers


Serviceprovider

s

Developers

Paymentapplications

Programme

managers

Corporate

customers

ExecutionEnvironment


Serviceprovider

s

Developers

Paymentapplications

Programme

managers

Corporate

customers


DevelopmentEnvironment

Processgivesrisetoissues

•  Istheapplicationlegal?



•  WhichServiceProviderwouldbewillingandabletorunit?



•  WhichServiceProviderwouldbewillingandabletorunit?

•  Canapplicationviolateregulationsatruntime?

OpenPaymentsEcosystem+Compliance

Serviceprovider

s

Developers

Paymentapplications

Programme

managers

Corporate

customers


Complianceengine


Compliance

1. Checkingcompliancetoregulations

Compliance


2. Matchingserviceprovidercapabilities

Compliance


2. Matchingserviceprovidercapabilities

3. Limitingriskforserviceproviders

Example

UKe-moneyregulationsstatethatfundsonfinancialinstrumentsshouldberedeemableatparvalue.

Example


1.IsthejurisdictiontheUK?

1.  Compliancetoregulations2.  Capabilitychecking3.  Riskmitigation

Example


1.Doestheapplicationfallunderthedefinitionofe-money?


Example


1.Arefundsredeemablethroughtheapplication?


Example


2.Canserviceprovidersupporte-moneyapplications?


Example


1.Iscorrectvaluegiventotheuser


Example


3.Howmanyfundsareallowedoninstruments?


OpenPaymentsEcosystem+Compliance

Serviceprovider

s

Developers

Paymentapplications

Programme

managers

Corporate

customers


Complianceengine


Complianceupfront?

ComplianceChallenges

● Notallpropertiesarecheckableupfront Implication:SAnotenough


● Notallpropertiesarecheckableupfront

● Notallinformationisavailable–onlythemodeloftheapplication

Implication:SAnotenough

Implication:SAcanonlybedoneonmodel


● Notallpropertiesarecheckableupfront

● Notallinformationisavailable–onlythemodeloftheapplication

● Wecannottrusttheapplication(itisrunbythirdparty)

Implication:SAnotenough

Implication:SAcanonlybedoneonmodel

Implication:Wehavetoverifymodeladherenceatruntime

Model

Developersubmitsmodelofapplicationratherthanimplementation

Model

Developersubmitsmodelofapplicationratherthanimplementation

Staticcheckthemodel

Model-Implementation

Implementation

Runtimecheckimplementationagainst

model

Runtimeverification

Implementation

Runtimecheckimplementationagainst

model

Runtimeverifyremainingchecks,eg:limits,atparvalue,delays

Example


2.Canserviceprovidersupporte-moneyapplications?

1.IsthejurisdictiontheUK?


Staticcheckthemodel

1.Arefundsredeemablethroughtheapplication?

Example



StaticcheckthemodelRuntimecheck

implementationagainstmodel

Example


3.Howmanyfundsareallowedoninstruments?

1.Iscorrectvaluegiventotheuser

Staticcheckthemodel

Runtimeverifyremainingchecks,

eg:limits,atparvalue,delays

Whataboutthemaths?

CombiningStaticandDynamicAnalysis

Integratingthemodel

Quotientoperatoronthemodel

Conclusions

•  Loadsofworkahead!!

DSLs and OPE - staff.um.edu.mtstaff.um.edu.mt/__data/assets/pdf_file/0011/348986/dslsandOPE.pdf•...

Documents

Transcript of DSLs and OPE - staff.um.edu.mtstaff.um.edu.mt/__data/assets/pdf_file/0011/348986/dslsandOPE.pdf•...