DSLs and OPE - staff.um.edu.mtstaff.um.edu.mt/__data/assets/pdf_file/0011/348986/dslsandOPE.pdf•...

DSLsandOPEChristianColombo(workwithMarkMicallefandGordonPace)

DSLsforTesting

CNLsforMonitoring

DSLsforTesting

CNLsforMonitoring

DSLsfortesting•  AgiledevelopmentèTestautomation

Theneedfortestautomation

Existingtechnology:GherkinGiven I am a premium user When I place a bet on a football match And I win the bet Then I will win 10% more than the advertised odds for the match

Testautomation–2challenges•  Nonskilledtesters(fortestautomation)•  Timepressure

Proposedsolution:• MorestructuredDSL•  Easyfornonskilledtesters•  Savestime

Manytestingdomains•  E-commerce(cart,stock,item,buy,sell,etc)•  Games(bonus,points,bet,win,lose,etc)•  GUIapps(button,progressbar,label,tap,swipe,etc)

DSLsfortesting

Well-DefinedDomains

UndefinedDomains

AndroidGUIApplications

E-CommerceApplications

GraphicalGames

DSLsfortesting

GenerictestingDSL

ECommerceexample

StructuredDSLsvsGherkin1. Theapproachworksonceagrammarisinplace

a.  (Automaticallygenerated)CodehelpersinIDEb.  Consistentscripts

2. Morecumbersometoaddnewlanguagefeaturesa.  Newfeaturesrequiregrammarmodificationb.  Notionoftagging@manualtestslost

3. Specialisedskillsneededforgrammardefinitionandcompilation

4. Wecannot“fudge”anymore(isthisgoodorbad?)

DefinedvsUndefineddomains1. Easytoreachastablelanguagequicklywithwell-defineddomains

2. Youcanquicklygodowntotheleafnodeofthedomainhierarchy

Questions:• Whocurates/ownsthelanguage?• Whateffectwillachangeonthelanguagehaveonexistingscripts?•  Howistheprocessoflanguageevolutioncontrolled?• Whomaintainscodegeneratorsandhow?

•  Importanttohavemanagementonboard

DSLsforTesting

CNLsforMonitoring

CNLsfordataprocessing•  Non-technicalpeopleneedtoprocessdatabasedontheirexpertise•  Theycannotprogram–evenDSLsmightstillfeeltootechnical

•  Examples:•  Businessintelligence

BusinessIntelligence•  ThebusinessFacebookpage•  Fastresponseexpected•  “Alertmewhenacustomerhaspostedaquestiononmypageandhasnotbeenansweredinanhour”

•  Reviewers’pages•  Badreviewsneedtobedamagecontrolled•  “Alertmewhenapostonareviewpagementionsmybusinessandgetsmorethan5likes”

•  Advertisingpages•  Competitorsarecontinuallyposting•  “AlertmewhenacompetitorpostsonanadvertisingpageandIhavenotpostedanythingtoday”

Offtheshelfsolutionsarenotso

flexible

Customsolutionsareexpensive

CNLsformonitoring•  Non-technicalpeoplewanttocreatemonitorsbasedontheirexpertise•  DSLsmightstillfeeltootechnical

•  Examples:•  Businessintelligence•  Taxfraud

TaxfraudAuditor

“Findindividualswhodeclaredanaverageincomeoflessthan€3000

forany3sequentialyears”

Taxfraud1.Describearule

2.RuleInterpretation

3.Code

4.Reportfoundcases

5.Reviewfoundcases

DeveloperAuditor

3.Code

4.Reportfoundcases

5.Reviewfoundcases

DeveloperAuditor

Repeatuntilthefraudexpertissatisfied!

3.Code

4.Reportfoundcases

5.Reviewfoundcases

DeveloperAuditor

Repeatuntilthefraudexpertissatisfied!

Manyplaceswherethiscangowrong

5.Reviewfoundcases

Auditor

Automatic

Solution?•  CNLfordomainexpert

Approach:BI

CNLspecification

BIexpert

FBeventstream

Approach:BI

CNLspecification CNL-to-Monitortool

LARVAspecification Larva

BIexpert

FBeventstream

Approach:BI

BusinessIntelligenceDashboard

BIexpert

FBeventstream

TaxfraudAuditor

Spreadsheetwithsuspiciouscases

Taxdatastream

TaxdatastreamTaxfraudAuditor

Spreadsheetwithsuspiciouscases

Inthelongtermmonitoringisfasterthandatabasequery

Lessonslearnt•  UsersfounditquiteeasytoexpressthemselvesinCNL•  Someexampleswereenoughtogetthemgoing

•  GoodUIsupportmakesagreatdifference

•  Taxfrauddomainwasmuchmoredifficulttocapture•  Containsmorejargon•  Canexpress(very)complexrules

OpenPaymentsEcosystemHorizon2020projectShaunAzzopardi,ChristianColombo,GordonJPace,andBrianVella

TravelAgency

TravelAgentCorporateCustomers

Airlines,Hotels,etc

TravelAgency

TravelAgentCorporateCustomers

Airlines,Hotels,etc

Pay-ments

Usingcorporatecreditcards

Flights

Transport

Usingcorporatecreditcards

Flights

Transport

Reconciliation

One-shotcards

Flights

One-shotcards

Flights

Easyreconciliation

Paymentprogrammesetupcosts

•  Implementingcardprocesses•  Agreementwithbank•  Compliancetolegislation•  Auditing•  Disputeresolution•  ...

Buildingapaymentapplication

TravelAgent

Paymentapplication

TravelAgent

Developer

Paymentapplication

TravelAgent

Serviceprovider(Bank)

Developer

Paymentapplication

TravelAgent

Serviceprovider(Bank)

Developer

Paymentapplication

Programme

(Application)

manager

TravelAgent

OpenPaymentsEcosystem

Serviceprovider

Developers

Paymentapplications

Programme

managers

Corporate

customers

Serviceprovider

Developers

Paymentapplications

Programme

managers

Corporate

customers

ExecutionEnvironment

Serviceprovider

Developers

Paymentapplications

Programme

managers

Corporate

customers

DevelopmentEnvironment

Processgivesrisetoissues

•  Istheapplicationlegal?

•  WhichServiceProviderwouldbewillingandabletorunit?

•  Canapplicationviolateregulationsatruntime?

OpenPaymentsEcosystem+Compliance

Serviceprovider

Developers

Paymentapplications

Programme

managers

Corporate

customers

Complianceengine

Compliance

1. Checkingcompliancetoregulations

Compliance

2. Matchingserviceprovidercapabilities

Compliance

2. Matchingserviceprovidercapabilities

3. Limitingriskforserviceproviders

Example

UKe-moneyregulationsstatethatfundsonfinancialinstrumentsshouldberedeemableatparvalue.

Example

1.IsthejurisdictiontheUK?

1.  Compliancetoregulations2.  Capabilitychecking3.  Riskmitigation

Example

1.Doestheapplicationfallunderthedefinitionofe-money?

Example

1.Arefundsredeemablethroughtheapplication?

Example

2.Canserviceprovidersupporte-moneyapplications?

Example

1.Iscorrectvaluegiventotheuser

Example

3.Howmanyfundsareallowedoninstruments?

OpenPaymentsEcosystem+Compliance

Serviceprovider

Developers

Paymentapplications

Programme

managers

Corporate

customers

Complianceengine

Complianceupfront?

ComplianceChallenges

● Notallpropertiesarecheckableupfront Implication:SAnotenough

● Notallpropertiesarecheckableupfront

● Notallinformationisavailable–onlythemodeloftheapplication

Implication:SAnotenough

Implication:SAcanonlybedoneonmodel

● Notallpropertiesarecheckableupfront

● Notallinformationisavailable–onlythemodeloftheapplication

● Wecannottrusttheapplication(itisrunbythirdparty)

Implication:SAnotenough

Implication:SAcanonlybedoneonmodel

Implication:Wehavetoverifymodeladherenceatruntime

Developersubmitsmodelofapplicationratherthanimplementation

Staticcheckthemodel

Model-Implementation

Implementation

Runtimecheckimplementationagainst

Runtimeverification

Implementation

Runtimecheckimplementationagainst

Runtimeverifyremainingchecks,eg:limits,atparvalue,delays

Example

2.Canserviceprovidersupporte-moneyapplications?

1.IsthejurisdictiontheUK?

Staticcheckthemodel

1.Arefundsredeemablethroughtheapplication?

Example

StaticcheckthemodelRuntimecheck

implementationagainstmodel

Example

3.Howmanyfundsareallowedoninstruments?

1.Iscorrectvaluegiventotheuser

Staticcheckthemodel

Runtimeverifyremainingchecks,

eg:limits,atparvalue,delays

Whataboutthemaths?

CombiningStaticandDynamicAnalysis

Integratingthemodel

Quotientoperatoronthemodel

Conclusions

•  Loadsofworkahead!!

DSLs and OPE - staff.um.edu.mtstaff.um.edu.mt/__data/assets/pdf_file/0011/348986/dslsandOPE.pdf•...

Documents

Transcript of DSLs and OPE - staff.um.edu.mtstaff.um.edu.mt/__data/assets/pdf_file/0011/348986/dslsandOPE.pdf•...

DSLs In Erlang

DSls in groovy

Internal DSLs in Scala

Java DSLs with Xtext

Markus Voelter Textual DSLs

Building DSLs with Scala

Building-Blocks for Performance Oriented DSLs · 2018-10-22 · DSLs while maintaining the modest effort required in creating purely-embedded internal (library-based) DSLs, a notion

Intentional Software - Domain Expert DSLs

Testing business-logic-in-dsls

Metaprogramming And DSLs

Internal DSLs

Scala DSLs Dissecting Rogue

Model-Driven Development and DSLs - · PDF fileModel-Driven Development and DSLs ... Architecture DSLs ... Eclipse Xtext Example 6: Math, Science and Java. 11.08.2011 29 ON ON. 11.08.2011

Combinators, DSLs, HTML and F#

B06 DSLs in Eclipse Strmecki - JavaCRO2017.javacro.hr/.../8748/168197/file/B06+DSLs+in+Eclipse_Strmecki.pdf · to comprehensible Java source code HOW TO DEVELOP YOUR OWN DSLS IN ECLIPSE

building dsl’s in static & dynamic languages...dynamic languages. groovy java external dsls best practices ruby building dsls in: types of dsls motivation what i cover. why won’t

Type checking your DSLs

Writing DSLs in Groovy

A Semantic Framework for DSLs

DSLs in JavaScript