Managing Large Scale Drupal and Agile Cultureby

Dinesh Waghmare, TCS

Myself @DrupalCon Dublin 2017

What is Large Scale Drupal?

Traditional Clients

• Top Product organisation want to promote there product, connect with customer base and would like to manage content and customer interaction

Functional Requirements

Ø Product Promotion section with pages

Ø Home Page, Product Feature slideshow, Inner Page Product Promotion and Offer Box

Ø Customers Registration Ability to log ticket, feedback, subscribe for new updates of product

Ø Lead generation forms, Email newsletters for subscribed users should be available

Ø Web Content is Focused

UI/UX Requirements Content Requirements Other Requirements

Ø Portal should allow look and feel to match product characteristics

Ø Navigations, Content styling should be easy to handle and update

Ø Browser Based Focused Desktop , Mobile and Tablet View

Ø Editor should able to draft /review / publish / unpublished content pages and promotion box, add navigations

Ø Media management for Image /PDF assets

Ø Guest / Role basedContent

Ø Low costØ Site analytics for user

interaction like manage form submissions, content view/downloads

Ø SEOØ Fast Response TimeØ Security?Ø Performance?Ø Deployment / Rollout?Ø Tight Backend and

Frontend IntegrationØ Single Site / Multi Site

Enterprise or Digital organisations Clients

• Top fortune 500 organisation with multiple set of brands looking for solution to manage existing brand specific websites, launch new template for common brands, have centralised user base, Omni channel marketing with 360 degree view of data analytics

Functional Requirements

Ø Migration Strategy for

existing websites

Ø Common Platform or

Template for rollout

Ø Single sign on with

central user dashboard

Ø Ability to override

platform and features

Ø Multi Country - Multi Language

Ø Data driven Ø Omni Channel

marketing experience

UI/UX Requirements Content Requirements Other Requirements

Ø Different templates for

different content like

Page / News / Product /

Forms etc.

Ø Responsive UI, UI

effects, Navigation

effects, Accessibility

Ø Responsive Support for

Media

Ø Uniformed Styling

Ø Accessibility

Ø LayoutØ Any Screen, Any

Device

Ø Editor workflow for

content and media

Ø Centralised content

management to cater

content to multiple

channel

Ø Personalisation –Personal and Contextual Content Experience

Ø Highly Scalability

Ø Highly Secured

Ø High Performance

Ø Easy to Deploy and

Rollout

Ø Easy maintenance and

Support

Ø Cost Reduction

Ø Automation

Ø Embrace multi vendor –

decoupled agency

Ø Agility

Ø Decoupled, Distributed Architecture

Ø Site Factory

How does Enterprise or Digital organisation look like?

Ø Big EnterprisesØ Big Plans : Web , Mobile, Connected echo system Ø Digital Transformation Strategy : Analytics, Integration, Automation, Omni channel , 360 ViewØ Multiple Stakeholders and Product Owners: Customer and Data centric strategies, Dashboards and

ReportingØ Multiple initiatives , Multiple globally distributed Partners , Multiple ProjectsØ Improve Speed : Performance, Scalability Ø Reduce Cost : Reusability, Easy workflow, Optimum use of resources and infrastructure and toolsØ Innovate Fast : Faster Deployment, Frequent releases, Integrations to channels, Automation, Strategic

solutions, Plans for FutureØ On time support : Easy customisation, Community releases, Security fixesØ Focus more on strategy while collaborate on solutionsØ Share challenges - knowledge - New Opportunities Ø Multi vendor – Decoupled agency

What does Enterprise or Digital organisations looks?

Ø State of Drupal : Drupal scale from small to large, no longer for Simple sites (Blog/Portfolio/Brand) but for sites with medium-to-high richness (community portals, integrations sites, Omni-channel websites, multi site platform )

Ø Drupal is for addressing Ambitious Digital Experience which is much more than just enterpriseØ Big enterprises - Big Plans, Digital strategies, Multiple Stakeholders Ø Enterprise targets for Mega trends (AI, SaaS, IoT, AR, Voice Assistance, Chabot's) and Drupal is getting better

with adoption of new technologiesØ Take off popular myths & facts about open e.g. security, selling data, "free" / costsØ Lone Wolves Lose Out : Are you having active participation and collaboration in Drupal Community,

DrupalCon?Ø Contribution and giving back Vs participationsØ Open Source : Thousand Eye , Faster Testing, Constant reviews

Ø LSD means - Focus more on strategy while collaborate on solutions Ø Share challenges - knowledge - New Opportunities : Events, Camps, Cons, Code SprintsØ Contributions and expertise from enterprise organization will help to keep Drupal “Longer”

Drupal

Highly Scalable

Mobile First

IntegratedApplications

Security

ContentAuthoring

ContentArchitecture

Multisite

Tools for Business

LAMPstack

Content as a Service

Community

Multilingual

Drupal Features

D8

Highly Scalable

Mobile First

IntegratedApplications

Security

ContentAuthoring

ContentArchitecture

Multisite

Tools for Business

LAMPstack

Content as a Service

Community

Multilingual

• Performance• High Volume• Content

Publishing• Architecture• Monitoring• Load Testing

Challenges in High Scalability

D8

Highly Scalable

Mobile First

IntegratedApplications

Security

ContentAuthoring

ContentArchitecture

Multisite

Tools for Business

LAMPstack

Content as a Service

Community

Multilingual

• Multiple Screens and Testing

• Regression

Challenges in Mobile First

D8

Highly Scalable

Mobile First

IntegratedApplications

Security

ContentAuthoring

ContentArchitecture

Multisite

Tools for Business

LAMPstack

Content as a Service

Community

Multilingual

• API First• Inventory• Testing• Uniformed

gateway for data

Challenges in App Integration

D8

Highly Scalable

Mobile First

IntegratedApplications

Security

ContentAuthoring

ContentArchitecture

Multisite

Tools for Business

LAMPstack

Content as a Service

Community

Multilingual

• Vulnerability• Penetration• Security

Advisory• Best Practices• Continuous

Integration

Challenges in Security

D8

Highly Scalable

Mobile First

IntegratedApplications

Security

ContentAuthoring

ContentArchitecture

Multisite

Tools for Business

LAMPstack

Content as a Service

Community

Multilingual

• AccessPermission

• ContentWorkflow

• ContinuousIntegration

• ContentAuditing

Challenges in Content Authoring

D8

Highly Scalable

Mobile First

IntegratedApplications

Security

ContentAuthoring

ContentArchitecture

Multisite

Tools for Business

LAMPstack

Content as a Service

Community

Multilingual

• Managing Configuration

• CMI/Features • BDT• Optimization

Challenges in Content Architecture

D8

Highly Scalable

Mobile First

IntegratedApplications

Security

ContentAuthoring

ContentArchitecture

Multisite

Tools for Business

LAMPstack

Content as a Service

Community

Multilingual

• Use Case• CI/CD• Brittleness of

a Single Codebase

• Single Points of Failure

• Illusion Vs Simplicity

Challenges in Multisite

D8

Highly Scalable

Mobile First

IntegratedApplications

Security

ContentAuthoring

ContentArchitecture

Multisite

Tools for Business

LAMPstack

Content as a Service

Community

Multilingual

• Distributions • Platforms • Builds• Headless • Automation

Challenges in Business Solutions

D8

Highly Scalable

Mobile First

IntegratedApplications

Security

ContentAuthoring

ContentArchitecture

Multisite

Tools for Business

LAMPstack

Content as a Service

Community

Multilingual

• Provisioning• Rollouts• Service

Provider• Future need?• Node JS• Apache Solr• Varnish• Memcache

Challenges in Platform Stack

D8

Highly Scalable

Mobile First

IntegratedApplications

Security

ContentAuthoring

ContentArchitecture

Multisite

Tools for Business

LAMPstack

Content as a Service

Community

Multilingual

• HeadlessDrupal

• Site Inventory• Stack

Provisioning• Continuous

integration

Challenges in Content as Service

D8

Highly Scalable

Mobile First

IntegratedApplications

Security

ContentAuthoring

ContentArchitecture

Multisite

Tools for Business

LAMPstack

Content as a Service

Community

Multilingual

• Common Initiatives

• Contributions • Collaboration• Participations • Open Culture

Challenges in Community

D8

Highly Scalable

Mobile First

IntegratedApplications

Security

ContentAuthoring

ContentArchitecture

Multisite

Tools for Business

LAMPstack

Content as a Service

Community

Multilingual

• Theming • External

Translation Vendor

• Translation Hub

• Regression

Challenges in Multilingual

Big Picture

Perspective of Development Stack for LSD Process, Tools , Solutions

Tools and SolutionsA. Drupal Distributions, Profile,

BuildsB. Editorial Flow + Deploy,

Workflow, Workbench, LayoutsC. Architecture Ø Static Vs Dynamic Vs HybridØ Single Site, Multi SiteØ Standalone Portal Vs Global PortalØ API First Vs Content OnlyØ Monolithic CMS Vs Decoupled

CMSD. IDE, Drush, Composer, Drupal

ConsoleE. VM, Docker, LAMP Stack,

XAMPP, MAMPPF. Git, SVNG. Jenkins , TravisH. PHPCS, Coder, JS Lint, CSS

LintI. Behat, Selenium, wraithJ. Modules, Libraries, FeaturesK. Sub ThemeL. PoEdit

Process and Requirements

A. Product RequirementsB. Content Publishing and

Content WorkflowC. Architecture D. Dev ToolsE. StackF. SCMG. CI/CDH. Best PracticesI. TestingJ. FeaturesK. ThemingL. Translation

Development

Perspective of Platform Infrastructure for LSD Process, Tools , Solutions

Tools and SolutionsA. Jenkins , Travis, PipelineB. Git, SVNC. Shell, Python, DrushD. Docker, Ansible, VME. Codebase Platform, Sub-

Platform, Custom and Contrib Tracker

F. LAMP / NodeJS, / Angular, MongoDB / Couch-PouchDB

G. Distributions D7 / D8 / Site Factory

H. Make file / Composer + Drush + shell

I. TaggingJ. CI+CD AutomationK. Scalability, Cloud – PaaS,

SaaSL. Acquia, Platformsh,

Pantheon AWS etc. M. Iron.io

A. Continuous IntegrationB. SCMC. AutomationD. ProvisioningE. Codebase PlatformF. Stack ProvisioningG. DistributionsH. DeploymentsI. BuildsJ. RolloutsK. High VolumeL. Service ProviderM. Automation

PlatformProcess and Requirements

Perspective of DevOps for LSD Process, Tools , Solutions

Tools and SolutionsA. Anisble , DockerB. (Code / DB / Files) SyncC. Drush sql-sanitizeD. S3 Backups E. Profiler, LogstashF. Slack Bots, WormlyG. Drupal Security

AnnouncementsH. Central Access

ManagementI. Site AuditJ. Content review, Content

Audit Logs, RevisionsK. HackedL. Webhooks, Bots

A. Environment ProvisioningB. Environment Sync and

CloneC. Sanitations of DataD. Backup ManagementE. Centralised LogF. MonitoringG. Security AdvisoryH. InventoryI. Access PermissionJ. Content AuditingK. Module MonitoringL. Communication and

Tools Integrations

DevOpsSupport and MaintenanceProcess and Requirements

Perspective of Testing for LSD Process , Tools , Solutions

Tools

A. Blaze Meter / jMeter , New Relic

B. Behat, SimpleTest, Drulenium,

C. Wraith, PhantomJS / PhantomCSS, backtrac

D. Site Audit, Security Review, Hacked, CMSmap , Wapiti ,

E. fod-devF. Drupal Cache,

Compression, CDN, Varnish, Cloudflare

G. Memcache, Redis

A. Performance & Load TestingB. Regression FunctionalC. Visual testingD. Vulnerability TestingE. Penetration TestingF. Optimization Front EndG. Optimization Backend

TestingProcess and Requirements

Perspective of Community Presence for LSD Process, Tools , Solutions

Tools and SolutionsA. Drupal Camps, Drupal

Cons, Code Sprints, blogsB. Drupal Initiatives like

Content staging stagey, Media initiatives

C. Module Sponsorship, Code Sprints, Drupal Credits

D. Participation, Partnership E. Business SummitsF. Open Source Forums

A. Community PresenceB. Common Initiatives and

TrendsC. ContributionsD. CollaborationE. LeadershipF. 3rd Party Service

Providers Connect

CommunityProcess and Requirements

Integrating Agile for Large Scale Drupal ProjectsØ Multiple Team

Ø Engineering

Ø Development

Ø Maintenance

Ø Support (L1/ L2/ L3/ L4)

Ø DocumentationØ Confluence

Ø JIRA

Ø Wiki

Ø CommunicationØ Slack / Skype

Ø MetingØ Webex

Ø Hangout

Ø PlanningØ JIRA, Asana, Aha

Ø Planning

Ø Learning ToolsØ DrupalCon / Drupal Camps / Open

Source ConfØ Lynda.com / Youtube

Ø Agile Workflow Ø Development Iterations

Ø Scrum, Daily Stand-ups

Ø Weekly Demos and Sprint planning, User

Stories, Storing Pointing

Ø Retrospectives

Ø Effective Communication and collaboration

Ø User RolesØ Product Owners

Ø Scrum Masters

Ø Project Managers

Ø Developers

Ø Project ReleasesØ Branching

Ø Tagging

Ø Critical Releases

Ø Documentations

Ø Tools Selection Ø JIRA, SLACK, ZENDESK

Ø Global Team Structure

Digitalization for Enterprise or Digital organisationsØ Digital

Ø Content and User Journey : Mobile to Digitalü Voice by Defaultü Contextualization based on data

Ø Mega Cognitive Trends Adoptionü Chatbotsü Augmented Experience, WebVR / VRü Voice Assistance - Voice Search

instead Apache Solrü Image Recognition and Searchü Internet of Things - Connected

Content and Dataü Micro-services / Everything as

Serviceü Artificial Intelligence and Big dataü Decentralized + API

Ø Creative over AI

Ø Drupal Ø API First, not API only : REST , JSON

API / GraphQL , OAuth, Framework / SDK’s

Ø hybrid, Headless CMS - Flexibility for Multi Front End, Flexi Backend development

Ø Migrate Fast - D72D8, Non Drupal to Drupal 8

Ø User Experience - Workflow, Layout, Content Staging and Preview, Media and Forms

Ø Cross Community Contribution -Process, Tools, People

Ø DevOpsØ Automate EverythingØ Agile

Build Small – Build Smart – Grow LargeØ Build Prototypes – Build Small – Build SmartØ Communicate OftenØ Plan Project Tracking , Support and TicketingØ Plan Scope and SOPØ Keep building KEDBØ Reactive Vs ProactiveØ Adopt ToolsØ Local and Global TeamsØ Estimate SmartØ Community Presence Ø Plan Governance Ø Do it Locally Work on Production as well

Common ChallengesØ Deployments ( Content / Configuration / Code / Files)Ø Turnaround time on Support (Sync / Backup / Environment Refresh / Rollback )Ø Planning ReactiveØ Being AgileØ Keeping Learning Curve with Community TrendsØ Keeping Priority and CriticalityØ Build Custom Vs Go Open SourceØ Auditing and Compliance (Content / Versions / Users )Ø Multiple Initiatives and Diversity Ø Global Development and Support

Thank YouDrupal Camp Goa 2018

https://drupalcampgoa.orgDrupal.org

TCSDinesh Waghmare