IBM Mobile Quality Assurance Study Group Session 6
-
Upload
roger-snook -
Category
Technology
-
view
647 -
download
1
description
Transcript of IBM Mobile Quality Assurance Study Group Session 6
© 2013 IBM Corporation
IBM Mobile Quality Assurance (Open Beta) Continuously deliver quality mobile apps, rapidly respond to feedback!
MQA Study Group – 20 February 2014
Host: Roger Snook, WorldWide Enablement Leader: Mobile, SOA & Design +1.703.943.1170, [email protected]
Session 6: Sentiment Analysis(Prior Session Slides and Recordings: http://ibm.co/174C6ug)
© 2013 IBM Corporation2 #IBMMobile
Please note – This discussion is about an Open Beta
IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion.
Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.
The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.
Performance is based on measurements and projections using standard IBM benchmarksin a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.
© 2013 IBM Corporation3 #IBMMobile
Scan & Certify
Instrument
Test
IntegrateObtain Insight
Manage
Deploy
Design & Develop
Mobile Enterprise Lifecycle “big picture”: Focus on Mobile Quality
© 2013 IBM Corporation4 #IBMMobile
Scan & Certify
Instrument
Test
IntegrateObtain Insight
Manage
Deploy
Design & Develop
Mobile Enterprise Lifecycle supported by a DevOps capabilityContinuously deliver high quality mobile apps and rapidly respond to feedback.
© 2013 IBM Corporation5 #IBMMobile
Mobile Quality automation fundamental to a DevOps LifecycleContinuously deliver high-quality mobile applications (HTML5, hybrid and native) and support multiple
mobile operating environments and devices with the simplicity of a single, shared code base
Systems ofInteraction
DevOps Lifecycle
Operations/ProductionDevelopment/TestCustomers Business Owners
Continuous Innovation, Feedback and Improvements
Ec
os
ys
tem
Be
st P
rac
tice
s
Plan and Measure Develop and Test Release and Deploy
Monitor and Optimize
IBM Mobile Quality Assurance
Worklight
Automate and orchestrate the delivery pipeline for IT infrastructure and the mobile app, reducing cycle times to respond faster to feedback
Judge mobile application quality and customer readiness across multiple dimensions, to deliver apps that better meet customer expectations
Rational Test Workbench
© 2013 IBM Corporation6 #IBMMobile
Continuously deliver high quality mobile applicationsWhat’s New
• End user feedback and quality metrics available at every stage of development
• App quality assurance in a fragmented and complex environment
Features/Business Value
• Evidence-based prioritization – enable business and IT to collaborate on mobile strategy and user experience
• Over the air app distribution – get the latest in the hands of testers as soon as it is available
• Frictionless bug reporting – spend every minute on testing latest and greatest builds, not the hassles
• In-app crash reporting – rapid understanding of why an app fails
• Sentiment analysis – mine app ratings and reviews to extract actionable feedback before they go viral(coming soon)
Client Benefits• Improve mobile app quality with holistic visibility into user
experience, including bugs, crashes, feedback, and user sentiment
• Proactively manage quality risks through rapid assessment of issues and reduced cycle time
Updated xx-xx-12
Introducing IBM Mobile Quality Assurance (beta)
”What you are talking about doing is fantastic. You have a
very powerful approach here and it will drive a lot of what people will want to do in the market”
IBM Mobile Quality Assurance (beta)
© 2013 IBM Corporation7 #IBMMobile
Streamline the feedback loop into development, before and after release – five use cases (aligned with this Study Group)
Developer Tester UsersDistribute to testers and users
1
Report Bugs 2
Report Crashes / Logs 3Provide Feedback 4
Analyze AppStore
5
© 2013 IBM Corporation8 #IBMMobile
End UsersDeveloper
Over the air build distribution1 In app bug reporting 2
Crash log reporting
4
In app user feedback 3
LOB/Digital Marketer
Sentiment Analysis5
Builds
User Feedback Crash logs
BugsBugs vs. Crashes
Quality Dashboard with Sentiment Analysis
Mobile Quality Assurance features that support the Use CasesSession 6 Focus: Sentiment Analysis
Tester
© 2013 IBM Corporation9 #IBMMobile
Helping the software team get smarter about their mobile apps
Tester End UsersDeveloperLOB/Digital Marketer
“When someone leaves a negative review in the app store, it scars your app for life, you can’t respond to it, and you can’t learn more about the problem in order to fix it quickly.”
- Mobile Orchard
• How effective our mobile app is at engaging customers?
• How can I stay on top of current quality metrics, and turn them into an actionable strategy?
• How could I get visibility to issues that customers experience in production so that I can address them quickly?
• How can I get more people to test the apps so that we can cover different devices, network carriers, and OS versions?
• How can I get the latest and greatest build without wasting my time to track that down?
• How can I quickly submit bug reports with screenshots and device details right from the application?
• How can I provide direct and constructive feedback?
© 2013 IBM Corporation10 #IBMMobile
User Sentiment
Mine app ratings and reviews to extract actionable feedback
User Sentiment enables key stakeholders throughout the SDLC to
•Consolidate all their app store ratings and reviews into easy to view "collections"
•Analyze mountains of explicit user feedback about features, performance and usability
•Understand what users are saying about their app – why they're cheering and why they're not
•Compare their apps against competitors to see how they stack up, and how they can improve end user satisfaction
Enables line of business to mine user sentiment
© 2013 IBM Corporation11 #IBMMobile
User Sentiment
Enables line of business to mine user sentiment
User Sentiment Score•Provides overall score •View overall score over time•Compare score over versions
© 2013 IBM Corporation12 #IBMMobile
User Sentiment
User Sentiment Attributes•Breaks down score into ten key User Sentiment Attributes •Provide deeper level of insight into areas that require improvement•Compare to competitors across attributes
Enables line of business to mine user sentiment
© 2013 IBM Corporation13 #IBMMobile
User Sentiment
User Sentiment Signals•View consolidated positive and negative signals from end user reviews•Match signals to public app store star ratings
Enables line of business to mine user sentiment
© 2013 IBM Corporation14 #IBMMobile
Your next steps:
1.Try It: MQA Open Beta – click on this button from the landing page.
2.Give us feedback directly in the beta site or in the Mobile Learning Circle forum (developerWorks)
3.Visit any of the reference info:• Watch the MQA Tutorial Video• Tools and Technologies for
MobileFirst Developers: http://www.ibm.com/developerworks/mobile/
• Read the CTO Mobile Frontier Blog: https://www.ibm.com/developerworks/community/blogs/mobileblog
• Watch the PRIOR Study Group sessions
Your next steps:
1.Try It: MQA Open Beta – click on this button from the landing page.
2.Give us feedback directly in the beta site or in the Mobile Learning Circle forum (developerWorks)
3.Visit any of the reference info:• Watch the MQA Tutorial Video• Tools and Technologies for
MobileFirst Developers: http://www.ibm.com/developerworks/mobile/
• Read the CTO Mobile Frontier Blog: https://www.ibm.com/developerworks/community/blogs/mobileblog
• Watch the PRIOR Study Group sessions
© 2013 IBM Corporation15 #IBMMobile
IBM Mobile Quality Assurance Open Beta Study Group: http://ibm.co/174C6ug
© 2013 IBM Corporation16 #IBMMobile
Thank You
MerciGrazie
GraciasObrigad
oDanke
Japanese
French
Russian
GermanItalian
Spanish
Portuguese
Arabic
Traditional Chinese
Simplified Chinese
Hindi
Romanian
Korean
Multumesc
Turkish
Teşekkür ederim
English
© 2013 IBM Corporation17 #IBMMobile
Legal Disclaimer
© IBM Corporation 2013. All Rights Reserved.The information contained in this publication is provided for informational purposes only. While efforts were made to verify the completeness and accuracy of the information contained in this publication, it is provided AS IS without warranty of any kind, express or implied. In addition, this information is based on IBM’s current product plans and strategy, which are subject to change by IBM without notice. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this publication or any other materials. Nothing contained in this publication is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in this presentation may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results. If the text contains performance statistics or references to benchmarks, insert the following language; otherwise delete:Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.If the text includes any customer examples, please confirm we have prior written approval from such customer and insert the following language; otherwise delete:All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.Please review text for proper trademark attribution of IBM products. At first use, each product name must be the full name and include appropriate trademark symbols (e.g., IBM Lotus® Sametime® Unyte™). Subsequent references can drop “IBM” but should include the proper branding (e.g., Lotus Sametime Gateway, or WebSphere Application Server). Please refer to http://www.ibm.com/legal/copytrade.shtml for guidance on which trademarks require the ® or ™ symbol. Do not use abbreviations for IBM product names in your presentation. All product names must be used as adjectives rather than nouns. Please list all of the trademarks that you use in your presentation as follows; delete any not included in your presentation. IBM, the IBM logo, Lotus, Lotus Notes, Notes, Domino, Quickr, Sametime, WebSphere, UC2, PartnerWorld and Lotusphere are trademarks of International Business Machines Corporation in the United States, other countries, or both. Unyte is a trademark of WebDialogs, Inc., in the United States, other countries, or both.If you reference Adobe® in the text, please mark the first use and include the following; otherwise delete:Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.If you reference Java™ in the text, please mark the first use and include the following; otherwise delete:Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.If you reference Microsoft® and/or Windows® in the text, please mark the first use and include the following, as applicable; otherwise delete:Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both.If you reference Intel® and/or any of the following Intel products in the text, please mark the first use and include those that you use as follows; otherwise delete:Intel, Intel Centrino, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.If you reference UNIX® in the text, please mark the first use and include the following; otherwise delete:UNIX is a registered trademark of The Open Group in the United States and other countries.If you reference Linux® in your presentation, please mark the first use and include the following; otherwise delete:Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others.If the text/graphics include screenshots, no actual IBM employee names may be used (even your own), if your screenshots include fictitious company names (e.g., Renovations, Zeta Bank, Acme) please update and insert the following; otherwise delete: All references to [insert fictitious company name] refer to a fictitious company and are used for illustration purposes only.