Testing needs to keep pace with the rapid evolution of technology and increasing user expectations. Customers require higher quality, faster, safer, more mobile solutions, often to problems that did not exist 15 years ago. Testers are challenged to get involved earlier in the software development process than previously, and therefore also to understand the customer in more detail than ever before. Testers have to deliver but also have to innovate, frequently limited by the budgets and resources the wider business is willing to allocate. Against these challenges are set the opportunities offered by new technologies, techniques and ways of working. This 15th Next Generation Testing conference focuses on the way forward, with a brief retrospective on how far we have come.
Keynote presentations and user case studies provide valuable insights, and the popular roundtable sessions allow all participants to join in and discuss their own experiences, and consider how to make the most of the opportunities on offer today and how to achieve their aspirations of delivering the solutions that will meet their customers’ expectations.
Kirk Botula, CEO, CMMI Institute
Senior executives believe that organizational agility is critical for business success. Yet, most companies admit they are not agile enough to mobilize quickly, respond positively and change to compete successfully. To achieve organizational agility, companies need to focus on the key capabilities that will help them develop better products, faster and at a lower cost to differentiate themselves and gain a sustainable competitive advantage.
Dave Snowden, CTO Cognitive Edge
The ambition of the DevOps community is to break down barriers than inhibit value driven behaviour. But some boundaries are useful allowing expertise to develop and be nurtured. Sensor technologies and wider economic and ecological pressures are creating both stress and opportunity at a national and organisational level. This presentation will attempt to change our perception of the ecosystem of an organisation away from manufacturing metaphors and control to something more fluid, adaptive and critically highly innovative. How to achieve whole of work force engagement in both strategic development and operational execution? How to rapidly repurpose existing capability to handle previously unanticipated needs? How to resource for systems that are effective, not just efficient?
Paul D. Nielsen, Director and CEO, Software Engineering Institute
We are incorporating more autonomous features and functions into the systems we build—from cars, airplanes and underwater vehicles to home thermostats and assistive devices. But increasing autonomy comes with increasing complexity and new concepts like deep and continuous learning and non-deterministic algorithms. These are challenges to current verification and validation methods. Furthermore the central principle of trust may be the key to the acceptance of these increasingly autonomous into our lives. New strategies for V&V and test may be needed to establish that trust.
Dr Richard Sykes, Cloud Industry Forum
Colin Deady, Capita IT Professional Services
Do you want to achieve fast product delivery or improve software quality? Are you looking to develop collaborative work between IT and other departments? Do you need to manage change of requirements during the software development phase? Then your business probably intended to become Agile! But have you been as successful as planned? During our presentation, Colin will help you identify the cultural changes that your organisation needs to undertake to generate real business value with Agile. Embracing the agile culture requires for many stakeholders to change their views, processes, documentations, etc. Waterfall or standard top-down methodologies have been the norm in organisations for decades and changing can be a challenge...
Scott Summers, Director at nFocus Testing
DevOps aims to reduce delivery times and achieve greater production stability and reliability, so automated testing is naturally seen as being key to this. While this may be true, just having automated tests is not enough. This session will discuss some of the challenges of automating deployment pipelines such as test environments, test data, deployment tools and success/failure metrics.
Dorothy Graham, Software Testing Consultant, Speaker & Author
Many people are still struggling to achieve good results from system-level test automation. It’s not just a technical matter, management involvement is critical for success. Unrealistic expectations can doom an automation effort before it starts. In this presentation, Dot Graham will outline what not to expect, what benefits you can realistically expect from good automation, and what you need to do to achieve them.
– what not to expect from automation
– achievable benefits
– building a lasting asset
– pitfalls to avoid: management, people issues and technical issues
Declan O'Riordan, Independent Consultant
Is it possible to blend different test types into combined test cases? Attempts to combine functional and non-functional tests defy the reasoning for differentiating these tests in the first place. With effort, blending tests can succeed at the overlapping margins, but as a wholesale approach it failed to provide sufficient coverage, until now. By installing a new breed of sensor technology we are transforming Performance and Security and making blended testing a reality. This case study is based on Declan’s work on behalf of a large organization that annually spends 20% of the UKs GDP. The organisation is rapidly transitioning from a closed sequential model to an Internet-facing highly iterative framework, with all the risk that entails!
Agile Testing (hosted by Stevan Zivanovic, Infuse); Implementing Agile Mobile Test Strategy (hosted by Mark Roberts and Colin Deady, Capita); Security Testing (hosted by Declan O’Riordan); Test Automation (hosted by Dot Graham)
Donald Firesmith, Principal Engineer, Client Technical Solutions, Software Engineering Institute (SEI), USA
While evaluating the test programs of numerous defence contractors, we have often observed that they are quite incomplete. For example, they typically fail to address all the relevant types of testing that should be used to (1) uncover defects (2) provide evidence concerning the quality and maturity of the system or software under test, and (3) demonstrate the readiness of the system or software for acceptance and being placed into operation. To address these problems, we developed a taxonomy that organizes roughly 200 types of testing into a structure that can help testing stakeholders understand these testing types and can use as a checklist to ensure that no important type of testing falls through the cracks.