Testing Is Not a Monolith: Lessons from DevOps Unbound | DevsDay.ru

IT-блоги Testing Is Not a Monolith: Lessons from DevOps Unbound

DZone DevOps 7 апреля 2021 г. Emma Peet


Do you remember a world before DevOps? Testing was set apart, an island reserved for testers only.  That software testing island at the end of a release wave got swamped, overwhelmed by today’s continuous software improvement across all industries. As testing and development teams are now crisis-averting by collaborating, we are also presented with a variety of testing approaches to choose from.

The many forms of testing have recently been explored in DevOps Unbound, where thought leaders take on DevOps’s toughest topics head-on (no slides, no spin). For this episode, we ended up back where the series began: looking at testing. Is automation the be-all and end-all? Does manual testing still have its place? And what about everything in between, from performance testing to BDD?

Alan Shimel, DevOps.com CEO and Editor-in-Chief, guided this session on scrutinizing different testing methods with the insights of  Christine Fisher (NAIC), Leonardo Melendez (Qualitest), Ken Pugh (Ken Pugh Inc.), and Mitch Ashley (Accelerated Strategies Group). Some of the topics covered include:

  • Getting a grip on the different software testing types.
  • Is better testing just an argument for adding automation?
  • Everyone should have a seat at the table.

This engaging discussion sure leaves an impact on Alan:

“It’s fascinating that testing has been so profoundly affected by DevOps. Rather than being left behind, it’s being accelerated through automation, speed, and more focus.”

Getting a Grip on The Different Software Testing Types

The session begins by diving into BDD — we’re reminded that, in a nutshell, it centers on understanding the behavior of the end-user. Christine points out that we should understand these requirements before testing and use common language across teams to underpin them. Ken explores the importance of the triad — the customer, developer, and tester — which, as Leonardo clarifies, are the 'three amigos!' Our amigos should get together prior to implementation to create scenarios; scenarios become the tests, and the developers are given said tests to run against their code.

This sounds straightforward enough, right? Not exactly! Initially, Leonardo states that developers are responsible for marking tests as completed but corrects himself by saying "in general you’re supposed to be a team, and everyone is responsible for each element." As BDD encourages collaboration and shared accountability, it’s no secret that this is no easy feat, but it is a venture that pays off.

Ken brings the testing matrix to the fore:

“The testing matrix shows testing that’s not just about functionality. It describes all the different sorts of tests, from the functionality tests which are on one side of the matrix, to the quality tests which are on the other side — including performance, security, usability, and so forth. ATDD and BDD tend to focus on the functionality, but you ought to have all those other tests already established ahead of time.”

Is Better Testing Just a Case of Test Automation?

Alan recognizes that most of our current testing approaches pre-date DevOps, but it’s DevOps that actually propelled us to adopt many of them. With this in mind, Alan asks our speakers how we can get better at testing.

Ken is a true advocate for 'exploratory testing' — using human intelligence and creativity to find the intricacies that functionality tests aren’t going to cover.  Leandro shares that many tools give transparency into the code and allow us to monitor it, catching bugs way before the push to production. Using a 'man with hammer' analogy, Leandro hits home that we have evolved way past the one-tool approach — "Prioritize, distribute and make the best effort with each of them."

Mitch poses a question about whether the ever-evolving conditions we’re in today, where software agility is not an option but a need, impact the way we work. Leandro compares the work of a manual tester to that of caring for horses; it is still essential and can’t be replaced. When we traveled in carts and not cars, horse groomers were commonplace. Today, where cars and automation drive our daily lives, there is still a niche for horse care, so the need for it persists — much like manual testing!

If your QA team sits outside of development, Christine invites you to reconsider. Her wake-up call came after testers on her team expressed concerns about their responsibilities changing dramatically. For instance, manual testers were reluctant to learn automation. The turning point was "realizing that quality is the responsibility of the entire team and that everybody needs to contribute to that conversation. The most important part to me is that the testers are at the table and part of that conversation."

Everyone Should Have a Seat at The Table

This DevOps mantra underpins Christine’s contributions throughout — ensuring that developers and testers know where they sit in the process early on has set up her team at NAIC for success.

This has been formalized as a test strategy meeting —

“we get the Business Analysts, manual and automation QA in a room and we talk about each of our stories. Should we automate it? What are we looking at manually? They took it further than when we first started, and they came up with a scoring guide to say what is our effort level with this, what’s the repeatability for the user etc., and they’ve realized that those conversations are so important.”

Giving the team room for critical thinking has drastically increased the quality of their tests from all angles. What’s not to like?

Join the Conversation

In bringing voices from different corners of the software testing globe to the DevOps Unbound table, it’s a joy to hear a variety of spins on hot DevOps topics.

Alan wraps up with the powerful sentiment — “It’s fascinating that testing has been so profoundly affected by DevOps. Rather than being left behind, it’s being accelerated through automation, speed, and more focus. DevOps has been one of the best things that’s ever happened to testing.”

[Watch the complete "Testing Is Not A Monolith" roundtable.]

Источник: DZone DevOps

devops agile testing bdd devops testing

Читайте также


Three Strategic Considerations for Choosing a CD Platform

DevOps DZone DevOps 20 апреля 2021 г. 18:45
Introduction Every company is trying to deliver software faster. The most important decision for setting up the organization for success is the CD platform. Sometimes the shiny object is not the right solution. Responding quickly to customer needs is...... читать далее
extensibility cicd pipeline spinnaker risk mitigation culture fit hiring cd platform

8 Best Practices To Reduce Your AWS Bill for Kubernetes

DevOps DZone DevOps 20 апреля 2021 г. 18:31
If your AWS Kubernetes bill went way over your budget this month, it’s not your fault. Typically, companies go over their cloud budgets by 23% (Flexera).  Cloud providers aren’t exactly helping here. The bills are long, complicated, and har...... читать далее
devops aws kubernetes k8s aws cost cloud optimization cloud compute

DevOps ubuntu.com 20 апреля 2021 г. 16:27

It’s that time of the year again! KubeCon and CloudNativeCon Europe 2021 are just around the corner and, as always, Canonical and Ubuntu have a lot cooking in the Kubernetes oven especially for the event. This year, we’ll be showcasing solutions and...... читать далее

Cloud Native CNCF containers edge events k8s KubeCon kubernetes MicroK8s

DevOps DZone DevOps 20 апреля 2021 г. 16:12

Currently, GitOps has become increasingly present in the day-to-day of an SRE. Fast error recovery, Self-documenting deployments, and highly traceable changes are just a few advantages provided in this case.  The core idea is having a Git reposi...... читать далее

tutorial devops gitops openshift cluster operators

Разработка .NET Escapades 20 апреля 2021 г. 10:00

In this post I describe how to hide the warning generated by the dotnet CLI when working with end-of-life frameworks like .NET Core 3.0 (netcoreapp3.0)... читать далее

.NET CLI DevOps .NET Core

DevOps ubuntu.com 19 апреля 2021 г. 13:51

Build and run Ubuntu containers that comply with the US and Canada government FIPS140-2 data protection standard.... читать далее

containers FIPS Security Ubuntu Pro

Разработка blogs.oracle.com 19 апреля 2021 г. 10:30

14 апреля 2021 года в Москве состоялась ежегодная конференция Oracle Systems Advantage Forum: «Инновации в IT и стратегии цифровой трансформации, основанные на эффективной обработке данных». Встреча прошла в онлайн-формате и была посвящен...... читать далее

Популярные темы

новости (393) ux (363) design (329) headline (271) python (226) ubuntu (220) ux-design (217) devops (206) новость (204) javascript (201) web dev (193) security (188) seo (150) tutorial (141) working in tech (137) дайджесты вакансий от new.hr (136) статьи (131) ui (127) programming (118) testing roundup (116) software testing (113) user-experience (111) дизайн (99) product-design (94) google (93) java (90) игровые проекты (85) ui-design (84) design-thinking (84) primary (77) api5 (76) технологии (76) движки и конструкторы игр (70) прочее (70) job hunting (68) windows 10 (68) бизнес (68) php (66) bash programming (66) laravel (65) technology (65) debian (61) hardware (60) css (59) linux mint (57) uncategorized (56) обучение (56) мероприятия (56) работа (52) docker (51) español (51) covid-19 (50) web design and applications (49) cloud (49) android (49) case-study (49) chrome (48) турбо-страницы (47) инструкции (46) обзоры (46) tutorials (46) data (45) ux-research (45) machine learning (44) publication (44) angular (44) networking (44) навыки алисы (43) inspiration (43) home page stories (43) разработчики (42) apple (42) kubernetes (42) web (41) art (41) job skills (41) c++ (41) powershell (41) ios (40) kali linux (40) mysql mariadb (40) google ads (39) cybersecurity (39) virtual reality (39) автоматизация (38) wp (38) vue.js (37) маркетинг (37) wordpress (36) aspnet (36) тестирование (36) события (36) arch linux (36) полезное (36) productivity (36) marketing (36) кейсы (35) css 3 (35) events (35) smm (35)