Code and No-Code Journeys: The Coverage Overlook
0 likes50 views
Explore practical ways to expand visual and functional UI coverage without deep coding or heavy maintenance in this session. Session recording and more info at applitools.com
![@Test
public void loginClassicTest() {
//Open browser
driver.get("http://localhost:8000/loginBefore.html");
//Click on the Login button
driver.findElement(By.id("log-in")).click();
//Assert the error text
assertEquals("Please enter username and password",
driver.findElement(By.id("alert")).getText());
//Assert if username field exists
assertTrue(driver.findElement(By.id("username")) instanceof WebElement);
//Assert username placeholder text
assertEquals("Enter your username",
driver.findElement(By.id("username")).getAttribute("placeholder"));
//Assert username label exists
assertEquals("Username", driver.findElement(By.xpath("//label[1]")).getText());
//Assert if password field exists
assertTrue(driver.findElement(By.id("password")) instanceof WebElement);
//Assert password placeholder text
assertEquals("Enter your password",
driver.findElement(By.id("password")).getAttribute("placeholder"));
//Assert password label exists
assertEquals("Password", driver.findElement(By.xpath("//label[2]")).getText());
//Assert if SignIn button field exists
assertTrue(driver.findElement(By.id("log-in")) instanceof WebElement);
//Assert if SignIn buttons label is "Sign In"
assertEquals("Sign in", driver.findElement(By.id("log-in")).getText());
//Assert Remember Me checkbox exists
assertTrue(driver.findElement(By.xpath("//input[@class='form-check-input']")) instanceof WebElement);
//Assert if Remember Me text exists
assertEquals("Remember Me", driver.findElement(By.xpath("//label[3]")).getText());
//Assert if Twitter button exists
assertTrue(driver.findElement(By.xpath("//form/a[1]/img[1]")) instanceof WebElement);
//Assert if Facebook button exists
assertTrue(driver.findElement(By.xpath("//a[2]/img[1]")) instanceof WebElement);
}
Navigation
Button Click
Validation
@Test
public void loginTest() {
//Open browser
driver.get("http://localhost:8000/loginBefore.html");
//Click on the Login button
driver.findElement(By.id("log-in")).click();
//Start the test
eyes.open(driver, "Demo App", "Login Page Test", new RectangleSize(800, 800));
//Take a screenshot so AI can analyze
eyes.checkWindow("Login Window");
//End the test
eyes.closeAsync();
}
Coded Assertions Testing Visual AI Assertions](https://image.slidesharecdn.com/codeandno-codejourneysthecoverageoverlook-250611192009-3d833084/85/Code-and-No-Code-Journeys-The-Coverage-Overlook-11-320.jpg)
Code and No-Code Journeys: The Coverage Overlook
- 1. The Coverage Overlook Code & No-Code Journeys: Tim Hinds Product Team @ Applitools
- 2. Code Coverage ≠ Test Coverage
- 3. Challenges with Test Coverage
- 4. Today’s Challenges with Test Coverage VOLUME Surging number of interfaces, states, and scenarios to verify COMPLEXITY UIs are more complex and dynamic than ever before VELOCITY Increasing frequency of new features and deployments, especially w/ AI coding co-pilots RESOURCES Limited team budgets = “do more with less.” ENVIRONMENTS Apps are accessed on thousands of browsers, devices, & screens
- 5. Traditional test automation doesn’t keep up Traditional testing scales linearly by adding resources 2000 2005 2010 2015 2020 2025 Release Frequency x Application Complexity x Device Proliferation Increasing complexity of software quality The Testing Gap
- 6. Prioritizing with RCRCRC Recent new features, new areas of code are more vulnerable Risky some areas of an application pose more risk Repaired bug fixes can introduce new issues Core essential functions must continue to work Configuration code that’s dependent on environment settings can be vulnerable Chronic some areas in an application may be perpetually sensitive to breaking
- 7. Leveraging Visual AI w/ Coded Tests
- 8. CODE INTEGRATE GIT CI/CD OPS Parallel Execution DESIGN AUTHOR VALIDATE EXECUTE ANALYZE Automated Maintenance Root Cause Analysis Dashboards & Reporting Insights & Optimizations Self-Healing Locators Functional Testing Visual Testing Accessibility Testing Cross Browser & Device Testing SDKs VISUAL AI INTELLIGENT INFRASTRUCTURE Website Testing AUT Web App Testing Native Mobile Testing Component Testing PDF & Doc Testing Applitools Eyes
- 9. Traditional Coded Assertions vs. Visual AI Assertions
- 10. Baseline New Candidate New Candidate Coded Assertions Visual AI
- 11. @Test public void loginClassicTest() { //Open browser driver.get("http://localhost:8000/loginBefore.html"); //Click on the Login button driver.findElement(By.id("log-in")).click(); //Assert the error text assertEquals("Please enter username and password", driver.findElement(By.id("alert")).getText()); //Assert if username field exists assertTrue(driver.findElement(By.id("username")) instanceof WebElement); //Assert username placeholder text assertEquals("Enter your username", driver.findElement(By.id("username")).getAttribute("placeholder")); //Assert username label exists assertEquals("Username", driver.findElement(By.xpath("//label[1]")).getText()); //Assert if password field exists assertTrue(driver.findElement(By.id("password")) instanceof WebElement); //Assert password placeholder text assertEquals("Enter your password", driver.findElement(By.id("password")).getAttribute("placeholder")); //Assert password label exists assertEquals("Password", driver.findElement(By.xpath("//label[2]")).getText()); //Assert if SignIn button field exists assertTrue(driver.findElement(By.id("log-in")) instanceof WebElement); //Assert if SignIn buttons label is "Sign In" assertEquals("Sign in", driver.findElement(By.id("log-in")).getText()); //Assert Remember Me checkbox exists assertTrue(driver.findElement(By.xpath("//input[@class='form-check-input']")) instanceof WebElement); //Assert if Remember Me text exists assertEquals("Remember Me", driver.findElement(By.xpath("//label[3]")).getText()); //Assert if Twitter button exists assertTrue(driver.findElement(By.xpath("//form/a[1]/img[1]")) instanceof WebElement); //Assert if Facebook button exists assertTrue(driver.findElement(By.xpath("//a[2]/img[1]")) instanceof WebElement); } Navigation Button Click Validation @Test public void loginTest() { //Open browser driver.get("http://localhost:8000/loginBefore.html"); //Click on the Login button driver.findElement(By.id("log-in")).click(); //Start the test eyes.open(driver, "Demo App", "Login Page Test", new RectangleSize(800, 800)); //Take a screenshot so AI can analyze eyes.checkWindow("Login Window"); //End the test eyes.closeAsync(); } Coded Assertions Testing Visual AI Assertions
- 12. Visual assertions powered by VisualAI Complete coverage Complete visual and functional coverage across multiple devices and browsers. Fewer test steps 80% less test steps to author and maintain for the entire lifetime of the test. Scalable maintenance Accept or reject differences once across all pages, devices and browsers The best computer vision tech Accurately mimics the human eye. 10+ dev years / 4B+ tests.
- 13. 20% Coded Assertions For testing your most critical and complex user flows, data validation, API calls, etc. 80% Visual AI Assertions For increasing test coverage with Visual AI for functional and visual testing across browsers and devices. 20% Coded Assertions + 80% Visual AI
- 14. What can no-code test cover?
- 15. NO-CODE Parallel Execution AUTHOR VALIDATE EXECUTE ANALYZE AI-ASSISTED Automated Maintenance INTEGRATE CI/CD Dashboards & Reporting OPS Insights & Optimizations Functional Testing Visual Testing API Testing Cross Browser & Device Testing FULLY AUTONOMOUS Web Crawler Natural Language Test Builder Codeless Recorder VISUAL AI & DATA VALIDATIONS INTELLIGENT INFRASTRUCTURE Applitools Autonomous Website Testing AUT Web App Testing
- 16. Interactive test authoring in plain English Author tests in plain English No coding or locators skills required. Easiest to understand and maintain. Interactively record test steps Speed up authoring by recording steps in English, and easily refine manually if needed. Debug tests interactively From setting breakpoints to step by step execution. Do everything a code IDE can do. 100% SaaS No need to install a local recorder. Record and playback tests exactly as they will run.
- 17. Functional data driven testing Robust textual assertions Verify everything you can do with coded tests from string formats to numeric values. Test parameterization Execute tests with explicit arguments or per row in a test arguments dataset. Capture data in variables Extract value fragments and use them in subsequent test steps. Execute JS code When you need to describe complex logic, reuse a utility or manipulate the page.
- 18. LLM assisted test authoring Automatic error correction Automatically corrects syntax and grammar mistakes Automatic step simplification Automatically splits complex steps to multiple simpler ones Automatic step disambiguation Automatically disambiguates step to clarify how the step will be executed Intent-based test generation Automatically generate test steps and test data given a test goal.
- 19. Deterministic LLM test execution Consistency No hallucinations or test variance day-to-day. We also provide 1:1 support if there are LLM questions specific to your environment. Fast With a purpose-built model we can control performance because the model is sized for understanding testing; not the history of the world. Cost With an in-house model built for testing; we control for the cost of running an LLM. Secure We use synthetic data to test our models; never your data.
- 20. API testing Initiate HTTP requests Custom authentication, reset app state, data cleanup, or verify the backend state. Fully configurable Specify HTTP verbs, cookies, headers, and body. Use variables and parameters. Capture response details Verify response details or store it in variables to use in subsequent test steps Capture application requests Capture outbound client requests and responses to verify or use their data.
- 21. Leveraging Visual AI w/ no-code tests
- 22. Autonomous self-maintaining website testing Easy one-click setup Everything is included out of the box, from devices & browsers to test scheduling. Automatic website discovery Automatically crawls and finds all the pages in your website given its URL. Comprehensive coverage Automatically reports of any HTTP issue, content change or rendering difference Adjusts to website changes Automatically detects and reports new, missing or faulty pages on every test run.
- 23. Autonomous self-maintaining website testing Easy setup Everything is included out of the box, from devices & browsers to test scheduling. Increase coverage for pages Upload URL list of to scan Run flows before tests Run flows like auth/login before running the test for web apps
- 24. Visual assertions powered by VisualAI Complete coverage Complete visual and functional coverage across multiple devices and browsers. Fewer test steps 80% less test steps to author and maintain for the entire lifetime of the test. Scalable maintenance Accept or reject differences once across all pages, devices and browsers The best computer vision tech Accurately mimics the human eye. 10+ dev years / 4B+ tests.
- 25. 20% Custom Flow Tests For testing your most important user flows with functional data, visual assertions, and API calls across browsers and devices. 80% Visual AI Full Page Tests For increasing test coverage autonomously with Visual AI for functional and visual testing across browsers and devices. 20% AI-Assisted + 80% Visual AI Autonomous
- 26. Real example of how teams balance code and no-code automation
- 27. Slash Regression Time: A Case Study from EVERSANA Intouch Applitools streamlined their testing, slashing regression time and uniting diverse teams to deliver flawless user experiences for their life sciences clients, including global pharmaceutical and healthcare organizations. The Journey with Applitools ● Coding skill disparities slowed testing, with non-technical testers sidelined and siloed teams lacking trust ● Empowered non-technical testers to create automated tests via Autonomous, while coders handled complex scenarios, fostering inclusivity and upskilling ● Leveraged parallel test execution and CI/CD pipelines to reduce regression testing time, allowing manual testers to focus on high-value edge cases ● Their teams were able to foster a Shift Left quality culture Customer Profile Before Applitools With Applitools EVERSANA Intouch struggled with skill gaps that sidelined non-coders and slowed releases, while siloed teams and fragmented tools eroded trust and efficiency. This chaos left them overwhelmed, with inconsistent testing and lagging morale. Applitools transformed EVERSANA INTOUCH’s testing chaos into a collaborative triumph, empowering non-coders and engineers alike with its no-code platform to automate tests effortlessly. Parallel testing slashed regression time, boosting efficiency and quality. Unified reporting fostered seamless teamwork, accelerating releases and setting a new standard for flawless user experiences. 65% 90% 750+ Reduction in Regression Testing Time Test Stability Manual Test Hours Saved Monthly Customer Since 2020 Use Cases Visual testing of pharmaceutical websites, automate regression testing, validate accuracy in client deliverables like compliance reports or promotional materials Integrations Azure DevOps, Teams
- 28. Questions? Sign up for a 14-day free trial of Applitools Autonomous https://applitools.info/nea