Posted by Sheba John

Introduction

As software development progresses, testing takes the central stage in the process of delivering reliable products. But, thanks to the emergence of AI pair programming tools, testers get a unique chance to turn traditional ideas into effective smart processes. All these tools help the teams to make the most of the creation of test cases, reuse the created templates and accelerate the work, and use AI-generated feedback to enhance the quality of the code. The integration of AI with collaborative programming and innovative testing practices signifies a new phase of software delivery where speed yes, but accuracy is equally possible making the best for organizations to compete in the market.

Top AI Pair Programming Tools for Software Testing

AI Pair Programming like GitHub Copilot, Codeium and Tabnine act as intelligent coding companions and transforming how developers and testers write and optimize test cases. 

1. GitHub Copilot

GitHub Copilot is an AI code completion tool that is advantageous in helping speed up the testing process of a software by automating various simple tasks or providing the programmer with useful suggestions. In the context of handling test data, it assists to create test cases, write code for the test automation and integrate with common frameworks such as Junit, Selenium, and PyTest. That includes edge cases, regression tests, and data-driven test scenarios which are valuable and beneficial to testers for extending the coverage of tests. It also comes with standard code, creates API test scripts and includes bug fixes and validation suggestions which increases the rate of work. In general, it is an effective one that assists in managing test processes so that real focus is put on scenarios. 

Steps to setup GitHub Copilot:

Pre-requisite: GitHub account  

1. Open VS code > Open Extensions view > Search for GitHub Copilot > Click on install 
2. Click on the github.com link.  
3. Login with your GitHub account. 
4. Start free trial >Provide required details to start free trial.

Example:

Scenario: Generating an automated test case in cypress to test an online shopping app 

Pre-requisite: Install and create cypress project in VS code 

Code:

1. Create a new test file in cypress > See that a field stating to ask github copilot to do something is displayed.
2. Press ctrl + I to start asking for suggestion on test cases creation.
3. See that a detailed test case suite has been provided with options to accept or discard the code.

describe(‘Online Shopping App’, () => { 
it(‘should load the homepage’, () => { 
cy.visit('https://your-online-shopping-app.com'); 
cy.get('h1').should('contain', 'Welcome to our store'); 
}); 
  
it('should search for a product', () => { 
cy.get('imput[placeholder="Search"]').type('Laptop'); 
cy.get('button[type="submit"]').click(); 
cy.get('.product-list').should('contain', 'Laptop'); 
}); 
  
it('should add a product to the cart', () => { 
cy.get('.product-list .product-item').first().click(); 
cy.get('button.add-to-cart').click(); 
cy.get('.cart-count').should('contain', '1'); 
}); 
  
it('should proceed to checkout', () => { 
cy.get('.cart-icon').click(); 
cy.get('button.checkout').click(); 
cy.url().should('include', '/checkout'); 
}); 
  
it('should fill in shipping information', () => { 
cy.get('input[name="name"]').type('John Doe'); 
cy.get('input[name='address']').type('123 Main St'); 
cy.get('input[name='city']').type('Anytown'); 
cy.get('input[name='zip']').type('12345'); 
cy.get('button.continue').click(); 
}); 
  
it('should place an order', () => { 
cy.get('button.place-order').click(); 
cy.get('.order-confirmation').should('contain', 'Thank you for your order'); 
}); 
});

2. Codeium

Codeium is an AI coding assistant and tool that can help with software tests by automating and optimizing some processes, and it provides code and test script automations, fake data. Some of the integrated elements that come with it include bug detecting elements, code checking and optimizing elements for test script and readability as well as ease of maintaining scripts. In general, it proves effective for testers to concentrate on strategy and exploratory testing that increases efficiency and provides more valuable results.

Steps to setup Codeium:

1. Open VS code > Open Extensions view > Search for Codeium > Click on install 
2. Login to Codeium by acknowledging the prompt after installation.

Example:

Scenario: Generating an automated test case in cypress to test online registration page 

Pre-requisite: Install and create cypress project in VS code 

Code:

• Write a description of the test case at the beginning of the file to guide Codeium.

// Test case: Automate the registration page 
describe() 
// Steps: 
// 1. Navigate to the registration page. 
// 2. Fill out the form (e.g., Name, Email, Password). 
// 3. Click the Submit button 
// 4. Verify successful registration 

• Start typing the test structure and let Codeium suggest code snippets. 

const cypress = require("cypress");
// Test case: Automate the registration page
describe("Registration Page", () => {
it("Automate the registration page", () => {
// Steps:
// 1. Navigate to the registration page.
cypress.visit('https://example.cypress.io')
cypress.get('a[href="/register"]').click()
// 2. Fill out the form (e.g., Name, Email, Password).
cypress.get('input[name="name"]').type('John Doe')
cypress.get('input[name="email"]').type('OBt61@example.com')
cypress.get('input[name="password"]').type('password123')
// 3. Click the Submit button.
// 4. Verify successful registration.
});
})

• Verify the generated code.

// Test Case: Automate the registration page 
describe(‘Registration Page’, () => { 
it(‘should navigate to the registration page’, () => { 
 
// 1. Navigate to the registration page. 
cypress.visit(‘https://example.com/registration’) 
 
// 2. Fill out the form (e.g., Name, Email, Password). 
cy.get(‘input[name=”name”]’).type(‘John Doe’) 
cy.get(‘input[name=”email”]’).type(‘5oGQ4@example.com’) 
cy.get(‘input[name=”password”]’).type(‘password123’) 
 
// 3. Click the Submit button 
Cy.get(‘button[type=”Submit”]’).click() 
// 4. Verify successful registration 
cy.contains(‘Registration successful’) 
}) 
});

3. Tabnine

Specifically, Tabnine is an AI code completion tool, a machine learning based product, which provides testers with context-based code completions leveraging massive code data sets. It builds tests for unit tests, integration tests and end-to-end tests that accelerates the generation of test code and eliminates copy-paste writing. It also indicates the possible fixes and improvements to test code, which will help in debugging faster. In case of test automation, the concept of WB vended reusability in the development of the automation scripts. All in all, code should be kept consistently and is helpful for the work itself as well as for more effective collaboration between the team members.

Steps to setup TabNine:

1. Open VS code > Open Extensions view > Search for Tabnine > Click on install
2. Click on the Sign in option > Sign in using your google account.

Example:

Scenario: Generating an automated test case in cypress to test a form submission where multiple fields require similar validation 

Pre-requisite: Install and create cypress project in VS code 

Code:

1. Select Tabnine from the nav bar menu > Click on Settings icon > Click Add on Define custom commands.
2. Add details in the fields for a new custom command > Click Save 
3. Go to Chat > Enter the slash name in chat input field > Run > Verify that the code is displayed.

describe('Form Validation Test', () => { 
  const formFields = [ 
    { name: 'name', selector: '#name', invalid: '123', valid: 'John Doe' }, 
    { name: 'email', selector: '#email', invalid: 'invalid-email', valid: 'john@example.com' }, 
    { name: 'phone', selector: '#phone', invalid: 'abc', valid: '1234567890' }, 
    { name: 'message', selector: '#message', invalid: 'a', valid: 'This is a test message' } 
  ]; 
  
  beforeEach(() => { 
    // Navigate to the form page 
    cy.visit('/form-page'); // Replace with your actual form page URL 
  }); 
  
  it('should validate form fields and submit successfully', () => { 
    // Verify presence of all required fields 
    formFields.forEach(field => { 
      cy.get(field.selector).should('exist'); 
    }); 
  
    // Test each field 
    formFields.forEach(field => { 
      // Test blank field 
      cy.get(field.selector).clear(); 
      cy.get('form').submit(); 
      cy.get(`${field.selector}-error`).should('contain', 'This field is required'); 
  
      // Test invalid input 
      cy.get(field.selector).type(field.invalid); 
      cy.get('form').submit(); 
      cy.get(`${field.selector}-error`).should('be.visible'); 
  
      // Test valid input 
      cy.get(field.selector).clear().type(field.valid); 
      cy.get(`${field.selector}-error`).should('not.exist'); 
    }); 
  
    // Submit form with all valid inputs 
    cy.get('form').submit(); 
  
    // Assert successful submission 
    cy.get('#success-message').should('be.visible').and('contain', 'Form submitted successfully'); 
  }); 
}); 

Comparison

Based on the below table of comparison between the three pair programming tools, any one among them can be selected as per testing preferences.

Conclusion:

When combined with testing tools, all three tools – GitHub Copilot, Codeium, and Tabnine – can be quite efficient for various aspects of software testing.

GitHub Copilot performs exceptionally well in generating whole or selective tests or specific test case scenarios like edge cases and is ideal for automated whole-spectrum test coverage across tools as well as complete test cases across tools and edge cases and is very effective for comprehensive test case automation scenarios across tools. It is well suited for writing full tests on new features.

As much as it is new language, Codeium can offer to its users, fast completions of basic test functions in software testing.