QA: Basic Test Plan Outline: For Testing New Software in Retail Locations

Basic Test Plan Outline for Beta Testing at Pilot Locations

1. Introduction

1.1 Revision History

Date

Changes

Editor

12/4/2007

Original

Lance.Roberts

12/11/2007

Added DN items

Lance.Roberts

 

1.2 Purpose and Scope

The purpose of this document is to outline the Beta Test Effort for BP Release 1.20. Locations, configurations, and timelines are to be addressed.

1.3 List of Reference Documents

Document Title

BP Release 1.20 Functional Specification Rev A.

1-920512 BP Nucleus Operations Rev 1A.pdf

2-920512 BP Nucleus Programming Rev 1A.pdf

003-920512 BP Nuke Onsite Training Rev 1(A).pdf

4-920512 BP Cashier QRef Rev 2A.pdf

007-920512 BP Nuke Startup Worksht Rev 1(A).pdf

8-920512 BP Countertop Reference Rev A.pdf

10-920512 BP Reference Sheets Rev A.pdf

920512 BP Documentation Review form.doc

920910 BP XP Nucleus Installation Rev 1A.pdf

920910 BP XP Nucleus Installation Rev A.pdf

FortiGate-60_QuickStart_Guide_01-30004-0032-20070301.pdf

FortiGate-60_series_Install_Guide_01-30004-0266-20070215.pdf

Fortigate Rule Set as of 072307.pdf

 

    2. Beta Test Scope, Strategy, and Timeline

    2.1 Beta Test Customers, Environment, and Scope

    Define the scope and strategy for testing the system at one or more customers. 

    Location

    Features

    Agreement Signed?

    P1 Bradenton

    SVB: xxxxxxx

    Creekwood Crossing BP
    Bradenton, FL 34203

    • BOS ( large internal network )
    • Fortigate60
    • X206 Server
    • SP563 IPTs
    • Wayne Ovation with qCAT

    Y

    P5 Vancleave

    SVB: ######

    Hood's Feed & Seed
    Van Cleave, MS 39565

    • Tokheim 262A
    • Tokheim Premier C with 4x21 DPTs
    • X206 Server
    • SP563 IPT

    Y

    P7 Cesar Chavez

    SVB: #######

    Austin, TX

    • Gilbarco MPD with Single Line CRIND
    • Fortigate60
    • SP742 Server
    • SP565 IPT
    • Close to Wayne Austin Campus

    Y

    P10 Bowie

    SVB: #######

    HighBridge BP
    Bowie, MD 20720

    • Wayne Ovation w qVGA
    • Unitec Car Wash Terminal
    • X206 Server
    • 2 SP563 IPTs

    Y

    P12 Home Oil

    Mark

    • Mannatec

    Y

    P13 Wassau, WI

    Petro

     

    • Mannatec

    Y

     

    2.2 Testing Criteria

    2.2.1 Beta Ship Criteria

     

    2.2.2 Beta Install and Criteria to Begin Testing

     

    2.3 Testing Scope

    2.3.1 Features Tested

    List or put in table form the functionality to be tested at the beta customer

    Feature

    Location

    Wayne Ovation qCAT

    P1 - Bradenton

    Wayne Ovation qVGA

    P10 - Bowie

    Gilbarco

    P7 - Cesar Chavez

    Gilbarco GSM

    P7 - Cesar Chavez

    Tokheim

    P5 - Hood’s

    Tokheim TED

    P5 – Hood’s

    CWT ( Unitec )

    P10 – Bowie

    BOS

    P1 – Bradenton

    Mannatec ( ONLY NEW FEATURE )

    P12 – Wassau, WI

    P13 – Home Oil, AL

     

    2.3.2 Features Not Tested

    Specifically state what will NOT be tested, if anything.

    Feature

    Location

    Currently, we have no ‘Discount by Card Type’ location and Verifone has bugs in the V900 preventing use of this feature with Debit. P1-Bradenton will be exercising the feature informally.

    N/A

    Mannatec Outdoor Sales with Gilbarco

    N/A

    Mannatec Outdoor Sales with Tokheim

    N/A

     

    2.3.3 Other Items Evaluated

    List any other aspects of the system or product that will be evaluated by the customer, i.e. operator interface, user manual usefulness, etc.

    Item

    DOCUMENTATION REVIEW

    BP Release 1.2 Functional Specifications

     

    1-920512 BP Nucleus Operations Rev 1A.pdf

     

    2-920512 BP Nucleus Programming Rev 1A.pdf

     

    003-920512 BP Nuke Onsite Training Rev 1(A).pdf

     

    4-920512 BP Cashier QRef Rev 2A.pdf

     

    007-920512 BP Nuke Startup Worksht Rev 1(A).pdf

     

    8-920512 BP Countertop Reference Rev A.pdf

     

    10-920512 BP Reference Sheets Rev A.pdf

     

    920512 BP Documentation Review form.doc

     

    920910 BP XP Nucleus Installation Rev 1A.pdf

     

    920910 BP XP Nucleus Installation Rev A.pdf

     

    Fortigate RetroFit SOW v1.08.doc

     

    Nucleus Copy CD For Later Instructions

     

     

     

    INTEGRATION TESTING / GOLDCOPY SUPPORT CD ( GENERIC )

    Testing is ONLY around the GoldCopy Support CD Framework. Can we install the goldcopy on the system in question and get the application loaded and logged on? This is to prevent ASO installation problems on any platform. Testing port config, etc for each image will not be performed. NPS will, however, follow up with PV to ensure the image testing was done and was verified as working as designed.

    X3105

    GoldCopy testing not performed due to lack of hardware availability

    X206-8482

    X205-8480

    X200-8479

    X200-8478

    SP741

    SP565

    SP563

    SP562

    SP561

    INTEGRATION / APPLICATION SUPPORT CD

    Testing is geared towards testing the various options an installer will have available to ensure each one functions as designed. Dependencies, such as documentation, should be created and/or reviewed.

    Nucleus Software Installation ( Install )

    Passed

    Nucleus Software Installation ( Upgrade )

    Passed

    Nucleus Software Installation ( COPY CD FOR LATER )

    Passed

    Nucleus Software Installation ( COPY CD FOR LATER ) Instructions

    Passed

    Antivirus Installation

    Passed

    Gold Copy Updates Installation

    Not Tested

     

     

    PERIPHERALS

    Ensure that various peripherals are handled appropriately by the Nucleus Application. This is not to be confused with a ‘Gold Copy’ test. Just verify that the software supports the listed devices.

    Scanner

    Passed

    Tank Gauge

    Passed

    BOS

    Passed

    Money Order?

    Not Supported

    Lottery

    Not supported

    Mannatec

    Passed

    CDU ( Customer Display Unit )

    Passed

    Network ( TCP/IP )

    Passed

    Remote Service Management

    Passed

    MANUAL TESTING

    Stress Testing

    Not performed

    Exception/Error Condition Testing

    Not performed

    DN Fixes

    N/A

    Mannatec Card at POS

    Passed

    Mannatec Card at Dispenser ( Wayne )

    Passed

    Mannatec Card at Dispenser ( Tokheim )

    No location available

    Mannatec Card at Dispenser ( Gilbarco )

    No location available

     

     

     

     

    TRAINING / HANDOFF

    These items need to be performed to ensure that the transition to production is planned and supported. This includes getting Helpdesk & Training acclimated to the product or product changes and creating formal or informal documentation this purpose.

    Helpdesk/Training Course

    Pending

    Helpdesk/Training Guide ( Best Practices )

    Pending

    Architecture Documentation

    Pending

    Contact Lists

    Pending

    Support Structure

    Pending

    Service Structure

    Pending

    Tech Tips / Knowledge Base

    Pending

     

    2.3.4 Safety-related Testing ( if applicable )

    Feature

    Location

    N/A

    N/A

     

     

      3. Test Descriptions

      For each major set of tests to be run (such as major functional groups, and performance, stress) describe the types of tests to be run. 

       

      3.1 Functional Tests

      Verification that the system meets it's functional/feature requirements

      Feature

      Location

      Mannatec Sales – Indoors

      P12 – Home Oil, AL

      P13 – Wassau, WI

      Mannatec Sales – Outdoors Wayne

      P12 – Home Oil, AL

      P13 – Wassau, WI

       

       

      3.2 Configuration Tests

      Testing to assure that all functions work under all combinations (hardware configurations, device assignment combinations, etc.)

      Feature

      Location

      Wayne Ovation with qCAT

      P1 – Bradenton

      Wayne Ovation with qVGA

      P10 - Bowie

      Wayne w Mannatec

      P12 – Home Oil, AL

      P13 – Wassau, WI

      Gilbarco w Mannatec

      NOT PLANNED

      Tokheim w Mannatec

      NOT PLANNED

      Outdoor CWT

      P10 - Bowie

      Gilbarco w/out Mannatec

      P7 – Austin

      Tokheim w/out Mannatec

      P5 - Hoods

       

      3.3 Load and Peformance Tests

      Testing to confirm that performance objectives are satisfied. Includes accuracy testing.

       

       

      3.4 Stress Tests

      Testing which attempts to break the system by stressing all of its resources.

      Feature

      Location

      Wayne qCAT Stress Tests

      P1 - Bradenton

      Wayne qVGA Stress Tests

      P10 - Bowie

      Gilbarco Error Conditions

      P1 – Bradenton

      Tokheim Error Conditions

      P5 – Hoods

      POS Mannatec Error Conditions

      P12 – Home Oil, AL

      P13 – Wassau, WI

       

      3.5 Recovery and Error Handling Tests

      Testing to confirm that the system recovers from hardware and/or software malfunctions without losing data or control, or that it follows the error handling requirements defined for the product.

      Feature

      Location

      Wayne qCAT Error Conditions

      P1 - Bradenton

      Wayne qVGA Error Conditions

      P10 - Bowie

      Gilbarco Error Conditions

      P1 – Bradenton

      Tokheim Error Conditions

      P5 – Hoods

      POS Mannatec Error Conditions

      P12 – Home Oil, AL

      P13 – Wassau, WI

       

      3.6 Specific Safety-Related Tests

        4. Tools and Test Equipment Required

         

         

        5. Roles and Responsibilities

        Identify all personnel to be involved directly in the testing, or in critical supporting roles. Define the responsibilities assigned to each.  

        Who

        Co.

        Role

        Responsibility

        Contact #

        Back-up contact

        Machelle

         

        Wayne

        Project Manager

        Manager Overall project

         

        N/A

         

        Lance

        Wayne

        NPS Tech

        Liason between Wayne and Beta Site.

        Provide direct support for site issues

         

        BJ Moore

        BJ

        Wayne

        NPS Tech

        Backup Tech

         

        N/A

        Stephen

         

        Wayne

        Project Lead  Engineer

        Engineering Resource, DN investigation & fixes

         

        Guizhong

        Guizhong

         

        Wayne

        Project Engineer

        Engineering Resource, DN investigation & fixes

         

        Guizhong

        Tim

         

        Wayne

        Product Validation Manager

        Directs testing efforts

         

        N/A

        Thomas

         

        Wayne

        PV Tech

        Day Shift

        Directs and Performs test effort for additionally releases during beta

         

        N/A

        Nelson

        Wayne

        PV Tech

        Night Shift

        Directs and Performs test effort for additionally releases during beta

         

        N/A

         

        6. Problems/Issues Encountered During Beta

        6.1 DNs

        Id

        Title

        O/C

        Resolution

        Severity

        25728

        Wayne: Nucleus didn't show pump status for pump waiting For Auth

        C

        Cannot Duplicate

        Moderate

        25733

        Reference number not displayed at ECR on indoor CFN transaction

        C

        Invalid DN

        Mild

        25736

        Signature Line Missing on Mannatec Merchant Receipt

        C

        Fixed & Verified

        Requirement

        25737

        System stuck on card processing screen after sale timed out

        C

        Duplicate DN

        Serious

        25738

        Pinpad Cancel Operation not working correctly

        C

        Fixed & Verified

        Moderate

        25741

        Mannatec transaction sent up to mannatec host when cancelled outdoors

        C

        Cannot Duplicate

        Serious

         

        6.2 Help Desk Issues

        ID

        Description

        Work Around

        26089

        IPT #2 stuck on processing cards (Card View Window stuck). 

        IPT Reset (no need to reboot server or entire site).

        25624

        IPT #2 getting 'Network Busy' SERVER/IPT#3/CATs processing OK.  Work around

        Pause off IPT

        Rebooting IPT

        Reset V900

        Rebooting Nucleus.

        25378

        Nucleus stuck on 'Processing Please Wait' after V900 reset

        Reboot the v900. 

        Rebooting Nucleus doesn’t do anything – the problem is inside the EPS box.

        X

        Debit Y/N Prompt NOT timing out. IPT shows yellow ‘R’ indefinitely. Pressing CANCEL at CAT will clear the ‘R’ and the pump will dispense

        Network needs to send the Debit Y/N prompt that sends back [Credit/Debit], instead of [Y,N]

        X

        Prepay/Gift Card Activation/Reload ringing up incorrect Department

        This is assignable in Application|Station. There are 2 depts: One for Activation, One for Recharge. Be sure to set the appropriate Department HPC to:

        532-Purchase

        533-Activation

         

        Discount Combos ( Not Discount Offerings ) with Car Wash Products not prompting at Pump, but awarding on the receipt.

        Delete all products from the Car Wash Department

        May need to delete combo and re-program

         

         

         

         

          7. Exit Procedures

           

           

          Tags