Basic Test Plan Outline for Beta Testing at Pilot Locations

1. Introduction

1.1 Revision History

Date	Changes	Editor
12/4/2007	Original	Lance.Roberts
12/11/2007	Added DN items	Lance.Roberts

 

1.2 Purpose and Scope

The purpose of this document is to outline the Beta Test Effort for BP Release 1.20. Locations, configurations, and timelines are to be addressed.

1.3 List of Reference Documents

Document Title

BP Release 1.20 Functional Specification Rev A.

1-920512 BP Nucleus Operations Rev 1A.pdf

2-920512 BP Nucleus Programming Rev 1A.pdf

003-920512 BP Nuke Onsite Training Rev 1(A).pdf

4-920512 BP Cashier QRef Rev 2A.pdf

007-920512 BP Nuke Startup Worksht Rev 1(A).pdf

8-920512 BP Countertop Reference Rev A.pdf

10-920512 BP Reference Sheets Rev A.pdf

920512 BP Documentation Review form.doc

920910 BP XP Nucleus Installation Rev 1A.pdf

920910 BP XP Nucleus Installation Rev A.pdf

FortiGate-60_QuickStart_Guide_01-30004-0032-20070301.pdf

FortiGate-60_series_Install_Guide_01-30004-0266-20070215.pdf

Fortigate Rule Set as of 072307.pdf

 

2. Beta Test Scope, Strategy, and Timeline

2.1 Beta Test Customers, Environment, and Scope

Define the scope and strategy for testing the system at one or more customers. 

Location	Features	Agreement Signed?
P1 Bradenton SVB: xxxxxxx Creekwood Crossing BP Bradenton, FL 34203	BOS ( large internal network ) Fortigate60 X206 Server SP563 IPTs Wayne Ovation with qCAT	Y
P5 Vancleave SVB: ###### Hood's Feed & Seed Van Cleave, MS 39565	Tokheim 262A Tokheim Premier C with 4x21 DPTs X206 Server SP563 IPT	Y
P7 Cesar Chavez SVB: ####### Austin, TX	Gilbarco MPD with Single Line CRIND Fortigate60 SP742 Server SP565 IPT Close to Wayne Austin Campus	Y
P10 Bowie SVB: ####### HighBridge BP Bowie, MD 20720	Wayne Ovation w qVGA Unitec Car Wash Terminal X206 Server 2 SP563 IPTs	Y
P12 Home Oil Mark	Mannatec	Y
P13 Wassau, WI Petro	Mannatec	Y

 

2.2 Testing Criteria

2.2.1 Beta Ship Criteria

 

2.2.2 Beta Install and Criteria to Begin Testing

 

2.3 Testing Scope

2.3.1 Features Tested

List or put in table form the functionality to be tested at the beta customer

Feature	Location
Wayne Ovation qCAT	P1 - Bradenton
Wayne Ovation qVGA	P10 - Bowie
Gilbarco	P7 - Cesar Chavez
Gilbarco GSM	P7 - Cesar Chavez
Tokheim	P5 - Hood’s
Tokheim TED	P5 – Hood’s
CWT ( Unitec )	P10 – Bowie
BOS	P1 – Bradenton
Mannatec ( ONLY NEW FEATURE )	P12 – Wassau, WI P13 – Home Oil, AL

 

2.3.2 Features Not Tested

Specifically state what will NOT be tested, if anything.

Feature	Location
Currently, we have no ‘Discount by Card Type’ location and Verifone has bugs in the V900 preventing use of this feature with Debit. P1-Bradenton will be exercising the feature informally.	N/A
Mannatec Outdoor Sales with Gilbarco	N/A
Mannatec Outdoor Sales with Tokheim	N/A

 

2.3.3 Other Items Evaluated

List any other aspects of the system or product that will be evaluated by the customer, i.e. operator interface, user manual usefulness, etc.

Item
DOCUMENTATION REVIEW
BP Release 1.2 Functional Specifications
1-920512 BP Nucleus Operations Rev 1A.pdf
2-920512 BP Nucleus Programming Rev 1A.pdf
003-920512 BP Nuke Onsite Training Rev 1(A).pdf
4-920512 BP Cashier QRef Rev 2A.pdf
007-920512 BP Nuke Startup Worksht Rev 1(A).pdf
8-920512 BP Countertop Reference Rev A.pdf
10-920512 BP Reference Sheets Rev A.pdf
920512 BP Documentation Review form.doc
920910 BP XP Nucleus Installation Rev 1A.pdf
920910 BP XP Nucleus Installation Rev A.pdf
Fortigate RetroFit SOW v1.08.doc
Nucleus Copy CD For Later Instructions
INTEGRATION TESTING / GOLDCOPY SUPPORT CD ( GENERIC ) Testing is ONLY around the GoldCopy Support CD Framework. Can we install the goldcopy on the system in question and get the application loaded and logged on? This is to prevent ASO installation problems on any platform. Testing port config, etc for each image will not be performed. NPS will, however, follow up with PV to ensure the image testing was done and was verified as working as designed.
X3105	GoldCopy testing not performed due to lack of hardware availability
X206-8482
X205-8480
X200-8479
X200-8478
SP741
SP565
SP563
SP562
SP561
INTEGRATION / APPLICATION SUPPORT CD Testing is geared towards testing the various options an installer will have available to ensure each one functions as designed. Dependencies, such as documentation, should be created and/or reviewed.
Nucleus Software Installation ( Install )	Passed
Nucleus Software Installation ( Upgrade )	Passed
Nucleus Software Installation ( COPY CD FOR LATER )	Passed
Nucleus Software Installation ( COPY CD FOR LATER ) Instructions	Passed
Antivirus Installation	Passed
Gold Copy Updates Installation	Not Tested
PERIPHERALS Ensure that various peripherals are handled appropriately by the Nucleus Application. This is not to be confused with a ‘Gold Copy’ test. Just verify that the software supports the listed devices.
Scanner	Passed
Tank Gauge	Passed
BOS	Passed
Money Order?	Not Supported
Lottery	Not supported
Mannatec	Passed
CDU ( Customer Display Unit )	Passed
Network ( TCP/IP )	Passed
Remote Service Management	Passed
MANUAL TESTING
Stress Testing	Not performed
Exception/Error Condition Testing	Not performed
DN Fixes	N/A
Mannatec Card at POS	Passed
Mannatec Card at Dispenser ( Wayne )	Passed
Mannatec Card at Dispenser ( Tokheim )	No location available
Mannatec Card at Dispenser ( Gilbarco )	No location available
TRAINING / HANDOFF These items need to be performed to ensure that the transition to production is planned and supported. This includes getting Helpdesk & Training acclimated to the product or product changes and creating formal or informal documentation this purpose.
Helpdesk/Training Course	Pending
Helpdesk/Training Guide ( Best Practices )	Pending
Architecture Documentation	Pending
Contact Lists	Pending
Support Structure	Pending
Service Structure	Pending
Tech Tips / Knowledge Base	Pending

 

2.3.4 Safety-related Testing ( if applicable )

Feature	Location
N/A	N/A

 

 

3. Test Descriptions

For each major set of tests to be run (such as major functional groups, and performance, stress) describe the types of tests to be run. 

 

3.1 Functional Tests

Verification that the system meets it's functional/feature requirements

Feature	Location
Mannatec Sales – Indoors	P12 – Home Oil, AL P13 – Wassau, WI
Mannatec Sales – Outdoors Wayne	P12 – Home Oil, AL P13 – Wassau, WI

 

3.2 Configuration Tests

Testing to assure that all functions work under all combinations (hardware configurations, device assignment combinations, etc.)

Feature	Location
Wayne Ovation with qCAT	P1 – Bradenton
Wayne Ovation with qVGA	P10 - Bowie
Wayne w Mannatec	P12 – Home Oil, AL P13 – Wassau, WI
Gilbarco w Mannatec	NOT PLANNED
Tokheim w Mannatec	NOT PLANNED
Outdoor CWT	P10 - Bowie
Gilbarco w/out Mannatec	P7 – Austin
Tokheim w/out Mannatec	P5 - Hoods

 

3.3 Load and Peformance Tests

Testing to confirm that performance objectives are satisfied. Includes accuracy testing.

 

 

3.4 Stress Tests

Testing which attempts to break the system by stressing all of its resources.

Feature	Location
Wayne qCAT Stress Tests	P1 - Bradenton
Wayne qVGA Stress Tests	P10 - Bowie
Gilbarco Error Conditions	P1 – Bradenton
Tokheim Error Conditions	P5 – Hoods
POS Mannatec Error Conditions	P12 – Home Oil, AL P13 – Wassau, WI

 

3.5 Recovery and Error Handling Tests

Testing to confirm that the system recovers from hardware and/or software malfunctions without losing data or control, or that it follows the error handling requirements defined for the product.

Feature	Location
Wayne qCAT Error Conditions	P1 - Bradenton
Wayne qVGA Error Conditions	P10 - Bowie
Gilbarco Error Conditions	P1 – Bradenton
Tokheim Error Conditions	P5 – Hoods
POS Mannatec Error Conditions	P12 – Home Oil, AL P13 – Wassau, WI

 

3.6 Specific Safety-Related Tests

4. Tools and Test Equipment Required

 

 

5. Roles and Responsibilities

Identify all personnel to be involved directly in the testing, or in critical supporting roles. Define the responsibilities assigned to each.  

Who	Co.	Role	Responsibility	Contact #	Back-up contact
Machelle	Wayne	Project Manager	Manager Overall project		N/A
Lance	Wayne	NPS Tech	Liason between Wayne and Beta Site. Provide direct support for site issues		BJ Moore
BJ	Wayne	NPS Tech	Backup Tech		N/A
Stephen	Wayne	Project Lead  Engineer	Engineering Resource, DN investigation & fixes		Guizhong
Guizhong	Wayne	Project Engineer	Engineering Resource, DN investigation & fixes		Guizhong
Tim	Wayne	Product Validation Manager	Directs testing efforts		N/A
Thomas	Wayne	PV Tech Day Shift	Directs and Performs test effort for additionally releases during beta		N/A
Nelson	Wayne	PV Tech Night Shift	Directs and Performs test effort for additionally releases during beta		N/A

 

6. Problems/Issues Encountered During Beta

6.1 DNs

Id	Title	O/C	Resolution	Severity
25728	Wayne: Nucleus didn't show pump status for pump waiting For Auth	C	Cannot Duplicate	Moderate
25733	Reference number not displayed at ECR on indoor CFN transaction	C	Invalid DN	Mild
25736	Signature Line Missing on Mannatec Merchant Receipt	C	Fixed & Verified	Requirement
25737	System stuck on card processing screen after sale timed out	C	Duplicate DN	Serious
25738	Pinpad Cancel Operation not working correctly	C	Fixed & Verified	Moderate
25741	Mannatec transaction sent up to mannatec host when cancelled outdoors	C	Cannot Duplicate	Serious

 

6.2 Help Desk Issues

ID	Description	Work Around
26089	IPT #2 stuck on processing cards (Card View Window stuck).	IPT Reset (no need to reboot server or entire site).
25624	IPT #2 getting 'Network Busy' SERVER/IPT#3/CATs processing OK.  Work around	Pause off IPT Rebooting IPT Reset V900 Rebooting Nucleus.
25378	Nucleus stuck on 'Processing Please Wait' after V900 reset	Reboot the v900.  Rebooting Nucleus doesn’t do anything – the problem is inside the EPS box.
X	Debit Y/N Prompt NOT timing out. IPT shows yellow ‘R’ indefinitely. Pressing CANCEL at CAT will clear the ‘R’ and the pump will dispense	Network needs to send the Debit Y/N prompt that sends back [Credit/Debit], instead of [Y,N]
X	Prepay/Gift Card Activation/Reload ringing up incorrect Department	This is assignable in Application|Station. There are 2 depts: One for Activation, One for Recharge. Be sure to set the appropriate Department HPC to: 532-Purchase 533-Activation
	Discount Combos ( Not Discount Offerings ) with Car Wash Products not prompting at Pump, but awarding on the receipt.	Delete all products from the Car Wash Department May need to delete combo and re-program

 

7. Exit Procedures