When it comes to software development, building an application that works according to functional specifications will only get you so far. Often, more complex issues relating to user acceptance and integration are the most critical success factors.

So, when the New Zealand Food Safety Authority (NZFSA) chose to develop an online billing application for its electronic certification (E-cert) tool, it quickly found that engaging the services of an independent software testing specialist was the only sure-fire way to get the application working in both technological and practical terms.

Testing times
NZFSA is the New Zealand controlling authority for imports and exports of food and food related products. In 2003, NZFSA developed E-cert, which is used to generate export certificates. A world first, E-cert has taken the process of generating, validating and presenting food industry certification information to the web.

But to make it pay, NZFSA required a custom-built application so it could bill users online. This meant taking information captured in E-cert and integrating it with NZFSA’s Navision and the Ugen financial system used at its parent ministry, the Ministry of Agriculture and Fisheries, to automatically generate and send electronic invoices to E-cert users.

E-cert users include organisations that create or receive certificates, including producers and buyers, independent reviewers who approve the content of the certificate, and border inspectors who approve the product at the importing country border.

An independently designed and administered software testing programme turned out to be the difference between bedding down an application that worked, and one that didn’t.

Dilky Cabraal, NZFSA executive manager, business services, says the key challenge facing the authority was a gap in knowledge and resources. While application development had been outsourced to a specialist application developer, NZFSA didn’t have the knowledge or the time required to test the application.

“When we developed the package we didn’t have the right knowledge or enough time to test it. That’s why we contracted Fujitsu – to provide the testing environment for both systems and user acceptance testing.”

E-cert was replacing an industry levy as the means to recover costs from users, so it was critical that the new billing application worked correctly from the outset. Complicating the development process were certain invoicing features, formats and interfaces between Navision and Ugen. While the design specifications were clear, without a sound knowledge of accounting systems and principles, software development would be challenged.

Bridging the gap between development and acceptance
Working on behalf of NZFSA, Fujitsuf rigorously tested the new billing application and, in the process, uncovered and remedied a number of issues.

System testing, where the application was tested against functional specifications, and user acceptance testing, were undertaken successively. The user acceptance testing programme saw Fujitsu’ testers interrogate the inter-relationships between all aspects of the billing system, to verify that specific user requirements had been satisfied, as well as developing training, on-line help and user guides to support the application.

“Although some overlap occurs, the perspective taken and specific techniques in systems and user acceptance testing are quite different,” says Cabraal.

“The end game is to apply different approaches but aim for a similar end result. The exercise is analogous to two proofreaders verifying a document: one is looking for grammatical errors and the other is looking for errors of fact.”

Fujitsu developed a test plan, including test cases, to provide realistic and adequate exposure of the billing system to reasonably expected events, user requirements, and a path for necessary remedial action, including the type and number of acceptable 'outstandings'.

Fujitsus’ programme of testing uncovered vital adjustments to the invoice format, application integration issues, and insufficient development testing and user support documentation.

The measure of success
The only hard measure of success for NZFSA was a billing system that worked from day one. And it has. However, it was only through six months of testing, regression testing and project management of fixes and remedial action that saw a smooth go live and ongoing operation.

“We have a system that lets us invoice our customers. Without the testing programme it wouldn’t have worked – the interfaces wouldn’t have worked nor would the system have supported E-cert. Fujitsu ensured what we wanted was done,” says Cabraal. “The implementation was smooth when it could have been long and drawn out.”

More than just getting its new billing application up and running, the testing programme has also provided NZFSA with professionally documented information and systems. This includes test cases relating to specific functions and future upgrades, a user manual, and systemised training.

“We built E-cert over a long period. It is only through experience that you are able to see the gaps,” says Cabraal. “Fujitsu ensured we were delivered the software that we needed. They were thorough and professional and delivered a quality outcome.”

FOR MORE INFORMATION//

FUJITSU NEW ZEALAND
+64 9 921 8093
www.fujitsu.co.nz