Evaluating Lab Models

Many organizations build an ad hoc lab each time they need test facilities for a new project. Other organizations build a permanent lab that is scalable for various projects and use it for change management. Both ad hoc labs and change management labs have their advantages and disadvantages.

Ad Hoc Labs

Ad hoc labs are set up for a specific project. When the project is over, the equipment is redeployed for a different use. For example, the equipment might be used in the production environment, become part of inventory, or be returned to the vendor.

The short-term costs of an ad hoc lab might be less than a permanent lab because all the equipment is redeployed for other uses. This view of cost is shortsighted, however, because a new lab must be built for every project that requires one. Ad hoc labs can lead to problems such as the following:

• When a new lab is required for each new project, time becomes a critical factor. Because teams need the lab early in a project, issues such as the following arise:
  • Can you obtain the appropriate hardware and software licenses in time?
  • Will hardware or software substitutions lead to inadequate testing?
  • Can you locate the vendors, models, and versions needed to adequately test the production mix of hardware and software?
  • Can you reserve the physical space needed for building the network configuration and performing the tests?
  • Will the time spent building and debugging the lab reduce the testing time, possibly resulting in incomplete testing?
• When many teams are searching for hardware and software licenses, it becomes difficult to track who is using what and who authorizes purchases. The resulting lack of accountability can lead to excess expenditures and increased costs.

Change Management Labs

The problems mentioned in the preceding section present compelling reasons for building a permanent, formalized lab. After Windows 2000 is implemented, you can use a permanent lab to test changes to your environment, such as:

• Network upgrades
• Service packs and software patches
• Business application compatibility
• Desktop configurations
• New hardware platforms
• Administrative and support processes
• Client computer management tools

A fully equipped, permanent lab that is used for change management has the following advantages:

Saves costs in the long run.

When viewed across projects, the cost of a permanent lab is likely to be more reasonable than ad hoc labs for which purchases are not tracked or financial accountability is diluted.

Reduces risk to your business.

Labs reduce risk to your production environment because solid testing leads to cleaner implementations. For example, it is tempting to forgo comprehensive testing of an apparently insignificant change if a test lab is not readily available. But even a minor change can bring a business process to a halt. Having a permanent lab for change management makes it easier to test even the simplest change. The more the lab reflects the production environment, the more valid the tests can be.

Saves time for the project.

Setup and debugging time are minimized because upgrades to an existing lab are faster than assembling a new lab each time. The time saving is critical if you plan to use lab equipment for ongoing developmental prototyping. If you use the lab for development as well as for testing, you have less time available to assemble it.

Helps equip the lab appropriately.

You might find it easier to justify the purchase of equipment you need for specific testing requirements if you plan to have a change management lab. With ad hoc labs, the equipment is likely to be reallocated from another use or purchased to meet the specifications of its future use and, therefore, might not meet your testing requirements.

You are also more likely to maintain the proper mix of equipment to accurately reflect your production environment. As time passes, you can retain the original equipment and acquire new equipment to reflect the constantly changing, diverse production environment. Maintaining the proper mix of equipment in the lab provides for thorough regression testing during the change management process.

Helps establish consistent methodologies.

When you have a permanent lab, you can assign dedicated personnel to support it. With a permanent lab and continuity in lab management, you can establish consistent testing processes and techniques which produce consistent results that can be compared over time.

© 1985-2000 Microsoft Corporation. All rights reserved.