Agile Tool Evaluator Guide

Agile Tool Evaluator Guide

Selecting an Agile Management Tool
As organizations continue to adopt and scale Agile development, the challenges of coordinating and managing multiple teams, locations, and projects continues to increase. Complexity is amplified due to Agile’s embrace of realtime changes to plans and priorities. This results in the need for a way to easily plan and track this change within a single, consistent management framework and is critical to maximizing the success of all of your Agile Development activities. In order to maximize value from an agile deployment, six key criteria should be considered when selecting an enterprise management tool: 

. Iterative, Feature-driven Development

Although it may seem to be an obvious mismatch, many teams attempt to use a series of traditional tools that do not facilitate planning and tracking by release or iteration, do not enable easy changes to plans and priorities, and do not use features (e.g., requirements, user stories, product backlog, features, …) as the primary planning asset. Agile development follows a tightly integrated process that coordinates high-level feature planning, detailed task and test planning, defect and test management, and overall project tracking. Tracking project information in multiple tools can inhibit accurate, real-time visibility.

2. Integrated Lifecycle Management

3. Cross-Functional Teams

True support for cross-functional teams means consolidating and facilitating the project planning and tracking needs of customers, product management, project management, programmers, testers, etc. in a single environment for improved collaboration and consistency. No two organizations operate in the exact same manner when it comes to organizational structure, terminology, product planning, project scheduling and tracking, and reporting. Any scalable management tool should accommodate this type of flexibility and allow organizations to define, organize, and plan according to their unique organizational requirements. While complex needs may arise, the necessity to provide team members with a simple, straightforward planning, tracking, and reporting system is critical for broad-based success. Like Agile development, the more simple the tool the better. Most importantly, tools should never replace the benefits achieved from daily planning, face-to-face communication, product reviews and retrospectives. An Agile lifecycle management tool is only as good as the process it facilitates and the people that use it. An agile tool for deployment within an enterprise must be able to handle a sophisticated project structure and thousands of features and defects. In larger deployments, key concerns include both ease-of-use and support for thousands of items flowing through an agile lifecycle with minimal overhead.

4. Flexible Configuration

5. Simplicity

6. Enterprise Scale

With these criteria in mind, the Evaluator Guide outlines a detailed set of features an enterprise Agile management application should enable for scaling Agile planning, tracking, and reporting across your organization. Highlighted is both functionality needed as you begin to implement an Agile management tool and longer range functionality that you will benefit from as your Agile process matures. 

Copyright © 2007 VersionOne, LLC. All rights reserved.

Agile Tool Evaluator Guide

“Top 0” Checklist
V: Agile Enterprise 

. 2. 3. 4. 5. 6. 7. 8. 9. 0.

Local installation or hosted, “on-demand” deployment options for teams of any size Configurable methodology templates (Scrum, XP, AgileUP, DSDM, Custom) License and subscription pricing alternatives Full Agile lifecycle support (features, defects, tests, tasks, impediments,…) 00% web-based deployment for distributed teams and locations Customizable project hierarchy to match your unique organizational and/or reporting structure Simple, drag-and-drop planning and prioritization Comprehensive management reporting and executive-level dashboards Open, web services API Expert training and implementation assistance

In addition to this critical Top 0 list, the following pages of the Evaluator Guide offer detail that is important to companies comparing the benefits and features of Agile tools. If you have any questions regarding the capabilities outlined within this document or how VersionOne can assist in your Agile deployment, please contact us at info@VersionOne.com.

2

Copyright © 2007 VersionOne, LLC. All rights reserved.

Agile Tool Evaluator Guide

Capability Matrix
Deployment
Local (On-Site) Install Hosted (On-Demand) Install Automated Setup/Instal l and Upgrades Subscription Pricing Option Perpetual License Pricing Option Free Evaluation 00% Web-based UI Configurable Methodology Templates 30-day trial Simplified deployment Scrum, XP, AgileUP, DSDM, or Custom/Hybrid

V: Agile Enterprise

Additional Notes

Application Setup & Configuration
Basic Project/Release Structure Fully Customizable Project Hierarchy Dynamically Defined Programs Program Management & Reporting Multi-team Planning & Reporting Shared Iteration/Sprint Schedules Across Projects Define Unique Iteration/Sprint Schedules for Concurrent Projects/Releases Configurable System List Values Customizable Terminology Customizable Grids System-wide Grid Settings Custom Fields Hide Fields Windows Integrated Authentication Feature and Defect Templates Customize grids to display specific fields Deploy default grid settings across company Add new fields and capture custom data Remove fields from display Integrate with Windows users and passwords Pre-define feature and defect defaults, tasks, and tests Rollup iteration planning, tracking, and reporting New projects and releases can have their own Track & manage synchronized projects and releases Customize all values for status, priority, risk, etc. Dynamically defined planning and reporting structure Cross-project & multi-team management

Reporting & Analytics Executive-level Reporting
Project Dashboard Project Summary Program Dashboard
Reporting & Analytics Continued Next Page

Single-level or rollup - burndown, scope trend, velocity, test trend, release progress Project progress and Gantt Cross-project - burndown, scope trend, velocity, test

3

Copyright © 2007 VersionOne, LLC. All rights reserved.

Agile Tool Evaluator Guide
V: Agile Enterprise

Reporting & Analytics (continued)
Program Summary Iteration/ Sprint Dashboard Member Group Dashboard

Additional Notes
Program progress and Gantt Burndown, scope srend, burn-up, test trend, and Burndown by project, member load across groups of users

Project / Release Reporting
Burndown Chart - Basic Burndown Chart - Filtered Velocity Chart - Basic Velocity Chart - Filtered Velocity Trend Burn-up Chart (Scope Trend) Project/Release Roadmap Parking Lot Scope Change Estimation Accuracy Test Trend Test Run Defect Status Trend Defect Priority Trend Defect Resolution Trend Scope Change Issue/Impediment Trend Request Trend Filter by project, status, priority, risk, feature group and features or defects Velocity, average velocity, and target velocity trending Total vs. completed features during a project Progress by feature or feature group across iterations Progress of features by business area and feature group Added, removed, and changed features during a project % by iteration Test status over time External test system pass/fail summary Open defects by status Open defects by priority Defect count by resolution Added, removed, and changed features during a project Open / Closed issue count Open / Closed request count Filter by dates, feature group, and features or defects

Iteration / Sprint Reporting
Burndown Chart - Basic Burndown Chart - Filtered Burnup Chart (Scope Trend) Estimate vs. Actual Trend Cumulative Flow Defect Status Trend Defect Priority Trend Defect Resolution Trend Test Trend Scope Change
Reporting & Analytics Continued Next Page

Filter by dates, feature group, and features or defects Total vs. completed features during an iteration Estimated vs. actual effort over time Progress of features through an iteration Open defects by status Open defects by priority Defects count by resolution Test status over time Added, removed, and changed features during an iteration

4

Copyright © 2007 VersionOne, LLC. All rights reserved.

Agile Tool Evaluator Guide
V: Agile Enterprise

Reporting & Analytics (continued) Member Reporting
Team Member Dashboard Member Actuals Member Load Chart Member Load Trend Estimates by Iteration / Sprint Load by Iteration / Sprint Estimation Accuracy

Additional Notes
Personal burndown, estimates, and actuals trend Actuals by project by day, week, month Current load for an iteration and across all projects Member estimate load and average by iteration Estimated work delivered by iteration Actuals by iteration % comparison of estimates and actuals Report on tasks, tests, features, iteration, etc. by or across project(s) Product backlog, user stories, requirements…

Ad Hoc
Customizable List Reporting

Asset Management and Tracking
Feature Planning Defect Tracking Task Management Test Case Tracking Request Management Issue/Impediment Tracking Feature Rollups Single-click view of Asset Details Manage customer & marketing requests Manage development issues & impediments Assign features to functional groups for planning & rollup reporting Displays details, relationships, links, notes, history, etc on a single page User stories, product backlog, requirements, etc. Consolidated planning and prioritization in a single environment

Product / Work Item Planning
Plan, Estimate, and Prioritize Features Plan, Estimate, and Prioritize Defects Prioritize and Rank Features and Defects Together Drag-and-drop Ranking Track & Prioritize Customer Requests Track & Prioritize Development Issues & Impediments Generate Features, Issues, and Defects from Requests Generate Features and Defects from Issues Break Features Down into Smaller Features Copy Features, Defects, Requests, and Issues
Product / Work Item Planning Continued Next Page

Automated generation

5

Copyright © 2007 VersionOne, LLC. All rights reserved.

Agile Tool Evaluator Guide

V: Agile Enterprise

Product / Work Item Planning (continued)
Delete Features, Defects, Requests, and Issues Close Features, Defects, Requests, and Issues Reopen Features, Defects, Requests, and Issues Flexible Filtering Column Sorting Define Hierarchical Feature Group Rollups Assign Features to Feature Group Bulk Edit/Apply Changes Undo/Reset Unapplied Changes Multi-select Move, Close, Reopen & Delete of Items Customizable Planning Grids Multi-Level Estimation

Additional Notes
Close items upon completion and automatically remove from displays Reopen if additional work required Display information by status, owner, priority, feature group, etc. Click on column to sort by any value For planning and rollup reporting Drag-and-drop assignment Update multiple records in a table and apply all changes at once Easily move or edit multiple items at a time Configure grids to display specific fields Estimate features and defects in one unit and tasks in another

Release Planning
Simple, Drag-and-Drop Release Planning Environment Estimate & Assign Features and Defects to Projects/Releases Rank Features & Defects within Projects Multi-select Assignment of Features and Defects to Projects Display Project & Release Summary Information Assign and Track Requests by Project or Release Assign and Track Issues by Project or Release Assign Items to Teams within Projects Easily Add New Releases and Projects Define Cross-Project Feature Dependencies Customize Release Planning Pages Configure grids to display specific fields Track features, defects, issues and requests within project, release, or team Easily drag-and-drop features and defects on to releases / projects Drag-and-drop ranking Move multiple items between projects all at once View total and remaining estimates

Sprint/Iteration Planning
Simple, Drag-and-Drop Iteration Planning Environment
Sprint/Iteration Planning Continued Next Page

6

Copyright © 2007 VersionOne, LLC. All rights reserved.

Agile Tool Evaluator Guide
V: Agile Enterprise

Sprint/Iteration Planning (continued)
Assign Features and Defects to Iterations Rank Features and Defects within Iterations Display Velocity by Iteration Multi-select Assignment of Features and Defects to Iterations Feature Planner Add Tasks to Features and Defects Add Tests to Features and Defects Copy Tasks Copy Tests Assign and Track Multiple Owners on Features, Tasks, and Tests Plan by Feature or Member

Additional Notes
Easily drag-and-drop features and defects on to iterations Drag-and-drop ranking View velocity for closed, active, and future iterations Move multiple features and defects all at once Easily manage features and defects, tasks, and tests all on a single page

Assign pair / multi-owners During planning: display issues for review

Review Issues and Impediments
Customize Iteration Planning Page Flexible Filtering Flexible Iteration Dates Highlight Broken Dependencies

Configure grids to display specific fields
Configure grids to display specific fields Display information by status, feature group, owner, etc Edit iterations to overlap or skips dates

Project Tracking Iteration / Sprint Tracking
Track Effort on Tasks Track Effort on Tests Track Remaining Work on Tasks and Tests Configure Tracking to only Track Remaining Effort Track Effort on Features and Defects Close Tasks, Tests, Features and Defects Reopen Tasks, Tests, Features and Defects Multi-select Close and Reopen of Items Split a Feature Track Pair / Multi-owner Actuals Queue Unassigned Items Copy Tasks and Tests View Tracking History Multi-select Delete of Tasks and Tests
Project Tracking Continued Next Page

Set up to not track actual effort Set up system to track at multiple levels

Unassigned work queue for signing up for tasks and tests

7

Copyright © 2007 VersionOne, LLC. All rights reserved.

Agile Tool Evaluator Guide

V: Agile Enterprise

Project Tracking (continued) My Home
Personal My Home Tracking Environment My Home Summary Customizable My Home Summary Page My Home Pages for All Owned Assets View Any Member’s Assignments View Unassigned Items My Home Filtering by Project My Home Dashboard Flexible My Home Filtering Search/Find Add Tasks and Tests Close, Reopen, and Delete Items View Tracking History

Additional Notes
Consolidated list of items for tracking across projects Summary of assigned items, status, and progress Configure grids to display specific fields Tabs for tasks, tests, features, projects, feature groups, etc. Member filter for quickly changing view Click to select all projects or one project Personal burndown and actuals trend Filter assignments by status, priority, etc. Search on name, description, etc.

Integration
Open Web Services API Import (XML, Excel) Export (Excel, MPX) Acceptance Test Framework Visual Studio Add-in Export (MPX) Wiki Integration Query, update, insert,… Import features, defects, issues, requests, tests, and tasks Customize and export grids Import external test results via API View and update tasks directly within the Microsoft Visual Studio IDE Export project information in MPX format Incorporate links to wiki pages Based on licensing

Security
Add Unlimited Users Activate/De-activate Users Password Authentication Drag-and-Drop Project Assignment of Members Assign Users to Multiple Projects Assign Users to Specific Projects, Release, Teams Manage Roles by Project across all Members Manager Roles for a Member across all Projects
Security Continued Next Page

Security automatically flows down thru project structure Assign users to specific levels in the project tree

8

Copyright © 2007 VersionOne, LLC. All rights reserved.

Agile Tool Evaluator Guide
V: Agile Enterprise

Security (continued)
Filter Users by Group Search/Find Users

Additional Notes

Miscellaneous Features
Notifications Add Features, Defects, Request, and Issues from Anywhere Audit History Attachments (DOC, XLS, PDF, etc.) Search/Find Rich Text Editing Notes Unit Independent Estimation Links User-Defined Filters Descriptions, resolution details, test steps Add comments to any item Example: ideal days or points at feature level and hours at task level Link assets to web pages or shared documents Automated RSS-based notifications Shortcut link to add from anywhere in the product Detailed change logging

Service & Support
Online Product Webinars On-Site Product Training Agile Training & Consulting Product/Technical Support Online Help Online Product Tours, Tutorials, etc. Searchable Knowledge Base

VersionOne, LLC
5490 McGinnis Village Place » Suite 27 » Alpharetta » GA 30005 Phone : 770.752.4 » Fax: 770.752.40 » www.versionone.com
9
Copyright © 2007 VersionOne, LLC. All rights reserved.

Sign up to vote on this title
UsefulNot useful