INCOSE Measurement Tools Survey INCOSE | TDWG Home | Tools Database: RM SA Measurement General

INCOSE Measurement Tools Survey Response: TychoMetrics 3.6 (client/server) and TychoMetrics.NET 1.1 (web enabled)

Measurement Working Group Primer references (ref.) are shown where applicable.

1 Measurement Objectives (ref. Primer Section 4)

1.1 Can the tool monitor and control on-going product and services? (ref. Primer section 4.1.1)

Yes. TychoMetrics provides many software metrics that can be used to monitor and control software development or maintenance. In addition new metrics can be easily created and customized for additional monitoring and control.

1.2 Can the tool quantify process improvements? (ref. Primer section 4.1.2)

Yes. We provide metrics that satisfy both the SEI's Capability Maturity Model (CMM) and CMMI Key Process Areas for level 2 and most of level 3. Higher levels require customization by the metric analyst. We also support Balanced Scorecard.

1.3 Does the tool support estimation and prediction for project planning? (ref. Primer section 4.1.3).

Yes. Our toolsuite provides for creation of any metric to support estimation. Results of the estimation can be used as a vehicle for project prediction.

1.4 Does the tool support distribution of measurement information for organizational status and feedback? (ref. Primer section 4.1.4)

Yes. We provide for the import and export of defined metric expressions. We also distribute calculated metrics values, real-time, across the company's organizational structure via the intranet and internet.

1.5 Does the tool allow measurement to be tailored for specific organizational units (OU)? [I.e. projects, departments, programs, etc…]

Yes. We use a hierarchical format for data storage which allows us to calculate metric values at a specific organization unit, and also allows us to roll-up data and calculate the metric values at a higher organizational unit.

1.6 Does the tool provide a mechanism for establishing "core" measures?

Yes. We allow for creation and distribution of "core" metrics across an organization.

2 Measurement Process

2.1 Selection and Specification of Measures / Indicators (ref. Primer Section 3.1.1)

2.1.1 Does the tool support the definition of measures and indicators for each OU being measured? Does the tool provide a mechanism to specify attributes of measures?

Yes. We define measurement attributes in a measurement schema file. This file is used to define the format of data collected and the metric expressions for each organizational unit. The measurement values for an organizational unit are calculated using data specific to the organizational unit. Using the measurement schema file in this manner ensures that measurement values are consistent across an organization.

2.1.2 Does the tool support the identification of project issues and measurement goals?

Yes. Measurement goals are explicitly supported for each metric. Users are notified via email when goals are met or project issues are raised.

2.1.3 Does the tool allow specification of measurement characteristics, including data source, data validity rules, collection method, temporal constraints and interpretive guidelines?

Yes. This is a key strength of TychoMetrics and is encapsulated in our patented Measurement Modeling Technology (MMT) (U.S. Patent No. 5,930,798). Measurements are harvested in accordance with the appropriate measurement schema which specifies the measurement's scale, units, data type, and bounds. Metric expressions are also based on the measurement schema, and when they are created the expression is validated against scale, units, data type, and scope of visibility per the degree of insight specified.

2.2 Data Collection Method (ref. Primer Section 3.1.2)

2.2.1 Does the tool perform validation of collected measurement data?

Yes. Data is validated as it is collected and stored in the TychoMetrics repository.

2.2.2 Does the tool provide a means for manual data entry?

Yes. Users can manually modify input source data and collect that data into the TychoMetrics repository.

2.2.3 Does the tool provide a means for automated data collection?

Yes. This is a strong feature of TychoMetrics. We allow for user identification of the data to be collected and for the schedule on which it is to be collected. Once identified, TychoMetrics follows this schedule to automatically collect the data.

2.2.4 Does the tool provide a mechanism for the user to tailor the tool for automated collection from user-defined data sources?

Yes. The schedule for automatic collection of user-defined data can be easily modified by the user.

2.3 Calculation Method: Getting from Measures to Indicators (ref. Primer Section 3.1.3)

2.3.1 Does the tool allow measurement data to be combined into complex measures or indicators?

Yes. We provide a graphical user interface, which allows the user to easily create complex measurements using combinations of measurement data.

2.3.2 Does the tool allow specification of weights or normalization factors to be used in combining measures into indicators?

Yes. Our tool provides flexibility in the user definition of metric expressions allowing formation of indicators from measurement combinations.

2.4 Analysis of the Measures or Indicators (ref. Primer Section 3.1.4)

2.4.1 Does the tool support the review and analysis of measurement data?

Yes. A graphical representation of measured data is provided for user review and analysis. This graphical representation is available within the tool and via a web browser.

2.4.2 Does the tool support statistical process control calculations including control charts and upper, lower and center line calculation?

Yes. All are available.

2.4.3 Does the tool provide a means for comparing actual measured data to planned, target or historical values?

Yes. Measured data, planned data, targeted data, and/or historical data may be plotted on the same chart for visual comparison.

2.5 Reporting and Using the Results (ref. Primer Section 3.1.5)

2.5.1 Does the tool present measurement data consistent with the needs of differing organizational or management levels?

Yes. We allow measurements to be defined and calculated at different organizational and management levels.

2.5.2 Present measurement data appropriate for the role of the user accessing the tool, where roles are analyst, OU manager or customer?

Yes. User access to the tool is based upon permissions assigned to the user.

2.5.3 Does the tool allow the user to customize the generation of reports, including adding, modifying and deleting reports?

Yes. Our graphical user interface provides these features.

2.5.4 Does the tool provide an mechanism for distributing measurement reports?

Yes. Reports are automatically distributed for viewing using a web browser. Measurement values can also be distributed in comma separated variable format.

2.5.5 Does the tool support the distribution of measurement reports via the Internet or Intranet?

Yes. See 2.5.4 above.

3 Measurement Program Infrastructure

3.1 Does the tool allow identification and tracking of management commitment to the measurement process? (ref. Primer Section 3.2.1)

Yes. We allow identification and tracking of management commitment to the measurement process through dynamic links to established and other company guides and documents.

3.2 Does the tool provide automation for a measurement process plan? (ref. Primer Section 3.2.2).

Yes. We provide automation of the measurement process plan by automatically collecting data, calculating measurement values, and distributing those values in report format for review.

3.3 Does the vendor identify the resources required to setup, operate and maintain the tool? (ref. Primer Section 3.2.3).

Yes. We provide user manuals and on-line help. We also provide a system administration tool for repository backup, repository statistics collection, and user account management.

3.4 Does the vendor provide training for all aspects of tool? (ref. Primer Section 3.2.4)

Yes. Training is provided for all aspects of the measurement process.

3.5 Does the tool provide a repository for capturing organizational measurement process best practices? (ref. Primer Section 3.2.6)

Yes. We use a high performance 7/24 object-oriented database with user-friendly system administration.

4 Computing Support

4.1 Measurement Database

4.1.1 Does the tool provide import capabilities from popular file formats and tool interfaces? Which ones?

Yes. We import data from Comma Separated Variable (CSV), Microsoft Project, Microsoft Excel, Microsoft Access, Microsoft SQL, Microsoft Word, Rational Rose, Rational RequisitePro, Rational ClearDDTS, Integrated Chipware Requirements Traceability Management (RTM), Lotus Notes, Telelogic DOORS, CM Synergy, Tau UML, Primavera, Test Director, PVCS Tracker, Version Manager and Oracle In addition, users can easily automate the collection of data from any source or in-house tool.

4.1.2 Does the tool provide export capabilities to popular file formats and tool interfaces? Which ones?

Yes. We export data to Comma Separated Variable (CSV),XML, BMP, and JPEG file formats.

4.1.3 Does the tool support access to measurement repository by other commercial tools (I.e. for data mining, statistical analysis tools, reporting tools, …) Which ones?

Yes. Access to calculated (or processed) metrics values can be exported in either graphical or data formats, and raw data is available to other tools and databases.

4.2 Does the tool provide a security mechanism for restricting access to the repository data?

Yes. Access to our repository is restricted to our toolsuite.

5 System Environment

5.1 Single user/multiple concurrent users. Does the tool support a single user or multiple concurrent users?

Both single and multiple concurrent users are supported.

5.2 Multiple Platforms/Operating Systems: On which platforms and operating systems does the tool run?

The TychoMetrics Server runs on Windows NT 4.0, Windows 2000, and XP. The TychoMetrics Client also runs on Windows 95 and 98. TychoMetrics .NET runs on Windows 2000 or XP Professional server.

5.3 Commercial vs. unique database. Does the tool use a proprietary or commercially available database?

We use a commercially available database.

5.4 Resource requirements (Please identify hardware/software configuration requirements):

5.4.1. Memory (RAM) requirements (MB): 256

5.4.2. CPU requirements (microprocessor): 400 MHz

5.4.3. Disk space requirements (MB): 20 MB (minimum). Repository size depends on amount of data collected by an organization.

6 Support and maintenance

6.1 Warranty: Does the tool have a warranty, if so what is it?

Based on Statement of Work and Contract requirement.

6.2 Network license policy: Does the tool support network licensing (floating, node locked, etc.), if so which license manager is used (ex. FLEXlm)?

Seat, Block, Site and/or Enterprise licenses supported. No license manager required.

6.3 Maintenance and upgrade policy: How often are software updates released; are updates separately priced items, etc.?

Major releases are scheduled every six months. Period software updates are released every quarter and no maintenance costs are associated provided the licensor is current in maintenance payment. Major releases are priced accordingly.

6.4 Recommended training time: What is the recommended training time for a user to become proficient in using the tool?

Typically, the training for TychoMetrics lasts from 1-3 days depending on types of training requested.

6.5 Online help: Are the users manuals online, is there online help with the tool?

Both online help and electronic manuals are provided.

6.6 Internet access/World Wide Web home page location: Does the tool supplier have an Internet e-mail address or World Wide Web home page location? If so, what is the Uniform Resource Locator (URL)?

http://www.tychometrics.com/

6.7 Phone support: What type of phone support is available from the tool supplier?

Normal business hours Monday through Friday, 8 a.m. to 5 pm. PST. Other arrangements are available upon request.

6.8 E-mail support: What type of e-mail support is available from the tool supplier?

24-hour response for email support questions from the designated corporate TychoMetrics system administrator (www.tychometrics.com).

7 What other features do you, as a tool supplier, think are important?

TychoMetrics prides itself on data integrity and measurement repeatability. Using the principles and methods of our patented Measurement Modeling Technology, we ensure there is no over or under counting of measurement data and there are no inappropriate mathematical or logical operations applied to measurement data. Because metrics expressions can be applied to different input sources and because metric expressions can be easily shared amongst organizational units, TychoMetrics provides consistent and repeatable results across the entire organization. In addition this technology provides the ability to create metric expressions by combining data from two or more different input data sources.

TychoMetrics is unobtrusive and seamlessly integrates with existing applications and tools. It automates the data collection and report generation processes, and it ensures metrics are consistent, repeatable, not over or under counted, and are algorithmically sound. It provides a cost-effective method for managing your metrics program.

Return to INCOSE Home
Content Owner: TDWG

Contact us at info@incose.org
Copyright 1998-2005 International Council on Systems Engineering
Last Modified: 01 March 2005