International Council on Systems Engineering

INCOSE Measurement Tools Survey
INCOSE | TDWG Home | Tools Database: RM SA Measurement General

INCOSE Measurement Tools Survey Response: DataDrill 3

Measurement Working Group Primer references (ref.) are shown where applicable.

1 Measurement Objectives (ref. Primer Section 4)

1.1 Can the tool monitor and control on-going product and services? (ref. Primer section 4.1.1)
Yes. DataDrill provides an extensive set of features to allow managers to monitor on-going business processes, activities/tasks, services, products and resources. In particular, DataDrill allows managers to organize, navigate, analyze, share and report any collection of graphs, charts, indicators, dashboards and other visualizations to allow them to quickly and efficiently monitor and control their business functions.

1.2 Can the tool quantify process improvements? (ref. Primer section 4.1.2)
Yes. DataDrill allows users to combine and compare from different OUs, or from different scheduled periods of the same OU. For example, DataDrill provides tools for the user to find all completed, systems engineering programs in a specific business unit that have been completed, and then compare the resulting data to a current/active systems engineering effort. There are also extensive tools for combining data (e.g. interpolation, normalization, projection, etc) from an organization's existing data.

1.3 Does the tool support estimation and prediction for project planning? (ref. Primer section 4.1.3).
Partially. DataDrill provides an organizational process execution history that can be used for estimation and planning. For estimation, DataDrill can provide quantitative data for specific estimation factors for models such as PRICE-S, COSYSMO, and others. For planning, DataDrill provides tool to establish plan data from historical project data, model-based plan lines (eg Rayleigh curve, Inflected S, etc) or by accepting plan data generated from external tools (eg the EAC line generated by an EVMS tool).

1.4 Does the tool support distribution of measurement information for organizational status and feedback? (ref. Primer section 4.1.4)
Yes. DataDrill provides a web-based collaborative environment where managers and other stakeholders can quickly review and assess program status. Large systems programs such as DDX/DD-21 and Joint Strike Fighter have used DataDrill to support stakeholders in different corporate/government entities, as well as different countries. In addition to on-line collaboration, DataDrill provides reporting to Word, PowerPoint and Excel.

1.5 Does the tool allow measurement to be tailored for specific organizational units (OU)? [I.e. projects, departments, programs, etc…]
Yes. DataDrill allows an organization to create one or more standard set of measures, indicators and reports, based on the manager's information needs. An organization can then allow individual OUs to customize any aspect of the measures. DataDrill provides authentication and security controls that allows an organization to determine who can and cannot tailor the measures shared throughout an organization.

1.6 Does the tool provide a mechanism for establishing "core" measures?
Yes. DataDrill provides centrally defined measurement templates (measures, graphs, projects, dashboards) which may be copied, pasted, synchronized and shared for one or more sets of "core" measures.

 

2 Measurement Process

2.1 Selection and Specification of Measures / Indicators (ref. Primer Section 3.1.1)

2.1.1 Does the tool support the definition of measures and indicators for each OU being measured? Does the tool provide a mechanism to specify attributes of measures?
Yes. Unlimited definition of custom and tailored measures and indicators in flexible user-defined structure. Single or multiple attributes may be used to filter, aggregate and otherwise evaluate information.

2.1.2 Does the tool support the identification of project issues and measurement goals?
Yes. Notes, document library, color-coded status display, analysis, alarms, graph narratives and annotations, milestones, phases, scorecard structure

2.1.3 Does the tool allow specification of measurement characteristics, including data source, data validity rules, collection method, temporal constraints and interpretive guidelines?
Yes. DataDrill supports specification of the measurement process in many ways. First, DataDrill provides a library to store management, measurement and other process documents and standards. Second, DataDrill provides the capability to describe each element involved in an individual measure. Third, DataDrill allows measures to be graphically annotated with textual information such as temporal constraints (eg the measure is only valid in requirements phase). DataDrill also provides a flexible web-based reporting mechanism that supports the automated generation of a measurement process document using the MS Office suite.

2.2 Data Collection Method (ref. Primer Section 3.1.2)

2.2.1 Does the tool perform validation of collected measurement data?
Yes. DataDrill provides two mechanisms, Extractors and Integration Studio, for "collecting" data, both options provide extensive capabilities for validating and transforming data before it enters DataDrill. Integration Studio is a web-based ETL tool which provides the capability to draw models of the collection process, where some of the steps in the model can be validation.

2.2.2 Does the tool provide a means for manual data entry?
Yes. Web-based manual data entry provided in an Excel-like format.

2.2.3 Does the tool provide a means for automated data collection?
Yes. Yes. Collection can be automated using both "push" (eg data generated and pushed from the source into DataDrill) and "pull" (eg DataDrill collects data from an external tool using an interface or API). DataDrill tailoring allows any tool, development environment or application that can generate a CSV, XML, TXT or Excel/XLS file.

2.2.4 Does the tool provide a mechanism for the user to tailor the tool for automated collection from user-defined data sources?
Yes. The Extractor Kit and Integration Studio components allow for completely customized collection of data from any data source

2.3 Calculation Method: Getting from Measures to Indicators (ref. Primer Section 3.1.3)

2.3.1 Does the tool allow measurement data to be combined into complex measures or indicators?
Yes. Graphs, reports and dashboards may be custom created to reflect unique information needs by including calculated data, regions, alarms, text, narratives, graphical annotations, colors, and more.

2.3.2 Does the tool allow specification of weights or normalization factors to be used in combining measures into indicators?
Yes. The combination of measures can be easily performed using a built-in equation editor and equation engine. The Equation mechanism supports weighting, averages, control limits, min.max, trend and projections for combining data.

2.4 Analysis of the Measures or Indicators (ref. Primer Section 3.1.4)

2.4.1 Does the tool support the review and analysis of measurement data?
Yes. Management by exception and drill to the details; quantitative analysis functions; alarms; flexible organization, aggregation, reporting and sharing of information; graph annotations and narratives add contextual value.

2.4.2 Does the tool support statistical process control calculations including control charts and upper, lower and center line calculation?
Yes. Equation wizard assists in setting up spc calculations which are then updated and evaluated automatically.

2.4.3 Does the tool provide a means for comparing actual measured data to planned, target or historical values?
Yes. Full support provided for collecting, graphing, reporting and evaluating plan, actual, target and historical data and any combinations and comparisons between them.

2.5 Reporting and Using the Results (ref. Primer Section 3.1.5)

2.5.1 Does the tool present measurement data consistent with the needs of differing organizational or management levels?
Yes. Data may be collected and reported to support the specific and varied information needs of each organizational level. In addition, data collected for one level may be re-used -- combined, aggregated, analyzed and otherwise manipulated to meet other organizational information needs.

2.5.2 Present measurement data appropriate for the role of the user accessing the tool, where roles are analyst, OU manager or customer?
Yes. Customized, role-based information display by user delivers only relevant, permissible measurement information to each user.

2.5.3 Does the tool allow the user to customize the generation of reports, including adding, modifying and deleting reports?
Yes. All measurement data may be organized as is relevant to the user's particular needs and reports may be generated as needed to support current information needs.

2.5.4 Does the tool provide an mechanism for distributing measurement reports?
Yes. Measurement reports may be viewed and shared within the tool using the Web and/or may be exported to Excel or PowerPoint for viewing and sharing.

2.5.5 Does the tool support the distribution of measurement reports via the Internet or Intranet?
Yes. Measurement reports may be viewed and shared within the tool using the Web.

 

3 Measurement Program Infrastructure

3.1 Does the tool allow identification and tracking of management commitment to the measurement process? (ref. Primer Section 3.2.1)
Yes. The DataDrill reporting capability allows documents and reports to be created using Office 2003 which can be "filled in" by DataDrill. DataDrill can provide details related to data sources, integration, organization, use/user, analysis, measures, graphs, business rules, data availability/completeness.

3.2 Does the tool provide automation for a measurement process plan? (ref. Primer Section 3.2.2).
Yes. The DataDrill reporting capability allows documents and reports to be created using Office 2003 which can be "filled in" by DataDrill. DataDrill can provide details related to data sources, integration, organization, use/user, analysis, measures, graphs, business rules, data availability/completeness.

3.3 Does the vendor identify the resources required to setup, operate and maintain the tool? (ref. Primer Section 3.2.3).
Yes. Deployment Guide, case studies, configuration services.

3.4 Does the vendor provide training for all aspects of tool? (ref. Primer Section 3.2.4)
Yes. WBT training, power-user instructor-led training, configuration services, on-line help and other documents and white papers.

3.5 Does the tool provide a repository for capturing organizational measurement process best practices? (ref. Primer Section 3.2.6)
Yes. DataDrill provides an online library for storing best practices, risk management or other organizational measurement documents, standards or best practices .

 

4 Computing Support

4.1 Measurement Database

4.1.1 Does the tool provide import capabilities from popular file formats and tool interfaces? Which ones?
Yes. xml, csv, xls; data may also be extracted from other data sources such as SQL databases, Access databases, Telelogic DOORS, MS Project, Rational Rose and more.

4.1.2 Does the tool provide export capabilities to popular file formats and tool interfaces? Which ones?
Yes. Excel, PowerPoint

4.1.3 Does the tool support access to measurement repository by other commercial tools (I.e. for data mining, statistical analysis tools, reporting tools, …) Which ones?
Yes. The DataDrill repository can be accessed using any ODBC-compliant tool. This includes Crystal Reports/Business Objects, SAP, SAS, QAIAnalyst, Mathematica, Macsima, and many others.

4.2 Does the tool provide a security mechanism for restricting access to the repository data?
Yes. DataDrill provides an extensive set of features for restricting access to all components in the measurement process, including sources of data, individual measures, analysis, reports, program tabs, individual pages and others.

 

5 System Environment

5.1 Single user/multiple concurrent users. Does the tool support a single user or multiple concurrent users?
Unlimited multiple concurrent users

5.2 Multiple Platforms/Operating Systems: On which platforms and operating systems does the tool run?
Windows 2000 or higher

5.3 Commercial vs. unique database. Does the tool use a proprietary or commercially available database?
SQL or Oracle

5.4 Resource requirements (Please identify hardware/software configuration requirements):
5.4.1. Memory (RAM) requirements (MB): DataCenter or ReportCenter Configuration – The recommended system requirements for each D3 component (either DataCenter or ReportCenter) are: Dual 2 GHz Intel Pentium 4, Itanium, AMD Athalon MP or faster processors, 512 Mbytes RAM, 80 GBytes of available disk space

SQL 2000 Database Server - For a computer hosting Microsoft SQL 2000 server, the recommended system requirement are: Dual 2 GHz Intel Pentium 4 or Itanium, AMD Athalon MP or faster processors; 1 GByte RAM; 100 GBytes of available disk space
5.4.2. CPU requirements (microprocessor): See above
5.4.3. Disk space requirements (MB): See above

 

6 Support and maintenance

6.1 Warranty: Does the tool have a warranty, if so what is it?
Yes. Distributive provides a usability and maintenance warranty.

6.2 Network license policy: Does the tool support network licensing (floating, node locked, etc.), if so which license manager is used (ex. FLEXlm)?
No. Since DataDrill is web-based, the server does not require a floating or network licensing mechanism.

6.3 Maintenance and upgrade policy: How often are software updates released; are updates separately priced items, etc.?
Yes. Every 6-12 months Updates are included in maintenance agreement.

6.4 Recommended training time: What is the recommended training time for a user to become proficient in using the tool?
2 days. Web-based training allows for self-paced, just-in-time learning that matches the user's job function.

6.5 Online help: Are the users manuals online, is there online help with the tool?
Yes. Complete on-line help available from within the tool, on-line knowledge base accessed through the Web-based help desk.

6.6 Internet access/World Wide Web home page location: Does the tool supplier have an Internet e-mail address or World Wide Web home page location? If so, what is the Uniform Resource Locator (URL)?
Yes. Contact us at info@distributive.com or http://www.distributive.com

6.7 Phone support: What type of phone support is available from the tool supplier?
Full phone support M-F 9-5 EST

6.8 E-mail support: What type of e-mail support is available from the tool supplier?
Full email support available as well as live, on-line chat and access to an on-line help desk

 

7 What other features do you, as a tool supplier, think are important?

Refer to our web site for product details & demos.

Return to INCOSE Home
Content Owner: TDWG

Contact us at info@incose.org
Copyright 1998-2005 International Council on Systems Engineering
Last Modified: 16 May 2005