Measure task time without inventing a savings claim

Use equivalent tasks and show assistance, setup and failure alongside elapsed time.

ContractCanvas insights

Define the comparison

Specify the task before measuring it. Preparing a complete scope and revised output is different from opening a template. Use comparable sample cases in the existing process and the new workflow. Keep the required output and completeness checks the same.

Record the full effort

Separate initial setup from repeat task time. Record interruptions, assistance and corrections. If an evaluator needs coaching, that time is part of understanding usability. A fast but incomplete output should not count as success.

Control obvious biases

Alternate the order where practical so participants do not always learn the task in the first tool. Use another equivalent case for a repeat attempt. Small convenience samples can reveal defects but do not establish a market-wide time-saving percentage.

Report the observation

A defensible result names the participant count, release, task, timing method and limitations. Keep failed and unfinished attempts visible. The current ContractCanvas materials contain a prepared evaluation method and local technical tests, not measured customer savings. Publish an outcome only after the underlying observations exist.