Data Collection
One of the most overlooked criteria’s required prior to data collection activities is to create an “Operational Definition.
”An Operational Definition is a precise description that tells how to get a value for the characteristic you are trying to measure. It includes what something is and how it is to be measured. The key word is characteristic (s).
It is also important to understand that you may need a separate definition for each subject area. For example, Employee “A” may have a different definition than Employee “B”. The purpose of an Operational Definition is two-fold:- 1) To remove uncertainty so everyone has the same understanding- 2) To make sure that no matter who does the measuring, the results are always the same.
The following is an example Operational Definition I used when I worked in the Voucher Department:
“An error-free expense report includes receipts for all items on the Expense Form over $25.00 and does not include any receipts for items not included on the Expense Form. There are no math errors and expenses are coded properly.”
or,
“The starting time to measure customer response time is when the customer enters our store and when the customer leaves.”Think of the Operational Definition in Data Collection as you would the Problem Statement for Root Cause Analysis. Both should be stratified (i.e., broken down/categorized) to provide a focus that can be measured and understood by all involved. Without this we will probably conduct meaningless data collection studies and reports (unfortunately I’ve done that many times when pressured for data).
Do NOT allow this process to be come bureaucratic, a nice guide (checklist) to follow that I inherently use when doing data collection or when I have no idea where to start a data collection conversation I ask myself Who, What, Where, When, Why and How (by “What Method”). Following are some tips that I have found useful:
1. Clarify Data Collection goals
• Decide why you are collecting data
• Decide what data you need to collectDecide how much (sample size) data you need to collect (i.e., are you looking for point in time or for an on-going trend)
• Decide What you will do with the data once you have it
2. Develop an Operational Definition
• Define what you are trying to evaluate
• Decide how you will attach a value to what you are trying to measure (develop data collection form and corresponding data base if necessary)
• Decide how you will display/record the data (i.e.; graph/chart, spreadsheet, report, etc.)
• Determine the period of time you will conduct the data collection activities
3. Test for Data Consistency
• Determine factors that may cause your data to vary from one item to another (i.e., people, your own subjectivity, location, time, size, different process, etc.)
• Reduce impact of those factors4. Data Collection
• Train all involved in study to ensure consistency (use associated data collection forms and input data base if required)
• Make data collection procedures error-proof
• Have frequent process checks (do a sample test on small group) to determine if data collection forms and tools are accurate and appropriate (i.e.; does the data look reasonable and actionable).
By following these guidelines you will not only improve your data collection activities, you will also reduce cycle time in analyzing and displaying your data with the appropriate graphs and charts.
p/s - When you can measure what you are speaking about and express it in numbers, facts, theory or application, then you know something about it, but when you cannot measure it, envision it, or provide meaningful information about it, or if you cannot express it in numbers, your knowledge or so called expertise is of an insufficient and unacceptable type.
Example Data Collection Forms
(Click on forms to enlarge)
The following DC forms are examples that may provide a starting point for data collection efforts:
1) This form can be used for collecting facts and information from a supplier, process owner or customer. Getting this information and data upfront allows the data collector to create high level end-to-end process flows, data collection sheets, further analysis, etc...
2) This form is used to not only collect data and information but it also serves in developing a sound operational definition and plan to data collecting.
3) The data collection from below is an example for collecting data on "Service Order Accuracy." When input orders are involved this is an excellent starting spot for correcting downstream problems, especially if the order travels through multiple departments. Do not forget the Sales Department(regardless of what they say) who usually are the first step in filling out the order.
Note: The data used above is "attribute" (i.e., counting, percentages) type data. This data can be useful in setting up Pareto Charts and for creating control charts (p, np, c, u).
qualityg always recommends a statistician before setting up and analyzing control charts.
No comments:
Post a Comment