The most common use of Attribute Agreement Analysis (AAA) is in evaluation of agreements in quality checks. In what other situations can you use AAA to your benefit?

1. To insure that we have an accurate perception of customer desires and expectations

2. To align expectations between suppliers and customers

3. To identify improvements needed for acceptance standards

 

• To evaluate alignment of decision making relative to specific conditions

Attribute Agreement Analysis can be used for determining the most common items to fail assessments. This can indicate that there are other factors involved in assessing the subjects than simply the appraiser.

any alignment analysis

You can use AAA for events such as:

• Interviewing / hiring
• Appraisals (car, jewelry, etc)
• Defining / improving acceptance criteria
• Any time a decision must be made with qualitative data; commonly used in coding of the data

For my Service organization, we are using AAA today in the QA process for ensuring that Acceptance Test Procedures are being correctly filled out.  Two reviewers from the installation team, and one SME individually assess if the document is complete.   The first time pass rate is monitored (among other items), and fed back into Engineering Change Review.  

 

Thakk

Attribute Agreement Analysis

- Evaluation of agreements within and between appraisers and to reference standards

- evaluation between final inspection of supplier and receiving inspection of customer

- determine if appraiser is capable of inspecting the part or process; use AAA as part of hiring process or to move a person out of the job

In what other situations can you use AAA to your benefit

• Evaluate agreement between supplier and customer - reduce NFF type failures
• Evaluate agreement between end -customer and manufacturer - reduce rejections or NFF failures
• Understanding (improve) repeatability of appraisers -  determine if more training/tool/methods or improvements needed - determine best tools, techniques for appraisers - establish robust training program
• Understanding accuracy (improve) between appraisers - is the measurement system sufficient to identify defects and only accept good product - am I at risk for escapes or in needed rework in the factory - determine how to minimize Type I and Type II errors

 

In order to determine other situations (beyond quality checks), let's first breakdown Attribute Agreement Analysis (AAA) into its components.  AAA includes assessing repeatability (both within and between) and accuracy (by appraiser and overall compared to a standard).  Repeatability and accuracy assessment could be useful in many other situations.  A few possible applications are marketing/advertising; communicating/messaging; opinion surveys; knowledge checks/education/process understanding; intelligence/comparison; information assurance/error checking.

When qualitative data is used for making decisions.