Perceptual Style^® Theory

Revolutionary Psychological Theory

of Human Behavior

Two things people are most curious about when using assessments are their reliability and validity.  

We’ve done several studies over the years to establish the reliability and validity of the Perceptual Style Assessment and the Recognized Strengths Assessment and we are very proud of the results. 

The following information is not for the faint hearted – meaning we hope you like graphs and charts and numbers! This is some of the detail that supports our reliability and validity claims. 

The Assessments

The PSA: The function of the PSA is to measure an individual’s unique Perceptual Style. However, perception cannot be directly measured so it was necessary to use a behavioral artifact that reflected an individual’s underlying perception to determine Perceptual Style. Research revealed that self selected descriptive adjectives provide the most reliable reflection of individual Perceptual Style. The PSA consists of 264 adjectives that are rated on a five point Likert scale that ranges from "never like you" to "always like you". The result of the PSA is one of the six possible Perceptual Styles described by PST. 

The RSA: PST states that each Perceptual Style supports an innate set of potential skills, abilities, and capacities and that individuals function most effectively and with greatest satisfaction when performing skills and acting in capacities that are naturally supported by their Perceptual Style. The RSA compares an individual’s preferred Natural Action Capacities (NACs) against those that are innately supported by their Perceptual Style and reveals areas of consciously realized talent and unrealized potential as well as the expression of acquired roles and skills that “steal” time and effort away from natural talent and skill. The RSA consists of 144 sets of three roles in which an individual rank orders one role as the one they would be “most comfortable” performing and one role as the one they would be “least comfortable” performing. 

Assessment Reliability - Perceptual Styles

The reliability of an instrument refers to the extent to which the test results are repeatable or consistent. Beginning in 1984, three separate investigations have examined the internal consistency of the Perceptual Style scales measured in the PSA. 

Cronbach’s alpha was used as the measure of reliability. When comparing several sets of data, Cronbach’s alpha measures how well the sets fit a single one-dimensional construct. Cronbach’s alpha is a coefficient of correlation similar to an r² coefficient of correlation, except that, where r² measures the correlation between two sets of data, Cronbach’s alpha measures the inter-correlations between multiple sets of data. The interpretation is similar: an alpha of one represents perfect correlation, while an alpha of zero represents maximum randomness. The alpha reliabilities for the standardized scales of the six Perceptual Styles as measured in the most recent study conducted in 2003 are presented in the following table: 

These findings show that the internal consistency of the Perceptual Styles scales within the PSA exceed the generally accepted levels of .70 commonly used to establish reliability. 

Assessment Reliability – Natural Action Capacities

The PST NAC scales and the RSA were not established until 1991 and, therefore, were not included in the two studies conducted prior to 2003. These scales were included in the 2003 study. 

The Cronbach’s alpha correlations in the 2003 study resulted in a median reliability of .81, and five roles had alpha coefficients less than .70. Subsequent analysis revealed that some adjectives in the inventory used to determine capacity preference were more commonly understood in wider definitions then was useful for the inventory assessment. As a result, the adjectives list was reformed to replace those adjectives with words more narrowly perceived, and additional comparative items were added to make the inventory more robust against the natural variances in understanding. 

A preliminary investigation was conducted in 2004 using 50 subjects to determine if reliability had improved as a result of the modifications to the inventory. The results of this study are presented in the table below, which shows that all of the 18 scales have acceptable alpha coefficients. Given that small sample sizes generally understate reliability, we believe this investigation indicates the modified inventory is sufficiently reliable. 

Assessment Validity

The validity of an instrument refers to the extent to which it measures what it is intended to measure. Psychologists have established three types of test validity – Content, Construct, and Criterion (consisting of concurrent and predictive). 

The properties of the numbers produced by type indicators (as opposed to trait indicators) require a focus on construct and criterion validity. 

Construct validity refers to the extent to which an instrument’s measurements correlate to a theoretical construct. 

The first construct of PST to be validated is the relationship of the six Perceptual Styles to each other. While the six Perceptual Styles describe six distinct psychological realities, the PST model asserts a circular relationship between them as shown in the table below. This implies a specific pattern of correlation among the six Perceptual Style scales. This pattern should exhibit a circumplex structure, which is to say that the score of a particular Perceptual Style should exhibit a strong positive correlation with the scores of adjacent Perceptual Styles and minimal or negative correlation with the scores of opposite Perceptual Styles. 

Note that the six Perceptual Styles do not lend themselves to overlaying on two mathematical axes (x and y). Therefore, a traditional circumplex plot is not possible. However, the existence of the circular ordering can be demonstrated by plotting every pair-wise correlation in a hexagonal structure in which the center point equals a correlation of -1.00, the outer edge equals a correlation of +1.00, and the midpoint between the two equals a correlation of 0.00. 

If a circumplex relationship exists, correlations will decrease as the distance between the two pairs of Perceptual Styles increases. 

The table below shows the pair-wise plot for the six Perceptual Styles from the 2003 study of 227 subjects and reveals the predicted structure.

Prior studies did not include construct validity measures for the NACs. This was due, in part, to the complex nature of the theoretical relationship between them. As the Perceptual Styles form a circle, the NACs form a torus. 

Criterion validity refers to the extent to which an instrument’s measurements correlate to a concurrent or predicted measure. A review of the 2004 research project by independent test construction experts determined that, as PST is an original styles theory, there are no comparable measures with which to establish concurrent validity. However, PST does lend itself to a measure of predictive validity. Discussions with test construction experts have resulted in the definition of an acceptable methodology, which will be employed in a future research project. The process will use a selected group of approximately 50 individuals who will be interviewed on video using standardized interview questions. These questions will be designed to elicit data that can be assessed by PST subject matter experts for Perceptual Style, and the NACs. The subject matter expert assessments will be performed independently and the results correlated with inventory results. 

Research Updates

For information about the content of this page or regarding current or future research activities, please contact Gary M. Jordan, Ph.D. using one of the following methods: