Types of Assessment


Antecedent

Behavior

Consequence

LA/Dem/Tang/None

1/2/3/4

Att/Esc/Tang/None

LA/Dem/Tang/None

1/2/3/4

Att/Esc/Tang/None

LA/Dem/Tang/None

1/2/3/4

Att/Esc/Tang/None

LA/Dem/Tang/None

1/2/3/4

Att/Esc/Tang/None

LA/Dem/Tang/None

1/2/3/4

Att/Esc/Tang/None

LA/Dem/Tang/None

1/2/3/4

Att/Esc/Tang/None

LA/Dem/Tang/None

1/2/3/4

Att/Esc/Tang/None



Unstructured ABC data have the advantage of allowing the clinician to record anything that might be relevant and to then analyze the relevance of each detail later. Disadvantages of unstructured ABC data are that it can be time-consuming and effortful to write the narrative and it may not be possible to write fast enough when observing particularly high-rate behavior. In addition, the necessity for interpreting the narrative after the observation introduces an additional source of potential subjectivity in the process. Structured ABC recording enjoys the advantages of being faster and easier to record in the moment and being relatively less subjective. A disadvantage is that the prespecified categories on the datasheet may fail to capture all relevant variables that the clinician observes. However, the clinician can always jot down any other anecdotes in the margin of the datasheet or in a section of the datasheet that is designed for additional comments.

Regardless of whether data are collected via structured or unstructured ABC recording, the clinician must then summarize the data and interpret the results according to function. It is worth keeping in mind that, as discussed in the section on indirect functional assessments above, the vast majority of research has shown that more than 90 % of challenging behaviors displayed by individuals with developmental disabilities are maintained by attention, escape, tangible, automatic reinforcement, or some combination. Therefore, it is prudent for the clinician to look for these potential functions first, before becoming overly creative with potential interpretations of the descriptive data.

Direct descriptive functional assessments have several strengths and limitations worth noting. One strength is that they allow the clinician to directly observe behavior, so it is possible that he/she will identify important environmental variables that would be missed in an indirect assessment. Another strength is that they are relatively easy to implement and only require sound observational data collection procedures. Finally, a strength of descriptive assessments is that they are safe, in that the clinician need not interact with the individual engaging in challenging behavior, they need only observe. Like any other assessment, descriptive assessments also suffer from limitations. First, like indirect assessments, the information they produce is only correlational. It is possible that the relations observed between behavior and environment during the assessment are mere correlation and do not actually point to the maintaining variables for the behavior. Perhaps the most concerning limitation is that several studies have shown that a large proportion of descriptive assessments produce either invalid or inconclusive results (Lerman & Iwata, 1993; Tarbox et al., 2009).



Experimental Functional Analyses


In particularly severe or perplexing cases, or when indirect and descriptive functional assessments produce inconclusive results, best practices often call for simpler functional assessments to be supplemented by experimental functional analyses (EFA ; Iwata, Dorsey, Slifer, Bauman, & Richman, 1982). An EFA is a procedure where antecedents and consequences for challenging behavior are intentionally manipulated to determine which antecedents reliably evoke the behavior and which consequences reliably reinforce the behavior. The classic procedure involves randomly alternating five analogue conditions: (1) attention, (2) escape, (3) tangible, (4) alone or no interaction, and (5) a control or play condition. Each of the first four experimental conditions test one putative function of challenging behavior by setting up antecedent conditions that are likely to evoke the behavior, if indeed it has that particular function, and consequences that are likely to reinforce the behavior, if indeed it has that particular function. The fifth condition serves as a control condition, wherein none of the antecedents are in place and none of the consequences are delivered. Table 2.2 depicts the conditions and the antecedents and consequences that are presented in each. Sessions of each condition are repeated in a random order until differentiation in the rate of challenging behavior between conditions is observed or until it becomes apparent that the analysis is not producing interpretable results.


Table 2.2
Conditions of an experimental functional analysis for challenging behavior









































Condition name

Potential function

Antecedent

Consequence for challenging behavior

Attention

Social attention

Pay no attention to client

Brief social attention

Escape

Escape from or avoidance of demands

High rates of low-preferred task demands

30-s break from task demands

Tangible

Access to preferred items of activities

Denied access to preferred items or activities

30-s access to preferred items or activities

Alone/no interaction

Automatic reinforcement/self-stimulation

No items or activities, no demands, no social contact

None

Play/control

N/A

High attention, no demands, continuous access to preferred items and activities

None

Serves as a control for other conditions

Experimental functional analyses have several advantages. First, substantial research has shown that they produce interpretable results in a large percentage of cases. For example, a large-scale review of research on EFAs found that 95.9 % of EFAs produce differentiated results (Hanley et al., 2003). However, it should be noted that this was a review of EFAs published in research, not a review EFAs actually done in real-life settings, so it is possible that the actual real-life success rate of EFAs is lower. A significant disadvantage of EFAs is that they require specialized training to administer and very few clinicians are available who possess that training. Even among Board Certified Behavior Analysts, the population of clinicians who possess the greatest training and expertise in functional assessment, only a very small minority possess the skills to safely and validly conduct EFAs. The unfortunate result is that EFAs are very rarely done in real clinical practice, despite their being considered the “gold standard” for functional assessment in research.




Clinical Judgment in the Assessment Process


As has been discussed throughout this chapter, clinicians use a wide variety of tools and procedures when assessing an individual with ASD. Some tools and procedures have come to be referred to as “gold standard” procedures. For example, the ADOS and ADI-R are often referred to as gold standard diagnostic procedures. Similarly, EFAs are often referred to as gold standard functional assessment procedures. However, in both diagnostic and functional assessments, it is worth noting that gold standard procedures tend to be more costly and labor intensive and require specialized training that a very small percentage of the population of clinicians possess. Even when a clinician does possess the resources and expertise required to implement gold standard procedures, it is critical to remember that no one modality or instrument is more valuable than clinical judgment. It is important to remember that results from any one modality (e.g., cognitive evaluation, diagnostic observation, functional assessment, etc.) comprise only a single component of the full evaluation process. For example, results of a single measure may indicate strengths and weaknesses in domains of intellectual functioning, but not account for possible delays in the realm of social development or compensatory adaptive skills. While findings may provide insight to a particular observed behavior, they may be based on a limited sample of time or a novel setting. Parental endorsements may suggest a high or low frequency of a behavior in one setting that is not observed as generalizing to other settings. Similarly, even though an EFA is likely to produce the most reliable and valid functional assessment results, it is, by definition, analogue and contrived and therefore may produce behavior that occurs in reaction to clinician-contrived circumstances, rather than behavior that is representative of the client’s real behavior in everyday life. Although little or no research has demonstrated it, it is hypothetically possible to “shape up” a new function for challenging behavior that was never before present, merely by systematically giving a particular consequence for a behavior during an EFA. Put differently, it is possible that a client may actually learn for the first time that a particular challenging behavior can earn him/her access to preferred items or activities.

Overall, no measure should be considered in isolation for the purpose of diagnosis or determining eligibility for services. In addition, measures should be evaluated and interpreted against one another in the evaluation process. A caregiver report should be evaluated against the clinician’s direct observation and subsequent findings. It is clinical judgment that incorporates the individual modalities of testing together and produces a cohesive evaluation. Clinical opinion is invaluable in the diagnosis of ASD and functional assessment of challenging behavior and cannot be substituted, only strengthened, with carefully considered and administered measures of development, cognition, language, and executive functioning; diagnostic observations and structured interviews; surveys, questionnaires, and inventories related to social skills, behavioral, emotional, and adaptive functioning; review of psychological and medical records; functional assessment tools; and detailed histories obtained by caregivers and teachers. Furthermore, a clinician has the ability to draw from the findings of one measure to inform his/her decision to administer additional measures as he/she attempts to answer the referral question. During the interpretation of data, an individual’s test performance in one domain of functioning can assist in the understanding of another domain. More specifically, a clinician can utilize an individual’s performance in the areas of cognition and language to support his/her interpretation of that individual’s functioning in the areas of social and communication abilities (Lord et al., 2012).


Behavioral Observations Impacting Interpretations


The behavioral observation section of an ASD evaluation focuses on the behaviors witnessed throughout the testing session(s). The behaviors exhibited by the client are described in an objective manner and can support the clinical judgment of the clinician in his/her determination or ruling out of a diagnosis. Often, the behaviors described in the behavioral observation section will be referenced in subsequent areas of the report, including the summary and diagnostic section, in which in vivo observations in combination with parent interview and behavioral questionnaires play a large role in supporting diagnostic criteria.
Jun 12, 2017 | Posted by in NEUROLOGY | Comments Off on Types of Assessment

Full access? Get Clinical Tree

Get Clinical Tree app for offline access