<?xml version='1.0' encoding='UTF-8'?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1d1 20130915//EN" "JATS-journalpublishing1.dtd">
<article>
  <front>
    <journal-meta>
      <journal-title-group>
        <journal-title>No Template</journal-title>
      </journal-title-group>
      <issn publication-format="print"/></journal-meta>
    <article-meta>
      <title-group>
        <article-title>A Single-Case Examination of Token Reinforcement and Self-Evaluation in a Self-Contained Classroom</article-title>
      </title-group>
      <contrib-group><contrib contrib-type="author"><name>
            <givenName>S</givenName>
            <surname>Fraidlin</surname>
          </name>
          <email/>
        </contrib><contrib contrib-type="author"><name>
            <givenName>A</givenName>
            <surname>Kankazil -Maimon</surname>
          </name>
          <email/>
        </contrib><contrib contrib-type="author"><name>
            <givenName>R</givenName>
            <surname/>
          </name>
          <email/>
        </contrib></contrib-group><permissions/><abstract>
        <title>Abstract</title>
      </abstract>
      <kwd-group>
        <title>Keywords</title>
      </kwd-group>
      </article-meta>
  </front>
  <body>
    <sec>
      <title>INTRODUCTION</title>
      <p/>
      <p>Students lacking in emotional or behavioral regulation are often described in the research literature as students with or at risk for Emotional Behavioral Disorder (EBD). According to the Diagnostic Statistical Manual of Mental Disorders <italic>(American Psychiatric Association, 2013)</italic>, specific diagnoses of disorders associated with emotional and behavioral regulation include Oppositional Defiant Behavior (ODD), Intermittent Explosive Disorder, Conduct Disorder, Antisocial Personality Disorder, Pyromania, and Kleptomania. Attention Deficit Hyper-Activity disorder (ADHD) is a common co-occurring condition together with the above disruptive, impulse-control and conduct disorders <italic>(American Psychiatric Association, 2013)</italic>. This paper uses the prevalent acronym EBD to refer to the cluster of the aforementioned disorders, particularly ODD and ADHD. ODD and ADHD are associated with deficits in emotional and/or behavioral regulation that occasion conflict with social norms and authority figures as well as behaviors that violate the rights of others <italic>(American Psychiatric Association, 2013)</italic>. Students with EBD, who are diagnosed with ODD and ADHD, exhibit persistent problem behaviors such as disruptive behavior, non-compliance, distractibility, offtask behavior, and physical aggression, that interfere with learning and instruction <xref rid="b13" ref-type="bibr">1</xref>. They struggle with managing their academic and social behaviors <xref rid="b24" ref-type="bibr">2</xref>. These persistent behavior problems and low academic engagement require teachers to provide evidence-based support interventions for students with EBD learning in general education schools. The type of support should match the students' specific needs <xref rid="b30" ref-type="bibr">3</xref>. One imperative need is for students to be able to manage their lives independently and adapt well to their environment. School settings require self-regulation and self-direction in following the school norms, appropriately interacting with adults and peers, and actively participating in the learning process <xref rid="b7" ref-type="bibr">4</xref>.</p>
      <p>Engaging students with EBD in the learning process requires increasing the number of opportunities students receive to actively respond to ongoing instruction. Active Student Response (ASR) occurs when the student emits a detectable response such as raising his or her hand, using a sign or writing an answer following a teacher-posed question <xref rid="b2" ref-type="bibr">5</xref><xref rid="b14" ref-type="bibr">6</xref><xref rid="b18" ref-type="bibr">7</xref>. The research on ASR with students with EBD has long shown that ASR is associated with improved students' engagement measures such as on-task behavior, and reduced levels of inappropriate behaviors such as inattention and disruptive behavior during instruction <xref rid="b2" ref-type="bibr">5</xref><xref rid="b14" ref-type="bibr">6</xref><xref rid="b18" ref-type="bibr">7</xref><xref rid="b27" ref-type="bibr">8</xref>).</p>
      <p>An approach that aims to cultivate optimal conditions for learning is the Response to Intervention (RTI) framework <xref rid="b12" ref-type="bibr">9</xref>. The Positive Behavior Support (PBS) approach is an RTI-based model designed to improve behavior across the school via a three-tiered approach <xref rid="b12" ref-type="bibr">9</xref><xref rid="b22" ref-type="bibr">10</xref>. The first tier entails universal practices that are applied to all students. The second tier focuses on targeted interventions for students who do not respond to the universal practice and need more specialized support. The third tier involves intensive function-based individualized interventions designed specifically for individual students who do not respond to the previous intervention supports.</p>
      <p>Universal practices are interventions that support teachers in structuring the classroom, and in relating to students in a positive manner. These are also interventions that promote active response, self-control, positive peer relations, and reduce disruptive behaviors. A growing body of literature documents the positive impact of universal teacher practices on classroom conduct, student behavior, and the use of disciplinary and aversive procedures <xref rid="b11" ref-type="bibr">11</xref><xref rid="b22" ref-type="bibr">10</xref><xref rid="b23" ref-type="bibr">12</xref><xref rid="b29" ref-type="bibr">13</xref>. Universal practices are also relatively low in cost per person in the classroom compared to the other tier levels' supports <xref rid="b12" ref-type="bibr">9</xref>. A more intensive intervention such as a function-based individualized intervention, albeit effective in reducing problem behaviors, is more expensive, more demanding to implement in terms of teachers' time, and reduces academic instruction <xref rid="b12" ref-type="bibr">9</xref><xref rid="b22" ref-type="bibr">10</xref><xref rid="b29" ref-type="bibr">13</xref>.</p>
      <p>This pilot study examined two universal practices, Token reinforcement (TR) and Self-Management (SM), that entail different contingency locus of control. TR, also known as token economy, is an entirely adult-mediated intervention <xref rid="b4" ref-type="bibr">14</xref>. TR is a contingency reinforcement system in which students can earn immediate reinforcement (i.e., token) contingent on exhibiting target behaviors and later exchange it for a reward <xref rid="b30" ref-type="bibr">3</xref>. The reinforcement contingencies in TR are contrived to occur more immediately and more frequently than how they naturally occur in the classroom and therefore may be more appropriate for students who exhibit challenging behaviors <italic>(DuPaul et al.,</italic> www.internationalsped.com Shiri Ayvazo, Avner Fraidlin, Ronit Kankazil -Maimon 2011). TR interventions are well-known in school settings and have long been used by teachers to reduce students' disruptive and off-task behavior, regulate behavior, increase academic engagement and encourage prosocial behavior <xref rid="b20" ref-type="bibr">15</xref><xref rid="b30" ref-type="bibr">3</xref>.</p>
      <p>"Self-Management" (SM) is an umbrella of interventions where concontingency management placed with the student. SM interventions have been documented to improve students' on-task behaviors, increase academic engagement, decrease disruptive behaviors, and improve social skills <xref rid="b4" ref-type="bibr">14</xref><xref rid="b7" ref-type="bibr">4</xref><xref rid="b8" ref-type="bibr">16</xref><xref rid="b9" ref-type="bibr">17</xref><xref rid="b19" ref-type="bibr">18</xref><xref rid="b24" ref-type="bibr">2</xref>. Self-evaluation (SE) is a variant of SM, where students attend to their own behavior and evaluate it relative to an objective standard or an external evaluator <xref rid="b1" ref-type="bibr">19</xref><xref rid="b13" ref-type="bibr">1</xref><xref rid="b24" ref-type="bibr">2</xref>. Students also receive reinforcement for the accuracy of their self-rating, in terms of how close their rating resembled the teacher's rating <xref rid="b1" ref-type="bibr">19</xref>. It has been two decades since <xref rid="b24" ref-type="bibr">2</xref>, in their literature review on SM applications for students with EBD, noted the lack of research in general education inclusive settings. <xref rid="b6" ref-type="bibr">20</xref> recently conducted another literature review examining the configurations of SM in school-based research. Their review indicates only a few studies in elementary school settings that have incorporated SE. There is still more to learn about SE applications in elementary school settings and with students with EBD.</p>
      <p>An early example of SE can be found at <xref rid="b1" ref-type="bibr">19</xref>, who studied how skilled elementary students (age 9-11) exhibiting behavioral and/or academic problems associated with ADHD can accurately evaluate their social behavior, disruptions, and out-of-seat behavior. Students were required to evaluate the amount of time they thought they were engaged in the target behavior (e.g., being out of their seat) using a four-point Likert scale. A symbol representing time (i.e., open and partially closed circles) and a written description (e.g., little amount of the time) appeared next to each point to aid understanding of the evaluation procedure. Students' disruptive behaviors decreased, particularly after they received training in SE accuracy. The researchers concluded that elementary students with problem behaviors can be trained to accurately evaluate their behavior <xref rid="b1" ref-type="bibr">19</xref>.</p>
      <p>Both SE and TR are considered universal teacher practices aimed to support students' behavior and minimize behavioral escalation. <xref rid="b22" ref-type="bibr">10</xref> pinpointed the limited research of universal evidence-based practices in educational settings serving students with EBD. More research is needed in these settings. <xref rid="b4" ref-type="bibr">14</xref> argued that although TR interventions are commonly used as a universal practice to support students with special needs, they might be limited in promoting students' self-control, independence and generalization, due to their inherent teacher-control locus. SE interventions could alleviate these limitations. As a student-managed intervention, SE could also be cost-effective by making more instructional time available for the teacher.</p>
      <p>Considering the importance of providing behavioral support to students where their actual placement is, and the great need of students with EBD for behavioral support interventions, the purpose of this pilot investigation was to examine the efficacy of two universal teacher practices: TR and SE intervention. The main research question was, "What are the differential effects of TR and SE interventions on ASR of a student in an EBD self-contained classroom." The research also examined the collateral effects of the interventions on on-task responding. Finally, the study examined the student's level and accuracy of SE. Social validity data on the interventions' social acceptability were also collected and examined. The TR intervention has been commonly used in this classroom, while SE was novel to the teacher and the student. The study contributes to the existing literature by (a) evaluating the effectiveness of the universal practices (TR and SE) in a comparative single-case design, (b) expanding the research on SE interventions in inclusive elementary school settings and (c) documenting research on universal teacher practices in a middle-eastern country.</p>
    </sec>
    <sec>
      <title>METHOD</title>
      <p/>
      <p>This research was reviewed and approved by the chief science officer of the Israeli Ministry of Education. The participant, his parents, and the teacher gave their informed permission and assent to participate in the study. Methods of this case study were based on previous validated procedures (e.g., <xref rid="b1" ref-type="bibr">19</xref><xref rid="b26" ref-type="bibr">21</xref>.</p>
    </sec>
    <sec>
      <title>THE PARTICIPANT</title>
      <p/>
      <p>The participant in this study was a fifth-grade male student named Yaron (pseudonym). Yaron was 10.6 years old and this was his first year attending a self-contained classroom for students with EBD. Yaron was diagnosed with ADHD, ODD and a learning disability. He had been treated with Methylphenidate for 2 years prior to the onset of the study. His medical treatment was gradually faded, as requested by his parents. He ceased medication entirely a month prior to the onset of the study and was not taking any medication during the study. The weening period was abundant with disruptive behaviors.</p>
      <p>The Functional Analysis Screen Tool (FAST; <xref rid="b16" ref-type="bibr">22</xref> was used for the completion of Yaron's Functional Behavior Assessment (FBA). The FBA outcomes depicted Yaron was displaying severe disruptive behaviors for over 12 months, such as screaming at staff and students, interrupting class, loitering outside the classroom, physically assaulting students, and destroying school property. Yaron's homeroom teacher described him as short-tempered, impulsive and very talkative. He continuously imposed his thoughts and ideas on others, to the extent of disrupting the lesson. Most of his remarks were irrelevant to the ongoing learning in class and therefore pervasively interrupted the lesson. When asked to delay or restrain his irrelevant engagement (e.g., you can share this idea with us during recess time), Yaron typically responded by screaming and refusing to comply with instructions. Scatter plot data indicated that on average, Yaron was off-task and disruptive in 54% of the weekly lessons. These behaviors occurred daily in every lesson aside from physical education and science. The teacher assessed his problem behaviors as highly disruptive but with little risk to property or health. He was the most behaviorally concerning student in the classroom. The FAST scoring summary resulted in social attention as the primary potential source of reinforcement for Yaron's problem behaviors, and escape from tasks or activities as a secondary source.</p>
      <p>Academically, Yaron was in the 70th percentile of his class. His Individualized Education Plan (IEP) consisted of language arts, math, and emotional-behavioral objectives. The educational team was challenged by his impulsive behavior and was ill-equipped to design appropriate objectives and activities to address the impulsivity. Yaron's language arts proficiency varied by topic. His reading comprehension and grammar skills were at the fourth-grade level and his oral expression was at the third-grade level. Writing skills were Yaron's main area of difficulty, as he performed at the second-grade level. Yaron's handwriting was sloppy and hard to decipher. Due to these ongoing difficulties, the homeroom special education teacher invited the research team, who were behavior analysts, to assist with an intervention aimed at improving Yaron's behavior regulation.</p>
    </sec>
    <sec>
      <title>SETTING AND MATERIALS</title>
      <p/>
      <p>The study was conducted at an elementary school in a central city in Israel serving approximately 600 students. Yaron was attending a fifth-grade classroom for students with EBD (N=10). Similar to the description in <xref rid="b28" ref-type="bibr">23</xref>, classrooms for students with EBD in Israel are primary placements for students whose main diagnosis is ADHD, ODD, and conduct disorder. Students placed in an EBD classroom might have comorbid diagnoses such as anxiety disorder or a learning disability. These classrooms are characterized by a high frequency of externalizing problem behaviors and low rates of desired behaviors.</p>
      <p>The study was conducted during language arts lessons, three times a week (i.e., two consecutive lessons each time, totaling six weekly lessons). Lessons included grammar, reading comprehension, and written and oral expression. Language arts sequencing, the pace of content, and level of difficulty were tailored for each student based on their performance levels as detailed in their IEP.</p>
      <p>The homeroom teacher had been a special educator for 10 years and this was her second-year teaching that group of students. She had been implementing a TR system regularly for more than 4 years, targeting classroom rule-following behaviors (e.g., be ready with your learning materials on the desk). The teacher was unfamiliar with the SE intervention but was enthusiastic about the opportunity to learn a new behavioral skill and address students' low engagement in class. She requested that the two interventions be applied to all students in her class. The research team collected data only on Yaron's behavior.</p>
      <p>For the SE intervention, the researchers used a wooden clip and a laminated 10X30 cm rectangle cardboard with a four-square column printed on it, which represented a medal scale of gold, silver, and bronze medals and an empty (i.e., white) square at the bottom. For the TR intervention, the researchers used a 5X8 cm laminated ticket called "Like" showing a thumbs-up picture, and a 5X8 cm "Golden Like" ticket. Discriminative stimuli in the form of visual symbols were alternately hung on the classroom whiteboard to signal which intervention was in effect. An enlarged medal scale (a 20X40 cm laminated cardboard with a green background) signaled SE, an enlarged golden "Like" ticket (40X40 cm laminated cardboard with orange background) signaled TE.</p>
    </sec>
    <sec>
      <title>Response Definitions and Measurement</title>
      <p/>
      <p>Dependent variables were ASR and on-task behavior. Active student response was defined based on previ-www.internationalsped.com Shiri Ayvazo, Avner Fraidlin, Ronit Kankazil -Maimon ous research (i.e., <xref rid="b18" ref-type="bibr">7</xref> as a hand raise above head height within 10 sec following the teacher's question and before another student's response. Observational data were collected live using an event recording method during the 20 min of acquisition time. Data were calculated and presented as the mean percentage of ASR out of total OTR.</p>
      <p>On-task behavior was also defined, based on previous research <xref rid="b26" ref-type="bibr">21</xref>, as any observable response made by the student that complied with instructions given by the teacher. Observers collected on-task data during a 20-min independent practice segment of the lesson, which was not supplemented with the intervention. Data were collected using a 10-sec whole-interval recording method. The teacher validated the definitions of ASR and on-task behavior.</p>
      <p>The study also measured data on permission to respond and the accuracy of SE. Permission to respond was defined as responding to the teacher's question after being permitted either by a head nod or by verbal permission (e.g., "Yes, Yaron"). Permission data were collected using an event recording method. Data were calculated and presented as the mean percentage of permissions to respond. Accuracy of the evaluation was defined as the match between the participant's SE of ASR and the actual raw data collected by the observers on ASR. Accuracy was recorded using the permanent product of Yaron's evaluation and the ASR percentage data collected by the observers.</p>
      <p>All aforementioned dependent variables were collected live in the classroom by three graduate-level behavior analysts with experience in observation and data collection methods. All observers were trained to collect live data on the dependent variables across all research conditions. The live observation was advantageous as the observers positioned themselves in vantage locations that allowed the detection of the student's and the teacher's verbal and non-verbal responses. Their presence in the classroom allowed great familiarity with the lessons' contextual variables that could be undetected in video recordings. Participants' reactivity to the observers in the classroom is a known drawback of live coding. One observer attended the class a few times before the beginning of the study to reduce possible students' reactivity and to collect preliminary data on participation levels and types of questions asked during language arts lessons. A second observer has been working as a behavior analyst in this classroom and the participant was acquainted with her. Finally, the observers stood in a permanent location at the back of the classroom away from students' sight.</p>
      <p>The study also examined social validity like <xref rid="b18" ref-type="bibr">7</xref> social validity assessment. A short interview was conducted with Yaron and a questionnaire was given to the teacher at the end of the study. The interview included seven questions regarding the execution of the interventions, level of difficulty, and level of satisfaction, for example: "Which of the interventions did you prefer most?" The teacher's questionnaire comprised 16 questions about the implementation of the interventions and their feasibility and suitability to the teacher, to the class, and to Yaron. For instance, one question was, "Which of the two interventions was more suitable for Yaron and why?"</p>
    </sec>
    <sec>
      <title>Experimental Design and Procedures</title>
      <p/>
      <p>This study entailed a single-case design (SCD) approach, that is commonly used to define and examine educational practices at the level of the individual learner <xref rid="b8" ref-type="bibr">16</xref><xref rid="b15" ref-type="bibr">24</xref>. SCD use individuals as their own control and collect repeated measures of one or more dependent variables (DV) in the presence and absence of a practice manipulated by the researcher (i.e., the independent variable, IV) over time <xref rid="b15" ref-type="bibr">24</xref>. The important elements to consider when evaluating SCD are methodological features associated with internal validity such as adequate interobserver agreement (IOA), treatment integrity data and repeated measurement over time; and experimental control evaluated by visually inspecting the graphed data to assess functional relations between the IV and the DV <xref rid="b8" ref-type="bibr">16</xref>.</p>
      <p>One of the appropriate and acceptable SCD is an Alternating Treatments Design (ATD). In ATD the researcher conducts rapid and frequent alternations of conditions in a manner that allows for comparisons between them. <xref rid="b21" ref-type="bibr">25</xref> argue that ATD is particularly useful in applied research due to its ability to compare different interventions' efficacy in applied settings, as opposed to the comparison that baseline interventions offer. The rapid and frequent alternation and comparison of treatments also allow for several demonstrations of the interventions' impact in a brief period. The current study used ATD with an initial baseline phase <xref rid="b3" ref-type="bibr">26</xref> to compare the effects of TR and SE on Yaron's classroom performance. The baseline condition consisted of 10 data points, and the two interventions (i.e., TR and SE) were delivered randomly and interchangeably across 24 days.</p>
    </sec>
    <sec>
      <title>Baseline Phase</title>
      <p/>
      <p>Typical instruction during the baseline phase did not involve any special contrived contingencies for impacting ASR beyond occasional verbal praise and prompts to participate (e.g., "I want to see more participants"). Each lesson began with a brief review of previous objectives (e.g., prefixes, suffixes, and roots) followed by a wholeclass 20-min segment for the acquisition of new content. Acquisition entailed questions and students were expected to respond with a hand raise. The interventions were applied throughout this segment. Next, students continued with personal-level independent practice until the lesson's end. The teacher guided as needed during this segment. The interventions were non-active during the independent practice time. These three segments (i.e., review, acquisition, and practice) were maintained throughout the study.</p>
    </sec>
    <sec>
      <title>TR and SE Training</title>
      <p/>
      <p>Two training sessions (one for each intervention) were delivered for all students in the class. Training for TR included the practice of appropriate ASR using examples and nonexamples. The teacher introduced the token that would be awarded for appropriate and frequent ASR. Students then practiced ASR during language arts lessons. At the conclusion of the practice, the teacher praised students who demonstrated high levels of ASR and awarded them with the "like" token. She also encouraged those who did not meet the criteria to try harder next time.</p>
      <p>Training for SE began with the teacher's explanation of SE, the medal scale, and contingencies pertaining to each of the medals. She explained that gold to bronze medal levels varied from responding to a majority of the questions to responding to only a few questions (accordingly) and that no-medal (i.e., the empty square on the scale) represented no participation at all. Each student received their own medal scale and a wooden clip and practiced placing the different squares. Next, students practiced attending to their participation level and evaluating it during short mock teaching segments. The teacher provided feedback to students on their SE and participation. These short simulations were repeated several times during the training session to promote students' acquisition of SE skills related to ASR. On day 22 all students in the class received a booster practice to enhance their SE accuracy.</p>
    </sec>
    <sec>
      <title>Token Reinforcement Intervention</title>
      <p/>
      <p>Each lesson began with the teacher reminding students of her expectation for ASR and the token reinforcer (i.e., the "like" ticket) for appropriate active participation. She placed the TR corresponding visual discriminative stimulus on the board to signal the intervention in effect. At the end of the acquisition segment, the teacher praised students who actively responded to more than 50% of the questions posed and gave them a token that could be exchanged for a social reinforcer (e.g., a picture with the teacher) or a tangible item (e.g., erasers). The teacher briefly consulted the researchers, who observed and collected data, to determine students' participation levels. After 16 intervention sessions, and following a class-wide preference assessment, a backup reinforcer was introduced, and students could redeem their earned and accumulated tokens toward the classroom token economy system that had been used regularly during other classes (excluding language arts).</p>
    </sec>
    <sec>
      <title>Self-Evaluation</title>
      <p/>
      <p>Each lesson began with the teacher reminding students of her expectation for ASR and the SE (i.e., medal scale) to be used to evaluate active participation. She placed the SE corresponding visual discriminative stimulus on the board to signal the intervention in effect and reminded the students of the four levels of participation performance. At the end of the acquisition segment, the teacher asked the students to evaluate their participation using their medal scale. After visually scanning students' reports, she praised those who participated at the gold level, provided corrective feedback to students whom she thought evaluated their performance inaccurately, and praised a selected student for an honest evaluation. Finally, the teacher encouraged students to strive for higher-level participation in the next lesson.</p>
    </sec>
    <sec>
      <title>Interobserver Agreement (IOA) and Treatment Integrity</title>
      <p/>
      <p>The percentage of IOA for ASR, permission to respond, and on-task behavior were calculated by dividing the number of agreements by the number of agreements plus disagreements and multiplying by 100. IOA for ASR and permission to respond was obtained for 35% of the sessions; IOA for ASR averaged 93% (range: 82%-100%) and IOA for permission to respond averaged 97% (range: 87%-100%). Interobserver agreement for on-task behavior was obtained for 41% of the sessions and averaged at 89% (range: 60%-100%).</p>
      <p>Two observers assessed treatment fidelity at the conclusion of every lesson via systematic direct observation of the occurrence or absence of the main components of the interventions: visual discriminative stimulus on the board, reminder of the expected behaviors, token and verbal praise given for responding to most questions during acquisition, abstention from exceedingly powerful verbal praise or prompts for participation and SE using the medal scale and contingent praise. Both interventions were www.internationalsped.com Shiri Ayvazo, Avner Fraidlin, Ronit Kankazil -Maimon executed with 100% accuracy on all items, excluding abstention which was achieved with 92.5% accuracy. <italic>Figure 1</italic> depicts the average percentage of Yaron's ASR and of permission given to respond across all research conditions. Yaron's ASR during the baseline phase was 32% (range: 9%-53%), and he increased his ASR to 72% (range: 43%-96%) under the TR intervention and 74% (range: 43%-95%) under the SE intervention. Yaron received permission to respond on 23% (range: 0%-50%) of ASR occurrences during the baseline phase. He was given permission to respond on 21% (range: 4%-52%) of the ASR occurrences during TR and on 16% (range: 5%-33%) of occurrences during SE.     Figure 2 depicts Yaron's ASR point-by-point performance throughout the study. His ASR performance during the baseline condition averaged 32% with variability and a slightly increasing trend. His ASR improved once interventions were introduced to 72% under the TR intervention and 74% under the SE intervention. An increasing trend was inspected under the two interventions with variability. Yaron's ASR performance stabilized above 90% in the last four sessions of the study, for both interventions. The percentage of non-overlapping data (PND) for each intervention was calculated by dividing the number of intervention data points that exceeded the highest baseline data point by the total number of intervention data points. The PND for TR was 87% and for SE it was 83%, yielding a moderately effective effect size <xref rid="b17" ref-type="bibr">27</xref>. <italic>Figure 3</italic> depicts Yaron's on-task behavior during the practice segment of each lesson. Data path appears as a dotted line since on-task measures were collected subsequent to the intervention. Average on-task behavior during the baseline phase was 67% (range: 31%-100%) with high variability and a decreasing trend followed by a decreasing trend. During the TR intervention, Yaron's on-task behavior increased to an average of 81% (range: 29%-100%) and of 81% during SE intervention (range: 53%-100%). On-task data during the interventions showed a variable trend, with frequent overlap with baseline data.</p>
    </sec>
    <sec>
      <title>RESULTS</title>
      <p/>
      <p>www.internationalsped.com <italic>Shiri Ayvazo, Avner Fraidlin, Ronit Kankazil -Maimon</italic> We measured the accuracy of Yaron's SE by tracking his SE selection and then dividing the number of accurate evaluations (compared to the observer's evaluations) by the total number of evaluations made. Data are presented in <italic>Table 1</italic>. Yaron evaluated his participation at the gold level 23 times (i.e., 92%) and once at the silver level. Twenty of the evaluations were accurate, reaching 83% accuracy.</p>
      <p>Social validity was assessed at the end of the study. Yaron reported in the interview that he liked both interventions, but preferred SE over TR since it was easier for him to SE his behavior and achieve an award using the medal scale than earning a token from the teacher under TR. Yaron thought he participated equally under each intervention. He also wanted to continue using both strategies in lessons other than language arts. The teacher reported she found both interventions useful, feasible, and suitable for her students. She thought TR was more suitable for Yaron because, in her opinion, he needed external reinforcement from an adult. She also thought his engagement in class improved. He seemed more regulated and less impulsive and made efforts to attend class discussions. She also noticed his on-task behavior during independent practice markedly improved upon success in the preceding acquisition segment. Lastly, his behavior conduct under intervention was better than in other lessons she taught without those interventions.</p>
    </sec>
    <sec>
      <title>DISCUSSION</title>
      <p/>
      <p>This pilot investigation compared the differential effects of two universal practices, TR and SE, on EBD self-contained classroom students' ASR. The study also examined the collateral effects of the interventions on on-task responding. Finally, the study examined the student's level and accuracy of SE and examined the social validity of the interventions. The TR intervention has been in use by the classroom teacher, while SE was a novel intervention for the teacher and the student. The two evaluated interventions resulted in a moderate positive impact on the student's ASR. The improvement in ASR performance was comparable in both interventions, although SE, was novel for the teacher and student while TR was conventionally used. These findings possibly demonstrate the potential value of SE on the behavior management of students with EBD. The current data show the participant, who was severely lacking self-control and experiencing disturbing behavior and conduct problems, evaluated his participation at the gold level 92% of the opportunities. He was accurate 83% of the time, based on the actual data collected by the observers. One hypothesis could be that Yaron rated himself "gold" all of the time, suggesting he was responding to the gold stimulus in the evaluations, rather than to his actual performance. However, since Yaron's SE data co-occurred simultaneously with an increase in his actual appropriate engagement in the classroom, we cautiously hypothesize that the participant's repeated assessment of his engagement at the gold level indicates increased effort to self-manage and meet the teacher's expectations regarding the target behavior. Previous findings by <xref rid="b1" ref-type="bibr">19</xref> and <xref rid="b10" ref-type="bibr">28</xref> offer similar observations. Elementary students with problem behaviors can successfully evaluate their behavior.</p>
      <p>This pilot investigation contributes to our clinical insights. Both TR and SE made an equally-comparable impact at the student's individual level. We carefully suggest that if a student with EBD can be taught to self-evaluate, then SE can be more valuable over a teacher-managed intervention in several ways. First, by promoting the acquisition of self-management among students who may need it most. Second, by extending the adaptive skillset and independence of students who demonstrate the greatest deficits in these areas. Third, by teaching a strategy that could assist students to generalize conduct and achievements across different conditions. Fourth, by reducing the behavior-management load from the teacher and possibly making more time available for instruction <xref rid="b1" ref-type="bibr">19</xref><xref rid="b4" ref-type="bibr">14</xref>). The social validity data also support these insights. The teacher acknowledged that SE allowed for more time to be dedicated to instruction and feedback as the student took responsibility for regulating his behavior. The participant also reported preferring SE over TR.</p>
      <p>On-task behavior showed only mild improvement. We suspect improvement in on-task behavior is better explained as a collateral positive change. Increases in on-task behavior may have been a function of increased ASR. The participant may have been more likely to engage in behaviors related to the assignment (i.e., staying on task) during the independent practice due to the preceding activity where he was responding to discriminative stimuli (i.e., OTR) and his response was differentially reinforced (e.g., praise or tokens for correct responses). The on-task finding does not shed light on a generalization of classroom engagement to un-intervened times and should be further examined under more rigorous research conditions. This pilot investigation might also contribute to ecological validity by examining the validity of two universal practices in a real-world self-contained classroom setting that accurately reflect students' placement as suggested by <xref rid="b24" ref-type="bibr">2</xref>. The behavior analysts providing the service in this setting pursued a research plan and empirically monitored the classroom interventions within a case-study capacity. These conditions also explain the limitations of this pilot study. The first limitation is the measurement of performance of a single participant in a SCD, which critically limits the generalization of findings. Future applications should specifically examine the effects of SE on a larger sample of participants with EBD in their natural educational settings. Second, the variable and comparable nature of the findings of the alternating treatments posed a threat to internal validity. A return to baseline consequently of the alternating treatments phase and reintroduction of each condition discretely could have substantiated the superiority of one intervention over the other. Third, this study is limited by the fact that it did not measure academic outcomes associated with increased ASR.</p>
      <p>All in all, the preliminary results of this study contribute to translating research into practice in two ways. First, this investigation adds information on SE as an IV in an elongated ATD. Second, this study generates empirical findings from two universal teacher practices executed in a real-world setting that accurately reflect students' placement (i.e., a self-contained classroom within a public-school elementary setting) as encouraged by <xref rid="b24" ref-type="bibr">2</xref> and <xref rid="b6" ref-type="bibr">20</xref>.</p>
    </sec>
    <sec>
      <title>IMPLICATIONS FOR PRACTICE</title>
      <p/>
      <p>Three implications for special educators and professionals (e.g., behavior analysts) who support students with EBD emerge from this study. First, teachers of students with EBD should carefully consider the suitability of interventions to students' needs. Self-management and SE techniques could be as good as TR in terms of lesson conduct, but better than TR in terms of the skillset it allows students to acquire. Second, although we collected data on a single participant, SE was implemented with the entire class classroom and served the teacher well as a universal intervention. SE could also be implemented at the individual level to support those students with EBD, who are placed in general education classrooms, or those who are based in a self-contained classroom and participate in a few weekly classes in the inclusive classroom. Third, when using SE, we recommend utilizing a criteria system of gold, silver, and bronze medals. Students in the current study were excited and motivated to use the medals' system, possibility due to their general acquaintance with the reinforcing qualities of medals in sports, and in other areas of performance.</p>
    </sec>
    <sec>
      <fig id="fig_0" orientation="portrait" fig-type="graphic" position="anchor">
        <caption>
          <title>Doi: https://doi.org/10.52291/ijse.2022.37.26A single case examination of token reinforcement ...</title>
        </caption>
      <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://upload.wikimedia.org/wikipedia/commons/6/66/SMPTE_Color_Bars.svg"/>
        </fig>
    </sec>
    <sec>
      <fig id="fig_2" orientation="portrait" fig-type="graphic" position="anchor">
        <caption>
          <title>Average percentage of Yaron's Active Student Responding (ASR, left half) and of permission given by the teacher to respond (right half) across Baseline (BL), Token Reinforcement (TR) and Self-evaluation (SE).</title>
        </caption>
      <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://upload.wikimedia.org/wikipedia/commons/6/66/SMPTE_Color_Bars.svg"/>
        </fig>
    </sec>
    <sec>
      <fig id="fig_3" orientation="portrait" fig-type="graphic" position="anchor">
        <caption>
          <title>Yaron's percentage of ASR throughout the study.</title>
        </caption>
      <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://upload.wikimedia.org/wikipedia/commons/6/66/SMPTE_Color_Bars.svg"/>
        </fig>
    </sec>
    <sec>
      <fig id="fig_5" orientation="portrait" fig-type="graphic" position="anchor">
        <caption>
          <title>Yaron's on-task behavior during the practice segment of each lesson. Dotted line represents average level of on-task behavior.</title>
        </caption>
      <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://upload.wikimedia.org/wikipedia/commons/6/66/SMPTE_Color_Bars.svg"/>
        </fig>
    </sec>
    <sec>
      <table-wrap id="tab_0" orientation="portrait">
        <table/>
        <caption>
          <title>Yaron's self-evaluation and its accuracy</title>
        </caption>
      </table-wrap>
    </sec>
  </body>
  <back>
    <ref-list>
      <title>References</title><ref id="b26">
        <element-citation publication-type="journal">
          <article-title>Increasing on-task behavior in students in a regular classroom: Effectiveness of a self-management procedure using a tactile prompt</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>D</given-names>
              <surname>Moore</surname>
            </name>
            <name>
              <given-names>A</given-names>
              <surname>Anderson</surname>
            </name>
            <name>
              <given-names>M</given-names>
              <surname>Glassenbury</surname>
            </name>
            <name>
              <given-names>R</given-names>
              <surname>Lang</surname>
            </name>
            <name>
              <given-names>R</given-names>
              <surname>Didden</surname>
            </name>
          </person-group>
          <source>Journal of Behavioral Education</source>
          <volume>22</volume>
          <fpage>302</fpage>
          <lpage>311</lpage>
          <year>2013</year>
        </element-citation>
        </ref>
      <ref id="b30">
        <element-citation publication-type="journal">
          <article-title>Implementation of promising practices that support students with emotional and behavioral disorders</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>I</given-names>
              <surname>Zaheer</surname>
            </name>
            <name>
              <given-names>D</given-names>
              <surname>Maggin</surname>
            </name>
            <name>
              <given-names>S</given-names>
              <surname>Mcdaniel</surname>
            </name>
            <name>
              <given-names>K</given-names>
              <surname>Mcintosh</surname>
            </name>
            <name>
              <given-names>B J</given-names>
              <surname>Rodriguez</surname>
            </name>
            <name>
              <given-names>J B</given-names>
              <surname>Fogt</surname>
            </name>
          </person-group>
          <source>Behavioral Disorders</source>
          <volume>44</volume>
          <issue>2</issue>
          <fpage>117</fpage>
          <lpage>128</lpage>
          <year>2019</year>
        </element-citation>
        </ref>
      <ref id="b20">
        <element-citation publication-type="journal">
          <article-title>A systematic evaluation of token economies as a classroom management tool for students with challenging behavior</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>D M</given-names>
              <surname>Maggin</surname>
            </name>
            <name>
              <given-names>S M</given-names>
              <surname>Chafouleas</surname>
            </name>
            <name>
              <given-names>K M</given-names>
              <surname>Goddard</surname>
            </name>
            <name>
              <given-names>A H</given-names>
              <surname>Johnson</surname>
            </name>
          </person-group>
          <source>Journal of School Psychology</source>
          <volume>49</volume>
          <issue>5</issue>
          <fpage>529</fpage>
          <lpage>554</lpage>
          <year>2011</year>
        </element-citation>
        </ref>
      <ref id="b28">
        <element-citation publication-type="journal">
          <article-title>Yoga in an urban school for children with emotional and behavioral disorders: A feasibility study</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>N J</given-names>
              <surname>Steiner</surname>
            </name>
            <name>
              <given-names>T K</given-names>
              <surname>Sidhu</surname>
            </name>
            <name>
              <given-names>P G</given-names>
              <surname>Pop</surname>
            </name>
            <name>
              <given-names>E C</given-names>
              <surname>Frenette</surname>
            </name>
          </person-group>
          <source>Journal of Child and Family Studies</source>
          <volume>22</volume>
          <issue>6</issue>
          <fpage>815</fpage>
          <lpage>826</lpage>
          <year>2013</year>
        </element-citation>
        </ref>
      <ref id="b2">
        <element-citation publication-type="journal">
          <article-title>Promoting active responding of students with Emotional-Behavioral Disorders through behavioral strategies</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>S</given-names>
              <surname>Ayvazo</surname>
            </name>
            <name>
              <given-names>A</given-names>
              <surname>Fraidlin</surname>
            </name>
            <name>
              <given-names>R</given-names>
              <surname>Kankazil-Maimon</surname>
            </name>
          </person-group>
          <source>Issues in Special Education and Inclusion</source>
          <volume>30</volume>
          <fpage>7</fpage>
          <lpage>24</lpage>
          <year>2020</year>
        </element-citation>
        </ref>
      <ref id="b19">
        <element-citation publication-type="journal">
          <article-title>An application of the What Works Clearinghouse standards for evaluating single-subject research: Synthesis of the self-management literature base</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>D M</given-names>
              <surname>Maggin</surname>
            </name>
            <name>
              <given-names>A M</given-names>
              <surname>Briesch</surname>
            </name>
            <name>
              <given-names>M</given-names>
              <surname>Chafouleas</surname>
            </name>
          </person-group>
          <source>Remedial and Special Education</source>
          <volume>34</volume>
          <issue>1</issue>
          <fpage>44</fpage>
          <lpage>58</lpage>
          <year>2013</year>
        </element-citation>
        </ref>
      <ref id="b5">
        <element-citation publication-type="misc">
          <person-group person-group-type="author">
            <name>
              <given-names>Shiri</given-names>
              <surname>Ayvazo</surname>
            </name>
            <name>
              <given-names>Avner</given-names>
              <surname>Fraidlin</surname>
            </name>
          </person-group>
        </element-citation>
        </ref>
      <ref id="b9">
        <element-citation publication-type="journal">
          <article-title>Combining self-monitoring and interdependent group contingency to improve the behavior of sixth graders with EBD</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>H</given-names>
              <surname>Denune</surname>
            </name>
            <name>
              <given-names>R</given-names>
              <surname>Hawkins</surname>
            </name>
            <name>
              <given-names>L</given-names>
              <surname>Donovan</surname>
            </name>
            <name>
              <given-names>D</given-names>
              <surname>Mccoy</surname>
            </name>
            <name>
              <given-names>L</given-names>
              <surname>Hall</surname>
            </name>
            <name>
              <given-names>A</given-names>
              <surname>Moeder</surname>
            </name>
          </person-group>
          <source>Psychology in the Schools</source>
          <volume>52</volume>
          <issue>6</issue>
          <fpage>562</fpage>
          <lpage>577</lpage>
          <year>2015</year>
        </element-citation>
        </ref>
      <ref id="b29">
        <element-citation publication-type="misc">
          <person-group person-group-type="author">
            <name>
              <given-names>R</given-names>
              <surname>Trussell</surname>
            </name>
            <name>
              <given-names>P</given-names>
              <surname>Lewis</surname>
            </name>
            <name>
              <given-names>T J</given-names>
              <surname>Raynor</surname>
            </name>
            <name>
              <given-names>C</given-names>
              <surname/>
            </name>
          </person-group>
          <source>The impact of universal teacher practices and function-based behavior interventions on the rate of problem behaviors among at-risk students. Education and Treatment of Children</source>
          <comment>
            <uri>http://www.jstor.org/stable/44684109</uri>
          </comment>
          <volume>39</volume>
          <fpage>261</fpage>
          <lpage>282</lpage>
          <year>2016</year>
        </element-citation>
        </ref>
      <ref id="b8">
        <element-citation publication-type="journal">
          <article-title>Self-management for primary school students demonstrating problem behavior in regular classrooms: Evidence review of single-case design research</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>M L</given-names>
              <surname>Busacca</surname>
            </name>
            <name>
              <given-names>A</given-names>
              <surname>Anderson</surname>
            </name>
            <name>
              <given-names>D W</given-names>
              <surname>Moore</surname>
            </name>
          </person-group>
          <source>Journal of Behavioral Education</source>
          <volume>24</volume>
          <issue>2</issue>
          <fpage>373</fpage>
          <lpage>401</lpage>
          <year>2015</year>
        </element-citation>
        </ref>
      <ref id="b0">
        <element-citation publication-type="journal">
          <article-title>Diagnostic and Statistical Manual of Mental Disorders</article-title>
          <source>American Psychiatric Association</source>
          <year>2013</year>
          <publisher-name>American Psychiatric Publishing</publisher-name>
        </element-citation>
        </ref>
      <ref id="b3">
        <element-citation publication-type="journal">
          <article-title>Alternating treatments design: One strategy for comparing the effects of two treatments in a single subject</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>D H</given-names>
              <surname>Barlow</surname>
            </name>
            <name>
              <given-names>S C</given-names>
              <surname>Hayes</surname>
            </name>
          </person-group>
          <source>Journal of Applied Behavior Analysis</source>
          <volume>12</volume>
          <issue>2</issue>
          <fpage>199</fpage>
          <lpage>210</lpage>
          <year>1979</year>
        </element-citation>
        </ref>
      <ref id="b10">
        <element-citation publication-type="misc">
          <person-group person-group-type="author">
            <name>
              <given-names>G J</given-names>
              <surname>Dupaul</surname>
            </name>
            <name>
              <given-names>L L</given-names>
              <surname>Weyandt</surname>
            </name>
            <name>
              <given-names>G M</given-names>
              <surname>Janusis</surname>
            </name>
          </person-group>
          <source>ADHD in the classroom: Effective intervention strategies. Theory into Practice</source>
          <comment>
            <uri>https://doi.org/10.1080/00405841.2011.534935</uri>
          </comment>
          <volume>50</volume>
          <fpage>35</fpage>
          <lpage>42</lpage>
          <year>2011</year>
        </element-citation>
        </ref>
      <ref id="b11">
        <element-citation publication-type="journal">
          <article-title>Effects of school-wide positive behavioral interventions and supports and fidelity of implementation on problem behavior in high schools</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>K</given-names>
              <surname>Flannery</surname>
            </name>
            <name>
              <given-names>B</given-names>
              <surname>Fenning</surname>
            </name>
            <name>
              <given-names>P</given-names>
              <surname>Mcgrath Kato</surname>
            </name>
            <name>
              <given-names>M</given-names>
              <surname>Mcintosh</surname>
            </name>
            <name>
              <given-names>K</given-names>
              <surname/>
            </name>
          </person-group>
          <source>School Psychology Quarterly</source>
          <volume>29</volume>
          <fpage>111</fpage>
          <lpage>124</lpage>
          <year>2014</year>
        </element-citation>
        </ref>
      <ref id="b22">
        <element-citation publication-type="journal">
          <article-title>School-wide positive behvioral interventions and supports for students with emotional and behavioral disorders</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>B L</given-names>
              <surname>Mccurdy</surname>
            </name>
            <name>
              <given-names>L</given-names>
              <surname>Thomas</surname>
            </name>
            <name>
              <given-names>A</given-names>
              <surname>Truckenmiller</surname>
            </name>
            <name>
              <given-names>S H</given-names>
              <surname>Rich</surname>
            </name>
            <name>
              <given-names>P</given-names>
              <surname>Hillis-Clark</surname>
            </name>
            <name>
              <given-names>J C</given-names>
              <surname>Lopez</surname>
            </name>
          </person-group>
          <source>Psychology in the Schools</source>
          <volume>53</volume>
          <issue>4</issue>
          <fpage>375</fpage>
          <lpage>389</lpage>
          <year>2016</year>
        </element-citation>
        </ref>
      <ref id="b7">
        <element-citation publication-type="journal">
          <article-title>Self-monitoring interventions for students with behavior problems: A systematic of current research</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>A</given-names>
              <surname>Bruhn</surname>
            </name>
            <name>
              <given-names>S</given-names>
              <surname>Mcdaniel</surname>
            </name>
            <name>
              <given-names>C</given-names>
              <surname>Kreigh</surname>
            </name>
          </person-group>
          <source>Behavioral Disorders</source>
          <volume>40</volume>
          <issue>2</issue>
          <fpage>102</fpage>
          <lpage>121</lpage>
          <year>2015</year>
        </element-citation>
        </ref>
      <ref id="b21">
        <element-citation publication-type="journal">
          <article-title>Quantitative techniques and graphical representations for interpreting results from alternative treatment design</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>R</given-names>
              <surname>Manolov</surname>
            </name>
            <name>
              <given-names>R</given-names>
              <surname>Tanious</surname>
            </name>
            <name>
              <given-names>P</given-names>
              <surname>Onghena</surname>
            </name>
          </person-group>
          <source>Perspectives on Behavior Science</source>
          <volume>45</volume>
          <fpage>259</fpage>
          <lpage>294</lpage>
          <year>2022</year>
        </element-citation>
        </ref>
      <ref id="b4">
        <element-citation publication-type="journal">
          <article-title>Review and analysis of literature on self-management interventions to promote appropriate classroom behaviors</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>A M</given-names>
              <surname>Briesch</surname>
            </name>
            <name>
              <given-names>S M</given-names>
              <surname>Chafouleas</surname>
            </name>
          </person-group>
          <source>School Psychology Quarterly</source>
          <volume>24</volume>
          <issue>2</issue>
          <fpage>106</fpage>
          <lpage>118</lpage>
          <year>1988</year>
        </element-citation>
        </ref>
      <ref id="b12">
        <element-citation publication-type="journal">
          <article-title>Universal interventions: Fully exploring their impacts and potential to produce population-level impacts</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>M T</given-names>
              <surname>Greenberg</surname>
            </name>
            <name>
              <given-names>R</given-names>
              <surname>Abenavoli</surname>
            </name>
          </person-group>
          <source>Journal of Research on Educational Effectiveness</source>
          <volume>10</volume>
          <issue>1</issue>
          <fpage>40</fpage>
          <lpage>67</lpage>
          <year>2017</year>
        </element-citation>
        </ref>
      <ref id="b1">
        <element-citation publication-type="journal">
          <article-title>Training children to make accurate self-evaluation: Effects on behavior and the quality of self-rating</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>S P</given-names>
              <surname>Ardoin</surname>
            </name>
            <name>
              <given-names>B K</given-names>
              <surname>Martens</surname>
            </name>
          </person-group>
          <source>Journal of Behavioral Education</source>
          <volume>13</volume>
          <fpage>1</fpage>
          <lpage>23</lpage>
          <year>2004</year>
        </element-citation>
        </ref>
      <ref id="b23">
        <element-citation publication-type="journal">
          <article-title>Establishing and sustaining research-based practices at centennial school: A descriptive case study of systematic change</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>D N</given-names>
              <surname>Miller</surname>
            </name>
            <name>
              <given-names>M P</given-names>
              <surname>George</surname>
            </name>
            <name>
              <given-names>J B</given-names>
              <surname>Fogt</surname>
            </name>
          </person-group>
          <source>Psychology in the Schools</source>
          <volume>42</volume>
          <fpage>553</fpage>
          <lpage>567</lpage>
          <year>2005</year>
        </element-citation>
        </ref>
      <ref id="b13">
        <element-citation publication-type="journal">
          <article-title>The effects of function-based self-management interventions on student behavior</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>B D</given-names>
              <surname>Hansen</surname>
            </name>
            <name>
              <given-names>H P</given-names>
              <surname>Wills</surname>
            </name>
            <name>
              <given-names>D M</given-names>
              <surname>Kamps</surname>
            </name>
            <name>
              <given-names>C R</given-names>
              <surname>Greenwood</surname>
            </name>
          </person-group>
          <source>Journal of Emotional and Behavioral Disorders</source>
          <volume>22</volume>
          <issue>3</issue>
          <fpage>149</fpage>
          <lpage>159</lpage>
          <year>2014</year>
        </element-citation>
        </ref>
      <ref id="b24">
        <element-citation publication-type="journal">
          <article-title>A review of self-management interventions targeting academic outcomes for students with emotional and behavioral disorders</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>P</given-names>
              <surname>Mooney</surname>
            </name>
            <name>
              <given-names>J B</given-names>
              <surname>Ryan</surname>
            </name>
            <name>
              <given-names>B M</given-names>
              <surname>Uhing</surname>
            </name>
            <name>
              <given-names>R</given-names>
              <surname>Reid</surname>
            </name>
            <name>
              <given-names>M H</given-names>
              <surname>Esptein</surname>
            </name>
          </person-group>
          <source>Journal of Behavioral Education</source>
          <volume>14</volume>
          <issue>3</issue>
          <fpage>203</fpage>
          <lpage>221</lpage>
          <year>2005</year>
        </element-citation>
        </ref>
      <ref id="b25">
        <element-citation publication-type="misc">
          <person-group person-group-type="author">
            <name>
              <given-names/>
              <surname>Doi</surname>
            </name>
          </person-group>
          <comment>
            <uri>https://doi.org/10.52291/ijse.2022</uri>
          </comment>
        </element-citation>
        </ref>
      <ref id="b18">
        <element-citation publication-type="journal">
          <article-title>Effects of response cards on disruptive behavior and academic responding during math lessons by fourth-grade urban students</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>M C</given-names>
              <surname>Lambert</surname>
            </name>
            <name>
              <given-names>G</given-names>
              <surname>Cartledge</surname>
            </name>
            <name>
              <given-names>W L</given-names>
              <surname>Heward</surname>
            </name>
            <name>
              <given-names>Ya-Yu</given-names>
              <surname>Lo</surname>
            </name>
          </person-group>
          <source>Journal of Positive Behavior Interventions</source>
          <volume>8</volume>
          <issue>2</issue>
          <fpage>88</fpage>
          <lpage>99</lpage>
          <year>2006</year>
        </element-citation>
        </ref>
      <ref id="b14">
        <element-citation publication-type="journal">
          <article-title>A comparison of three types of opportunities to respond on student academic and social behaviors</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>T</given-names>
              <surname>Haydon</surname>
            </name>
            <name>
              <given-names>M A</given-names>
              <surname>Conroy</surname>
            </name>
            <name>
              <given-names>T M</given-names>
              <surname>Scott</surname>
            </name>
            <name>
              <given-names>P T</given-names>
              <surname>Sindelar</surname>
            </name>
            <name>
              <given-names>B R</given-names>
              <surname>Barber</surname>
            </name>
            <name>
              <given-names>A</given-names>
              <surname>Orlando</surname>
            </name>
          </person-group>
          <source>Journal of Emotional and Behavioral Disorders</source>
          <volume>18</volume>
          <fpage>27</fpage>
          <lpage>40</lpage>
          <year>2010</year>
        </element-citation>
        </ref>
      <ref id="b27">
        <element-citation publication-type="journal">
          <article-title>Using technology to increase opportunities to respond</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>A</given-names>
              <surname>Rila</surname>
            </name>
            <name>
              <given-names>S</given-names>
              <surname>Estrapala</surname>
            </name>
            <name>
              <given-names>A L</given-names>
              <surname>Bruhn</surname>
            </name>
          </person-group>
          <source>Beyond Behavior</source>
          <volume>28</volume>
          <issue>1</issue>
          <fpage>36</fpage>
          <lpage>45</lpage>
          <year>2019</year>
        </element-citation>
        </ref>
      <ref id="b6">
        <element-citation publication-type="journal">
          <article-title>Unpacking the term "Self-Management": Understanding intervention applications with the school-based literature</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>A M</given-names>
              <surname>Briesch</surname>
            </name>
            <name>
              <given-names>B</given-names>
              <surname>Daniels</surname>
            </name>
            <name>
              <given-names>M</given-names>
              <surname>Beneville</surname>
            </name>
          </person-group>
          <source>Journal of Behavioral Education</source>
          <volume>28</volume>
          <fpage>54</fpage>
          <lpage>77</lpage>
          <year>2019</year>
        </element-citation>
        </ref>
      <ref id="b15">
        <element-citation publication-type="journal">
          <article-title>The use of single-subject research to identify evidence-based practice in special education</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>R H</given-names>
              <surname>Horner</surname>
            </name>
            <name>
              <given-names>E G</given-names>
              <surname>Carr</surname>
            </name>
            <name>
              <given-names>J</given-names>
              <surname>Halle</surname>
            </name>
            <name>
              <given-names>G</given-names>
              <surname>Mcgee</surname>
            </name>
            <name>
              <given-names>S</given-names>
              <surname>Odom</surname>
            </name>
            <name>
              <given-names>M</given-names>
              <surname>Wolery</surname>
            </name>
          </person-group>
          <source>Exceptional Children</source>
          <volume>71</volume>
          <issue>2</issue>
          <fpage>165</fpage>
          <lpage>179</lpage>
          <year>2005</year>
        </element-citation>
        </ref>
      <ref id="b16">
        <element-citation publication-type="journal">
          <article-title>Reliability and validity of the functional analysis screening tool</article-title>
          <person-group person-group-type="author">
            <name>
              <given-names>B A</given-names>
              <surname>Iwata</surname>
            </name>
            <name>
              <given-names>I G</given-names>
              <surname>Deleon</surname>
            </name>
            <name>
              <given-names>E M</given-names>
              <surname>Roscoe</surname>
            </name>
          </person-group>
          <source>Journal of Applied Behavior Analysis</source>
          <volume>46</volume>
          <fpage>271</fpage>
          <lpage>284</lpage>
          <year>2013</year>
        </element-citation>
        </ref>
      <ref id="b17">
        <element-citation publication-type="misc">
          <person-group person-group-type="author">
            <name>
              <given-names>T R</given-names>
              <surname>Kratochwill</surname>
            </name>
            <name>
              <given-names>J</given-names>
              <surname>Hitchcock</surname>
            </name>
            <name>
              <given-names>R H</given-names>
              <surname>Horner</surname>
            </name>
            <name>
              <given-names>J R</given-names>
              <surname>Levin</surname>
            </name>
            <name>
              <given-names>S L</given-names>
              <surname>Odom</surname>
            </name>
            <name>
              <given-names>D M</given-names>
              <surname>Rindskopf</surname>
            </name>
            <name>
              <given-names>W R</given-names>
              <surname>Shadish</surname>
            </name>
          </person-group>
          <source>Single-case designs technical documentation</source>
          <comment>
            <uri>http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdf</uri>
          </comment>
          <year>2010</year>
        </element-citation>
        </ref>
    </ref-list>
  </back>
</article>
