WIXLIB

SEL-specific sources for identifying assessmentsThree sources provide lists of assessments specifically related to SEL. Thesesources can be helpful in your initial search for an appropriate measure, but theidentification alone is not an endorsement of its match with your local purposesor the technical quality of the measure.The Assessment Catalog in CASEL’s AWG SEL Assessment Guide outlines steps inselecting an SEL assessment and provides a list of more than two dozen SELassessments. Each listing offers basic information about such things as targetconstructs and age groups, administration times, and links to publisherinformation about the assessment.The RAND Education Assessment Finder is a web-based, searchable tool withinformation for approximately 200 assessments of interpersonal andintrapersonal competencies as well as cognitive abilities. Each assessment listingincludes basic information such as a brief summary of validity and reliabilityevidence, and populations from which available technical evidence has beencollected.The American Institutes for Research (AIR) offers a Tools Index with a list of severaldozen SEL assessments organized by age/grade level that provides basicinformation such as target constructs, time for completion, and authors. The siteindicates plans to update the list annually and that several assessments areavailable but not sold commercially.Comprehensive sources for identifying assessmentsThere are also four more comprehensive sources that include SEL assessmentswithin a broader listing of assessments.The Test Collection at ETS is a freely available, searchable online database withentries for over 25,000 assessments that provide basic information such as targetconstructs or traits, age or grade ranges, source (e.g., publisher or journalarticle), and such matters as number of items and time for administration. Not allassessments listed are commercially available but information on how to obtainspecific assessments is provided. Note that some entries can be dated giventhat the listing is cumulative.Tests in Print (TIP) is a reference volume published by the Buros Center for Testingthat provides descriptions of more than 2,300 commercially available tests inEnglish. Each listing details such information as test purpose, scores, population,administration time, publisher, and price. TIP is available in hard copy as well asSEL Assessment Technical Guidebook Buros Center for Testing7

electronically via the searchable EBSCO or Ovid databases in most academiclibraries across the country or through the Buros website Test Reviews OnlinePruebas Publicadas en Español (PPE),a reference volume also published by theBuros Center for Testing, is the Spanish counterpart to TIP in that it offersdescriptive listings of more than 600 commercially available tests offered eitherwholly or partly in Spanish. Listings are given in both Spanish and English andprovide the same information as TIP as well as information about the test’s origin,norms, translation/ adaptation process, and test components available inEnglish and Spanish. PPE is sold in both hard copy and electronic (PDF) formatsand may also be accessed online through EBSCO/Ovid databases atsubscribing libraries.PsycTESTS is a searchable electronic database available as a subscription orthrough academic libraries sponsored by the American PsychologicalAssociation. It contains approximately 55,000 entries. At least 75% of those listingsare available but not sold commercially. Listings provide purpose, constructs,administration information as well as minimal information on reliability, validity,and norms. For some entries, the assessment itself is attached, along with anindication of whether its use requires special permission.Alternate sources for identifying assessmentsProfessional journals feature articles, or collections of articles in special issues,oriented toward SEL assessments. Some articles will provide listings and briefdescriptions of the assessments and other times more evaluative summaries.Such articles, when recent, can be very helpful, but their appearance is quiteunpredictable.Other users in your professional circles may be a good source for identifying SELassessments overlooked in the other sources. However, keep in mind that justbecause a particular SEL assessment is appropriate for one setting does notnecessarily mean it is appropriate for your own setting without further evaluation.Step 3: Review the Technical Evaluations of SEL AssessmentsWith the identification of a subset of potential SEL assessments that align withyour purposes, the next step would be to attempt to obtain existing technicalevaluations for those SEL assessments. There are several sources in whichtechnical evaluation typically by qualified professionals can be found.SEL Assessment Technical Guidebook Buros Center for Testing8

Mental Measurements YearbookThe Mental Measurements Yearbook (MMY) series by the Buros Center for Testingpublishes professional reviews of commercially available tests by two qualifiedprofessionals. Reviews include a description of the test, developmentprocedures, technical characteristics (reliability, validity, fairness), and asummary commentary on the quality of the test. The most recent edition (the20th MMY) contains reviews for about 200 tests and is available in hard copyand electronic database form in most academic libraries. Reviews of individualtests may be purchased directly from the Buros Center for Testing’s Test ReviewsOnline website.Professional JournalsProfessional journals, as noted earlier, provide articles that can sometimes assistin identifying SEL assessments as well as provide reviews of the technical qualityof the assessments. Keep in mind that authors of the articles may not always beindependent in terms of conflict of interests (e.g. author is the assessmentdeveloper).Technical ManualsAssessment publishers’ technical manuals are the primary source of technicalevidence for an assessment, but that evidence may not always align withprofessional standards and guidelines. Information in manuals can be technicaland difficult to read without the help of someone with psychometric expertise.However, an assessment’s technical manual is the primary source forconducting a technical evaluation; any assessment should have a manual orreport available that provides detailed information about the assessment’spurpose, development, structure, norms, reliability, validity, and fairness, as wellas administration and scoring procedures.Professional ConsultantsProfessional consultants may help evaluate the technical quality of theassessments you are considering. Such persons might come from localuniversities or research centers but should not have a conflict of interest in SELassessment.SEL Assessment Technical Guidebook Buros Center for Testing9

Guide 2: Evaluating the Measurement Quality of Socialand Emotional Learning (SEL) AssessmentsOnce potential SEL assessments have been identified using the three steps inGuide 1, educators should conduct their own evaluation of the measurement(technical) quality of a social and emotional learning (SEL) assessment byidentifying what types of information and evidence a developer has providedfor an assessment and determining from that information if the assessment isappropriate for local plans for interpretation and use. Technical (psychometric)considerations addressed in this guide are based on the 2014 Standards forEducational and Psychological Testing published by the American EducationalResearch Association (AERA), the American Psychological Association (APA),and the National Council on Measurement in Education (NCME).The purpose of this guide.The purpose of this guide is to prepare assessment users to know what questionsto ask regarding the availability of information and empirical evidence that maysupport the intended interpretation and use of an SEL assessment for theirstudent population. The extent to which the technical evidence for an SELassessment addresses these questions will assist informed selection decisions thatwill translate into more valid interpretations and uses.The intended users of this guide.This guide is for educators tasked with the selection and use of an SELassessment. Ideally, a group of educators and experts with relevant insightsabout the content to be assessed and the use of the resulting information toguide action will be involved in the evaluation. Although specializedpsychometric expertise can be helpful, this guide was written for assessmentusers who may not be experts in the technical details of assessmentdevelopment.Types of interpretations and uses addressed by the SEL assessment guide.This guide is applicable to situations where SEL is measured to provide feedbackand improve instruction and programs. The guide is not intended for situationswhere SEL assessments are being used for accountability or in consequentialdecision making at a group or individual level.Consequential decisions at an individual student level would involve measuringstudent learning to screen or diagnose students in need of additional services orintervention or to identify students with a mental health concern. If an SELSEL Assessment Technical Guidebook Buros Center for Testing10

assessment will be used for these types of consequential decisions, educatorsshould consult with school district professionals who have received appropriatetraining and who hold the licenses or certifications necessary to conduct clinicalevaluations of children for mental health or special education intervention,mental health diagnosis or special education classification. These professionalsshould also be well-versed in the tenets of the Standards for Educational andPsychological Testing (AERA, APA, NCME, 2014).If an SEL assessment will be used to make high-stakes decisions about a schoolor program, it is highly recommended that evidence be carefully scrutinized withthe assistance of someone with psychometric expertise and an understandingof the context in which the decisions will be made.Structure of the guide.This guide is divided into four parts and all four parts list questions that should beconsidered when evaluating the measurement quality of the SEL assessment. Atable for each of the following four parts can be found in the Appendices.Part 1: Does the assessment effectively measure the SEL competencies ofinterest?Part 2: Does the SEL assessment provide credible evidence for your intendeduses?Part 3: Is the SEL assessment relevant for your students and your setting?Part 4: Does the SEL assessment address issues relate to administration, scoringand assessment format?SEL Assessment Technical Guidebook Buros Center for Testing11

Guide 3: Recommendations when Using Social andEmotional Learning (SEL) AssessmentsValid interpretation and use of social and emotional learning (SEL) assessmentresults does not end after identifying an assessment that aligns with your localpurposes and ensuring the measurement quality. It also involves carefulconsideration of administration and scoring and communicating the results froman SEL assessment. This guide was developed using the 2014 Standards forEducational and Psychological Testing published by the American EducationalResearch Association (AERA), the American Psychological Association (APA),and the National Council on Measurement in Education (NCME) to identifyconsiderations before and after administering an SEL assessment.Before Administering and Scoring the AssessmentsMost SEL assessments have manuals that provide guidance on how toadminister and score the assessment appropriately. Use this guidance todevelop a formal plan for preparing personnel who will use the assessment.Outline the following considerations in that plan:Identifying and sharing standardized procedures for administration and scoring.Standardized administration procedures may involve instructions, time limits, andassessment conditions. Standardized scoring procedures may address how toaggregate item responses or apply a rubric. Follow any required qualifications ortraining recommended by the assessment developer for administration andscoring and check for correct and consistent administration and scoring acrossindividuals, classrooms, or schools as well as documenting of deviations ordisruptions.If there is a need to ensure the assessment is being administered and scoredcorrectly and consistently across individuals, classrooms, or schools, additionalchecks for quality control might be called for or documenting of deviations ordisruptions.Availability and use of accommodationsIf students need alterations to administration and scoring procedures to receivefull and fair access to the assessment (e.g. students with disabilities or fromdiverse cultural and linguistic backgrounds), identify valid accommodationsdocumented by the assessment developer. If there is no documentation of aneeded accommodation, consult state or school district policies for guidance.SEL Assessment Technical Guidebook Buros Center for Testing12

Inform students as well as the school personnel administering the assessmentabout available accommodations and process for obtaining thoseaccommodations.Security and integrity of assessment materials and scores.Protect copyrighted materials by not allowing reproduction or re-creation ofassessment materials in paper or electronic form without consent of thecopyright holder. If results are viewed as consequential, have a plan for securingassessment materials as well as protecting the integrity of scores from fraud ordeceit on the part of the respondent or assessment user.Providing instructions, practice or other support to test takers.Inform respondents if the way in which they respond (e.g. guessing or the speedof their responses) could affect their scores. If unfamiliar equipment or software isused in administration (e.g., computer administered assessments), providerespondents practice opportunities with equipment or software unless the use ofunfamiliar tools is part of what is being assessed (e.g., problem solving).Collection of empirical evidence for alterationsIf altering the assessment format, mode of administration, instruction, orlanguage of the assessment, the assessment developer should provide (oralternatively the test user should collect) empirical evidence that thosealterations will not affect reliability/precision and validity of score interpretation.Published norms may not be valid under altered conditions if it is determinedthat changes to the assessment alter the meaning of scores.Before Reporting and Interpreting Resultsfrom an SEL AssessmentTest users should only report and interpret results as recommended andempirically supported by the assessment developer. To reach conclusions thatvalidly inform decision-making, keep the following considerations in mind:Levels at which results are reported.Report assessment scores only at the level intended and empirically supportedby the assessment developer. For example, group vs. individual scores, overallscores vs. subscores, separate scores for subgroups. Never combine scores orseparate scores unless recommended and empirically supported by theSEL Assessment Technical Guidebook Buros Center for Testing13

assessment developer. If reporting subgroup results, individual users familiar withthose subgroups should be involved in interpretation and use.How results are reported.Ensure reporting of results protects copyright of the assessment materials and theprivacy of assessment takers through security and confidentiality of individualscores. Consult the developer’s cautions about the limitations of the scores,norms/comparison groups, and potential misinterpretation and misuse. Reportamount of error expected for a score using standard error or confidenceintervals to indicate scores are estimates that can vary from one occasion to thenext.Use simple language to describe what the assessment covers, what scoresrepresent, the precision/reliability of the scores, and how to interpret and usescores. If reporting performance categories or labels, clearly and preciselydescribe the intended inference. Minimize potential biases for assessment takersdue to demographics (e.g. cultural groups, age, social class, gender etc.)Identify supplemental information (e.g., results from other assessments,academic/behavioral data) that would support appropriate interpretation anduse, especially if reporting individual-level scores. Indicate how to weighassessment scores in relation to supplemental information when makingdecisions.If using an assessment regularly over time and/or used previously, verify thatassessment interpretations remain relevant and appropriate when there aresignificant changes in the SEL curriculum/instruction, the population ofassessment takers, modes of administration, or the purpose of conducting theassessment.Before Communicating Assessment Results andConclusions to StakeholdersA plan for communicating assessment results to stakeholders can assist inensuring valid interpretation and use and minimize potential negativeconsequences. Considerations include the following.Providing framing information.Provide assessment name, quotes of the purpose and intended interpretationand use, and cautions about interpretation and use from the assessmentdeveloper at the beginning of every discussion of assessment results. If sharingSEL Assessment Technical Guidebook Buros Center for Testing14

assessment results publicly, accompany those results with enough informationabout the purpose of the assessment and how to appropriately interpret resultsto minimize the possibility of misinterpretations.Anticipating misinterpretations and setting parameters for the discussion.Anticipate the possibility stakeholders might oversimplify their interpretations ofresults or misattribute reasons for results. Encourage sound conclusions anddecision-making by thinking about these potential issues ahead of time. Beforediscussing assessment results, use recommendations from the assessmentdeveloper to define conversations about the results indicating what topics andconclusions are within bounds and outside of bounds (e.g. assigning meaning toresults that were unintended or have no evidential basis).SEL Assessment Technical Guidebook Buros Center for Testing15

AppendicesPart 1: Does the assessment effectively measure the SEL competencies of interest?Part 2: Does the SEL assessment provide credible evidence for your intended uses?Part 3: Is the SEL assessment relevant for your students and your setting?Part 4: Does the SEL assessment address issues relate to administration, scoring andassessment format?SEL Assessment Technical Guidebook Buros Center for Testing16

Evaluating the Measurement Quality of Social andEmotional Learning (SEL) Assessments1. Does the assess

SEL-specific sources for identifying assessments Three sources provide lists of assessments specifically related to SEL. These sources can be helpful in your initial search for an appropriate measure, but the identification alone is not an endorsement of its match with your local purposes or the technical quality of the measure. The Assessment Catalog in CASEL's AWG SEL Assessment Guide .