CAEP Data Dive - Sbcc.edu

Transcription

Comprehensive Adult Student Assessment SystemsCAEP Data DiveApril 28, 2021www.casas.org

Overview April 28: CAEP Data Dive: Detail CAEP outcomes andservices; review CAEP Reports in TE, and what’s new May 18: Barriers and Equity: Using new and existingTE reporting features to target data, and focus onspecific populations that meet statewide and regionalpriorities May 25: CAEP Performance Goals: Review keyconcepts of NRS performance and persistence andapply these concepts to CAEP data reporting.

Data as Culture33

Agenda 2020-21 CAEP Programs and AB 104 OutcomesStructure Distinguishing key CAEP Outcomes Troubleshooting examples at the Student level ABE-ASE-ESL/Literacy Gains Workforce Prep and CTE Transitions Recording Short Term Services CAEP Reports in TE Consortium Level Reports

PY 2020-21 CAEP Program Structure: 5ProgramsAdult Basic &SecondaryEducationAdults withDisabilitiesEnglish as 2ndLanguageCareer andTechnicalEducation (CTE)Parents/K12Success

PY 2020-21 CAEP Program Structure:Primary ProgramsAdult Basic &SecondaryEducation: Basic Skills(ABE) HSE (HiSET,GED) HS DiplomaEnglish asSecond Language(ESL/ELL)Career andTechnicalEducation (CTE) CTE Short Term CTE PreApprenticeship WorkforcePreparation

CAEP Reporting : CAEP ProgramsUnder CTECareer and Technical Education (CTE) CTE – Long term/occupation specific Short Term CTE – short term/occupation specific Pre-Apprenticeship – Long term/occupation specific Workforce Preparation – Short term/not occupationspecific7

CAEP Reporting: Adults ServedCAEP reports the number of “Adults Served” whichincludes three categories:1. Service only students2. Students receiving 1-11 instructional contacthours3. Participants who received 12 or moreinstructional contact hours over a singleprogram year.

WIOA Alignment to AB 104The WIOA Performance Indicators, along with the 5 typesof MSG, comprise the framework for the six AB 104outcomes:Indicators:1. Employment2. WagesMSGs:1. Literacy gain2. Secondary3. Post-Secondary4. Training Milestone5. Skills ProgressionAB 104 Outcomes:1. Improved literacy skills2. Completion of high schooldiplomas or theirrecognized equivalents3. Completion ofpostsecondary4. Placement into jobs5. Improved wages6. Post Secondary Transition

CAEP OutcomesLiteracy Gains Pre/Post LevelCompletion Carnegie Units /HSCredits CDCP Certificate Occupational Skills Gain Workforce PreparationEnterEmployment Get a Job Retain a Job Enter MilitaryHSE/HSDiploma High School Diploma Passed GED Passed HiSETIncreaseWages Increase Wages Get a Better JobPostSecondary College Degree – AA, AS, BA, BSGraduate StudiesTraining CredentialOccupational Licensure/CertificateApprenticeshipTransition Transition to ASE Transition to Post-Secondary/CTE Transition to PostSecondary/College

Literacy Gains – HS CreditsIn TE, go to Records –Students – Records and referto Instructional Levels: Select ASE Low uponenrollment Select ASE High later in theyear once studentprogresses to the 11th or12th grade level

Literacy Gains – CTE Related OutcomesOccupational Skills Gain: Usually suggests accomplishment of aportion of a longer term programWorkforce Prep Outcome: Usually suggests completion of ashorter term program

Literacy Gains – CTE Related OutcomesOccupational Skills Gain: Usually suggests accomplishment of a portion ofa longer term program For example: a student enrolls in a long termwelding program in CTE, which is fivesemesters/five modules long. The studentpasses a skills check/written test thatindicates the student is ready to finish ModuleI and enroll in Module II.

Literacy Gains – CTE Related OutcomesWorkforce Prep Outcome: Usually suggests completion of a shorter termprogram For example: a student enrolls and completes a15 hour instructional module on job searchstrategies. The student earns documentationsuch as an informal certificate at the end of theinstructional module.

Occupational Outcomes:Post-Secondary vs. LiteracyGainsPost-Secondary: Attained Credential Occupational licensure Occupational certificateLiteracy Gains: Occupational Skills Gain Workforce PrepMilestonePost-Secondary Completion of a longer termprogram“Literacy Gains” Partial completion of a longer termprogram Completion of a shorter termprogram

Post-Secondary CredentialCompletionThese are potential ways to measure and verify that yourIET program comprises a legitimate career pathway: Locally approved certificates eligible for inclusion on theEligible Training Provider List (ETPL) (WIOA Title I) CDCP CTE certificates with more than 48 instructionalcontact hours (CCCCO) Certificates that meet the minimum for inclusion underPerkins Certificates meeting the threshold for Title IV federalstudent aid16

Post-Secondary Credential Completion If there is not a careerpathway established fromyour workforce training, theagency may need to piecetogether several componentsto ensure it comprises apathway.Ultimately, it should equate toan “Earned Post-Secondary”outcome.17

WSD 019-03Examples of training opportunities that qualify asa post-secondary credential: Associate degreeBachelor’s degreeOccupational licensure (such as CNA license)Occupational certification (such as Automotive ServiceExcellence certification).Occupational certificate, including RegisteredApprenticeship and CTE educational certificates.Other recognized certificates of industry/occupationalskills completion sufficient to qualify for entry-level oradvancement in employment18

WSD 019-03Examples of training opportunities that do NOTqualify as a post-secondary credential: Occupational Safety and Health Administration 10hour course on job-related common safety and healthhazards (OSHA 10).Microsoft Office, Customer Service, and/or GeneralOffice.National Career Readiness Certification.National Retail Federation Credentials.ServSafe Food Handler’s Certification.Cardio Pulmonary Resuscitation (CPR) Certification.19

WSD 019-03 Attributes of a quality post-secondary credential:Accessible — Affordable and readily available at places andtimes convenient for working adultsTransparent — Clearly articulated costs and prerequisites;accurate picture of what skills, knowledge and abilities arebenchmarked by a given credential, and the value it carries inthe labor marketStackable — One of multiple manageable chunks that add upto a more substantial credential and do not require startingover at each new stepPortable — Transferable between firms, regions andeducational institutionsMeaningful — Has value in the labor market20Connected — Links to a job or an educational pathway

TransitionK12 AdultEducation(ABE, ASE, ESL)To:K12 Adult EdCTECC CTENon Credit CC(ABE, ASE, ESL)For Credit CCTransition to CTETransition to for credit

Transition to CTEK12 AdultEducation(ABE, ASE, ESL)To:K12 Adult EdCTECC CTENon Credit CC(ABE, ASE, ESL)Transition to CTETransition to for credit

Transition to CollegeK12 AdultEducation(ABE, ASE, ESL)To:For Credit CCNon Credit CC(ABE, ASE, ESL)Transition to CTETransition to for credit

Literacy ion

In TE go to Records-Students--Records

Troubleshooting Examples Examples for ABE, ASE and ESL Examples for Workforce Preparationand CTE Transitions Examples

Troubleshooting ExamplesABE, ASE, and ESL Recording HS Credits Recording Distance Learning Outcomes EL Civics/COAAPs IET/EL Co-Enrollment

Troubleshooting ExamplesRecording HS Credits Student 1 enrolled in Adult HS diploma program atXYZ Unified District, which requires 180 credits forHS graduation. Student 1 had completed 75 creditsat enrollment. At the end of the year the Studenthad completed 125 credits. Student 1 earns the HS credits outcome

Troubleshooting ExamplesRecording HS Credits Student 2 enrolled in the same program at thesame date. Student 2 had completed 145 creditsupon enrollment in the Adult program. Student 2 does not earn this outcome. The outcomefor this student is to earn HS diploma.

Troubleshooting ExamplesRecording Distance Learning Outcomes Use “passage of exam” process for WorkforcePrep Milestone and Occupational Skills Gain as aguide for recording student achievement in avirtual environment. Record when student passes virtual activities suchas class assessments, written & listeningassignments, or oral interviews

Troubleshooting ExamplesRecording Distance Learning Outcomes Example 1: Learner Mastery. Record when studentcompletes established list of activities and passesassigned quiz required for instructional hours, asdefined in Agency’s Local Assessment Policy (LAP). Example 2: Educational Software. Mark whenstudent completes activities such written &listening assignments, quizzes, and exams indefined units or modules in educational software.

Troubleshooting ExamplesEL Civics/COAAPs For 2019-20: “Completes skills demonstration inworkforce preparation activities” Example: If an ESL class in IELCE focuses on jobsearch, application and interview skills, andadministers the COAAPs assessments that relate tothese targeted areas For 2020-21: Passed EL Civics COAAPs now displayas I-3 outcomes

Troubleshooting ExamplesIntegrated Education and Training (IET) A student completes pre-requisite academic orperformance requirements prior to enrollment intothe Workforce Training component of IntegratedEducation and Training (IET). Completes required short term course(s) Passes a skills check for selected occupation Attains minimum required score on placement assessment Completes interviews and orientation sessions with union ortraining provider Record when requirements being met facilitatesenrollment into IET.

Troubleshooting ExamplesIntegrated Education and Training (IET) Example 1: As a pre-requisite for enrollment in theworkforce training (CTE) component of IntegratedEducation and Training (IET), the student passesrequired occupational skills checks. Example 2: Student completes required short termclasses needed to transition to certificated CTEprogram that qualifies for IET workforce training. Example 3: Student surpasses minimum requiredplacement scores for Reading and Math on theCASAS Appraisal Form 900.

Troubleshooting ExamplesEL Co-Enrollment EL Co-Enrollment English Language Learner enrolledin both Title I and Title II. Record Workforce Prep Milestone or OccupationalSkills Gain when student completes activities in theTitle I program such as job skills training, job searchassistance or career pathways completion.

Troubleshooting ExamplesEL Co-Enrollment Example: Student is enrolled in an ESL class at anAdult Education Program. Student is also enrolled in aWIOA Title I program, she completes 20 hours of jobskills training.

Troubleshooting ExamplesWorkforce Preparation and CTE Workforce Preparation classes that are OccupationSpecific (Short term CTE) Classes and programs designed to improve thestudent’s employability, but that do not result informal certification Classes required for CTE enrollment or certificationthat are Occupation GenericPost-Secondary

Troubleshooting ExamplesWorkforce Preparation classes that are OccupationSpecific (Short Term CTE) Class that focuses on one occupation, and mayresult in employment in that field, but that also isshort term and does not result in formalcertification. Examples: Phlebotomy, Forklift Operator Record either Workforce Prep Milestone versusOccupational Skills GainPost-Secondary

Troubleshooting ExamplesWorkforce Preparation classes that are OccupationSpecific (Short Term CTE) Example 1: Student completes 15 hour course onAccounting Principles. Record Workforce Preparation Milestone Example 2: Student completes 15 hour course onAccounting, after completing 2 related coursesearlier in the year. The student has enrolled for thefourth and final class next semester. Record Occupational Skills GainPost-Secondary

Troubleshooting ExamplesWorkforce Preparation classes that are OccupationSpecific (Short Term CTE) Example 3: Student completes 15 hour course onAccounting. Completing this course enabled thestudent to enroll in the advanced CTE program forAccounting and Finance. Record Occupational Skills Gain Example 4: Student completes all six Accounting &Finance courses that, as a battery, is recognized bythe local workforce board and ontheir ETPL.Post-Secondary Record Occ Skills Gain or Post-Sec Outcome

Troubleshooting ExamplesWorkforce Preparation classes that help thestudent’s employability, but that do not earnformal certification Example: OSHA Food handling, Microsoft Office Record Workforce Prep Milestone or short termservice Can use 12 hours as a guideline (but not required)Post-Secondary

Troubleshooting ExamplesWorkforce Preparation classes that help thestudent’s employability, but that do not earnformal certification Example 1: Student completes 15 hour course onMicrosoft Office. Record Workforce Preparation Milestone Example 2: Student completes a 2 hour course onMicrosoft Excel Basics. Record as a Training ServicePost-Secondary

Troubleshooting ExamplesWorkforce Preparation classes that help thestudent’s employability, but that do not earnformal certification Example 3: Student complete 2 hour tour offinance office to learn about accounting principles. Record short term service (such as on the job training orwork experience) Example 4: Student completes third successive 15hour course on Microsoft Office, that enabledenrollment into the CTE Accounting program . Record Workforce Prep MilestonePostSecondary

Troubleshooting ExamplesClasses required for CTE program that areOccupation Generic Example: OSHA Food handling, Microsoft Office Record Workforce Prep Milestone or short termservice When the service or accomplishment is the“trigger” that facilitates enrollment or promotionto a higher level or certificated program – then youmay record outcomes instead of services even ifhours total is lowPost-Secondary

Troubleshooting ExamplesClasses required for CTE that are Occupation Generic Example 1: Student completes third successive 15hour course on Microsoft Office, that results in“promotion” into the CTE Accounting program . Record Workforce Prep Milestone Example 2: Student completes 6 hour course onworkplace safety measures that enables enrollmentinto Construction pre-apprenticeship program. Record Workforce Prep MilestonePost-Secondary

Troubleshooting ExamplesTransitions Transition to CTE Transition to CollegeK12 AdultEducation(ABE, ASE,ESL)Non CreditCC(ABE, ASE,ESL)K12 AdultEd CTECC CTEFor CreditCCTransition

Troubleshooting ExamplesExamples of Transition to CTE Enrollment in apprenticeship or preapprenticeship WIOA Title I workforce training Enrollment in workforce training that is approvedas workforce training in IETExamples that are NOT Transition to CTE Wait listing/Pending application/etc. Workforce Preparation (or other similar shortterm or not for credit) classes Enrollment in IELCE but not IETTransition

Troubleshooting ExamplesExamples of Transition to College From non-credit CC to for credit CC within the samecommunity college district From an Adult School to for credit CC From an Adult School or non-credit CC toenrollment in a universityExamples that are NOT Transition to College From an Adult School to a non-credit CC program From an Adult School or non-credit CC todevelopmental level community college coursesTransition

CAEP Short Term ServicesRecord short term services that may be receivedoutside of the classroom. Supportive Services Training Services Transition Services49

CAEP Short Term ServicesCommon Supportive Services for PY 20-21 Health Care Services Emergency Financial Services Financial Counseling Housing Assistance50

CAEP Short Term ServicesTraining Services Prerequisite Training Skill Upgrading Skill upgrades to work remotelyAssist with new software applicationsDigital Literacy/“Tech support”51

CAEP Short Term ServicesTransition Services Assessment/Testing Remote Testing (CASAS & HSE)Career InventoryJob Search AssistanceOccupational Skills Training52

CAEP Summary

CAEP Summary

CAEP Summary

CAEP Summary56

CAEP Summary

CAEP Data Integrity

CAEP Data Integrity Report: PY 20-21Some items that may potentially change due to COVID-19issues: 12 Hours of Instruction - Item 02 No Post-Test/Pre-Post-Test pair - Items 09, 10 Earned HSE/HS Diploma - Items 12, 13 Earned outcome but did not qualify for CAEP - Items 23a-27 Achieved CAEP outcome - Items 23b-27b

CAEP Data Integrity Report: PY 20-21Some items that should NOT change due to COVID-19 issues: Demographics - Items 01, 03, 04, 05, 06 Primary/Secondary Goal - Items 17, 18 Missing Barriers of Employment - Item 19 Earned outcome but did not qualify for CAEP - Items 23a27a

CAEP Consortium Manager Reportsallow a consortium level login to compareand contrast outcomes across agencieswithin one consortium.Menu currently includesfour reports options withthis feature

CAEP Consortium Manager Reports now includesconsortium level CAEP Data Integrity Report.

The CAEP Summary andBarriers to Employment alsolists information by agencyand by consortium.Click Aggregate MultipleAgencies to run a combinedsummary of all agencies inthe consortium.

Statewide CAEP Summary

Remember: Everyone need not getto OZ--But you must build the Yellow Brick Road!65

Example 3: Student completes 15 hour course on Accounting. Completing this course enabled the student to enroll in the advanced CTE program for Accounting and Finance. Record Occupational Skills Gain Example 4: Student completes all six Accounting & Finance courses that, as a battery, is recognized by the local workforce board and on