Transcription
AMP COMPUTER-BASED TESTINGApplied Measurement Professionals, Inc. (AMP) has partnered with the Association of Boardsof Certification (ABC) to offer secure, high stakes computer-based testing (CBT) services. Weare excited to be working with ABC to help state/provincial regulatory bodies and othercertification agencies (Clients) offer candidates the many advantages that accompany CBT,such as the flexibility to choose a testing time and location that best fits their schedule andimmediate feedback in the form of instant score reports. CBT also provides Clients with onlineaccess to scheduling and results data and heightened security measures. The following pagesoffer an overview of the processes involved in offering CBT administration through AMP.SCHEDULINGThe process for candidates to schedule an examination appointment at an AMP AssessmentCenter is simple. Eligible applicants may schedule in real time by visiting www.goAMP.com orby calling AMP’s toll-free customer support number. With either method, the applicants willknow immediately if they are scheduled for the preferred session time and location.Candidates who register online are accessing the same database forms as our own customersupport staff, so it is truly “first-come, first-served”.Applicants may be tested as soon as 3 days after contacting AMP to schedule an appointment(e.g., call Monday by 3:00 pm central time and test Thursday morning). After an individual isscheduled for a testing appointment, the identification information is merged with a test formselected for that candidate and the file is prepared to be transmitted to the chosen test centerat the appropriate time. AMP maintains an applicant data file that allows us to track which testform applicants have taken to ensure they do not receive the same form when retesting ifmultiple forms are available. AMP does not typically offer a refund policy. However, we doallow a candidate to change or reschedule an examination appointment one time withoutpenalty with at least four-business days notice.“We thoroughly enjoyed our visit to the CBTsite at Stanton, CA. We found the staff to beprofessional, efficient and helpful. Theinstructions were easy to follow, and thelocation was clean, neat and easilyidentifiable.”TEST SITESASSAMP Assessment Centers are available 5 days perweek, Monday through Friday, throughout the yearat more than 150 sites geographically distributedLisa Miller, RN, BSN, American Associationacross the United States. AMP Assessment Centersof Critical Care Nursesserve 135 unique cities, with only majormetropolitan areas such as New York, Los Angeles,Chicago, etc. hosting multiple locations to serve the population. With this approach tocoverage, AMP has a test center within 2 hours of the top 175 metropolitan service areas. Thefollowing table and map detail the current Assessment Center locations.ENTSMESAPPLIED MEASUREMENT PROFESSIONALS,INC.A B C Dpage 1
AMP ASSESSMENT CENTERS (CBT)ALASKAAnchorageILLINOISCarbondaleChicago DIANAEvansvilleFort e RockIOWADavenportDes MoinesCALIFORNIAFresnoLos Angeles (2)SacramentoSan DiegoSan FranciscoSan JoseSanta MariaKANSASKansas olnNorth elphiaPittsburghWyomingNEVADALas VegasRenoRHODE ISLANDProvidenceNEW HAMPSHIREConcordManchesterNashuaPortsmouthNEW JERSEYRobbinsville (Trenton)WayneNEW MEXICOAlbuquerqueNEW YORKAlbanyBuffaloRochesterLong IslandNew YorkWhite PlainsUticaCOLORADODenverGrand JunctionLOUISIANABaton RougeNew OrleansShreveportCONNECTICUTWest oreNORTH ostonHolyokeNORTH DAKOTABismarckFargoMICHIGANDetroitFlintGrand JacksonvilleMiamiOrlandoSarasotaTallahasseeWest Palm BeachGEORGIAAtlanta n CityKansas CitySpringfieldSt. LouisMONTANABillingsMissoulaAPPLIED MEASUREMENT PROFESSIONALS,INC.OKLAHOMAOklahoma CityTulsaOREGONBendEugeneMedfordPortlandSalemSOUTH CAROLINAColumbiaGeorgetownSpartanburgSOUTH DAKOTARapid CitySioux FallsTENNESSEEChattanoogaJohnson CityKnoxvilleMemphisNashvilleTEXASAustinDallasEl PasoFort WorthHoustonLubbockMcAllenSan AntonioWichita FallsUTAHSalt Lake eWASHINGTONSeattleSpokaneWEST VIRGINIACharlestonWISCONSINGreen hamHuntsvilleMobileMontgomeryENTSMESA B C D
AMP Assessment ATXAKFLPRASSHIENTSMESA B C DAPPLIED MEASUREMENT PROFESSIONALS,INC.
AMP has chosen to build its CBT business in a controlled fashion; focused on access andquality. We currently have 30 clients testing 150,000 candidates per year. With a current totalcapacity of roughly 300,000, we have approximately 150,000 available testing appointmentseach year. Simply put, AMP candidates usually test when and where they want.AMP strives to ensure that each candidate is provided with a high-quality testing experience. Inthat regard, we ask CBT candidates to provide us feedback on their testing experience byvoluntarily responding to 16 questions after the timed examination is terminated. Thesequestions allow for feedback on test center location and comfort, proctor, testing software andoverall testing environment. With over 500,000 responses, the results indicate an overall 99%approval rating. Of particular interest is that:97% found the on-screen instructions easy to follow96% rated the supervisor and staff friendly97% found the noise level at the test center quiet to acceptable97% thought the software was easy to use99% said the overall testing environment was excellent to acceptableMany AMP Assessment Centers are established within H&R Block tax offices, while others arein AMP leased facilities. Regardless of the test center model, AMP is in complete controlover the testing environment. Each center is equipped with sufficient computer stations toaccommodate the indicated applicant volume, and is constantly monitored to ensure adequatecoverage.Sites are designed to meet AMP specifications for a professional image and an appropriateand secure testing environment. Sites comply with all federal, state and local laws regardinguse of public buildings, ensure accessibility required under the Americans with Disabilities Act,and accommodate applicants with disabilities on an individual basis without additional cost toABC, the Client or the applicant. AMP does require that individuals with a disability provideadvance written documentation of their condition.SECURITYAPPLIED MEASUREMENT PROFESSIONALS,INC.ASSSecurity procedures are in place at all AMPAssessment Centers. Tests are delivered to thetest sites shortly before the day of the exam usinga state-of-the-art 128-bit encryption technique. Incontrast to many testing companies, AMPexaminations do not permanently reside oncomputers at the assessment centers. Everycandidate will register with a trained AssessmentCenter Proctor and must present photoidentification. Each candidate will have a digitized picture taken (included on the score reportform) and will be monitored throughout the administration by trained staff. In addition to the onsite staff, the area is continuously monitored by video equipment. Verification of candidateENTSMESA B C Dpage 4
identity and other security procedures related to the administration are strictly enforced. Nowritten materials or personal belongings will be allowed within the testing area during theexamination.In providing computer-based testing, AMP will ensure standardized testing conditions for allcandidates and will monitor the results for examination performance and comments ofcandidates in order to provide evidence that the testing process is secure and fair at all times.To enhance security, LXR TEST software can scramble the numbering of items within eachform and the options within an individual item. Using this feature, the chances that candidatestesting at the same time and place will receive an identical examination in the same questionsequence are extremely remote. This renders the simplest and oldest form of cheating; lookingat another person’s work, virtually impossible. If security measures do uncover a candidatecheating, the individual will be removed from the assessment center without receiving a scorereport and ABC will be notified.ASSESSMENT CENTER MONITORINGAMP employs a revolutionary AssessmentCenter Network Command and ControlSystem (ACN-CCS) to provide web-based,real-time analysis and feedback regardingover 100 conditions at all of our nationalassessment center locations. The ACN-CCSallows AMP information technology staff tosee the status and condition of all sites at aglance and locate detailed reports with theclick of a mouse.The ACN-CCS also monitors candidate callcenter volumes, on-line scheduling rates, examinee volume trends, examinee satisfactionlevels and test site capacity and utilization. If a test site is consistently running at capacity orcandidates have to wait more than a few days to schedule an examination at a particularlocation, AMP is alerted immediately, so we may address the issue.ASSA unique strength of the AMP Assessment Center network is that as candidate demand growsor other environmental factors change, we can easily add or change test centers from morethan 11,000 H&R Block locations. For example, if a noisy music store were to move next doorto a test center in leased space, it would be difficult to break the lease and move to anotherlocation, but the AMP system would allow us to easily and quickly move to another bettersuited location nearby.ENTSMESAPPLIED MEASUREMENT PROFESSIONALS,INC.A B C Dpage 5
TEST ADMINISTRATION“I passed – a great experience. The testingsupervisor was very personable and did asuper job dispelling the tension that normallycomes with taking a state exam.”No special skills are needed to take theexaminations on computer. Candidates arrive atthe assessment center and, following verification ofidentification, receive an orientation to the- AMP Real Estate Candidatecomputer-delivered testing environment. To initiatethe testing session, candidates register theiridentification number (i.e., social security) against the computer file and take a short practicetest to become familiar with the equipment, question layout and features of the program. Whencomfortable using the equipment (after being queried twice to be sure), they begin the actualtest. While taking an examination, candidates record their response by typing a keystroke orclicking a mouse, and have the capability of paging through the test one item at a time. Thesystem allows candidates to return to items and change their response if desired, or if they donot answer all items, the software will automatically return to the unanswered items with theclick of a button. Further, a clock is always available on screen that shows the testing timeremaining to the candidate, and the computer automatically terminates the test at the end ofthe prescribed time.All assessment center proctors are trained by AMPand required to pass an Assessment Center Proctorcertification examination. This examination wasdeveloped by AMP to ensure that all proctorsunderstand the procedures and exhibit the decisionmaking skills necessary to provide a standardizedtesting environment. The certification examinationcovers five major content areas, including generalprocedures, checking-in candidates, assisting andmonitoring candidates during the testing process,post-examination protocol and troubleshooting.SCORING AND REPORTINGAPPLIED MEASUREMENT PROFESSIONALS,INC.ASSAMP systems allow for score reports to be provided at the Assessment Center in a matter ofmoments after the completion of testing. The key to providing instant scoring is the use ofstatistically sound, tried items in every test form. If ABC and AMP determine that a programhas sufficient statistics, candidates will receive a score report at the Assessment Centerindicating whether they have passed or failed the examination, as well as diagnosticinformation (if requested) to provide feedback to failing candidates about performance onspecific examination content areas. If a program is new or does not have sufficient statistics,candidates will receive preliminary score reports until enough statistical data (50 to 100candidates) is collected to ensure initial score accuracy. Once the program is established,candidates can receive final score reports at the test site. Score reports will also include adigitized color photograph of each candidate for security and identification purposes. Failingcandidates will receive instructions on reapplying for future examinations.ENTSMESA B C Dpage 6
AMP will submit periodic reports to ABC and the Client showing summaries of candidateperformance, including number and percentage of candidates tested and the number/percentage of first time and repeat candidates passing and failing the examinations. AMP willsend an electronic file of candidate response strings to ABC monthly so that they may providestatistical analyses of items and test forms.GETTING STARTEDASSOnce the Client and ABC have made the decision to move forward with CBT, AMP will workwith the Client and ABC to ensure a smooth transition to CBT at AMP Assessment Centers.We will initiate a conference call to determine several operational considerations regardingapplication processing, eligibility determination, fee collection, data transfer, reportingrequirements, etc. Collectively, we will develop appropriate text for the candidate informationbulletin, score reports and on-screen examination pages. We will then coordinate with ABC forthe delivery of the electronic test file(s), corresponding keys, content classifications and cutscores. Once test files are transferred and converted to CBT format, experienced AMP staffwill complete a full set of quality control procedures, including viewing each item in a testcenter setting and taking the examination at, above and below the cut score to ensure properscoring. Once examination forms are finalized, candidates may begin testing at AMPAssessment Centers.ENTSMESAPPLIED MEASUREMENT PROFESSIONALS,INC.A B C Dpage 7
certification examination. This examination was developed by AMP to ensure that all proctors understand the procedures and exhibit the decision making skills necessary to provide a standardized testing environment. The certification examination covers five major content areas, including general ,
