Maryland

Maryland has implemented these monitoring procedures to support program improvement:

1. Program Reviews: Systematic monitoring of LACES data entry. Grantees are identified for site visits based on desk monitoring. The site visits combine an evidence audit and technical assistance to verify/improve local grantees' policies and procedures.
2. Auditing/enrollment monitoring: Onsite audits are currently conducted by the Department of Labor Monitoring team.
3. Certification Process: Local grantees are required to complete annually a Data Quality Checklist which indicates they have supporting evidence for each standard met and a DQ Improvement Plan for each standard not met.

Error checking in LACES is continuous. The State adult education database, LACES (Literacy, Adult, and Community Education System) has comprehensive NRS business rules integrated into the system to prevent most errors and guide data entry staff to properly complete records. Local programs run LACES Error Reports to continuously correct any additional errors. The MIS/data entry personnel are provided with comprehensive LACES training so they can run custom/targeted error checks. The State LACES Accountability Specialist reviews data throughout the year and alerts programs to any errors identified. At the end of each fiscal year, the LACES Accountability Specialist runs additional reports to check for errors. Programs are subsequently notified of any errors as well as the time frame to reconcile data errors.

State staff reviews their assigned programs' data continuously to monitor and identify issues that need to be addressed for program improvement. Only Maryland approved NRS assessments can be used to record learner placement and advancement in LACES. The NRS levels are determined by scaled score.

The State requires a LACES MIS Specialist for each local program. State staff provide the LACES MIS Specialists with regular Program Memoranda and assistance by phone, email, or personal visit. In addition, LACES MIS Specialists participate in at least two MIS trainings/meetings annually and sometimes as part of a team with their local Program Administrator, as well as additional training webinars.

State Specialists routinely assist their assigned local programs by phone, email, or site visits, providing information of these activities to the LACES Accountability Specialist so all remediation efforts can be coordinated.

The Maryland LACES Community of Practice, led by a State Specialist and comprised of local program data personnel, meets regularly to discuss data issues, answer data entry questions and identify data collection problems.