An AI Automated Waiting List Validation Solution for Betsi Cadwaladr

Automated      waiting list validation powered by AI

Betsi Cadwaladr University Health Board

Betsi Cadwaladr University Health Board (BCUHB) is the largest Health Board in Wales employing over 19,000 staff. It delivers primary care, hospital, community, and mental health care services to more than 700,000 people in North Wales.

The local IT infrastructure consists of multiple national systems provided by Digital Health and Care Wales (DHCW), such as the Welsh Patient Administration System (WPAS), integrated with bespoke systems to provide a cohesive local eco-system.

Due to the impact of the COVID-19 Pandemic on NHS services, like many other NHS organisations, BCUHB faced the challenge of unprecedented waits for planned care services. As a result, in April 2022, the Welsh Government published ‘Our programme for transforming and modernising planned care and reducing waiting lists in Wales’, which set out the expectation for all Health Boards to constantly review and validate their waiting lists “to ensure that the list is accurate and up to date through administrative validation”.

Summary of outcomes

61%

response rate

97%

conversation completion rate

93%

patient satisfaction rate

£137K

estimated systems efficiency per validation cycle

The Case for Change

To ensure waiting lists are accurate, patient validation needs to take place every 3-months during a patient’s wait. This will ensure that patients that need to be seen, receive an appointment, or procedure as quickly as possible and according to clinical need. Through validation, patients can tell BCUHB whether they still need an appointment.

The current patient validation activity is being delivered using a call centre model. This activity is being undertaken in tranches and often requires the services of external companies to call patients and record their responses in the WPAS.
This process presents a number of challenges:

  • Costly one-off validation exercises

  • Limited number of contacts during the patients’ wait

  • Poor patient feedback and experience

  • Quality of the calls and recording of responses difficult to standardise

  • External suppliers’ numbers are not always recognised and are sometimes reported as fraudulent

  • Tranche based validation means manual updating of WPAS can be delayed and inefficient, resulting in poor appointment utilisation and impacting waiting times

  • Difficult to manage the process across the call centre and internal speciality teams, often with multiple users updating excel spreadsheets resulting in poor data quality and auditability

The Opportunity

Working in partnership with EBO, BCUHB developed and undertook a proof of concept (POC) of the EBO Waiting List Validation Solution which, through integration with WPAS, would allow BCU to:

  • Replace up to 76% of costly one-off validation call tranches with automated and continuous digital patient validation

  • Initiate contact with patients via SMS directing them to a virtual conversation at a time convenient for them

  • Capture the responses for the remaining patients that are contacted by telephone within the same database as the virtual responses

  • Automatically update the WPAS to reduce administrative costs and provide equitable high standards of communication with patients

  • Create an enriched patient experience and digital-first uptake, by signposting patients to key information and services via the Virtual Assistant

Deployment

The POC project was delivered over two phases. In Phase 1, BCUHB wanted to understand whether patients were willing to engage with a Virtual Assistant. Phase 2 focused on making improvements in line with patient feedback, developing the waiting list view and reporting dashboards for staff.

Phase 1 -Assessing Patient Appetite to Engage with a Virtual Assistant

Phase 1 included 685 Ear Nose Throat (ENT) patients with mobile numbers in WPAS that were:

  • Stage 1 Category (waiting for a first appointment)

  • Had been waiting between 26-51 weeks for an appointment

  • Un-booked

  • Un-validated in the previous 3 months

  • 16years old and over

Phase 2 – Development of the EBO Dashboard

The focus for Phase 2 was to develop the product dashboards and reporting. An additional 448 ENT patients were validated in Phase 2. This phase focused on the development of EBO dashboards for monitoring and reporting. Improvements were made to the EBO Solution following Phase 1 that were then deployed in Phase 2. These included:

  • Improved two-factor authentication 

  • Concatenated text messages 

  • Detailed Q&A on the Virtual Assistant landing page 

  • New dashboards and reports

Evaluation

Response Rates

62%

of patients provided a response in Phase 1

59%

of patients provided a response in Phase 2

97%

of patients that responded, completed the conversation and provided a response to the validation questions

Removal rates

In Phase 1, 6% of patients were removed from the waiting list because they did not require an appointment. Similarly in Phase 2, 7% of patients responded saying they did not require an appointment. The breakdown for all responses for each phase is shown figure 1.

Patient feedback

Patient feedback was requested at the end of each conversation with patients choosing between a score of like, neutral, or dislike. Patients were also invited to leave a comment to explain the reason for their score.

cut customer engagement costs with AI in forex | EBO

Key Benefits

The main benefits achieved from the POC cohorts for patients and the Health Board were:

Benefits to Patients

  • Improved access for patients, with the ability to respond round the clock

  • Consistent and equitable standards of conversation

  • Patient has a choice of Welsh, or English conversations every time

  • Linked through to key signposts e.g. the Appointment Reminder service

Benefits to Health Board

  • Unlimited initial patient contact messages were delivered in seconds

  • Responses managed within the dashboard with real-time reporting

Next Steps

Phase 3 – Continuous Validation with Bi-directional Integration to the WPAS (Welsh EPR)

 This phase will focus on deployment of the solution in BCUHB. The solution enhancements planned for Phase 3 will allow: 

  • Automated upload of data from WPAS to EBO via integration

  • Speciality clinical review processes agreed and reflected in workflow

  • Continuous trigger built into EBO database

  • Bi-directional integration to auto update WPAS

  • Handling of patients on multiple pathways

  • Full audit trail and report suit

Conclusion

 As a result of this POC project, EBO and BCUHB developed an AI-driven waiting list validation tool that can successfully engage patients in a cost-effective manner at scale. The next phase of work will develop the integration element reducing the need for manual entries and improving reporting and audit capabilities, to enable a deployment of the solution across BCUHB services.

 

EBO is trusted by