Is ISO 15189 accreditation really the gift that keeps on giving? Yes, for the assessment cartel. No, for labs.
Green et al. have investigated the effects of ISO 15189 accrediation by INAB in a clinical biochemistry lab (https://doi.org/10.1016/j.plabm.2020.e00159).
These authors developed the methodology used by Wilson et al. and showed rather similar results to the microbiology setting accredited to ISO 17025 by UKAS.
Non-conformities identifed by audits were unlikey to affect quality:
Fig. 1. Estimated impact of audit-identified non-conformities identified by audit between 2012 and 2018. The potential impact on QoS of each of the 483 audit-identified non-conformities documented between 2012 and 2018 was re-assessed. The audit-identified non-conformities were re-sorted into classifications according to their perceived likelihood of causing poor QoS according to a majority decision of three clinical biochemists. The classifications as shown in the Figure were Unlikely (The occurrence had no clear adverse consequences); Possible (Such an occurrence has the potential to cause poor QoS or harm to patients/staff, and has a reasonable likelihood of doing so at some point); and Probable (The occurrence has either lead to poor QoS/harm, or such an occurrence would be considered likely to cause poor QoS/harm).
Audits identified fewer non-conformances each year after accreditation was awarded:
Fig. 2. Breakdown of audit-identified non-conformities and their estimated impacts on QoS by year. The total numbers of audit-identified non-conformities and the estimated likelihood of their having a detrimental effect on QoS are broken down according to year.
Auditing failed to diminish the number of real time non-conformances but few were critical or major:
Fig. 3. Numbers and severity ratings of real-time non-conformities by year. The total numbers and assigned severity ratings of all real-time non-conformities documented between 2012 and 2018 were gathered. Raw numbers are shown in table format (A) and are additionally displayed graphically (B) to illustrate observed trends. Severity ratings are based upon departmental criteria. Observation = A finding warranting clarification/investigation to improve the quality management system; Minor = A minor deficiency or lapse in discipline; Serious = An incident had the potential to have a negative clinical impact or cause a serious technical error; Critical = An incident that would have had clinical impact on a patient, but was stopped prior to having done so; Major = An incident in which there was clinical impact on a patient.
The authors conclude that audit is a poor and inefficient means of quality assurance.
This strikes at the heart of ISO accreditation because the planned internal audits are supposed to validate the annual audits that assessors for which assessment bodies charge fees.
To conclude, the high proportion of non-compliances deemed to be unlikely to have any important effect on QoS indicates that continued auditing for conformity with ISO 15189 (2012) standards may be an inefficient and largely unavailing approach to further improving the QoS in clinical laboratories with a mature QMS. Accordingly, there is room for improvement in the audit process required for compliance with ISO 15189, to promote more efficient and effective use of time and resources to better deliver and sustain a high QoS. There is also need to define better indicators of QoS which could allow the value of compliance with such quality standards to be more meaningfully assessed to enable delivery of a high QoS conducive to the provision of excellent patient care.
Go to Practical Laboratory Medicine and read this paper to see further evidence that accreditation is a confidence trick void of the proof that could establish its claims.
This validation of the earlier paper points other researchers to investigate further.
However, a suggestion that audits or other QoS indicators can usefully be done better is an example of what John Seddon has described as “doing the wrong thing wronger”. It makes nothing better and appeals to obsessive and controlling personalities.