12th May 2017, Volume 130 Number 1455

Peter Jones, James Le Fevre, Alana Harper, Susan Wells, Joanna Stewart, Elana Curtis, Papaarangi Reid, Shanthi Ameratunga

In May 2009 the Ministry of Health formally announced six national health targets for public hospitals in Aotearoa New Zealand.1 One of these was the Shorter Stays in Emergency Departments target, which states that 95% of patients should be admitted, discharged or transferred from an emergency department (ED) within six hours of arrival.2 Performance against this target would be reported publicly according to district health board (DHB).

This policy was introduced on the basis of international evidence that suggested an association between ED and hospital overcrowding (reflected by long waits for admission to hospital from ED) and poorer outcomes for patients.3–6 Time-based ED targets were initially introduced in the UK’s National Health Service in 2001,7 and have since been introduced both in New Zealand2 and in Australia.8 There is debate as to whether or not ‘Targets’ are helpful or harmful,9 and the effect that time-based targets have upon patient care is uncertain. Some studies suggest better outcomes for patients when such targets were introduced,10,11 and other evidence suggests that targets may distort clinical and management priorities, diverting attention from clinical care.12

The Shorter Stays in ED (SSED) National Research Project is a mixed methods study within New Zealand public hospital EDs, investigating the relationship between the introduction of a time target for the completion of care in ED and quality of care.13 An important goal was to understand the effect that introducing a process measure such as an ED length of stay (LOS) target had on other aspects of care for the healthcare consumer. A key research question for this broader project was: “Is there any change in clinically relevant outcomes after the target was introduced?”13

To explore this research question, a number of clinical indicators of quality of care were identified from a literature review, and a stakeholder analysis process was conducted.14 The indicators were chosen to cover both ED and hospital outcomes to determine whether target implementation had effects on care quality beyond the ED.

The primary outcomes of interest in this study were the times to thrombolysis for ST elevation myocardial infarction (STEMI), time to antibiotics for severe sepsis, time to analgesia for moderate or severe pain, time to theatre for fractured neck of femur (NOF) and time to theatre for appendicitis. The secondary outcomes of interest were the adequacy of care with respect to each indicator condition; appropriate thrombolysis for STEMI, appropriate antibiotics for the site of infection for sepsis, adequate analgesia for pain, time to theatre <24 hours for NOF and perforated appendix at operation for appendicitis.

Methods

Study design and setting

The overall SSED study has previously been described in detail,13 and involved all emergency departments across New Zealand. This sub-study was a retrospective, pre- and post-intervention study, which linked administrative data with chart review using the National Health Index number, a number unique to each New Zealand citizen used to record health visits. Four case study site hospitals were selected based on a combination of factors, including: populations with a higher average proportion of Māori people, geographic diversity and initial target performance.13 There were two urban major referral academic hospitals, one urban district academic hospital and one major regional hospital, serving a combined population of 1.5 million people and a combined annual ED census of 290,000 in 2010.

Selection of participants

All patient visits to the study sites that were recorded in the New Zealand Health Information Service (NZHIS) database from first January 2006 to 31st December 2012 were identified, along with the visit date and demographic data. Data from 2009 were excluded as this was the year in which the target was introduced. Using the random number generator function in Microsoft Excel®, a random sample of visits sufficient to meet the required sample size for each outcome was taken for each of the time periods 2006–08 and 2010–12 (pre- and post-target introduction). For the ‘analgesia’ outcome, we sample data from all ED presentations nationally. Due to a change in coding practice, NZHIS only supplied data from 1/7/2006 for this outcome. To evaluate the remaining condition specific outcomes the International Classification of Diseases (ICD-10-AM) codes for STEMI, sepsis, fractured neck of femur and appendicitis were used to identify potentially eligible cases at one of the case sites (Table 1). The randomly selected visits were linked to site-specific patient information management systems that included data on the times for each patient journey within a hospital from presentation, triage and assessment, to admission and discharge. Finally, the case notes of the selected visits were reviewed, and the relevant clinical data were extracted by researchers. Prior to data collection a data dictionary that defined each data field and how to classify missing or incomplete data was developed. Smart electronic data extraction forms (Microsoft Excel®) were developed based on the data dictionary.15 Built-in validation rules were set for cells in the data extraction form to prevent incorrect entries. To avoid bias in selecting and classifying cases, formulas based upon clinical, laboratory and radiological data were used where relevant to ascertain whether patients met the entry criteria. The data extraction forms were piloted prior to data collection, and 15–20% of the data for the specific condition outcomes were independently checked for accuracy by a second data collector who was blinded to the initial data extract. Due to logistic issues, this step was not possible for the eligible records for the analgesia outcome, where data was collected nationally. Patients were excluded from analysis if the clinical notes were not available or were incomplete, if the patient was transferred from another hospital, if the episode did not involve an ED stay or if the data relevant to the outcome of interest was missing.

Table 1: Definitions of outcomes, clinically important differences and sample size requirements. 

Outcome

Definition

Clinically important difference*

Total sample size required

Time to antibiotics in severe sepsis

ICD codes

A39 (0–5,8,9), A40 (0–3,8,9), A41 (0–5,8,9), A48 (0,3), A49.9, A42.9, A20.7, A21.7, A22.7, A22.7, A24.1, A26.7, A28.2, A54.8, A32.7, B00.7, B37.7, R57.8, T81 (1,4,42), P36 (0–5,8,9), P37 (2,52)

First antibiotic administration time—presentation time to ED.

 

Severe sepsis = adults aged 18: clinical evidence of infection AND systemic inflammatory response syndrome, AND any of evidence of end-organ dysfunction, hypo-perfusion or hypotension (Surviving Sepsis Campaign definitions17,18).

Children and adolescents under the age of 18: suspected or proven infection OR a clinical syndrome associated with a high probability of infection, and SIRS, and any of cardiovascular organ dysfunction, acute respiratory distress syndrome, or two or more other organ dysfunctions.19

 

Appropriate antibiotics = antibiotic recommended in local guideline for presumed site of infection or cultured organism sensitive to antibiotic given in ED.

60 minutes

230

Time to reperfusion for STEMI

ICD codes

I21 (0,1,2,3,9)

 

First thrombolytic time—presentation time to ED.

STEMI = clinical evidence of myocardial ischaemia and ECG changes indicative of ischaemia: New >1mm ST elevation in two contiguous limb leads, new >2mm ST elevation in two contiguous chest leads, new Left Bundle Branch Block, development of pathologic Q waves, or a new regional wall motion abnormality.20 No age limit.

Appropriate thrombolysis = thrombolysis given for STEMI within 12 hours with no contraindication, or thrombolysis not given where contraindication exists.

15 minutes

50

Time to theatre for fractured neck of femur

ICD codes

S72 (00–05, 08, 10,11)

Operation start time—ED presentation time.

No age limit.

Adequate time to theatre <24 hours.21

6 hours

310

Time to theatre for appendicitis

ICD codes

K35 (0,1,9), K36, K37

Operation start time—ED presentation time.

Age >14 years.

Appropriateness = proportion of perforated appendix at operation.22

12 hours

140

Time to analgesia for patients with moderate to severe pain

All ED presentations with pain

First analgesic time—ED presentation time.

No age limit.

Adequate analgesia = a reduction in pain by 2 points on a 100mm visual analogue scale (or one category on a 4 category scale) and reduced to mild or no pain.23

20 minutes

800

ICD = International Classification of Diseases version 10, ED=Emergency Department, STEMI=St Elevation Myocardial Infarction, CT=Computerised Tomography, GCS=Glasgow Coma Scale. SIRS=Systemic Inflammatory Response Syndrome *Based on a literature review and expert opinion. 

Sample size

We determined a clinically important difference in time to treatment for each condition, based on a literature review and expert opinion prior to starting the data collection for these outcomes. Sample sizes were calculated for each outcome to detect this difference, with a power of 90% and an alpha of 0.05, based on the mean and standard deviation (SD) of data piloted at a separate site prior to commencing the study (Table 1).

Analysis

Medians with interquartile range (IQR), means with 95% confidence intervals (95%CI) and proportions (95%CI) were used to describe the data. To investigate changes in treatment times before and after target introduction, a general linear model was fitted with the log of the time plus 0.5 as the outcome. The log transformation was necessary, as treatment time data was skewed. The explanatory variables included were period (pre- or post-target), ethnicity (Māori, Pacific or other), deprivation score (a standard measure of socioeconomic deprivation used in New Zealand based on small geographic areas of domicile16), age and severity of condition where appropriate (Pain outcome). Back transformed least square means (LSM) of time were used to describe the effect size. For the binary outcomes, the analyses were the same with the exception that a generalised linear model was used with a binary distribution and a log link. The explanatory variables included were as above. Unadjusted time-based and descriptive analysis was performed using SPSS v21, Armonk, New York, USA. Multivariable analysis was performed using SAS/STAT version 9.3 SAS Institute, Cary, NC, USA.

Ethics approval

The Shorter Stays in Emergency Departments National Research Project was approved by the Multiregional Ethics Committee (MEC 10/06/60).

Results

Site specific population samples, case selection and study inclusion are outlined in Figure 1. Fewer patients were available for selection in the pre-target period for the pain outcome due to the data that was supplied by NZHIS starting in July rather than January 2006 (see methods), and fewer visits being selected from 2007 compared to other years (168 compared to ≈269 in the years 2008–2012), the reason for which is unclear. Similar proportions of screened visits were excluded for the pain, STEMI and appendicitis outcomes. More exclusions occurred in the pre-target period for the sepsis outcome due to the initial data request inadvertently capturing cases of neo-natal sepsis, which were not ED visits. Once this was recognised during data collection, the data request for subsequent records was changed to exclude births. There were fewer notes available in the post-target period for the NOF outcome due to patients still under active treatment during the data collection phase in late 2012 and early 2013, and more cases being incorrectly coded as fractured NOF (Figure 1).

Figure 1: Case selection and reasons for exclusion. 

 

c 

c 

Key: ED = Emergency Department, STEMI=ST Elevation Myocardial Infarction, NOF=Neck of Femur
*Due to a change in the way coding occurred at NZHIS in 2006, there were fewer visits eligible in the pre-target period for the pain outcome, which starts on 1/7/2006 rather than 1/1/2006.  

The yearly SSED target performance is shown in Figure 2. All sites increased the proportion of patients who left ED within six hours after the target was introduced, although the target threshold was not reached by all hospitals.

Figure 2: Target performance over time. 

c 

The unadjusted median times are reported in Table 2, and the modelled primary outcomes adjusting for the explanatory variables as described in the methods are shown in Table 3. There were no clinically important or statistically significant differences between the pre- and post-target periods for any of the primary or secondary outcomes.

Table 2: Unadjusted primary and secondary outcomes. 

Outcome

Overall ED LOS at sites

median (IQR) hours

Time to treatment

median (IQR)

Treatment adequacy*

% (95%CI)

Pre

Post

Pre

Post

Pre

Post

Sepsis

(†minutes)

4.6 (2.9–6.9)

3.8 (2.4–5.6)

136 (59–199)†

113 (52–217)†

92 (84–97)

90 (82–95)

ST elevation myocardial infarction (minutes)

3.5 (2.0–5.5)

3.1 (1.8–4.7)

27.5 (19–50)†

32 (21–52)†

91 (83–96)

88 (80–92)

Neck of femur fracture

(hours)

5.3 (3.1–9.4)

3.7 (1.8–5.6)

34.4 (22–57)

27.6 (20–51)

32 (26–39)

43 (35–51)

Appendicitis

(hours)

4.1 (2.7–6.27)

3.4 (2.3–4.8)

14.2 (11–22)

20.7 (10–28)

29 (20–40)

31 (21–43)

Pain

(†minutes)

3.0 (1.6–5.1)

2.9 (1.6–4.60)

57.5 (29–126)†

64 (30–138)†

36 (27–47)

44 (38–52)

*Adequacy was defined a-priori as appropriate antibiotics for the site of infection for Sepsis, either thrombolysed or not thrombolysed appropriately for ST elevation myocardial infarction, time to theatre <24 hours for neck of femur fracture, perforated appendix at operation for appendicitis, and adequate analgesia for pain. IQR = Interquartile Range, CI = Confidence Interval† indicates time in minutes (all other times are in hours). 

Table 3: Adjusted primary outcomes.

Outcome

Time to treatment

Back-transformed least square mean (95%CI)

Clinically important difference*

Pre

Post

p

Sepsis

(minutes)

60

105.9 (73–153)

104.3 (70–155)

0.93

ST elevation myocardial infarction (minutes)

15

36.9 (28–49)

47.6 (35.7–63)

0.14

Neck of femur fracture

(hours)

6

35.4 (32.1–39.1)

32.4 (29.2–36.1)

0.24

Appendicitis

(hours)

12

14.1 (12–17)

16.4 (14–20)

0.21

Pain

(minutes)

20

48 (31–75)

46 (32–66)

0.77

CI = Confidence Interval *This was determined prior to commencing the study. 

Discussion

This study found that the implementation of the Shorter Stays in ED target was not associated with clinically important or statistically significant differences in the time to treatment or adequacy of care for five acute clinical conditions reflecting care in both the ED and inpatient surgical units in different hospitals. More people left ED within six hours overall, and the median time spent in ED by patients included in the current study either reduced or remained the same after the target was introduced.

Although introduced with a view to reduce unnecessary time patients spend in ED and hence to reduce ED crowding, time targets for ED length of stay have been criticised on the grounds that they may lead to unintended consequences or divert attention away from other aspects of quality of care.9 Concerns have also been raised by inpatient clinicians about the potential for inappropriate patients to be admitted under their care if sufficient time is not spent differentiating patients in the ED prior to admission. This may lead to inefficient care or unnecessary resource use on inpatient medical24 or surgical wards.25

Prior research has reported mixed results with respect to ED time targets. New Zealand research using similar methods also found no change in the time to steroids in acute moderate to severe asthma in four hospitals, while the proportion of patients receiving steroids in ED increased.26 Another study from our group found improvements in the quality of discharge summaries from the ED to primary care in two other New Zealand hospitals.27 In two Australian hospitals, times to theatre for appendectomy were similar to those we found in their pre-National Emergency Access Target (NEAT) period. However, in the subsequent year, the time to theatre increased to 26 hours in the Australian study.25 In Ontario, a further study compared the difference in outcomes one year before implementation of ED LOS targets with one year after in hospitals that succeeded in reducing ED LOS versus those that didn’t succeed or got worse. The authors reported no difference in the time to thrombolysis for STEMI, time to analgesia or splinting for patients with arm fractures and time to steroids in asthma.28

The results from our study alongside others noted above indicate that there is little evidence to suggest that targets focusing on ED length of stay have diverted attention away from other aspects of quality of care in the specific clinical conditions studied. However, whether this represents ‘success’ with respect implementation of such targets is may depend on the perspective of an observer. An alternative view of this data is that despite apparent ED LOS target ‘success’, the quality of care did not improve substantially. One reason for this may be a ceiling effect, ie, given good quality of care pre-target, it is difficult to demonstrate a clinically important improvement. This may be a relevant issue in our study, as the baseline times to treatment were reasonable for all outcomes. It is also possible that the reported improvements in ED length of stay targets at our study sites may not have been sufficient to result in important reductions in crowding, as not all of the sites we studied achieved the 95% target threshold. In a secondary analysis, the authors of the Ontario study found that treatment times were faster in the least crowded ED shifts (average ED LOS <4 hours) compared to those in the most crowded ED shifts (average ED LOS >8 hours). This suggests that reductions of around one hour in median ED LOS from a baseline of four hours similar to those we observed may not necessarily result in reductions in ED crowding sufficient to accelerate treatment times. Further research is currently underway to explore how the implementation of the SSED target may have impacted on hospital length of stay, re-presentation to ED, re-admission to hospital, rates of leaving prior to being seen in ED and acute and elective mortality nationally.29

Limitations

Due to the number of cases notes required for each outcome and logistic constraints for both the research team and the clinical records departments at the participating hospitals, it was not feasible to measure all outcomes at all sites. We therefore measured different outcomes at different sites so that collectively, we covered a range of quality of acute care indicators in relation to the target, both in the ED and the hospital. For ‘pain’ and ‘sepsis’ the estimated sample size was not achieved, weakening the strength of conclusions around the results for these outcomes and increasing the risk of a type II error. However, the observed differences were small even though the estimates were imprecise. As the SSED target was introduced rapidly by the Ministry of Health to all New Zealand public hospitals, we were limited to using a ‘pre and post’ design rather than a prospective study control sites. Consequently, a causal relationship between the introduction of the target and any differences in quality or lack thereof cannot be assumed because other variables not accounted for by the design may have influenced the outcomes. Retrospective data abstraction involving clinical notes may introduce both selection and measurement bias. In an attempt to minimise bias, notes were selected at random, and electronic data was used wherever possible. Electronic data extraction forms with automated logic checks on individual variables minimised typographical errors. These forms also contained built-in validations, such as formulas which calculated whether or not a given patient met the entry criteria for respective outcomes and additional criteria for severity of condition to reduce subjectivity in these assessments. However, data extractors were not blinded to the objectives of the study, and the collection of time variables meant blinding was not possible with respect to the pre- and post-intervention time periods. Finally, the study results for outcomes measured at single sites may not be generalisable to other settings where the baseline care may differ. It is also possible that quality of care for outcomes that we did not explore may have changed. Importantly, the investigations of these clinical indicators were not powered adequately to explore variations in quality of care between different groups, eg, ethnicity or socio-economic status. This should be the focus of future research.

Conclusion

The introduction of the SSED target was not associated with clinically important or statistically significant changes in the time to treatment and adequacy of care for five clinical indicators of quality of care in Aotearoa New Zealand. For those indicators measured at one site only, it is unknown whether these results can be generalised to other sites.

Summary

This study explored the association between the introduction of a mandatory national target for emergency department (ED) length of stay, which was introduced in New Zealand in 2009, and five key indicators of quality of care. We did this study as there is some evidence from overseas that focusing on a process target for the time spent in the ED may divert attention away from other aspects of quality of care. Our study found that more people left the ED within six hours after introduction of the shorter stays in ED target. There was no difference in the quality of care for patients in pain, with severe infections, with heart attacks, with appendicitis and with fractured hips when comparing the outcomes for these conditions before and after the introduction of the target.

Abstract

Aim

To determine whether implementation of a national health target called Shorter Stays in Emergency Departments impacted on clinical markers of quality of care.

Method

A retrospective pre- and post-intervention study from 2006 to 2012 examined quality of care metrics for five different indicators at different sites in relation to the implementation of the target using a general linear model for times to treatment. Explanatory variables included period (pre- or post-target), ethnicity, age, deprivation and severity of condition. Back transformed least square means were used to describe the outcomes.

Results

The times to treatment for ST elevation myocardial infarction; 36.9 (28–49) vs 47.6 (36–63) minutes p=0.14, antibiotics for severe sepsis; 105.9 (73–153) vs 104.3 (70–155) minutes p=0.93, analgesia for moderate or severe pain; 48 (31–75) vs 46 (32–66) minutes p =0.77, theatre for fractured neck of femur; 35.4 (32.1–39.1) vs 32.4 (29.2–36.1) hours, and to theatre for appendicitis; 14.1 (12–17) vs 16.4 (14–20) hours were unchanged after implementation of the target. Treatment adequacy was also unchanged for these indicators.

Conclusion

Introduction of the Shorter Stays in Emergency Departments target was not associated with any clinically important or statistically significant changes in the time to treatment and adequacy of care for five different clinical indicators of quality of care in Aotearoa New Zealand. For those indicators measured at one site only, it is unknown whether these results can be generalised to other sites.

Author Information

Peter Jones, Adult Emergency Department, Auckland City Hospital, Auckland District Health Board, Auckland, Section of Epidemiology and Biostatistics, University of Auckland, Auckland; James Le Fevre, Adult Emergency Department, Auckland City Hospital, Auckland District Health Board, Auckland; Alana Harper, Adult Emergency Department, Auckland City Hospital, Auckland District Health Board, Auckland; Susan Wells, Section of Epidemiology and Biostatistics, University of Auckland, Auckland; Joanna Stewart, Section of Epidemiology and Biostatistics, University of Auckland, Auckland; Elana Curtis, Te Kupenga Hauora Māori, University of Auckland, Auckland; Papaarangi Reid, Te Kupenga Hauora Māori, University of Auckland, Auckland; Shanthi Ameratunga, Section of Epidemiology and Biostatistics, University of Auckland, Auckland.

Correspondence

Peter G Jones, Director of Emergency Medicine Research, Adult Emergency Department, Auckland City Hospital, Park Road, Grafton, Auckland 1142.

Correspondence Email

peterj@adhb.govt.nz

Competing Interests

During his time as a research fellow on this study, JLF was also an elected member of one district health board. This potential competing interest was declared to all relevant parties prior to commencing the research activities, and his work was supervised directly by the corresponding author (PJ). The relevant parties and all other authors were satisfied that this potential conflict did not influence JLF’s contributions to the submitted work. No other authors have any conflict of interest to declare.

References

  1. Ryall T. Fewer more focussed targets 2009 [16/12/2015]. Available from: http://www.beehive.govt.nz/release/fewer-more-focussed-targets
  2. MOH. Shorter Stays in Emergency Departments Health Target 2009 [08/04/2011]. Available from: http://www.moh.govt.nz/emergencydepartments
  3. Sprivulis PC, Da Silva J, Jacobs IG, Frazer ARL, Jelinek GA. The association between hospital overcrowding and mortality among patients admitted via Western Australian emergency departments. Medical Journal of Australia. 2006; 184(5):208–12.
  4. Richardson DB. Increase in patient mortality at 10 days associated with emergency department overcrowding. Medical Journal of Australia. 2006; 184(5):213–6.
  5. Bernstein SL, Aronsky D, Duseja R, Epstein S, Handel D, Hwang U, et al. The Effect of Emergency Department Crowding on Clinically Oriented Outcomes. Academic Emergency Medicine. 2009; 16(1):1–10.
  6. Sun BC, Hsia RY, Weiss RE, Zingmond D, Liang LJ, Han W, et al. Effect of emergency department crowding on outcomes of admitted patients. Annals of Emergency Medicine. 2013; 61(6):605–11.e6.
  7. The NHS Plan: a plan for investment a plan for reform. Cm 4818-I. Report number 010481829, Department of Health. Department of Health, UK; 2000. p. 1–147.
  8. Expert Panel Review of Elective Surgery and Emergency Access Targets under the National Partnership Agreement on Improving Public Hospital Services: Australian Government; 2011 [16/12/15]. Available from: http://www.coag.gov.au/sites/default/files/Expert_Panel_Report%20D0490.pdf
  9. Gubb J. Have targets done more harm than good in the English NHS? Yes. BMJ. 2009; 338:442.
  10. Geelhoed GC, de Klerk NH. Emergency department overcrowding, mortality and the 4-hour rule in Western Australia. Med J Aust. 2012; 196:122–6.
  11. Hauck K, Street A. Do targets matter? A comparison of English and Welsh National Health priorities. Health Econ. 2007; 16(3):275–90.
  12. Wood H, Fontain P, Harvey D, Catford G, Hills A, Holland B. Investigation into Mid Staffordshire NHS Foundation Trust. Healthcare Commission, 2009 March. Report No.: ISBN: 978-1-84562-220-6.
  13. Jones P, Chalmers L, Wells S, Ameratunga S, Carswell P, Ashton T, et al. Implementing performance improvement in New Zealand emergency departments: the six hour time target policy national research project protocol. BMC Health Serv Res. 2012; 12(1):45.
  14. Jones P, Harper A, Wells S, Curtis E, Carswell P, Reid P, et al. Selection and validation of quality indicators for the Shorter Stays in Emergency Departments National Research Project. Emergency Medicine Australasia. 2012; 24(3):303–12.
  15. Jones P, Harper A, Kumar D. Shorter Stays in Emergency Departments National Research Project Raw Data Definitions 2012 [24/3/2016)]. Available from: http://static-content.springer.com/esm/art%3A10.1186%2F1472-6963-12-45/MediaObjects/12913_2012_1949_MOESM3_ESM.PDF
  16. Clare Salmond PC, Atkinson J. NZDep2006 Index of Deprivation 2007 11th March 2011. Available from: http://www.wnmeds.ac.nz/NZDep-info.html
  17. Levy MMM, FCCP; Fink, Mitchell P. MD, FCCP; Marshall, John C. MD; Abraham, Edward MD; Angus, Derek MD, MPH, FCCP; Cook, Deborah MD, FCCP; Cohen, Jonathan MD; Opal, Steven M. MD; Vincent, Jean-Louis MD, FCCP, PhD; Ramsay, Graham MD; For the International Sepsis Definitions Conference,. 2001 SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference. Crit Care Med. 2003; 31(4):1250–6.
  18. Dellinger RPMD, Levy MMMD, Carlet JMMD, Bion JMD, Parker MMMD, Jaeschke RMD, et al. Surviving Sepsis Campaign: International guidelines for management of severe sepsis and septic shock: 2008. [Article]. Critical Care Medicine January. 2008; 36(1):296–327.
  19. Goldstein B, Giroir B, Randolph A. International pediatric sepsis consensus conference: definitions for sepsis and organ dysfunction in pediatrics. Pediatric critical care medicine: a journal of the Society of Critical Care Medicine and the World Federation of Pediatric Intensive and Critical Care Societies. 2005; 6(1):2–8.
  20. Thygesen K, Alpert JS, White HD, on behalf of the Joint ESC/ACCF/AHA/WHF Task Force for the Redefinition of Myocardial Infarction, TASK FORCE MEMBERS: Chairpersons: Kristian Thygesen JSA, Harvey D. White, Biomarker Group: Allan S. Jaffe C, Fred S. Apple , Marcello Galvani , Hugo A. Katus, L. Kristin Newby , Jan Ravkilde, et al. Universal Definition of Myocardial Infarction. Circulation. 2007; 116(22):2634–53.
  21. New Zealand Guidelines Group: Acute Management and Immediate Rehabilitation after Hip Fracture Amongst People Aged 65 years and Over. Wellington, New Zealand: New Zealand Guidelines Group, 2003 Contract No.: ISBN: 0-473-09091-0.
  22. Omundsen M, Dennett E. Delay to appendicectomy and associated morbidity: a retrospective review. ANZ Journal of Surgery. 2006; 76(3):153–5.
  23. Jao K, Mc DTD, Taylor SE, Khan M, Chae J. Simple clinical targets associated with a high level of patient satisfaction with their pain management. Emergency medicine Australasia: EMA. 2011; 23(2):195–201.
  24. Nash L, Tacey M, Liew D, Jones C, Truesdale M, Russell D. Impact of emergency access targets on admissions to general medicine: a retrospective cohort study. Internal Medicine Journal. 2013; 43(10):1110–6.
  25. Perera ML, Gnaneswaran N, Roberts MJ, Giles M, Liew D, Ritchie P, et al. The ‘four-hour target’ and the impact on Australian metropolitan acute surgical services. ANZ J Surg. 2015.
  26. Jones P, Wells S, Harper A, LeFevre J, Stewart J, Curtis E, et al. Is a national time target for emergency department stay associated with changes in the quality of care for acute asthma? A multicentre pre-intervention post-intervention study. Emergency medicine Australasia : EMA. 2016; 28(1):48–55.
  27. Harper A, Jones P, Wimsett J, Stewart J, Le Fevre J, Wells S, et al. The effect of the Shorter Stays in Emergency Departments health target on the quality of ED discharge summaries. Emerg Med J. 2016.
  28. Vermeulen MJ, Guttmann A, Stukel TA, Kachra A, Sivilotti ML, Rowe BH, et al. Are reductions in emergency department length of stay associated with improvements in quality of care? A difference-in-differences analysis. BMJ Qual Saf. 2015.
  29. Jones P, et al. Impact of a national time target for ED length of stay on patient outcomes. NZ Med J 2017; 130(1455):15–34.