27th March 2015, Volume 128 Number 1411

Tary Yin, Stephen Child

Surgical knowledge, procedural and interventional skills form an integral part of the learning objectives for New Zealand house officers (prevocational doctors) however the role of the operating theatre in house officer learning is unclear.1 This study aims to assess whether attending the operating theatre is perceived as beneficial by house officers utilising an easy to use and administer method.

The Surgical Theatre Educational Environment Measure (STEEM) was one of the first tools developed specifically for measuring the operating theatre learning environment.2 This was validated on surgical trainees in the United Kingdom who rated their environment a mean overall score of 74.4%.2 This research was subsequently reproduced with general surgical residents in Canada, medical students in the United Kingdom as well as Australian and New Zealand surgical trainees with similar scores.3–5

Subsequently, a condensed Mini-STEEM, was created after discovering that 13 out of 50 of the survey questions covered 73.2% of the total variance.6 Each of these studies were validated by demonstrating a high internal consistency and using exploratory factor analysis these studies were then able to divide their inventories into various subscales reflecting distinct areas of the surgical theatre educational environment.7

Our study utilised items from the mini-STEEM and full STEEM to construct a short 15-item, house officer-focused, Likert-type scale questionnaire called the Auckland Surgical Theatre Educational Environment Measure (ASTEEM; Appendix 1). For each Likert-type scale question, a score of 5 was given if the participant ‘strong agreed’, 4 if ‘agreed’, 3 if ‘uncertain’, 2 if ‘disagreed’ and 1 if ‘strongly disagreed’. For negative statements (questions 14, 15, 19, 20, 24, 25 and 26), the scoring was reversed. An overall total score and three subscale scores were calculated based on the mini-STEEM’s subscales.6

In addition, 11 questions preceding the ASTEEM were included (Appendix 1 & 2) which asked about gender, level of training, district health board, current run, run experiences, New Zealand Curriculum Framework procedural learning outcomes achieved, opportunity to admit undifferentiated patients, belief in added educational value in going to theatre, theatre attendance, career intention and primary trainer.1

This questionnaire was distributed to house officers using SurveyMonkey (SurveyMonkey Inc.), an online survey development website. House officers undergoing surgical runs at all Auckland hospitals were included (Waitemata District Health Board, WDHB; Auckland District Health Board, ADHB; and Counties Manukau District Health Board, CMDHB).

86 of 183 (46.99%) house officers working in surgical attachments responded, of which 84.88% had attended a case in theatre by the end of their attachment with 81.40% having completed ASTEEM as well. There were equal numbers of male and female respondents with postgraduate year one (PGY1) house officers making up the largest proportion (47.67%) followed by PGY2 house officers (39.53%).

84.88% of respondents attended the operating theatre during their run with 87.21% believing that there was added educational value in going to theatre. The mean overall score of the ASTEEM was 68.76% which compared similarly to previous surgical theatre educational environment measures.2–6 See Table 1.

 

Table 1. ASTEEM results

Subscales

Score

Questions

Good surgical operating experience

56.2%

Before the operation my trainer discusses the surgical technique planned 3.19/5

I get enough opportunity to assist 3.27/5

I am usually too busy doing other work to go to theatre 1.97/5

Friendly atmosphere in theatre

75.7%

My trainer is enthusiastic about teaching 4.17

The theatre staff are friendly 3.85/5

There are enough theatre sessions per week for me to gain the appropriate experience 3.25/5

The atmosphere in theatre is pleasant 3.81

Discrimination against me

 

81.3%

The anaesthetists put pressure on my trainer to operate himself to reduce anaesthetic time 3.47

I feel discriminated against in theatre because of my gender 4.29/5

I feel discriminated against in theatre because of my ethnicity 4.44/5

Questions from the full STEEM

 

 

I get on well with my trainer 4.33/5

The nursing staff dislike it when I operate as the operation takes longer 2.91/5

My trainer’s surgical skills are very good 4.53/5

I get bleeped during operations 1.89/5

When I am in theatre, there is nobody to cover the ward 2.14/5

 

A Mann-Whitney test was then performed to compare ASTEEM scores between house officers with surgical versus non-surgical career intentions. In total there were 31 house officers who had surgical career intentions and 39 house officers who had non-surgical career intentions. House officers interested in surgery rated their surgical educational environments significantly higher overall (72.43% versus 65.84%, p=0.006) as well as in the ‘friendly atmosphere in theatre’ subscale (80.95% versus 71.55%, p=0.002). See Table 2.

 

Table 2. ASTEEM scores comparing house officers with surgical career intentions versus non-surgical career intentions

Variable

Surgical

n=31

Non-surgical

n=39

P-value

Total score

72.43%

65.84%

0.006

Good surgical operating experience

58.93%

54%

0.185

Friendly atmosphere in theatre

80.95%

71.55%

0.002

Discrimination against me

83%

80%

0.521

 

A high percentage of surgical house officers achieved the New Zealand Curriculum Framework procedural learning outcomes of: managing common complications (95.35%), monitoring and managing patients postoperatively (94.19%) and being able to explain indications and contraindications for common procedures (90.70%). However procedural skills including wound dressing, simple skin lesion excision and wound debridement were very poorly achieved at 37.21%, 25.58% and 20.93% respectively.1

Our study suggests that attending the operating theatre is perceived as beneficial by most house officers irrespective of career intention and that the operating surgical theatre environment is positive to their learning experience. It should be noted that our sample size precludes subgroup analysis and that we have no validation of our modified ASTEEM. Nevertheless, our results compare favourably to previous STEEM and mini-STEEM studies suggesting reliability.2–6

In addition, it was noteworthy that while 84.88% attended theatre, New Zealand Curriculum Framework procedural learning outcomes of managing common complications, monitoring and managing patients postoperatively and being able to explain indications and contraindications of common procedures were met by over 90% of respondents.

Educational environments should be monitored regularly and this survey provides a simple method to audit the effects of any interventions implemented.7 It is also the first house officer-focused tool for assessing the operating theatre educational environment to our knowledge.

(Ethics approval for this study was granted by the Auckland District Health Board Ethics Committee.)

 

Tary Yin
House Officer
Auckland District Health Board
Auckland, New Zealand
TaryY@adhb.govt.nz

Stephen Child
General Physician
Clinical Education and Training Unit
Auckland District Health Board
Auckland, New Zealand

 

References

1. Medical Council of New Zealand. New Zealand Curriculum Framework for Prevocational Medical Training. 2014. Retrieved from https://www.mcnz.org.nz/assets/News-and-Publications/NZCF26Feb2014.pdf

2. Cassar K. Development of an instrument to measure the surgical operating theatre learning environment as perceived by basic surgical trainees. Medical Teacher. 2004;26(3):260–264.

3. Kanashiro J, McAleer S, Roff S. Assessing the educational environment in the operating room—a measure of resident perception at one Canadian institution. Surgery. 2006;139(2):150–158.

4. Mahoney A, Crowe PJ, Harris P. Exploring Australasian Surgical Trainees' Satisfaction with Operating Theatre Learning Using the ‘Surgical Theatre Educational Environment Measure’. ANZ Journal of Surgery. 2010;80(12):884–889.

5. Nagraj S, Wall D, Jones E. Can STEEM be used to measure the educational environment within the operating theatre for undergraduate medical students? Medical Teacher. 2006;28(7):642–647.

6. Nagraj S, Wall D, Jones E. The development and validation of the mini-surgical theatre educational environment measure. Medical Teacher. 2007;29(6):e192–e197.

7. Soemantri D, Herrera C, Riquelme A. Measuring the educational environment in health professions studies: A systematic review. Medical Teacher. 2010;32(12):947–952.


 

Appendix 1. Survey (page 2); including 15 Likert-scale type questions (questions 12–26)

content00

 Appendix 2. Survey (page 1)

content01