An Analysis of the Educational Environment at the Malta Foundation Programme Using the Postgraduate Hospital Educational Environment Measure (PHEEM)

Abstract

Background:

Learning from managing patients in a real-world context is by far superior to simulation learning. A substandard educational environment is associated with poor patient care and suboptimal learning outcomes. The measurement of the educational environment provides insight into what is needed to improve the level of training.

Objective:

To measure the educational environment as perceived by trainees within the Malta Foundation Programme.

Methods:

This study used the Postgraduate Hospital Educational Environment Measure (PHEEM) to measure the educational environment at the Malta Foundation Programme. Descriptive statistics were used to describe the demographics of the study population. Nonparametric comparative statistics were used to identify statistically significant differences between groups.

Results:

Ninety-eight trainees out of 370 (26.5%) completed the online questionnaire. These consisted of 39 FY1s (31.5% of 124), 33 FY2s (24.8% of 133), and 26 extended FYs (23.0% of 113). The 40-item PHEEM showed good reliability with a Cronbach’s α value of .912. These doctors perceived their educational environment as more positive than negative. Perceptions are worst among trainees at the end of their first year of training. Those who had just finished their training have reported better perceptions. The 3 worst scoring items are related to when the trainees are on call.

Conclusion:

Among trainees within the Malta Foundation Programme, perceptions of role autonomy and social support are areas where most work is needed. Teaching seems to be moving in the right direction, but there is always room for improvement.

Keywords

Educational environment clinical postgraduate Malta Foundation Programme

Introduction

For healthcare professionals, there is no substitute for learning in the clinical environment.¹ Learning from managing patients in a real-world context is by far superior to simulation learning. Over the past 3 decades, the subject of the educational environment, both at the undergraduate and postgraduate levels, has been the focus of much research and discussion among all stakeholders in medical education. Both the General Medical Council (GMC)² and Kilty et al³ have underlined that a substandard educational environment is associated with poor patient care and suboptimal learning outcomes. Not only do young trainees learn from their work with patients, but patient care would suffer were these trainees to be removed from teaching organizations as their work is essential for any healthcare organization. This is further confirmed by the GMC² when it states, “patient safety is inseparable from a good learning environment and culture that values and supports learners and educators.” The educational environment is, therefore, considered an important measure in both undergraduate and postgraduate medical training.

Postgraduate medical trainees have a dual contrasting role. On the one hand, they are trainees transitioning to hospital life, still in need of support and still adapting to their new responsibilities.⁴ On the other hand, as practicing doctors, they need to provide answers to patients’ questions, work long hours, be accountable for their actions and may find inadequate support from their more senior colleagues. Trainees may feel under constant evaluation by their patients, colleagues, and senior grades.⁵ This dual role is known to increase the risk of stress, anxiety, depression, and burnout.⁶ Medical trainees are known to be one of the most vulnerable categories of employees to occupational stress.⁷

The MACY Foundation⁸ sees the educational environment as:

“the social interactions, organizational cultures and structures, and physical and virtual spaces that surround and shape participants’ experiences, perceptions, and learning.”⁸

The American Medical Association defines the educational environment as:

“a social system that includes the learner, the individuals with whom the learner interacts, the setting(s) and purpose(s) of the interaction, and the formal and informal rules/policies/norms governing the interaction.”⁹

These definitions, among others, identify the complexity of the educational environment when compared to education in a class room.

The measurement of the educational environment provides insight into what is needed to improve the level of training. This is done by identifying the weaknesses and strengths of a training program and which areas should be prioritized in any improvement that is planned.

For many years, the educational environment was ignored, possibly because of the lack of suitable and validated instruments that could be used to assess it. This has now changed, and a number of validated instruments have been used to assess the different aspects or domains of the educational environment. One of the first to be developed was the Dundee Ready Education Environment Measure (DREEM).¹⁰ DREEM uses 5 subscales in its evaluation of the education environment:

Students’ perception of learning

Students’ perception of teachers

Students’ academic self-perceptions

Students’ perceptions of atmosphere

Students’ social self-perceptions

Following DREEM, a number of other instruments aimed at assessing the education environment in different settings were developed and validated. List 1 provides a selection of instruments for evaluating specific learning environments in medical education.

List 1¹¹

C-Change Resident Survey: Culture Change Resident Survey¹²

SPEED: Scan of Postgraduate Educational Environment Domains¹³

UCEEM: Undergraduate Clinical Education Environment Measure¹⁴

AMEET: Assessment of Medical Education Environment by Teachers¹⁵

DREEM: Dundee Ready Educational Environment Measure¹⁶

MSLES: Medical School Learning Environment Survey¹⁷

LEQ: Learning Environment Questionnaire¹⁸

MSEI: Medical School Inventory¹⁹

JHLES: Johns Hopkins Learning Environment Scale²⁰

LE Survey: Learning Environment Survey¹²

ATEEM: Anesthetic Theatre Educational Environment Measure²¹

DR-CLE: Diagnostic Radiology Clinical Learning Environment²²

STEEM: Surgical Theatre Educational Environment Measure²³

OREEM: Operating Room Educational Environment Measure²⁴

ACLEEM: Ambulatory Care Learning Education Environment Measure²⁵

PHEEM: Postgraduate Hospital Educational Environment Measure²⁶

D-RECT: Dutch Residency Educational Climate Test²⁷

LPS14-PR: Veteran Affairs (VA) Learners’ Perception Survey 2014 for Trainees in Primary Care Settings²⁸

PHEEM is a 40-item questionnaire scored on a Likert scale as follows:

4—Strongly agree

3—Agree

2—Uncertain

1—Disagree

0—Strongly disagree.

PHEEM is sub-divided into 3 sub-scales, each measuring perceptions of role autonomy (14 items), teaching (15 items), and social support (11 items). When interpreting the scores for each of the 3 sub-scales, Roff et al²⁶ recommend the following schema:

I. Perceptions of role autonomy

0 to 14—very poor

15 to 28—a negative view of one’s role

29 to 42—a more positive perception of one’s role

43 to 56—excellent perception of one’s job

II. Perceptions of teaching

0 to 15—very poor quality

16 to 30—in need of some retraining

31 to 45—moving in the right direction

46 to 60—model teachers

III. Perceptions of social support

0 to 11—non-existent

12 to 22—not a pleasant place

23 to 33—more pros than cons

34 to 44—a good supportive environment.

Roff et al²⁶ recommend the following interpretation of the overall score:

0 to 40—very poor

41 to 80—plenty of problems

81 to 120—more positive than negative but room for improvement

121 to 160—excellent

Individual items can be scored as follows:

>3.5—very positive point

<2—problem area

2 to 3—item can potentially be improved.

PHEEM was specifically created to measure the educational environment within a postgraduate setting. Thus, PHEEM was an ideal tool for this study.

With the use of different measures of the education environment now widespread in the literature, such instruments can be used to gain holistic views of the curriculum; understand the students’ perceptions of learning, teaching, and the atmosphere; compare the different perceptions of the various stakeholders; compare environments between schools or departments; provide organizations with indications of what needs to be changed or improved; and evaluate the results of any changes made to the education environment.²⁹

Objective

To measure the educational environment as perceived by trainees within the Malta Foundation Programme.

Methodology

The aim of this study was to analyze the educational environment within the Malta Foundation Programme as perceived by the trainees within the program themselves.

The Malta Foundation Programme (MFP)³⁰ was founded in 2009. The Malta Foundation Programme is a 2-year training program for newly graduated doctors consisting of structured teaching, hands-on training, and assessments while working in a supervised hospital or primary-care environment.

As the MFP bases its operations on the same Reference Guide while offering the same Curriculum and training opportunities as the UK Foundation Programme (UKFPO), the MFP was awarded the status of Affiliate Program by the UK Foundation Programme. This status has ensured that trainees of the MFP, upon completion of their programme, can compete on the same level as those completing the UK Foundation Programme for training posts in specialities in Malta, the UK, or elsewhere. This affiliation has since been renewed at regular intervals after the MFP repeatedly fulfilled the Quality Standards of the Malta Medical Council and the UKFPO.³⁰

A cross-sectional observational method was chosen for a study of the educational environment and burnout among foundation doctors in Malta. It is the author’s personal opinion that the educational environment at the Malta Foundation Programme may be related to possible burnout among the trainees. The aim of the study was to analyze both the educational environment and burnout at the Malta Foundation Programme. This paper reports on the results for the educational environment. The other results are reported elsewhere.

The instrument chosen to assess the educational environment is the PHEEM questionnaire administered online through Google Forms to all doctors within the Malta Foundation Programme. The PHEEM questionnaire has been validated in various settings and in different countries. Minor changes were made to the wording of the questionnaire to ensure that each question was relevant to the Maltese setting. Direct correspondence with the original author of the PHEEM questionnaire ensured permission to use and validity of the minor changes to the wording.

PHEEM was administered in English, as all medical tuitions in Malta are carried out in English. The questionnaires were distributed to all foundation program doctors via their year representatives in the form of a Google Form online questionnaire. As the Foundation Programme does not offer the service of forwarding emails directly, the questionnaire was initially sent to the Foundation School Secretary, who then passed it on to the foundation doctors’ representatives. A reminder was sent after 7 days to increase the response rate. All respondents were requested to submit solely a single reply, especially as this was an anonymous questionnaire. The period of data collection coincided with a period when 3 cohorts of foundation doctors could be sampled. The first years were sampled at the end of their first rotation, 3 months into practice. The second years were sampled between their first and second years, a year into practice. A third category, though technically not under the responsibility of the Foundation Programme, was the extended Foundation doctors. These were doctors who had successfully finished their foundation training and were waiting for their BST posts to be decided. These trainees were sampled at the end of their 2-year foundation training. The sampling period ran between July and August 2020 for FY2s and extended FYs and in October 2020 for FY1s.The deadline for the collection of data was 2 weeks after the reminder was sent.

The responses were analyzed using SPSS 25.0. Questions 7, 8, 11, and 13 are negatively worded statements and need to be reversed for scoring. Reliability tests of the whole instruments and the 3 factors were performed using Cronbach’s alpha. Descriptive statistics were used to describe the demographic features of the respondents. Tests for normality (Kolmogorov-Smirnov and Shapiro-Wilk) for all factors revealed that no question was normally distributed. Therefore, all comparative statistics were of the nonparametric type. The Mann-Whitney U test was used to analyze differences between sexes. The Kruskal-Wallis H test was used to test for differences between foundation years. The threshold for statistical significance was a P < .05 and 95% confidence interval. Factor analysis of all 40 items was also performed using both the scee plot and a criterion of an eigenvalue >1.

Ethics approval and consent to participate

Ethical approval was obtained from the University of Malta Faculty Research Ethics Committee, and approval to disseminate the questionnaire was obtained from the Malta Foundation Programme.

A covering letter and a participant information sheet accompanied the questionnaire. Informed consent was obtained from all participants. All methods were carried out in accordance with relevant guidelines and regulations.

Results

Demographics

Table 1 describes the response rates for the different cohorts. 60.2% were female and 94.9% were single. 87.8% were Maltese. A total of 86.7% worked in excess of the 48-hour week stipulated in the European Working Time Directive.

Table 1.

Response rates.

	Invited	Responses received (%response rate)
Foundation Year 1	124	39 (31.5%)
Foundation Year 2	133	33 (24.8%)
Extended Foundation	113	26 (23.0%)
Total	370	98 (26.5%)

Internal consistency

The 40-item PHEEM showed good reliability with a Cronbach’s α value of .912. Cronbach’s α for each of the 3 subscales of the PHEEM was as follows:

Autonomy—.790

Teaching—.885

Social support—.683

Item analysis

The responses of each FY cohort to each of the 40 items forming up the PHEEM are listed in Table 2.

Table 2.

Summarizes the responses to each of the 40 questions according to year.

No.	Question	FY1s		FY2s		Extended FYs		Total
No.	Question	Mean	SD	Mean	SD	Mean	SD	Mean	SD
1	I have a contract of employment that provides information about hours of work	2.36	0.932	1.61	1.223	1.62	1.061	1.91	1.122
2	My clinical teachers set clear expectations	2.59	0.938	2.48	0.870	2.12	1.071	2.43	0.963
3	I have protected educational time in this post	1.82	1.189	1.67	1.267	1.92	1.383	1.80	1.260
4	I have an informative induction program	2.36	1.088	1.82	1.044	2.12	1.033	2.11	1.073
5	I have the appropriate level of responsibility in this post	2.49	0.914	2.06	1.116	2.42	1.027	2.33	1.023
6	I have good clinical supervision at all times	2.87	0.978	2.39	1.171	2.69	1.158	2.66	1.102
7	There is racism in this post	2.44	1.188	2.48	1.093	2.62	1.359	2.50	1.195
8	I have to perform inappropriate tasks	2.00	1.051	1.52	1.093	1.69	1.289	1.76	1.140
9	There is an informative Junior Doctors handbook	1.82	1.023	2.30	1.132	2.27	1.002	2.10	1.070
10	My clinical teachers have good communication skills	2.85	0.875	2.79	0.820	2.65	1.056	2.78	0.903
11	I am bleeped inappropriately	1.13	1.005	0.58	0.902	0.96	1.399	0.90	1.108
12	I am able to participate actively in educational events	2.36	0.778	2.06	0.864	1.96	0.958	2.15	0.866
13	There is sex discrimination in this post	2.56	1.142	2.61	1.197	2.77	1.243	2.63	1.179
14	There are clear clinical protocols in this post	2.85	0.432	2.58	0.969	2.69	0.838	2.71	0.760
15	My clinical teachers are enthusiastic	2.54	0.884	2.30	1.015	2.38	0.983	2.42	0.852
16	I have good collaboration with other doctors in my grade	3.21	0.695	3.42	0.561	3.35	0.562	3.32	0.619
17	My hours conform to the European Working Time Directive	1.03	1.013	0.64	1.025	0.62	0.983	0.79	1.018
18	I have the opportunity to provide continuity of care	2.33	0.898	1.94	1.197	2.58	0.945	2.27	1.041
19	I have suitable access to careers advice	1.85	1.040	1.67	1.137	1.64	0.810	1.73	1.016
20	This hospital has good quality accommodation for junior doctors, especially when on call	2.08	1.178	1.45	1.325	1.73	1.218	1.78	1.256
21	There is access to an educational program relevant to my needs	2.31	0.766	1.94	1.116	1.92	1.038	2.08	0.975
22	I get regular feedback from seniors	2.28	1.123	2.30	0.984	2.31	1.011	2.30	1.038
23	My clinical teachers are well organized	2.61	0.823	2.30	1.075	2.27	0.962	2.41	0.955
24	I feel physically safe within the hospital environment	2.62	0.963	2.45	1.003	2.38	0.983	2.50	0.977
25	There is a no-blame culture in this post	1.62	1.161	1.33	1.242	1.19	1.234	1.41	1.209
26	There are adequate catering facilities when I am on call	1.15	1.014	0.70	0.951	0.62	0.898	0.86	0.984
27	I have enough clinical learning opportunities for my needs	2.05	1.025	1.91	1.146	2.00	1.080	1.99	1.071
28	My clinical teachers have good teaching skills	2.74	0.751	2.61	0.899	2.58	0.902	2.65	0.839
29	I feel part of a team working here	2.92	0.870	2.75	0.718	2.77	0.992	2.82	0.854
30	I have opportunities to acquire the appropriate practical procedures for my grade	2.41	0.850	2.03	1.132	2.19	1.021	2.22	1.000
31	My clinical teachers are accessible	2.82	0.970	2.64	0.994	2.58	0.703	2.69	0.913
32	My workload in this job is fine	2.08	1.085	1.48	1.176	2.15	1.190	1.90	1.171
33	Senior staff utilize learning opportunities effectively	2.49	0.885	2.21	0.857	2.23	0.951	2.33	0.894
34	The training in this post makes me feel ready to be a BST	1.67	0.737	1.58	1.062	1.96	1.113	1.71	0.963
35	My clinical teachers have good mentoring skills	2.64	0.932	2.67	0.736	2.38	0.804	2.58	0.836
36	I get a lot of enjoyment out of my present job	2.38	0.935	2.06	1.116	2.12	1.071	2.20	1.035
37	My clinical teachers encourage me to be an independent learner	2.79	0.801	2.76	0.902	2.73	0.724	2.77	0.81
38	There are good counseling opportunities for junior doctors who fail to complete their training satisfactorily	1.87	0.656	1.30	0.883	1.58	0.987	1.60	0.858
39	The clinical teachers provide me with good feedback on my strengths and weaknesses	2.26	1.093	2.09	1.208	2.46	1.174	2.26	1.152
40	My clinical teachers promote an atmosphere of mutual respect	3.00	0.946	2.64	0.962	2.46	1.067	2.73	1.001

Table 3 illustrates the cumulative scores for the 3 themes and for the total PHEEM score for each of the 3 cohorts assessed in this study.

Table 3.

Scores for the 3 PHEEM themes and total score.

		FY1	FY2	Ext. FY	Total
Perceptions of role autonomy		30.44	25.42	28.50	28.23
0-14	Very poor
15-28	A negative view of one’s role
29-42	A more positive perception of one’s role
43-56	Excellent perception of one’s job
Perceptions of teaching		34.46	31.61	32.00	32.85
0-15	Very poor quality
16-30	In need of some retraining
31-45	Moving in the right direction
46-60	Model teachers
Perception of social support		26.26	23.82	23.88	24.81
0-11	Non-existent
11-22	Not a pleasant place
23-33	More pros than cons
34-44	A good supportive environment
Overall score		92.15	81.97	85.46	86.95
0-40	Very poor
41-80	Plenty of problems
81-120	More positive than negative, but room for improvement
121-160	Excellent

The authors of PHEEM recommend that any item with a mean of 2 or less should be examined in detail as it may indicate a problem area. Table 4 provides a summary of the items with a mean total score below 2 for the 3 cohorts in the study. The items have been arranged in ascending order.

Table 4.

Summary of the items with a mean total score below 2 for the 3 cohorts in the study. The items have been arranged in ascending order.

No.	Item	Total
No.	Item	Mean	SD
17	My hours conform to the European Working Time Directive	0.79	1.018
26	There are adequate catering facilities when I am on call	0.86	0.984
11	I am bleeped inappropriately	0.90	1.108
25	There is a no-blame culture in this post	1.41	1.209
38	There are good counseling opportunities for junior doctors who fail to complete their training satisfactorily	1.60	0.858
34	The training in this post makes me feel ready to be a BST	1.71	0.963
19	I have suitable access to careers advice	1.73	1.016
8	I have to perform inappropriate tasks	1.76	1.140
20	This hospital has good quality accommodation for junior doctors, especially when on call	1.78	1.256
3	I have protected educational time in this post	1.80	1.260
32	My workload in this job is fine	1.90	1.171
1	I have a contract of employment that provides information about hours of work	1.91	1.122
27	I have enough clinical learning opportunities for my needs	1.99	1.071

There was only 1 question that was rated >3 by the 3 cohorts: “I have good collaboration with other doctors in my grade.” Another question, “My clinical teachers promote an atmosphere of mutual respect,” was rated 3.00 by Foundation Year 1 respondents. The original authors of PHEEM have suggested that items with a mean score of 3.5 or over are real positive points. None were identified in this study.

Statistically significant differences between genders were identified on 7 items, as listed in Table 5. In general, females seemed to give higher rankings in almost all 7 items. The only exception is the question regarding sex discrimination in the workplace.

Table 5.

Items with statistical significance between genders.

	Gender	N	Mean rank	Sum of ranks	Mann-Whitney U	Wilcoxon W	Z	Asymp. Sig. (2-tailed)
I have the appropriate level of responsibility in this post	Female	59	55.35	3265.50	805.5	1585.5	–2.712	0.007
	Male	39	40.65	1585.50
	Total	98
I have to perform inappropriate tasks	Female	59	54.06	3189.50	881.5	1661.5	–2.024	0.043
	Male	39	42.60	1661.50
	Total	98
I am paged inappropriately	Female	59	54.21	3198.50	872.5	165.5	–2.175	0.030
	Male	39	42.37	1652.50
	Total	98
There is sex discrimination in this post	Female	59	43.04	2539.50	769.5	2539.5	–2.863	0.004
	Male	39	59.27	2311.50
	Total	98
There are adequate catering facilities when I am on call	Female	59	56.19	3315.50	755.5	1535.5	–3.088	0.002
	Male	39	39.37	1535.50
	Total	98
I have opportunities to acquire appropriate practical procedures for my grade	Female	59	54.17	3196.00	875.0	1655.0	–2.131	0.033
	Male	39	42.44	1655.00
	Total	98
My workload in this job is fine	Female	59	53.92	3181.50	889.5	1669.5	–1.962	0.050
	Male	39	42.81	1669.50
	Total	98

Table 6 reports on the mean total PHEEM and perceptions of autonomy, teaching, and social support by gender.

Table 6.

Mean total PHEEM and perceptions of autonomy, teaching, and social support by gender.

	Total PHEEM	Role autonomy	Teaching	Social support
Female
Mean	89.2203	29.5593	34.6429	23.2881
N	59	59	56	59
Std. Deviation	19.878	6.848	8.742	5.455
Male
Mean	83.5128	26.5789	32.8947	23.0789
N	39	38	38	38
Std. Deviation	21.398	8.066	7.486	5.683

Statistically significant differences between foundation-year cohorts were identified in 5 items using the Kruskal-Wallis H test. These results are illustrated in Table 7.

Table 7.

Items with statistical significance between years of training.

	Foundation year	N	Mean rank	Kruskal-Wallis H	df	Asymp. Sig.
I have a contract of employment that provides information about hours of work.	Foundation Year 1	39	60.46	10.477	2	0.005
	Foundation Year 2	33	42.41
	Extended Foundation	26	42.06
	Total	98
I am paged inappropriately	Foundation Year 1	39	57.81	7.155	2	0.028
	Foundation Year 2	33	41.41
	Extended Foundation	26	47.31
	Total	98
There are adequate catering facilities when I am on call	Foundation Year 1	39	58.38	7.433	2	0.024
	Foundation Year 2	33	44.58
	Extended Foundation	26	42.42
	Total	98
My workload in this job is fine	Foundation Year 1	39	53.56	6.238	2	0.044
	Foundation Year 2	33	39.85
	Extended Foundation	26	55.65
	Total	98
There are good counseling opportunities for junior doctors who fail to complete their training satisfactorily	Foundation Year 1	39	57.09	7.704	2	0.021
	Foundation Year 2	33	40.68
	Extended Foundation	26	49.31
	Total	98

Generally speaking, mean scores seem to dip midway through the 2-year training period, only to pick up again at the end of training, but never reaching the same levels as at the early stages of training.

Discussion

The current study evaluates foundational doctors’ perceptions of the educational environment at the Malta Foundation Programme. These doctors perceived their educational environment as more positive than negative. The educational environment scores worst among trainees at the end of their first year of training. Those who had just finished their training have reported better perceptions but these do not reach the levels of those at the start of training. This dip could signify that the perception of the educational environment hits a low midway through the 2-year period, but as their career progresses, foundation doctors are quick to adapt. As a result, their perception of the educational environment improves toward the end of the training program. One needs to keep in mind that these results are the reflection of the perception of different cohorts. A longitudinal observational study can provide more concrete results to explain this dip.

Perceptions of teaching and social support ranked higher than perceptions of role autonomy. Trainees have demonstrated particularly low rankings in perceptions of role autonomy midway and at the end of training.

Interestingly, out of the 11 items with a mean score less than 2, 6 form part of the autonomy subscale, 5 form part of the social support subscale, and only 2 were part of the teaching subscale.

The 3 worst scoring items seem to be related to when the trainees are on call. Malta persists with a system of on call duties that has been scrapped in many countries. Under the current conditions, foundation doctors work for some 28 hours at a stretch. While adoption of the European Working Time Directive is part of Maltese law, foundation doctors may feel that if they choose not to exceed 48 hours of work in a week, they may find themselves at a disadvantage when applying for training posts at a later stage in their career. On call duties are made worse by the lack of proper catering facilities on site and by an inordinate number of inappropriate pages.

Statistically significant differences between genders were identified on 7 items, as illustrated in Table 4. Five of these items form part of the perceptions of role autonomy subscale, and 2 form part of the perceptions of social support subscale. Female trainees gave higher mean rankings for all 7 items except for “There is sex discrimination in this post.” It is encouraging to note that female trainees do not perceive the educational environment at the Malta Foundation Programme to be sexually discriminatory.

Foundation Year 1 trainees scored significantly higher on 5 items, as shown in Table 5 (3 items on the autonomy subscale and 2 on the social support subscale). There seems to be a trend of deterioration in perceptions across all items and subscales as training reaches its midpoint. Perceptions then improve by the end of training but never reach the same levels of ranking achieved at the start of training. Whether this could be related to the development of burnout in trainees will be analyzed in a further study. As this is an observational, not longitudinal, study conclusions are guarded in this respect.

In a similar local study, Farrugia Jones and Cacciotolo³¹ assessed the postgraduate educational environment in the Department of Medicine at Mater Dei Hospital, Malta. The response rate for house officers in this study was 10%. Problem areas identified by trainees in this study were the absence of protected time, no access to an individual educational program and working hours that do not conform with the European Working Time Directive. The same problems have, unfortunately, again been highlighted by this study. Poor catering facilities, poor access to career advice and counseling opportunities, a strong blame culture, and an inappropriate workload were also replicated in the current study.

There are multiple benefits of a healthy educational environment. Studies have shown that the learning environment is associated with the quality of care provided.³² The educational environment also influences the prescribing habits of trainees³³ and the management and use of health care services and resources.³⁴ In surgical training, higher rated surgical training programs were associated with lower complication rates.³⁵ A healthy learning environment has been associated with better residents’ outcomes including satisfaction with training, the use of knowledge, and a professional identity development.^36,37

The importance of having a high-quality clinical learning environment stems from the knowledge that a high-quality learning environment will have a direct impact on workplace learning and, on the quality, and safety of the clinical care received by patients. Trainees exposed to a high-quality clinical learning environment will have been exposed to participation in the clinical care of patients in a supervised manner. They will also be exposed to coaching, assessment and feedback, deliberate practice, and peer collaboration.³

Many trainees are meant to learn and develop their clinical skills in understaffed, underfunded, uncontrolled, and overcrowded clinical educational environments.^38,39 Exceeding a certain critical level of workload will result in a decline in trainee learning. Heavy workloads were found to be linked to a number of undesirable outcomes in trainees. These outcomes include an increased likelihood of burnout and lower engagement, health, and well-being.^40,41 Lower levels of patient satisfaction, poor standards of care, and higher mortality were also associated with self-reported heavy workloads.^42,43

In view of the above benefits of a healthy educational environment on quality of care, learning, trainees’ mental health and safety of care, efforts at improving the role autonomy, and social support aspects of the educational environment need to be prioritized.

Limitations

This study has limitations. The response rate was relatively low despite a reminder being sent. The quantitative nature of the study precludes an in-depth exploration of the reasons why trainees have expressed perceptions. A qualitative additional study is warranted. The study was also carried out in a single center, albeit this is the only 1 on the island. The study did not take into account the effect of a pandemic on the educational environment.

Conclusion

This study aimed to evaluate the educational environment of the Malta Foundation Programme. The first 2 years of postgraduate medical education signify a transition that can be rough and demanding, as trainees are suddenly burdened with professional responsibilities. It is a period where learning has not ended with the undergraduate years but is only beginning in the postgraduate years.

The current study has identified areas in the educational environment where improvement is needed. Perceptions of role autonomy and social support are areas where most work is needed. Teaching seems to be moving in the right direction, but there is always room for improvement. A comparison with another local study identified similar problem areas.

The study was conducted at a time where the COVID-19 pandemic was having its toll on healthcare systems across the world. It may also have had an impact on the results of this study.

Footnotes

Acknowledgements

Dr. Marco Grech is a Senior General Practitioner. He is currently Assessment Lead at the Malta College of Family Doctors and has served as AKT Lead and Education Secretary for the same College in the past. He is a visiting senior lecturer within the Department of Family Medicine, Faculty of Medicine and Surgery, University of Malta. He is also a tutor in Medical Education at the University of South Wales (UK). Stefania Grech is a medical student with special interest in medical education.

Funding:

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The authors have self-funded this study.

Declaration of conflicting interests:

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Author Contributions

Marco Grech was the main contributor to this manuscript having written and reviewed all the manuscript. Stefania Grech contributed with data collection and analysis and reviewing of the manuscript.

Availability of Data and Materials

All data can be downloaded here: .

Ethics Approval and Consent to Participate

Ethics approval was obtained from the Faculty Research Ethics Committee at the University of Malta. Permission to conduct the study was also obtained from the Foundation Programme, Malta. Informed consent was obtained from all participants. The participants also consented to the publication of results. All methods were carried out in accordance with relevant guidelines and regulations.

ORCID iD

Marco Grech

References

Nordquist

Hall

Caverzagie

, et al. The clinical learning environment. Med Teach. 2019;41:366-372.

General Medical Council. Promoting Excellence: Standards for Medical Education and Training, 2016. Available online at https://www.gmc-uk.org/-/media/documents/Promoting_excellence_standards_for_medical_education_and_training_0715.pdf_61939165.pdf

Kilty

Wiese

Bergin

, et al. A national stakeholder consensus study of challenges and priorities for clinical learning environments in postgraduate medical education. BMC Med Educ. 2017;17:17.

Hakanen

Schaufeli

WB.

Do burnout and work engagement predict depressive symptoms and life satisfaction? A three-wave seven-year prospective study. J Affect Disord. 2012;141:415-424.

Zis

Anagnostopoulos

Sykioti

Burnout in medical residents: a study based on the job demands-resources model. Sci World J. 2014;2014:1.

Papaefstathiou

Tsounis

Papaefstathiou

Malliarou

Sergentanis

Sarafis

Impact of hospital educational environment and occupational stress on burnout among Greek medical residents. BMC Res Notes. 2019;12:281.

Antoniou

Davidson

Cooper

CL.

Occupational stress, job satisfaction and health state in male and female junior hospital doctors in Greece. J Manag Psychol. 2003;18:592-621.

Irby DM. 2018) Improving environments for learning in the health professions. In: Proceedings of a conference sponsored by Josiah Macy Jr. Foundation in April 2018. New York, NY: Josiah Macy Jr. Foundation.

Delva

Kirby

Schultz

Godwin

Assessing the relationship of learning approaches to workplace climate in clerkship and residency. Acad Med. 2004;79:1120-1126.

10.

Roff

McAleer

Harden

, et al. Development and validation of the Dundee Ready Education Environment Measure (DREEM). Med Teach. 1997;19:295-299.

11.

Irby

O”Brien

Stenfors

Palmgren

PJ.

Selecting instruments for measuring the clinical learning environment of medical education: a 4-domain framework. Acad Med. 2021;96:218-225.

12.

Pololi

Price

Validation and use of an instrument to measure the learning environment as perceived by medical students. Teach Learn Med. 2000;12:201-207.

13.

Schönrock-Adema

Visscher

Raat

ANJ

Brand

PLP

. Development and validation of the Scan of Postgraduate Educational Environment Domains (SPEED): a brief instrument to assess the educational environment in postgraduate medical education. PLoS One. 2015;10:e0137872.

14.

Strand

Sjöborg

Stalmeijer

Wichmann-Hansen

Jakobsson

Edgren

Development and psychometric evaluation of the Undergraduate Clinical Education Environment Measure (UCEEM). Med Teach. 2013;35:1014-1026.

15.

Shehnaz

Premadasa

Arifulla

Sreedharan

Gomathi

KG.

Development and validation of the AMEET inventory: an instrument measuring medical faculty members’ perceptions of their educational environment. Med Teach. 2015;37:660-669.

16.

Roff

The Dundee Ready Educational Environment Measure (DREEM)—a generic instrument for measuring students’ perceptions of undergraduate health professions curricula. Med Teach. 2005;27:322-325.

17.

Skochelak

Stansfield

Dunham

, et al. Medical student perceptions of the learning environment at the end of the first year: a 28-medical school collaborative. Acad Med. 2016;91:1257-1262.

18.

Rothman

Ayoade

The development of a learning environment: a questionnaire for use in curriculum evaluation. JMIR Med Educ. 1970;45:754-759.

19.

Hutchins

EB.

The 1960 medical school graduate: his perception of his faculty, peers, and environment. JMIR Med Educ. 1960;36:322-329.

20.

Shochet

Colbert-Getz

Wright

SM.

The Johns Hopkins Learning Environment Scale: measuring medical students’ perceptions of the processes supporting professional formation. Acad Med. 2015;90:810-818.

21.

Holt

Roff

Development and validation of the Anaesthetic Theatre Educational Environment Measure (ATEEM). Med Teach. 2004;26:553-558.

22.

Bloomfield

Subramaniam

Development of an instrument to measure the clinical learning environment in diagnostic radiology. J Med Imaging Radiat Oncol. 2008;52:262-268.

23.

Cassar

Development of an instrument to measure the surgical operating theatre learning environment as perceived by basic surgical trainees. Med Teach. 2004;26:260-264.

24.

Kanashiro

McAleer

Roff

Assessing the educational environment in the operating Room—a measure of resident perception at one Canadian institution. Surgery. 2006;139:150-158.

25.

Riquelme

Padilla

Herrera

, et al. Development of ACLEEM questionnaire, an instrument measuring residents’ educational environment in postgraduate ambulatory setting. Med Teach. 2013;35:e861-e866.

26.

Roff

McAleer

Skinner

. Development and validation of an instrument to measure the postgraduate clinical learning and teaching educational environment for hospital-based junior doctors in the UK. Med Tech. 2005; 27(4): 326-31. doi: 10.1080/01421590500150874.

27.

Boor

Van Der Vleuten

Teunissen

Scherpbier

Scheele

Development and analysis of D-RECT, an instrument measuring residents’ learning climate. Med Teach. 2011;33:820-827.

28.

Cannon

Keitz

Holland

, et al. Factors determining medical students’ and residents’ satisfaction during VA-based training: findings from the VA learners’ perceptions survey. Acad Med. 2008;83:611-620.

29.

Harden

Laidlaw

, eds. Essential Skills for a Medical Teacher: An Introduction to Teaching and Learning in Medicine. 3rd ed. Churchill Livingstone; 2020.

30.

Malta Foundation Programme. Welcome to the Foundation Programme. Malta. Published 2020. Accessed October 28, 2020. http://fpmalta.com

31.

Farrugia Jones

Cacciotolo

. Postgraduate Health Education Environment at the Department of Medicine at Mater Dei Hospital. In: Malta Medical School Conference VII, 2009. Accessed October 28, 2020. https://www.um.edu.mt/library/oar/bitstream/123456789/15864/1/VII%20MMSC%20abstract%20book%20full.pdf

32.

Tamblyn

Abrahamowicz

Dauphinee

, et al. Effect of a community oriented problem based learning curriculum on quality of primary care delivered by graduates: historical cohort comparison study. BMJ. 2005;331:1002.

33.

Cadieux

Tamblyn

Dauphinee

Libman

Predictors of inappropriate antibiotic prescribing among primary care physicians. CMAJ. 2007;177:877-883.

34.

Chen

Petterson

Phillips

Bazemore

Mullan

Spending patterns in region of residency training and subsequent expenditures for care provided by practicing physicians for Medicare beneficiaries. JAMA. 2014;312: 2385-2393.

35.

Bansal

Simmons

Epstein

Morris

Kelz

RR.

Using patient outcomes to evaluate general surgery residency program performance. JAMA Surg. 2016;151:111-119.

36.

Silkens

MEWM

Lombarts

KMJMH

Scherpbier

AJJA

Heineman

Arah

. Towards healthy learning climates in postgraduate medical education: exploring the role of hospital-wide education committees. BMC Med Educ. 2017;17:241.

37.

Dyrbye

Shanafelt

A narrative review on burnout experienced by medical students and residents. Med Educ. 2016;50:132-149.

38.

Karanikolos

Mladovsky

Cylus

, et al. Health in Europe 7 financial crisis, austerity, and health in Europe. Lancet. 2013;6726:1-9.

39.

Di Somma

Paladino

Vaughan

Lalle

Magrini

Magnanti

. Overcrowding in emergency department: an international issue. Intern Emerg Med. 2015;10:171-175.

40.

Visser

MRM

Smets

EMA

Oort

de Haes

. Stress, satisfaction and burnout among Dutch medical specialists. CMAJ. 2003;168:271-275.

41.

Jennings

Slavin

SJ.

Resident wellness matters. Acad Med. 2015;90:1246-1250.

42.

Dixon-Woods

Baker

Charles

, et al. Culture and behaviour in the English national health service: overview of lessons from a large multimethod study. BMJ Qual Saf. 2014;23:106-115.

43.

Reader

Gillespie

Patient neglect in healthcare institutions: a systematic review and conceptual model. BMC Health Serv Res. 2013;13:156.

An Analysis of the Educational Environment at the Malta Foundation Programme Using the Postgraduate Hospital Educational Environment Measure (PHEEM)

Abstract

Background:

Objective:

Methods:

Results:

Conclusion:

Keywords

Introduction

List 1 11

Objective

Methodology

Ethics approval and consent to participate

Results

Demographics

Internal consistency

Item analysis

Discussion

Limitations

Conclusion

Footnotes

Acknowledgements

Funding:

Declaration of conflicting interests:

Author Contributions

Availability of Data and Materials

Ethics Approval and Consent to Participate

ORCID iD

References

List 1¹¹