Advertisement
Other| Volume 5, ISSUE 2, SUPPLEMENT , S41-S64, July 2014

Appendices

        • Appendix A: Definition of Terms S42
        • Appendix B: Creating a Comprehensive Standardized Simulation Curriculum for Prelicensure Nursing ProgramsAppendix B S43
          • Table B1. Round 1 Survey Respondent Demographics S43
          • Table B2. Round 1 Responses by Clinical Specialty Area S44
        • Appendix C: Example of a Simulation Day Schedule Appendix C S45
          • Table C. Sample Simulation Day Schedule for Three Clinical Groups S45
        • Appendix D: Results of ATI Content Mastery Series Assessments S46
          • Table D1. ATI Fundamentals of Nursing Scores S46
          • Table D2. ATI Adult Health Nursing Scores S47
          • Table D3. ATI Maternal-Newborn Nursing Scores S48
          • Table D4. ATI Nursing Care of Children Scores S49
          • Table D5. ATI Mental Health Nursing Scores S50
          • Table D6. ATI Community Health Nursing Scores S51
        • Appendix E: Results of the Clinical Learning Environment Comparison Survey (CLECS) S52
          • Table E1. Clinical Learning Environment Comparison Survey: Fundamentals S52
          • Table E2. Clinical Learning Environment Comparison Survey: Medical-Surgical Nursing S53
          • Table E3. Clinical Learning Environment Comparison Survey: Advanced Medical-Surgical Nursing S54
          • Table E4. Clinical Learning Environment Comparison Survey: Maternal-Newborn Nursing S55
          • Table E5. Clinical Learning Environment Comparison Survey: Combined Maternal-Newborn and Pediatric Nursing S56
          • Table E6. Clinical Learning Environment Comparison Survey: Pediatric Nursing S57
          • Table E7. Clinical Learning Environment Comparison Survey: Mental Health Nursing S58
          • Table E8. Clinical Learning Environment Comparison Survey: Community Health Nursing S59
        • Appendix F: Results from Study Part II: Follow-Up S60
          • Table F1. New Graduate Nurse Workplace Demographics S60
          • Table F2. New Graduate Nurse Self-Assessments of Clinical Competency S61
          • Table F3. New Graduate Nurse Self-Assessments of Critical Thinking S62
          • Table F4. New Graduate Nurse Ratings of Preparation for Practice S63
          • Figure F1. Workplace Stress Ratings: I Am Experiencing Stress at Work S64
          • Figure F2. Workplace Stress Ratings: I Felt Overwhelmed by Patient Care Responsibilities S64
          • Figure F3. Workplace Stress Ratings: I Felt Expectations of Me Were Unrealistic S64

        Appendix A. Definition of Terms

        Tabled 1
        TermDefinition
        SimulationAn activity or event replicating clinical practice using scenarios, high-fidelity manikins, medium-fidelity manikins, standardized patients, role playing, skills stations, and computer-based critical thinking simulations (Hayden, Jeffries, Kardong-Edgren, & Spector, 2009).
        High-fidelity simulation“Experiences using full scale computerized patient simulators, virtual reality or standardized patients that are extremely realistic and provide a high level of interactivity and realism for the learner” (NLN-SIRC, as cited in Meakim et al., 2013).
        Medium-fidelity simulation“Experiences that are more technologically sophisticated such as computer-based self-directed learning systems simulations in which the participant relies on a two dimensional focused experience to problem solve, perform a skill and make decisions or the use of mannequins more realistic than static low fidelity ones having breath sounds, heart sounds and/or pulses” (NLN-SIRC, as cited in Meakim et al., 2013).
        Debriefing“An activity that follows a simulation experience, led by a facilitator. Participants’ reflective thinking is encouraged, and feedback is provided regarding the participants’ performance while various aspects of the completed simulation are discussed. Participants are encouraged to explore emotions and question, reflect, and provide feedback to one another. The purpose of debriefing is to move toward assimilation and accommodation in order to transfer learning to future situations” (NLN-SIRC, as cited in Meakim et al., 2013).
        Traditional clinical experienceAcademic time designated by the nursing education program for learning outside the classroom. Activities customarily include observation, hands-on experience with patients, and interaction with the interdisciplinary team.
        Clinical competencyThe ability to observe, gather information, recognize deviations from expected patterns, prioritize data, make sense of data, maintain a professional response demeanor, provide clear communication, execute effective interventions, perform nursing skills correctly, evaluate nursing interventions, and self-reflect to improve performance in a culture of safety (Hayden, Jeffries, Kardong-Edgren & Spector, 2009).
        Clinical instructorFaculty and staff members responsible for an assigned cohort of students in the traditional clinical and simulated environments.
        Clinical preceptorAn RN supervising a student in the clinical setting. The preceptor provides oversight of the student’s patients and gives feedback to the student and clinical instructor.
        Core nursing coursesSpecialty courses in the prelicensure nursing curriculum where randomization occurred:

        Fundamentals of Nursing

        Medical-Surgical Nursing

        Advanced Medical-Surgical Nursing

        Maternal-Newborn Nursing

        Pediatric Nursing

        Mental Health Nursing

        Community/Public Health Nursing.
        Study teamFaculty and staff members designated by the participating programs who dedicated a portion of their workload to the study.

        Appendix B. Creating a Comprehensive Standardized Simulation Curriculum for Prelicensure Nursing Programs

        Establishing the Simulation Scenario Topics

        A large task for the study was the assembly of the scenario curriculum. A three-round modified Delphi methodology was utilized for determining the key concepts and patient conditions to be included in the simulation curriculum used throughout the study. The Delphi technique is a group communication process that uses a series of questionnaires over multiple iterations to come to consensus of opinion in a select group of experts. Hsu and Sandford (2007) distinguish the difference between survey techniques as, “Common surveys try to identify “what is,” whereas the Delphi technique attempts to address “what could/should be” (Miller, 2006). (p.1).” A Delphi method enabled us to obtain opinions from educators across the United States regarding what simulations were most important to include in a prelicensure nursing curriculum in 2010.
        There were two large nursing organizations devoted to or providing resources for early nursing simulation faculty, the International Nursing Association for Clinical Simulation and Learning (INACSL) and the National League for Nursing’s Simulation Innovation Resource Center (SIRC). The collective knowledge and expertise of both of these organizations and their members was used to assess what the faculty most familiar with simulation at the time thought should be included in the scenario curriculum being designed for the study.

        Round 1

        In Round 1, an electronic survey was developed to obtain data about what nurse educators and clinicians believed were the key concepts and behaviors students should be able to demonstrate in each major clinical course, and the main patient conditions (i.e., patient diagnoses) and health topics students should know related to each of these courses. The link to the electronic survey was posted on both the INACSL and SIRC Listservs and sent by e-mail to each of the schools participating in the multi-site study. The survey was active for 4 weeks (October 2010 to November 2010).
        In order to have responses included in the analysis, the respondent needed to indicate his/her clinical specialty area and provide a minimum of three key concepts or health topics. Two hundred fifty-five nurse educator surveys met these criteria. Responses were received from 33 states; over half (56%) of the respondents indicated they were from urban or metropolitan areas; and the majority of respondents were from associate and baccalaureate programs. (See Table B1.)
        Table B1Round 1 Survey Respondent Demographics
        %nGeographic Location of Nursing Program%nType of Nursing Program
        56%142Urban/metropolitan area45%115Baccalaureate degree
        21%52Suburban area44%111Associate degree
        17%43Rural area4%9Hospital/practice setting
        6%16Not answered1%3Practical program
        7%17Not answered
        In all, 1,682 key concepts and 2,124 responses for patient conditions were collected. Key concept and patient condition responses were sorted by clinical specialty area. Table B2 shows the number of respondents per specialty area, and the number of health conditions and key concepts received by clinical specialty during Round 1.
        Table B2Round 1 Responses by Clinical Specialty Area
        Number of RespondentsPatient ConditionsKey Concepts
        All ResponsesDuplicates ConsolidatedAll ResponsesDuplicates Consolidated
        Nursing fundamentals46374177273148
        Medical-surgical nursing75636285529266
        Advanced medical-surgical nursing4027671221114
        Maternal-newborn nursing2723315217199
        Pediatric nursing22234136184106
        Mental health nursing171536311862
        Community health nursing191218712698
        Gerontological nursing997686059
        Total:2552,1241,0391,682952

        Round 2

        Each school participating in the study committed a team of people to conduct the study for the 2-year duration. All members of the study team from each of the 10 schools came together for a 2-day meeting to learn about the study protocol, build team cohesion, set the stage for high-fidelity simulations, and determine the simulation curriculum. For Round 2, study team members were grouped according to their clinical specialty areas. They reviewed the Round 1 responses for their clinical areas, narrowing the list of topics to approximately 40 patient conditions and 10 key concepts for each course. These became the patient conditions and key concepts included in the study simulation curriculum.

        Round 3

        Once the key concepts and patient conditions were identified by the clinical teams, these lists were sent back to each of the 10 participating study schools for their Round 3 ranking of the importance of each topic. Faculty, staff, and instructors in each major clinical course were asked to rate each item on the list according to three levels of importance:
        • 1
          =most important content, all students should experience these simulations
        • 2
          =important, 25% and 50% students should experience these simulations
        • 3
          =good content to cover if time allows
        This was important to gain buy-in from those study schools’ faculty who were less familiar with simulation at the time and to be sure we covered all areas faculty felt were crucial to their own programs. Key concepts varied by clinical course, but several themes emerged that were identified by the study team members as important throughout the curriculum: Safety, communication, and patient/family education were specifically listed in five of the seven courses, while documentation, assessment, and prioritization were included in four of the courses.

        Obtaining Scenarios

        Once topics were identified, the assembling of the scenario curriculum began. Scenarios utilized in the study curriculum needed to conform to the NLN/Jeffries Simulation Framework, and be validated either by inclusion in a major vendor package or by multiple uses at a school submitting the scenario. All scenarios required clear learning objectives and were designed to be run over a 15- to 30-minute time frame.
        Simulations were readily available for the fundamentals, medical-surgical, maternal-newborn, and pediatric courses, and the majority of the patient conditions and key concepts were covered by commercially prepared scenarios for these courses. For the topics not available, particularly mental health and community/public health, calls were placed on the major simulation Listservs requesting scenarios for consideration for use in the study based on topics that were harder to find. The response was frequently overwhelming, with many choices available for inclusion. Scenarios that were donated by simulation faculty were reviewed by a professor of nursing and national expert in the field of simulation to ensure that the scenario content was accurate and conformed to the NLN/Jeffries Simulation Framework.
        In addition to the scenarios, study schools received manikin programming files for each scenario in which a manikin could be appropriately used. For some mental health and community health scenarios, only a Standardized Patient was appropriate; therefore, programming files were not needed. A team of programmers reviewed each scenario included in the curriculum and created programming files for each type of human patient simulator being used at the study schools. Programming was provided for two reasons: Team members had varying levels of experience with running manikins prior to the study, and the programming ensured that the scenarios were being run the same way at each school.
        Schools were not required to use any particular scenarios in a course but were required to use scenarios from the study curriculum when using simulation, to provide consistency across all sites. Study sites used the scenario curriculum like a menu and selected those scenarios that worked best for their curricular objectives.
        All study-related scenario information was housed on a wiki accessible only to study team members. The wiki was organized by course and contained an overview of the scenarios available for that course, the scenario template, and the programming files.

        Appendix C. Example of a Simulation Day Schedule

        Table CSample Simulation Day Schedule for Three Clinical Groups
        TimeClinical Group 1Clinical Group 2Clinical Group 3
        0700-0725Pre-conferencePre-conferencePre-conference
        0730-0845Scenario: S M

        Bed: 1

        Topics: Chemical ingestion, potential abuse
        Scenario: J P

        Bed: 2

        Topics: Tylenol overdose, depression
        Scenario: J G

        Bed: 3

        Topics: s/p appendectomy, POD#1 pain, nausea, vomiting
        0845-0900BreakBreakBreak
        0900-1010Scenario: S R

        Bed: 4

        Topics: Tay-Sachs disease, pneumonia, DNR
        Scenario: J G

        Bed: 3

        Topics: s/p appendectomy, POD#1 pain, nausea, vomiting
        Scenario: S M

        Bed: 1

        Topics: Chemical ingestion, potential abuse
        1010-1015BreakBreakBreak
        1015-1125Scenario: J P

        Bed: 2

        Topics: Tylenol overdose, depression
        Scenario: S M

        Bed: 1

        Topics: Chemical ingestion, potential abuse
        Scenario: S R

        Bed: 4

        Topics: Tay-Sachs disease, pneumonia, DNR
        1125-1205LunchLunchLunch
        1205-1315Scenario: J G

        Bed: 3

        Topics: s/p appendectomy, POD#1 pain, nausea, vomiting
        Scenario: S R

        Bed: 4

        Topics: Tay-Sachs disease, pneumonia, DNR
        Scenario: J P

        Bed: 2

        Topics: Tylenol overdose, depression
        1315-1330BreakBreakBreak
        1330-1430Computerized critical thinking simulationComputerized critical thinking simulationComputerized critical thinking simulation
        1430-1530Post conferencePost conferencePost conference
        Note. Each Scenario time slot includes
        • 10 minutes for report
        • 20 to 25 minutes for simulation
        • 10 minutes to document
        • 30 minutes to debrief

        Appendix D. Results of ATI Content Mastery Series Assessments

        Table D1ATI Fundamentals of Nursing Scores
        TotalControl Group25% Group50% GroupEvaluation of Significance
        (n = 800)(n = 254)(n = 279)(n = 267)
        MeanSDMeanSDMeanSDMeanSDF valueEffect Sizep valueSignificant Differences
        Total Score68.08.268.18.067.38.668.67.81.870.160.155
        Categories:
         Management of care70.518.171.117.268.818.771.718.21.920.150.148
         Safety & infection control62.413.862.312.962.114.462.914.00.260.060.773
         Health promotion & maintenance66.816.168.215.665.716.166.716.31.590.160.205
         Psychosocial integrity67.221.868.322.765.221.868.220.81.790.140.168
         Basic care & comfort60.613.459.813.160.513.961.713.11.350.150.259
         Pharmacological & parenteral therapies70.120.470.019.970.321.570.219.70.010.010.991
         Reduction of risk potential55.622.657.022.355.322.954.522.50.850.110.426
         Physiological adaptation61.725.759.825.461.225.864.125.61.840.160.159
        Dimensions:
         Clinical judgment/ Clinical thinking in nursing69.49.469.68.968.910.069.79.10.660.090.518
         Foundational thinking in nursing59.310.659.210.558.610.960.010.41.180.130.306
         Analysis/Diagnosis67.515.768.914.766.616.667.215.61.430.140.240
         Assessment73.118.372.717.873.018.573.618.40.150.050.864
         Evaluation60.815.159.514.960.315.562.714.93.140.210.04450% > CTL
         Implementation/Therapeutic nursing intervention55.511.556.112.054.911.355.711.30.760.100.468
         Planning78.412.178.612.177.812.678.811.70.510.080.599
         Priority setting74.314.575.214.373.615.374.314.00.850.110.427
        Bold = statistically significant p value
        Table D2ATI Adult Health Nursing Scores
        TotalControl Group25% Group50% GroupEvaluation of Significance
        (n = 683)(n = 225)(n = 238)(n = 220)
        MeanSDMeanSDMeanSDMeanSDF valueEffect Sizep valueSignificant Differences
        Total Score64.19.062.79.864.19.065.58.15.370.310.00550% > CTL
        Categories:
         Safety & infection control57.828.858.731.055.528.959.326.01.200.140.303
         Health promotion & maintenance57.449.556.049.859.749.256.449.70.390.070.680
         Basic care & comfort75.516.875.717.075.816.975.216.40.090.040.912
         Pharmacological & parenteral therapies71.211.169.911.871.311.372.59.93.060.240.04750% > CTL
         Reduction of risk potential61.011.959.712.961.711.761.711.02.160.170.116
         Physiological adaptation62.611.760.612.262.211.865.110.88.700.390.00050% > CTL & 25%
        Dimensions:
         Clinical judgment/ Clinical thinking in nursing64.89.463.510.064.69.666.38.45.120.300.00650% > CTL
         Foundational thinking in nursing66.312.164.512.967.011.967.311.43.690.230.02550% > CTL
         Analysis/Diagnosis60.211.059.111.159.711.361.810.53.770.250.02450% > CTL
         Assessment68.113.566.014.268.513.769.912.34.660.290.01050% > CTL
         Evaluation65.014.064.514.164.714.665.913.30.690.100.500
         Implementation/Therapeutic nursing intervention69.011.867.312.869.711.870.210.43.950.250.02050% > CTL
         Planning62.417.061.118.361.916.064.316.42.150.180.117
         Priority setting59.112.957.613.958.612.761.211.84.660.280.01050% > CTL
        Bold = statistically significant p value
        Table D3ATI Maternal-Newborn Nursing Scores
        TotalControl Group25% Group50% GroupEvaluation of Significance
        (n = 680)(n = 225)(n = 240)(n = 215)
        MeanSDMeanSDMeanSDMeanSDF valueEffect Sizep valueSignificant Differences
        Total Score69.59.768.410.769.29.771.18.54.510.280.01150% > CTL
        Categories:
         Management of care40.022.437.723.443.222.439.020.94.000.240.01925% > CTL
         Safety & infection control73.820.873.421.172.721.075.420.40.960.130.385
         Health promotion & maintenance64.113.363.014.863.812.665.412.41.900.180.151
         Psychosocial integrity92.825.992.027.292.925.793.524.70.190.060.831
         Basic care & comfort72.322.771.322.870.522.875.422.22.900.210.056
         Pharmacological & parenteral therapies57.617.658.018.656.217.358.716.81.270.150.280
         Reduction of risk potential59.316.757.617.359.117.161.315.42.710.220.067
         Physiological adaptation71.917.070.417.671.117.574.315.83.240.230.04050% > CTL
        Dimensions:
         Clinical judgment/Clinical thinking in nursing58.310.857.111.458.010.859.910.04.040.270.01850% > CTL
         Foundational thinking in nursing77.012.676.313.976.512.378.511.32.160.180.116
         Analysis/Diagnosis50.114.150.114.349.613.950.714.20.320.080.723
         Assessment63.218.560.819.863.518.765.416.63.370.250.03550% > CTL
         Evaluation71.220.169.422.069.919.774.717.94.610.260.01050% > CTL & 25%
         Implementation/Therapeutic nursing intervention70.610.469.211.070.310.572.29.44.600.290.01050% > CTL
         Planning65.520.964.820.564.922.467.019.60.760.110.470
         Priority setting59.712.758.213.060.312.660.412.42.250.180.107
        Bold = statistically significant p value
        Table D4ATI Nursing Care of Children Scores
        TotalControl Group25% Group50% GroupEvaluation of Significance
        (n = 620)(n = 201)(n = 226)(n = 193)
        MeanSDMeanSDMeanSDMeanSDF valueEffect Sizep valueSignificant Differences
        Total Score65.29.763.79.565.010.267.19.06.300.370.00250% > CTL
        Categories:
         Safety & infection control53.828.251.627.753.529.756.526.91.510.180.222
         Health promotion & maintenance63.116.663.016.262.817.063.616.60.120.040.890
         Psychosocial integrity43.433.741.532.847.434.940.732.92.500.200.083
         Basic care & comfort58.120.057.020.056.820.160.619.82.310.190.100
         Pharmacological & parenteral therapies73.016.672.715.871.717.174.916.71.970.190.140
         Reduction of risk potential67.112.864.812.766.513.070.312.29.680.44<.00150% > CTL & 25%
         Physiological adaptation59.512.758.012.159.813.260.812.82.350.220.096
        Dimensions:
         Clinical judgment/Clinical thinking in nursing62.59.361.39.361.99.764.48.66.150.350.00250% > CTL & 25%
         Foundational thinking in nursing64.213.162.313.464.613.165.612.83.390.250.03450% > CTL
         Analysis/Diagnosis70.514.468.713.970.415.172.413.83.350.270.03650% > CTL
         Assessment56.515.654.015.856.616.159.114.35.490.340.00450% > CTL
         Evaluation55.815.256.415.655.615.955.514.10.230.060.796
         Implementation/Therapeutic nursing intervention65.710.964.310.865.410.967.510.94.450.300.01250% > CTL
         Planning60.624.258.424.058.425.465.522.45.750.300.00350% > CTL & 25%
         Priority setting63.615.661.615.663.315.965.915.13.830.280.02250% > CTL
        Bold = statistically significant p value
        Table D5ATI Mental Health Nursing Scores
        TotalControl Group25% Group50% GroupEvaluation of Significance
        (n = 633)(n = 206)(n = 227)(n = 200)
        MeanSDMeanSDMeanSDMeanSDF valueEffect Sizep valueSignificant Differences
        Total Score65.09.863.410.965.210.066.38.14.530.300.01150% > CTL
        Categories:
         Management of care80.717.278.618.882.416.881.015.82.710.210.067
         Safety & infection control84.218.782.419.584.518.385.818.21.670.180.190
         Health promotion & maintenance62.832.061.932.663.731.062.832.50.160.060.849
         Psychosocial integrity67.910.466.311.468.110.769.28.73.960.280.02050% > CTL
         Pharmacological & parenteral therapies54.820.454.920.653.920.755.919.80.500.100.606
         Reduction of risk potential74.325.772.524.473.428.377.023.71.750.190.174
        Dimensions:
         Clinical judgment/Clinical thinking in nursing68.59.867.010.968.99.969.78.13.980.280.01950% > CTL
         Foundational thinking in nursing73.113.771.714.973.113.574.712.52.450.220.087
         Analysis/Diagnosis76.019.375.919.476.419.975.718.70.070.040.932
         Assessment66.616.864.617.067.216.968.116.52.310.210.100
         Evaluation71.017.170.418.169.917.172.715.81.550.170.213
         Implementation/Therapeutic nursing intervention68.111.465.912.268.711.469.710.06.330.340.00250% & 25% > CTL
         Planning70.013.069.713.770.013.870.411.30.140.050.867
         Priority setting71.313.068.913.972.112.773.112.15.940.320.00350% & 25% > CTL
        Bold = statistically significant p value
        Table D6ATI Community Health Nursing Scores
        TotalControl Group25% Group50% GroupEvaluation of Significance
        (n = 344)(n = 127)(n = 116)(n= 101)
        MeanSDMeanSDMeanSDMeanSDF valueEffect Sizep valueSignificant Differences
        Total Score66.010.065.511.565.59.367.18.50.950.180.387
        Categories:
         Management of care64.812.964.513.864.213.266.011.30.640.150.526
         Safety & infection control68.413.367.714.467.712.670.112.61.170.190.313
         Health promotion & maintenance65.315.963.717.765.915.666.613.61.100.190.333
         Psychosocial integrity59.723.261.824.657.823.259.221.40.960.170.385
         Physiological adaptation81.324.282.723.980.224.680.724.50.360.100.698
        Dimensions:
         Clinical judgment/Clinical thinking in nursing65.110.464.412.065.09.966.28.70.910.170.405
         Foundational thinking in nursing69.815.670.417.068.013.871.215.81.260.210.285
         Analysis/Diagnosis69.714.968.915.869.514.970.813.90.460.130.633
         Assessment61.314.560.915.360.914.762.313.40.320.100.728
         Evaluation77.521.375.422.779.519.778.021.31.170.190.312
         Implementation/Therapeutic nursing intervention61.616.161.317.260.315.763.415.01.040.200.356
         Planning66.314.266.315.565.513.767.313.30.430.130.648
         Priority setting62.515.762.816.761.315.263.415.00.510.140.598

        Appendix E. Results of the Clinical Learning Environment Comparison Survey (CLECS)

        Table E1Clinical Learning Environment Comparison Survey: Fundamentals of Nursing
        Control Group25% Group50% GroupEvaluation of Significance
        nMeanSDWithin Group Effect SizenMeanSDWithin Group Effect SizenMeanSDWithin Group Effect SizeF valueBetween Group Effect Sizep valueSignificant Differences
        Overall Rating
         Traditional1923.290.431.222573.170.500.312263.050.550.3511.920.48<.001CTL > 25% 50%
         Simulation1642.590.712553.010.542263.230.4761.581.10<.00150% > 25% > CTL
        Subscale: Communication
         Traditional1903.410.481.362573.260.580.492263.180.580.028.880.430.000CTL > 50% & 25%
         Simulation1592.540.792542.950.682243.190.6440.890.92<.00150% > 25% > CTL
        Subscale: Nursing process
         Traditional1903.380.500.932573.330.540.292263.210.570.245.340.320.005CTL & 25% > 50%
         Simulation1602.800.752543.160.622253.350.5834.720.84<.00150% > 25% > CTL
        Subscale: Holism
         Traditional1913.030.631.212572.820.710.232262.660.780.2913.720.52<.001CTL > 25% 50%
         Simulation1562.140.852552.650.772252.880.7641.210.93<.00150% > 25% > CTL
        Subscale: Critical thinking
         Traditional1863.240.680.792463.060.760.162162.900.870.609.620.43<.001CTL > 50% & 25%
         Simulation1552.590.972483.180.762183.360.6645.360.96<.00150% > 25% > CTL
        Subscale: Self-Efficacy
         Traditional1883.170.550.822493.110.650.252222.990.690.214.230.290.015CTL > 50%
         Simulation1592.590.862482.940.712223.130.6325.680.74<.00150% > 25%
        Subscale: Teaching-learning dyad
         Traditional1893.510.530.812493.390.560.092223.290.620.757.490.380.001CTL > 50%
         Simulation1572.940.872493.440.612223.680.4065.691.16<.00150% > 25% > CTL
        Bold = statistically significant effect size or p value.
        Table E2Clinical Learning Environment Comparison Survey: Medical-Surgical Nursing
        Control Group25% Group50% GroupEvaluation of Significance
        nMeanSDWithin Group Effect SizenMeanSDWithin Group Effect SizenMeanSDWithin Group Effect SizeF valueBetween Group Effect SizeP valueSignificant Differences
        Overall Rating
         Traditional1573.360.490.832373.310.440.352113.200.490.334.950.330.007CTL > 50%
         Simulation1252.860.722373.150.482093.360.4733.890.87<.00150% > 25% >CTL
        Subscale: Communication
         Traditional1573.470.531.072363.430.460.722113.310.530.075.040.300.007CTL & 25%

        >50%
         Simulation1242.740.842353.050.592093.270.6324.680.74<.00150% > 25% >CTL
        Subscale: Nursing process
         Traditional1573.470.540.642363.460.470.162113.380.530.221.970.170.140-
         Simulation1253.040.812353.380.522093.490.4824.990.72<.00150% & 25% >CTL
        Subscale: Holism
         Traditional1573.100.660.932373.030.610.292112.870.710.286.190.330.002CTL % 25% > 50%
         Simulation1242.420.812372.840.702093.070.7230.490.86<.00150% > 25% >CTL
        Subscale: Critical thinking
         Traditional1553.350.640.452343.260.660.202093.120.720.685.270.330.005CTL > 50%
         Simulation1243.000.912363.390.632093.570.6026.840.78<.00150% > 25% >CTL
        Subscale: Self-Efficacy
         Traditional1553.300.580.582363.170.610.202113.170.620.282.370.220.094-
         Simulation1232.890.842363.040.662093.340.5820.510.65<.00150% > 25% &CTL
        Subscale: Teaching-learning dyad
         Traditional1553.460.580.282363.430.550.132103.340.580.672.310.210.100-
         Simulation1243.270.802363.500.532083.680.4320.470.69<.00150% > 25% >CTL
        Bold = statistically significant effect size or p value.
        Table E3Clinical Learning Environment Comparison Survey: Advanced Medical-Surgical Nursing
        Control Group25% Group50% GroupEvaluation of Significance
        nMeanSDWithin Group Effect SizenMeanSDWithin Group Effect SizenMeanSDWithin Group Effect SizeF valueBetween Group Effect Sizep valueSignificant Differences
        Overall Rating
         Traditional1743.570.421.222103.360.480.311933.250.520.4220.460.67<.001CTL > 25% > 50%
         Simulation1322.930.642103.200.551933.460.4737.970.97<.00150% > 25% > CTL
        Subscale: Communication
         Traditional1743.640.431.592103.450.500.561933.330.540.0918.410.63<.001CTL > 25% > 50%
         Simulation1292.740.712103.130.641933.380.6038.570.99<.00150% > 25% > CTL
        Subscale: Nursing process
         Traditional1743.640.450.922103.460.460.111933.410.550.4210.520.46<.001CTL > 50% & 25%
         Simulation1303.140.652103.400.581933.630.4928.710.88<.00150% > 25% > CTL
        Subscale: Holism
         Traditional1743.410.561.222103.110.650.241932.910.690.4528.270.79<.001CTL > 25% > 50%
         Simulation1322.590.802102.950.681933.210.6530.250.87<.00150% > 25% > CTL
        Subscale: Critical thinking
         Traditional1723.570.550.712093.390.630.021933.230.690.6012.880.54<.001CTL > 25% > 50%
         Simulation1313.120.732103.380.651923.610.5722.600.77<.00150% > 25% > CTL
        Subscale: Self-Efficacy
         Traditional1723.500.510.962103.290.580.281933.260.590.349.400.43<.001CTL > 50% & 25%
         Simulation1322.890.772103.110.691933.460.5829.420.86<.00150% > 25% > CTL
        Subscale: Teaching-learning dyad
         Traditional1723.630.510.632103.470.570.021933.360.630.689.470.47<.001CTL > 50% & 25%
         Simulation1323.250.702103.460.641933.730.4426.890.86<.00150% > 25% > CTL
        Bold = statistically significant effect size or p value
        Table E4Clinical Learning Environment Comparison Survey: Maternal-Newborn Nursing
        Control Group25% Group50% GroupEvaluation of Significance
        nMeanSDWithin Group Effect SizenMeanSDWithin Group Effect SizenMeanSDWithin Group Effect SizeF valueBetween Group Effect Sizep valueSignificant Differences
        Overall Rating
         Traditional1123.470.500.741853.310.460.331593.130.580.6714.630.62<.001CTL > 25% > 50%
         Simulation913.050.641843.140.561593.480.4624.280.81<.00150% > CTL & 25%
        Subscale: Communication
         Traditional1123.560.520.991853.420.480.591583.270.580.249.860.52<.001CTL & 25% > 50%
         Simulation912.900.811843.070.681583.410.6119.460.74<.00150% > CTL & 25%
        Subscale: Nursing process
         Traditional1123.560.520.451853.440.460.211583.260.600.6410.870.53<.001CTL & 25% > 50%
         Simulation913.300.631843.330.591583.610.4813.720.57<.00150% > CTL & 25%
        Subscale: Holism
         Traditional1123.240.690.731853.030.690.171592.870.730.629.250.520.000CTL > 50% & 25%
         Simulation912.690.821842.910.711593.290.6223.660.86<.00150% > 25% > CTL
        Subscale: Critical thinking
         Traditional1103.500.600.411843.280.670.011583.080.840.7510.860.56<.001CTL > 25% > 50%
         Simulation893.200.861823.270.721583.620.5713.990.61<.00150% > CTL & 25%
        Subscale: Self-Efficacy
         Traditional1103.410.560.481843.220.590.351583.080.690.549.060.520.000CTL > 50% & 25%
         Simulation893.090.771823.000.661583.430.6018.310.68<.00150% > CTL & 25%
        Subscale: Teaching-learning dyad
         Traditional1103.610.520.411843.480.500.091583.250.660.9213.920.59<.001CTL & 25% > 50%
         Simulation893.360.701823.430.621583.740.3717.920.74<.00150% > CTL & 25%
        Bold = statistically significant effect size or p value.
        Table E5Clinical Learning Environment Comparison Survey: Combined Maternal-Newborn and Pediatric Nursing
        Two study sites combined maternal-newborn and pediatric content into one course. This table represents the CLECS scores for these two programs.
        Control Group25% Group50% GroupEvaluation of Significance
        nMeanSDWithin Group Effect SizenMeanSDWithin Group Effect SizenMeanSDWithin Group Effect SizeF valueBetween Group Effect Sizep valueSignificant Differences
        Overall Rating
         Traditional553.410.400.84543.380.450.35463.290.520.620.920.260.400
         Simulation553.010.54543.210.51453.560.3317.071.20<.00150% > CTL & 25%
        Subscale: Communication
         Traditional553.490.471.11533.460.460.80463.360.550.251.010.260.367
         Simulation552.810.73533.030.60453.490.4915.321.07<.00150% > CTL & 25%
        Subscale: Nursing process
         Traditional553.510.450.61533.490.470.02463.370.520.811.170.290.314
         Simulation553.200.56533.500.52453.710.2814.341.12<.00150% & 25% > CTL
        Subscale: Holism
         Traditional553.220.550.82543.220.580.16463.040.720.751.350.280.261
         Simulation552.660.80543.120.66453.500.4819.651.24<.00150% > 25% > CTL
        Subscale: Critical thinking
         Traditional543.410.570.28523.390.660.02463.400.680.290.010.030.994
         Simulation543.230.70523.380.63453.590.643.610.530.02950% > CTL
        Subscale: Self-Efficacy
         Traditional543.290.480.62523.290.640.33463.170.710.380.600.200.552
         Simulation542.950.61523.060.75453.410.546.740.790.00250% > CTL & 25%
        Subscale: Teaching-learning dyad
         Traditional543.490.500.06523.410.560.08463.400.560.840.410.170.663
         Simulation543.460.58523.360.63453.790.348.170.830.00050% > CTL & 25%
        Bold = statistically significant effect size or p value.
        a Two study sites combined maternal-newborn and pediatric content into one course. This table represents the CLECS scores for these two programs.
        Table E6Clinical Learning Environment Comparison Survey: Pediatric Nursing
        Control Group25% Group50% GroupEvaluatin of Significance
        nMeanSDWithin Group Effect SizenMeanSDWithin Group Effect SizenMeanSDWithin Group Effect SizeF valueBetween Group Effect Sizep valueSignificant Differences
        Overall Rating
        Traditional1083.540.480.871843.350.460.351563.290.510.388.980.500.000CTL > 50% & 25%
        Simulation853.060.631823.170.561563.480.4821.040.78<.00150% > CTL & 25%
        Subscale: Communication
        Traditional1083.610.491.221833.420.490.591563.380.550.117.190.440.001CTL > 50% & 25%
        Simulation852.810.821793.090.621563.440.5927.530.93<.00150% > 25% > CTL
        Subscale: Nursing process
        Traditional1083.660.460.731833.450.500.151563.410.530.449.020.500.000CTL > 50% & 25%
        Simulation853.270.621793.370.561563.630.4715.210.68<.00150% > CTL & 25%
        Subscale: Holism
        Traditional1083.350.630.861823.110.630.311563.070.680.316.490.420.002CTL > 50% & 25%
        Simulation842.710.871812.900.731563.280.6619.190.77<.00150% > CTL & 25%
        Subscale: Critical thinking
        Traditional1053.500.640.421813.340.670.041563.260.660.444.120.370.017CTL > 50%
        Simulation813.200.791813.310.711543.540.608.110.510.00050% > CTL & 25%
        Subscale: Self-Efficacy
        Traditional1053.480.520.641823.300.560.331563.220.630.146.260.440.002CTL > 50% & 25%
        Simulation823.090.701813.100.661553.470.5815.990.61<.00150% > CTL & 25%
        Subscale: Teaching-learning dyad
        Traditional1053.610.570.371823.520.510.111563.430.590.493.370.310.035CTL > 50%
        Simulation823.400.561813.460.611563.690.4610.210.58<.00150% > CTL & 25%
        Bold = statistically significant effect size or p value.
        Table E7Clinical Learning Environment Comparison Survey: Mental Health Nursing
        Control Group25% Group50% GroupEvaluatin of Significance
        nMeanSDWithin Group Effect SizenMeanSDWithin Group Effect SizenMeanSDWithin Group Effect SizeF valueBetween Group Effect Sizep valueSignificant Differences
        Overall Rating
         Traditional1683.220.640.702223.130.550.021963.100.570.582.120.200.121
         Simulation732.730.822203.120.561933.410.4938.391.14<.00150% > 25% > CTL
        Subscale: Communication
         Traditional1663.220.670.662223.100.650.111963.050.610.413.150.270.044CTL > 50%
         Simulation722.740.862183.030.661923.300.6120.530.82<.00150% > 25% > CTL
        Subscale: Nursing process
         Traditional1663.270.690.542223.230.630.001963.210.620.540.500.090.607
         Simulation712.860.902183.230.631923.510.4929.311.04<.00150% > 25% > CTL
        Subscale: Holism
         Traditional1683.140.710.712222.970.660.071962.920.760.534.710.300.009CTL > 50%
         Simulation712.600.882192.920.711933.290.6229.500.99<.00150% > 25% > CTL
        Subscale: Critical thinking
         Traditional1613.090.820.412203.000.830.251942.940.850.631.510.180.222-
         Simulation672.740.942193.200.761933.440.7420.190.88<.00150% > 25% > CTL
        Subscale: Self-Efficacy
         Traditional1633.210.700.632213.080.620.061963.100.670.472.080.200.126
         Simulation682.730.912193.040.631933.390.5630.180.99<.00150% > 25% > CTL
        Subscale: Teaching-learning dyad
         Traditional1633.330.720.452213.370.600.151963.310.620.660.410.100.663
         Simulation692.990.812193.460.611933.670.4534.141.20<.00150% > 25% > CTL
        Bold = statistically significant effect size or p value.
        Table E8Clinical Learning Environment Comparison Survey: Community Health Nursing
        Control Group25% Group50% GroupEvaluation of Significance
        nMeanSDWithin Group Effect SizenMeanSDWithin Group Effect SizenMeanSDWithin Group Effect SizeF valueBetween Group Effect Sizep valueSignificant Differences
        Overall Rating
        Traditional573.430.441.59883.270.520.24723.020.740.558.310.660.000CTL & 25% > 50%
        Simulation542.550.65883.380.40723.370.5052.961.63<.00150% & 25% > CTL
        Subscale: Communication
        Traditional573.430.591.49883.190.690.08722.970.760.516.970.670.001CTL > 50%
        Simulation532.400.79883.240.56723.310.5738.881.35<.00150% & 25% > CTL
        Subscale: Nursing process
        Traditional573.500.521. 10883.350.590.29723.130.820.565.230.530.006CTL > 50%
        Simulation522.750.82883.500.45723.510.4933.431.22<.00150% & 25% > CTL
        Subscale: Holism
        Traditional573.280.681.47883.180.640.12722.820.820.507.900.600.001CTL & 25% > 50%
        Simulation532.240.74883.250.55723.200.7145.331.61<.00150% & 25% > CTL
        Subscale: Critical thinking
        Traditional533.350.621.01823.270.640.42702.910.880.567.040.560.001CTL & 25% > 50%
        Simulation492.550.95853.520.56723.350.6830.121.34<.00150% & 25% > CTL
        Subscale: Self-Efficacy
        Traditional553.440.521.22873.340.560.04723.170.760.283.000.400.052CTL > 50%
        Simulation522.640.77873.320.51723.360.5925.661.10<.00150% & 25% > CTL
        Subscale: Teaching-learning dyad
        Traditional553.580.491.01873.390.610.56723.170.850.675.960.570.003CTL > 50%
        Simulation522.930.77873.670.36723.630.4836.641.35<.00150% & 25% > CTL
        Bold = statistically significant effect size or p value.

        Appendix F. Results from Study Part II: Follow-Up

        Table F1New Graduate Nurse Workplace Demographics
        TotalControl Group25% Group50% GroupEvaluation Of Significance
        (n = 335)(n = 101)(n = 116)(n = 118)
        n%n%n%n%Cramer’s vp value
        Employment location
         Urban/Metropolitan21865.16564.46656.98773.70.110.102
         Suburban9428.12928.73933.62622.0
         Rural126.976.9119.554.2
        Type of institution
         Hospital/Medical center27080.68079.29178.59983.90.130.089
         Long-term care facility3510.51110.9119.51311.0
         Community-based or ambulatory setting236.955.01311.254.2
         Other72.155.010.910.9
        Magnet® designation
         Yes9026.93231.72118.13731.40.120.164
         No14743.93938.65950.94941.5
         Unsure4613.71211.91613.81815.3
         Not applicable5215.51817.82017.21411.9
        Patient care environment
         Critical care11333.23130.43328.04940.80.160.680
         Medical-surgical unit8525.02524.52924.63125.8
         Pediatrics or nursery257.487.8119.365.0
         Labor & delivery or postpartum216.298.886.843.3
         Psychiatry92.743.932.521.7
         Operating room or postanesthesia care82.422.032.532.5
         Long-term care facility3710.91312.8119.31310.8
         Ambulatory or outpatient care185.322.0108.565.0
         Home health or home hospice72.122.032.521.7
         Acute rehab82.422.032.532.5
         Other92.743.943.410.8
        Table F2New Graduate Nurse Self-Assessments of Clinical Competency
        New Graduate Nurse Self-Assesments of Clinical Competency
        6 Week3 Month6 Month
        nMeanSDnMeanSDnMeanSD
        Clinical Knowledge
         Control684.760.65924.620.80984.840.60
         25% group994.640.721064.740.731084.810.63
         50% group994.750.811104.840.641094.940.62
         Total2664.710.743084.740.733154.870.62
        Effect size: 0.17Effect size: 0.31Effect size: 0.21
        p value: 0.449p value: 0.107p value: 0.256
        Technical Skills
         Control684.810.83924.740.77984.920.73
         25% group994.550.861064.750.861084.780.82
         50% group994.670.901104.900.691095.100.61
         Total2664.660.873084.800.783154.930.73
        Effect size: 0.31Effect size: 0.22Effect size: 0.44
        p value: 0.159p value: 0.234p value: 0.005
        50% > 25%
        Critical Thinking
         Control684.680.68924.680.82984.870.71
         25% group994.750.751064.860.751084.850.73
         50% group994.900.691104.900.691095.060.65
         Total2664.790.713084.820.763154.930.70
        Effect size: 0.32Effect size: 0.29Effect size: 0.30
        p value: 0.112p value: 0.108p value: 0.062
        Communication
         Control685.090.69925.040.84985.130.68
         25% group994.990.741065.210.701085.190.63
         50% group995.150.721105.190.721095.320.61
         Total2665.080.723085.150.753155.220.64
        Effect size: 0.22Effect size: 0.22Effect size: 0.29
        p value: 0.1282p value: 0.249p value: 0.097
        Professionalism
         Control685.440.61925.280.73985.380.62
         25% group995.350.641065.400.601085.390.61
         50% group995.470.631105.390.621095.500.57
         Total2665.420.633085.360.653155.420.60
        Effect size: 0.19Effect size: 0.18Effect size: 0.20
        p value: 0.382p value: 0.390p value: 0.287
        Management of Responsibilities
        Control684.910.71924.870.84985.010.74
        25% group994.910.691064.910.681085.070.67
        50% group994.910.741105.010.701095.240.65
        Total2664.910.713084.930.743155.110.69
        Effect size: 0.00Effect size: 0.18Effect size: 0.33
        p value: 1.000p value: 0.371p value: 0.046
        Bold = statistically significant p value.
        Table F3New Graduate Nurse Self-Assessments of Critical Thinking
        Critical Thinking Diagnostic
        6 Week3 Month6 Month
        nMeanSDnMeanSDnMeanSD
        Problem Recognition
         Control684.780.60924.910.79985.050.57
         25% group994.800.611054.950.611085.090.58
         50% group994.890.661105.050.641095.090.60
         Total2664.830.633074.970.683155.080.58
        Effect size: 0.17Effect size: 0.20Effect size: 0.07
        p value: 0.470p value: 0.296p value: 0.815
        Clinical Decision Making
         Control685.040.47925.070.65985.160.51
         25% group995.030.581055.180.531085.260.49
         50% group995.160.531105.250.491095.250.47
         Total2665.080.543075.170.563155.230.49
        Effect size: 0.24Effect size: 0.32Effect size: 0.20
        p value: 0.171p value: 0.083p value: 0.251
        Prioritization
         Control674.850.57925.020.72985.170.62
         25% group994.920.681055.020.561075.210.57
         50% group994.960.621105.160.571095.270.54
         Total2654.920.633075.070.623145.210.58
        Effect size: 0.18Effect size: 0.25Effect size: 0.17
        p value: 0.518p value: 0.178p value: 0.443
        Clinical Implementation
         Control684.960.54915.060.63985.170.63
         25% group974.980.621035.080.581075.230.56
         50% group985.030.621105.120.581095.230.56
         Total2634.990.603045.080.603145.210.58
        Effect size: 0.12Effect size: 0.10Effect size: 0.10
        p value: 0.786p value: 0.765p value: 0.692
        Reflection
         Control685.170.48925.180.67985.320.53
         25% group995.180.581065.220.501085.310.50
         50% group995.240.561105.320.551095.330.53
         Total2665.200.553085.240.573155.320.52
        Effect size: 0.13Effect size: 0.23Effect size: 0.04
        p value: 0.610p value: 0.212p value: 0.963
        Table F4New Graduate Nurse Ratings of Preparation for Practice
        6-Week Survey New Graduate Nurse
        During your nursing program, how well did your clinical experiences (both traditional and simulated) prepare you for practice as a new RN?
        TotalControl Group25% Group50% Group
        (n = 266)(n = 68)(n = 99)(n = 99)
        freq%freq%freq%freq%Cramer’s vp value
        Very well prepared7126.71522.12020.23636.40.160.030
        Quite a bit prepared10338.72536.84242.43636.4
        Somewhat prepared9033.82638.23737.42727.3
        Not at all prepared20.822.900.000.0
        Bold = statistically significant p value.
        3-Month Survey New Graduate Nurse
        During your nursing program, how well did your clinical experiences (both traditional and simulated) prepare you for practice as a new RN?
        TotalControl Group25% Group50% Group
        (n = 308)(n = 92)(n = 106)(n = 110)
        freq%freq%freq%freq%Cramer’s vp value
        Very well prepared7022.72223.91716.03128.20.150.025
        Quite a bit prepared14246.13841.34643.45852.7
        Somewhat prepared9129.63133.74037.72018.2
        Not at all prepared51.611.132.810.9
        Bold = statistically significant p value.
        6-Month Survey New Graduate Nurse
        During your nursing program, how well did your clinical experiences (both traditional and simulated) prepare you for practice as a new RN?
        TotalControl Group25% Group50% Group
        (n = 315)(n = 98)(n = 108)(n = 109)
        freq%freq%freq%freq%Cramer’s vp value
        Very well prepared6420.31414.32119.42926.60.110.261
        Quite a bit prepared13041.34444.94037.04642.2
        Somewhat prepared11737.13838.84642.63330.3
        Not at all prepared41.322.010.910.9
        Figure thumbnail fx1
        Figure F1Workplace Stress Ratings: I Am Experiencing Stress at Work
        Figure thumbnail fx2
        Figure F2Workplace Stress Ratings: I Felt Overwhelmed by Patient Care Responsibilities
        Figure thumbnail fx3
        Figure F3Workplace Stress Ratings: I Felt Expectations of Me Were Unrealistic