Outcomes: From Start to Finish or Reverse? What to Measure.

Sheryl Cosme, DNP, RN-BC

From Start to Finish or Reverse?

What to measure

© 2016 American Nurses Credentialing Center

• The purpose of this session is to enable the learner to

investigate outcomes measures used in transition to

practice programs and have a dialogue regarding

common outcomes so APRN fellowship programs can

begin to compare programs nationally.

Purpose


• Participants will review potential outcome measures

related to didactic objectives.

• Participants will examine outcome measures related to

patient quality indicators.

• Participants will explore potential research topics related

to NP post graduate training programs.

Objectives


http://venture2.typepad.com/innovationnet/2004/07/creating_an_inn.html

Where do you think we are?


1. What is your end goal of

your program?

2. What outcomes

measures do you use?

3. Do you have

benchmarks?

Reflection


Share


Outcomes – Levels of Evaluation

http://bit.ly/1NWnFIG


• Program should have measures in place to determine

not only quality of education provided to fellows, but also

quality of clinical care given by fellows to patients.

Quality Outcomes


1. Organization

2. Nurse

3. Patient

Categories of Outcomes


• ROI (Hansen, 2015)

• Organizational Commitment Questionnaire (Pagna,1989)

• Nurse Practitioner Stakeholder Questionnaire (Drennan et al. 2009)

• Sense of Belonging Instrument (Hagery-Patusky, 1995)

• Anticipated Turnover Scale (Hinshaw & Atwood, 1987)

• Preceptor Evaluation Tool (Spector, et al., 2015)

Quality Outcomes – Organization


• Satisfaction of Stakeholders

• Turnover

• Retention

• # of Applicants for program

• Successful Completion

• Revenue?

• Length of Stay

Quality Outcomes – Organization


Didactic Outcomes

• Simulation Didactic

• Clinical decision making

• Knowledge Exam(s)• Pre and Post

• Competency achievement

Quality Outcomes – Nurse

Dreyfus SE and Dreyfus HL. 1980

Carraccio CL et al. Acad Med 2008;83:761-7


Nursing Professional Development

• Publication

• Posters or Podium Presentations

• Continuing education

• Precepting

• Mentoring

• Teaching

• Community service

Quality Outcomes – Nurse


• Casey- Fink, Graduate Nurse

Experience Survey (Casey, Fink,

Krugman, & Propst, 2004)

• McCloskey-Mueller

Satisfaction (Mueller & McCloskey, 1990)

• New Nurse Confidence Scale (Grundy, 1993)

• Nursing Competence Scale (Meretoja, Isoaho, & Leino-Kilpi, 2004)

• Gerber Control Over Nursing

Practice Scale (Gerber, Murdaugh,

Verran, & Milton 1990)

• Pagana’s Clinical Stress

Questionnaire (Pagana, 1898)

• Clinical Decision Making in

Nursing Scale (Jenkins, 1995)

Quality Outcomes – Nurse (RN Residency)


• Number of sentinel events pre and post fellowship

implementation

• Patient Satisfaction

• Number of occurrence report from fellows (near misses,

occurrence, etc.)

• Patients seen – efficiency

• Productivity

• Patient Preference (Begley et al. 2010)

• Outcomes of NP manage care model (Sawatzy, Christie, & Singal,

2012)

Quality Outcomes - Patient


HUGE OPPORTUNITY FOR TOOL DEVELOPMENT!!!

Let’s think about it…what else can you measure??


Outcomes – Levels of Evaluation

http://bit.ly/1NWnFIG


1. What outcomes can you begin to use?

2. Can you work with another institution to begin to

compare your outcomes?

Reflection


Brain Storm – Research Ideas


• Program start to publish data related to outcome

measures

• Robust Research

• Meta analysis and Systematic Reviews

• Randomize Control Research

Future of APRN Fellowship Programs


• Participants will review potential outcome measures related to

didactic objectives.

• Participants will examine outcome measures related to patient

quality indicators.

• Participants will explore potential research topics related to NP post

graduate training programs.

Objectives

Questions

[email protected]

301-628-5377


• Anderson, G., Hair, C., & Todero, C. (2012). Nurse Residency Programs: An Evidence-Based Review of Theory, Process, and

Outcomes. Journal of Professional Nursing, 28(4), 203–212. http://doi.org/10.1016/j.profnurs.2011.11.020

• Barlow, K. M., & Zangaro, G. A. (2010). Meta-analysis of the reliability and validity of the Anticipated Turnover Scale across

studies of registered nurses in the United States: Reliability and validity of the ATS. Journal of Nursing Management, 18(7), 862–

873. http://doi.org/10.1111/j.1365-2834.2010.01171.x

• Beecroft, P. C., Kunzman, L., & Krozek, C. (2001). RN internship: Outcomes of a one-year pilot program. Journal of Nursing

Administration, 31(12), 575–582.

• Begley C., Murphy K., Higgins A., Elliot N., Lalor J., Sheerin F., Coyne I., Comiskey C., Norman C., Casey C., Dowling M., Devane

D., Cooney A., Farrelly F.Brennan.M., Meskell P. & MacNeela P. (2010) Evaluation of Clinical Nurse and Midwife Specialist and

Advanced Nurse and Midwife Practitioner Roles in Ireland (SCAPE). Retrieved from

http://www.tcd.ie/Nursing_Midwifery/assets/research/pdf/SCAPE_Final_Report_13th_May.pdf on 4 July 2013.

• Bratt, M. M. (2013). Nurse Residency Program: Best Practices for Optimizing Organizational Success. Journal for Nurses in

Professional Development, 29(3), 102–110.

• Casey, K., Fink, R. R., Krugman, A. M., & Propst, F. J. (2004). The graduate nurse experience. Journal of Nursing Administration,

34(6), 303–311.

• Chappell, K. B., & Richards, K. C. (2015). New Graduate Nurses, New Graduate Nurse Transition Programs, and Clinical

Leadership Skill: A Systematic Review. Journal for Nurses in Professional Development, 31(3), 128–137.

http://doi.org/10.1097/NND.0000000000000159

• Comiskey, C., Coyne, I., Lalor, J., & Begley, C. (2014). A national cross-sectional study measuring predictors for improved service

user outcomes across clinical nurse or midwife specialist, advanced nurse practitioner and control sites. Journal of Advanced

Nursing, 70(5), 1128–1137. http://doi.org/10.1111/jan.12273

• D’Addona, M., Pinto, J., Oliver, C., Turcotte, S., & Lavoie-Tremblay, M. (2015). Nursing Leaders’ Perceptions of a Transition

Support Program for New Nurse Graduates: The Health Care Manager, 34(1), 14–22.

http://doi.org/10.1097/HCM.0000000000000043

• Drennan J, Naughton C, Allen D, Hyde A, Felle P, O’Boyle K, Treacy P & Butler M (2009) Independent Evaluation of the Nurse

and Midwife Prescribing Initiative. University College Dublin, Dublin.

References


• Edwards, D., Hawker, C., Carrier, J., & Rees, C. (2015). A systematic review of the effectiveness of strategies and interventions to

improve the transition from student to newly qualified nurse. International Journal of Nursing Studies, 52(7), 1254–1268.

http://doi.org/10.1016/j.ijnurstu.2015.03.007

• Friday, L., Zoller, J. S., Hollerbach, A. D., Jones, K., & Knofczynski, G. (2015). The Effects of a Prelicensure Extern Program and

Nurse Residency Program on New Graduate Outcomes and Retention: Journal for Nurses in Professional Development, 31(3),

151–157. http://doi.org/10.1097/NND.0000000000000158

• Gardner, G., Gardner, A., & O’Connell, J. (2014). Using the Donabedian framework to examine the quality and safety of nursing

service innovation. Journal of Clinical Nursing, 23(1-2), 145–155. http://doi.org/10.1111/jocn.12146

• Grundy, S. E. (1993). The Confidence Scale Development and Psychometric Characteristics. Nurse Educator, 18(1), 6–9.

• Harrison, D., & Ledbetter, C. (2014). Nurse Residency Programs: Outcome Comparisons to Best Practices. Journal for Nurses in

Professional Development, 30(2), 76–82. http://doi.org/10.1097/NND.0000000000000001

• Hagerty, B. M. K., & Patusky, K. (1995). Developing a Measure of Sense of Belonging. Nursing Research, 44(1), 9–13.

• Hansen, J. (2014). The Financial Case for Nurse Residency Programs, Part 1: Journal for Nurses in Professional Development,

30(6), 322–324. http://doi.org/10.1097/NND.0000000000000109

• Hinshaw, A. S., Smeltzer, C. H., & Atwood, J. R. (1987). Innovative Retention Strategies for Nursing Staff. Journal of Nursing

Administration, 17(6), 8–16.

• Jenkins, H. M. (1985). A research tool for measuring perceptions of clinical decision making. Journal of Professional Nursing, 1(4),

221–229. http://doi.org/10.1016/S8755-7223(85)80159-9

• Kramer, M., Maguire, P., Halfer, D., Brewer, B., & Schmalenberg, C. (2013). Impact of Residency Programs on Professional

Socialization of Newly Licensed Registered Nurses. Western Journal of Nursing Research, 35(4), 459–496.

http://doi.org/10.1177/0193945911415555

• Lucas, M. D., Atwood, J. R., & Hagaman, R. (1993). Replication and Validation of Anticipated Turnover Model for Urban

Registered Nurses. Nursing Research, 42(1), 29–35.

References


• Letourneau, R. M., & Fater, K. H. (2015). Nurse Residency Programs: An Integrative Review of the Literature. Nursing Education

Perspectives, 36(2), 96–101. http://doi.org/10.5480/13-1229

• Linus, R. M., Reeder, S. J., Bradley, P. K., & Polis, N. S. (2014). Nurse Leaders’ Perceptions of the Value of a Nurse Residency

Program: Journal for Nurses in Professional Development, 30(3), 117–121. http://doi.org/10.1097/NND.0000000000000062

• McCalla-Graham, J. A., & De Gagne, J. C. (2015). The Lived Experience of New Graduate Nurses Working in an Acute Care

Setting. The Journal of Continuing Education in Nursing, 46(3), 122–128. http://doi.org/10.3928/00220124-20150220-17

• Meretoja, R., Isoaho, H., & Leino-Kilpi, H. (2004). Nurse competence scale: development and psychometric testing. Journal of

Advanced Nursing, 47(2), 124–133.

• Missen, K., McKenna, L., & Beauchamp, A. (2014). Satisfaction of newly graduated nurses enrolled in transition-to-practice

programmes in their first year of employment: a systematic review. Journal of Advanced Nursing, 70(11), 2419–2433.

http://doi.org/10.1111/jan.12464

• Mitchell, T. R., Holtom, B. C., Lee, T. W., Sablynski, C. J., & Erez, M. (2001). Why people stay: Using job embeddedness to

predict voluntary turnover. Academy of Management Journal, 44(6), 1102–1121.

• Mueller, C., & McCloskey, J. C. (1990). Nurses’ Job Satisfaction: A Proposed Measure. Nursing Research, 39(2), 113–117.

• Newhouse, R. P., Hoffman, J. J., Suflita, J., & Hairston, D. P. (2007). Evaluating an innovative program to improve new nurse

graduate socialization into the acute healthcare setting. Nursing Administration Quarterly, 31(1), 50–60

• Pagana, K. D. (1989). Pscyhometric Evaluation of teh Clinical Stress Questionnaire. Journal of Nursing Education, 28(4), 169–

174.

• Pfaff, K., Baxter, P., Jack, S., & Ploeg, J. (2014). An integrative review of the factors influencing new graduate nurse engagement

in interprofessional collaboration. Journal of Advanced Nursing, 70(1), 4–20. http://doi.org/10.1111/jan.12195

• Pittman, P., Herrera, C., Bass, E., & Thompson, P. (2013). Residency Programs for New Nurse Graduates: How Widespread Are

They and What Are the Primary Obstacles to Further Adoption? JONA: The Journal of Nursing Administration, 43(11), 597–602.

http://doi.org/10.1097/01.NNA.0000434507.59126.78

References


• Rosenfeld, P., Glassman, K., & Capobianco, E. (2015). Evaluating the Short- and Long-term Outcomes of a Post-BSN Residency

Program: Findings of a Retrospective Study of Nurse Residents, 2005-2012. JONA: The Journal of Nursing Administration, 45(6),

331–338. http://doi.org/10.1097/NNA.0000000000000211

• Rush, K. L., Adamack, M., Gordon, J., Lilly, M., & Janke, R. (2013). Best practices of formal new graduate nurse transition

programs: An integrative review. International Journal of Nursing Studies, 50(3), 345–356.

http://doi.org/10.1016/j.ijnurstu.2012.06.009

• Schwirian, P. (1978). Evaluating the Performance of Nurses: A Multidimensional Approach. Nursing Research, 27(8), 347–351.

• Schutzenhofer, K. K. and Musser, D. B. (1994), Nurse Characteristics and Professional Autonomy. Image: the Journal of Nursing

Scholarship, 26: 201–205. doi: 10.1111/j.1547-5069.1994.tb00314.x

• Spector, N. (2015). The National Council of State Boards of Nursing’s Transition to Practice Study: Implications for Educators.

Journal of Nursing Education, 54(3), 119–120. http://doi.org/10.3928/01484834-20150217-13

• Spector, N., Blegen, M. A., Silvestre, J., Barnsteiner, J., Lynn, M. R., Ulrich, B., … Alexander, M. (2015). Transition to Practice

Study in Hospital Settings. Journal of Nursing Regulation, 5(4), 24–38.

• Spector, N., Blegen, M.A., Silversre, J., Lynn, M.R., Barnestein, J., & Ulrich, B. (2015). Preceptor evaluation tool: Hospital nurse

transition to practice programs. Retrieved from https://www.ncsbn.org/Preceptor_Support_Tool_1_28_15.pdf

• Sawatzky, J.-A. V., Christie, S., & Singal, R. K. (2013). Exploring outcomes of a nurse practitioner-managed cardiac surgery

follow-up intervention: a randomized trial. Journal of Advanced Nursing, 69(9), 2076–2087.

• Zigmont, J. J., Wade, A., Edwards, T., Hayes, K., Mitchell, J., & Oocumma, N. (2015). Utilization of Experiential Learning, and the

Learning Outcomes Model Reduces RN Orientation Time by More Than 35%. Clinical Simulation in Nursing, 11(2), 79–94.

http://doi.org/10.1016/j.ecns.2014.11.001

References

Outcomes: From Start to Finish or Reverse? What to Measure.

Education

Transcript of Outcomes: From Start to Finish or Reverse? What to Measure.