My Research

Exploratory Data Analysis in Schools: A Logic Model to Guide Implementation

Exploratory data analysis (EDA) is an iterative, open-ended data analysis procedure that allows practitioners to examine data without pre-conceived notions to advise improvement processes and make informed decisions. Education is a data-rich field that is primed for a transition into a deeper, more purposeful use of data. This article introduces the concept of EDA as a necessary structure to be embedded in school activities by situating it within the literature related to data-driven decision making, continuous school improvement systems, and action research methodologies. It also provides a succinct six-part framework to guide practitioners in establishing EDA procedures.

 

Link: Courtney, M. B. (2021). Exploratory Data Analysis in Schools: A Logic Model to Guide Implementation. International Journal of Education Policy and Leadership, 17(4), 14 pp. https://doi.org/10.22230/ijepl.2021v17n4a1041

Monitoring School Improvement with Non-Academic Indicators

In 2017, the Kentucky Department of Education (KDE) set out to develop a new monitoring instrument for low-performing schools. This report, called the Student Performance Monitoring Report (SPMR), standardizes the incremental school improvement monitoring system, allowing for greater scalability and analysis by users at the school, system and agency levels. Instead of traditional academic measures, which vary from school to school and district to district, the SPMR uses indicators that are known to be influenced by multiple system-level factors; including attendance, behavior and early warning indicators. This study uses exploratory data analysis procedures to examine the relationships between these variables and established indicators of school quality such as identification for Comprehensive Support and Improvement (CSI) and other federally required classifications. In sum, this analysis provides early evidence that these indicators can be utilized as standardized measures of overall institutional health by demonstrating clear alignment and relationships between the variables and school outcomes. This report establishes a theoretical framework upon which future work can be built.

 

Link: Courtney, M.B. (2021). Monitoring School Improvement with Non-Academic Indicators. Paper presented at the Association of Education Finance and Policy Annual Conference. Online.

Coaching for Continuous Improvement

Since 2015, the Kentucky Department of Education (KDE) has provided schools across the state with access to highly skilled instructional coaches. Primarily working in rural settings, these coaches provide a voluntary, integrated coaching model that focuses on building sustainable systems. Coaches provide a range of services, including systems design, strategic planning support, whole-team professional learning, professional learning community (PLC) LC facilitation, and fidelity monitoring. This article describes the theory of action for KDE’s Continuous Improvement Coaching program, presents two case studies of rural elementary schools who utilized the program, and discusses the key features of the program and its relevance for rural schools.

 

Link: Courtney, M.B. (2020). Coaching for Continuous Improvement. The Rural Educator, 41(2). DOI: https://doi.org/10.35608/ruraled.v41i2.859

An Exploration of School Improvement Priorities Issued by the Kentucky Department of Education

Since 2012, the Kentucky Department of Education (KDE) has completed 145 school improvement audits resulting in 611 school and district improvement priorities for schools identified as low performing based on the state’s accountability system. Improvement priorities are brief statements that provide guidance to inform the turnaround process. This study utilized standard text mining protocols to determine what we can learn from the collective wisdom of Kentucky audit teams. The protocol resulted in 1768 unigrams, 4149 bigrams, and 2743 trigrams, which were ranked in order of frequency for examination. This poster reports the top twenty unigrams, bigrams, and trigrams for both schools and districts. These high frequency words and phrases give insight into the school improvement process and provide a foundation upon which schools can launch their school improvement efforts.

 

Link: Courtney, M.B. (2020). An Exploration of School Improvement Priorities Issued by the Kentucky Department of Education. Poster presented at the Association of Education Finance and Policy Annual Conference. Fort Worth, TX.

The Education Agency as Research Intermediary

Since the late 1970s, researchers and policy makers have debated the role of research in policy making. Since the passage of the Every Student Succeeds Act (ESSA) in 2015, education policy has experienced a renewed interest in this topic. ESSA presents a rigorous framework and set of requirements for research use in educational decision making. This paper presents an evidence-informed model that education agencies (EAs) can follow to support schools in the implementation of ESSA’s evidence-based practice provisions. The model includes three key activities that EAs should engage in to become effective research intermediaries: (1) model effective research use, (2) build capacity in educators, and (3) promote action research.

 

Link: Courtney, M.B. (2020). The Education Agency as Research Intermediary. Journal of Educational Issues 6(1).

Recruiting for School Improvement: The Relationship Between Teacher-Centric School Quality Factors and School Improvement Designations in Kentucky

In 2018, Kentucky began the implementation of a new school accountability system. Like other states across the nation, Kentucky's new system was designed to bring state policy into alignment with federal changes brought about by the Every Student Succeeds Act (ESSA) of 2015. In addition to the creation of new school improvement labels, Kentucky's system also reports on a variety of teacher-centric school quality factors. A statistical analysis was conducted to determine if a relationship exists between these school quality factors and the school's improvement designation. The study found that schools identified as needing the greatest improvement (Comprehensive Support and Improvement [CSI]) are statistically more likely to have higher teacher turnover rates, higher percentages of new teachers, and employ teachers with lower rates of advanced education in the year prior to identification than their counterparts with either the Targeted Support and Improvement (TSI) or Other designations. These findings should inform future policy making and elevate teacher recruitment and retention as a school improvement priority.

 

Link: Courtney, M. B. (2019). Recruiting for School Improvement: The Relationship Between Teacher-Centric School Quality Factors and School Improvement Designations in Kentucky. Educational Policy Analysis and Strategic Research 14(2).

Best Practices Guidebook: Supporting Students' Self-Efficacy

Albert Bandura's theory of self-efficacy is a commonly known social-emotional learning theory that states that learners can only achieve that which they believe they can achieve. Strong self-efficacy, associated with confidence and a willingness to take risks in learning, has been positively correlated with strong student achievement. While some element of self-efficacy is determined by the learner's psychological underpinning, self-efficacy can be developed over time through a combination of mastery experiences, vicarious experiences, and positive social persuasions. This report identifies and examines six best practices for developing student self-efficacy in the classroom. [This report was published by Bluegrass Center for Teacher Quality, Inc.]

 

Link: Constantine, J., Fernald, J. Robinson, J., Courtney, M. B. (2019) Best Practices Guidebook: Supporting Students’ Self-Efficacy. Barbourville, KY. Bluegrass Center for Teacher Quality, Inc.

Best Practices Guidebook: Professional Learning Communities

The Professional Learning Community model of professional growth and development is an increasingly popular method of teacher training. Commonly abbreviated and referred to as PLCs, this style of professional learning is characterized by its focus on small groups and individualized learning. While the PLC has nearly become a standard feature of the American public school, many teachers and administrators have reported difficulty in implementing a meaningful process. By their very nature, PLCs are unique to each school environment, but the research described in this paper suggests that effective PLC processes share a set of common characteristics. This report makes seven best practice recommendations for implementing the professional learning community model.

 

Link: Courtney, M.B., Constantine, J., Trosper, J. (2017). Best Practices Guidebook: Professional Learning Communities. Bluegrass Center for Teacher Quality.

Teacher Perceptions of the Effectiveness of Professional Development Delivery Styles

One-hundred-thirty-one southeastern Kentucky public school teachers were surveyed with respect to their preferred mode of professional development. An ANOVA was conducted to determine if there was a difference in teacher perceptions among content related variables. That ANOVA showed no significant difference among the means for new instructional practices (M = 387), new classroom management strategies (M = 369.8), and new policies and procedures (M = 356.9), (F [2, 27]= 1.66, p > 0.05). A second ANOVA produced a statistically significant difference in teacher perceptions for the 10 modes of delivery, (F [9, 20] = 8.04, p < 0.05). Tukey's HSD tests were then used to make post-hoc, pairwise comparisons; those tests showed that teachers perceived teacher-led and teacher-driven modes of professional developments as best. A similar procedure determined that participants perceived trainers who were in similar job roles within their school to be more effective.

 

Link: Courtney, M.B. (2016). Teacher perceptions of the effectiveness of professional development delivery styles. (Unpublished Doctoral Dissertation). University of the Cumberlands.

Writers Workshop for Elementary Music Classrooms

With Kentucky's adoption of the national core standards, literacy in all content areas has received a new and revived focus in our state. Students of all grade levels are expected to be able to communicate complex ideas with clarity of focus that has not been necessary in the past. The music educator must be able to adapt and grow in order to keep up with the changing times. By teaching writing techniques through the music curriculum, the music teacher will be armed with powerful tools for advocacy, new assessment mechanisms for students, and the ability to achieve success for students who otherwise would struggle to compete in the general education classroom.

 

Link: Courtney, M.B. (2012). Writers Workshop for Elementary Music Classrooms. Bluegrass Music News, Winter 2012.