Ïã¸ÛÁùºÏ²Ê¿ª½±½á¹û2023

CAEP Accountability Measures for Initial and Advanced Programs

• Measure #1: Completer Impact and Effectiveness (Initial Only)

  Measure #1 - Completer Impact and Effectiveness (Initial Only)

  Initial Licensure Programs

  1. Completer impact in contributing to P-12 student-learning growth
  2. Completer effectiveness in applying professional knowledge, skills and dispositions

  a: Completer impact in contributing to P-12 student-learning growth

  Completer Impact is based on Completer VAM, or value-added model. VAM scores are calculated using P-12 student performance on statewide tests in ELA and/or Math to determine contribution to learning growth. A P-12 student’s expected score is based on the student’s prior test score history and measured characteristics, as well as how other P-12 students in the state actually performed on the assessment. The VAM is reported as a decimal number where zero represents expected growth. A score greater than zero represents a positive contribution to learning growth.

  While there were 76 completers only 24 were responsible for ELA, Math, or both.

  Thirty-three percent of the 24 completers had positive VAM scores. Sixty-six percent of the 24 completers had scores below zero.

  The VAM scores for 2020-2021 completers are:

  Category	VAM Scores
  Elementary Education	0.223, 0.164, 0.108, 0.005, -0.011*, -0.082, -0.085, -0.089, -0.136*, -0.139, -0.157*, -0.182, -0.190*, -0.217, -0.310, -0.581
  English Education 6-12	1.311, 0.390, 0.179, 0.096, - 0.016, -0.050, -0.328
  Middle Grades Math Education	-0.035

  *indicates that completer received both an ELA and Math VAM score

  b: Completer effectiveness in applying professional knowledge, skills and dispositions

  Completer effectiveness in applying professional knowledge, skills and dispositions is based on Teacher Evaluations of completers from 2020 - 2021 and is taken from the 2024 FLDOE Teacher Evaluations Report. 

  Evaluation systems must differentiate among the following four levels of performance:

  1. Highly Effective
  2. Effective
  3. Needs Improvement or, for instructional personnel in the first three years of employment, Developing
  4. Unsatisfactory

  Others: “Not Evaluated” means the instructional staff member or school administrator was not required to be evaluated. If completers were not employed in an instructional or school administrator position, they were not included.

  Elementary Education - Of 44 program completers, 36 received an evaluation rating 

  

  Programs with fewer than 30 completers 

  1. Prek-Primary - 1 program completers, 1 received an evaluation rating
     • 1 Effective 

  2. Biology – 2 program completers, 2 received an evaluation rating
     • 2 Effective 

  3. English - 9 program completers, 8 received an evaluation rating
     • 1 Highly Effective, 7 Effective 

  4. Math - 1 program completers, 1 received an evaluation rating
     • 1 Highly Effective 

  5. Middle Grades Math/Gen Science -1 program completers, 1 received an evaluation rating 
     • 1 Highly Effective 

  6. Social Science - 3 program completers, 3 received an evaluation rating
     • 2 Highly Effective, 1 Effective 

  7. Deaf Education – 6 program completers, 6 received an evaluation rating
     • 2 Highly Effective, 4 Effective 

  8. Exceptional Student Education – 4 program completers, 4 received an evaluation rating
     • 2 Highly Effective, 2 Effective 

  9. Music Education – 8 program completers, 8 received an evaluation rating
     • 6 Highly Effective, 2 Effective 
• Measure #2: Satisfaction of Employers and Stakeholder Involvement (Initial & Advanced)

  Measure #2 - Satisfaction of Employers and Stakeholder Involvement (Initial and Advanced)

  Initial Licensure Programs

  Ïã¸ÛÁùºÏ²Ê¿ª½±½á¹û2023 teacher preparation provides an annual employer survey to principals/employers of graduates in their first or second year of employment. Employer survey items align with the Florida Educator Accomplished Practices (FEAPs) and InTASC standards to gauge perceptions of preparedness of graduates for the responsibilities required of a professionally certified teacher.

  Employer Satisfaction Survey Results – 2024

  *Employer Response: Surveys Sent = 50, Surveys Returned= (40%)

  Description: Employers of Ïã¸ÛÁùºÏ²Ê¿ª½±½á¹û2023 Graduates were asked to what degree the employed Ïã¸ÛÁùºÏ²Ê¿ª½±½á¹û2023 Graduate was able to perform in the following areas:

  Standards	FEAP Description	Not Applicable	Very Unprepared	Somewhat Unprepared	Neither Prepared nor Unprepared	Somewhat Prepared/th>	Very Prepared/th>	Total
  FEAPs 1, InTASC 1, 2, 7	Plan instruction	0%	0%	0%	0%	35%	65%	20
  FEAPs 2, InTASC 3	Design effective classroom environments	0%	0%	0%	0%	30%	70%	20
  FEAPs 2b, InTASC 3	Maintain effective classroom management	0%	5%	0%	10%	25%	60%	20
  FEAP 3, InTASC 4,5	Deliver engaging lessons that respond to learners' needs	0%	5%	0%	0%	20%	75%	20
  FEAPs 3h, InTASC 4, 5	Modify and differentiate instruction for diverse learners' needs	0%	0%	5%	5%	35%	55%	20
  FEAPs 1, 3, 6, InTASC 4, 9	Demonstrate knowledge and understanding of the FLorida Standards to guide instruction	0%	0%	0%	5%	20%	75%	20
  FEAPs 4, InTASC 6, 9	Design and modify assessments	0%	0%	5%	5%	45%	45%	20
  FEAPs 4, InTASC 6, 9	Use assessment data to plan instruction	0%	0%	5%	5%	30%	60%	20
  FEAPs 5, InTASC 9	Engage in continuous professional development	0%	0%	0%	5%	35%	60%	20
  FEAPs 5	Engage in reflective teaching practices	0%	0%	5%	5%	35%	55%	20
  FEAPs 1, 3, 4, InTASC 4, 5, 6, 7, 8, 9	Apply appropriate measures to improve students' reading and computational processes	0%	0%	5%	15%	10%	70%	20
  FEAPs 3, InTASC 5, 8, 10	Effectively use technology for instructional purposes	0%	0%	5%	10%	5%	80%	20
  FEAPs 6, InTASC 9	Abide by professional responsibilities and code of ethics	0%	0%	0%	0%	11%	89%	19
  FEAPs 3, InTASC 2, 7, 8	Teach students with diverse ethnic backgrounds	0%	0%	5%	0%	15%	75%	20
  FEAPs 3, InTASC 2, 7, 8	Teach students with diverse linguistic backgrounds	0%	0%	0%	17%	11%	72%	18
  FEAPs 3, InTASC 2, 7, 8	Teach students with exceptionalities	0%	5.5%	0%	11%	5.5%	78%	18

  Advanced Programs

  The purpose of the Employer Satisfaction Survey is to ascertain the preparation of graduates of the M.Ed. in Educational Leadership degree program at Ïã¸ÛÁùºÏ²Ê¿ª½±½á¹û2023 to serve in Florida schools. The leadership candidates who graduate from the degree have a variety of options to them for leadership positions as designed by the local districts, with some districts requiring additional in-district training before a graduate can apply for an Assistant Principal position. Graduates of the M.Ed. in Educational Leadership may choose to remain in the classroom, work at the district level as a supervisor or director, serve as an instructional coach, or serve in a dean role within the school setting. In addition to Assistant Principal, the above-mentioned roles are also recognized as leadership roles. For this reason, the survey seeks input from school supervisors and principals about the graduates of the degree who serve in their school settings in leadership roles. Employer survey items align with the Florida Educational Leadership Standards (FELS).

  Employer Satisfaction Survey Results – 2024

  *Employer Response: Surveys Sent = 9, Surveys Returned = 4 (44%)

  Description: Employers of Ïã¸ÛÁùºÏ²Ê¿ª½±½á¹û2023 Graduates were asked to what degree the employed Ïã¸ÛÁùºÏ²Ê¿ª½±½á¹û2023 Graduate was able to perform in the following areas:

  Standards	FELS Description	Not Applicable	Very Unprepared	Somewhat Unprepared	Neither Prepared nor Unprepared	Somewhat Prepared/th>	Very Prepared/th>	Total
  FELS 1	Act ethically and according to professional norms to promote the academic success and well-being of all students	0%	25%	0%	0%	0%	75%	4
  FELS 2	Collaborate with parents, students, and other stakeholders to develop, communicate, and enact a shared vision, mission, and core values to promote the academic success and well-being of all students	0%	25%	0%	0%	25%	50%	4
  FELS 3	Manage school operations and resources to cultivate a safe school environment and promote the academic success and well-being of all students	0%	25%	0%	0%	0%	75%	4
  FELS 4	Enable continuous improvement to promote the academic success and well-being of all students	0%	25%	0%	0%	0%	75%	4
  FELS 5	Cultivate a caring, rigorous, and supportive school community that promotes the academic success and well-being of all students	0%	25%	0%	0%	0%	75%	4
  FELS 6	Build the collective and individual professional capacity of school personnel by creating support systems and offering professional learning to promote the academic success and well-being of all students	0%	25%	0%	0%	0%	75%	4
  FELS 7	Cultivate, support, and develop other student leaders to promote the academic success and well-being of all students	0%	25%	0%	0%	0%	75%	4
  FELS 8	Utilize multiple means of reciprocal communication to build relationships and collaborate with parents, families, and other stakeholders to promote the academic success and well-being of all students	0%	25%	0%	0%	0%	75%	4

• Measure #3: Candidate Competency at Program Completion (Initial & Advanced)

  Measure #3 - Candidate Competency at Program Completion (Initial and Advanced)

  Initial Licensure Programs

  Teacher candidates must pass all portions of the Florida Teacher Certification Exam before graduating. Candidates in initial licensure programs test for the Subject Area and Professional Educator Exam.

  Candidate Readiness based on passage rates on educator certification examinations under Section 1012.56, F.S., is based on the performance of completers on required assessments for program completion, as measured by first and second attempt pass rates,” as stated in Rule 6A-5.066(1)(e), F.A.C.

  Program	Subject Area Exam Pass Rate	Professional Educator Exam Pass Rate
  Elementary/ESOL/Reading	77%	97%
  Exceptional Student Education	100%	100%
  Deaf Education	100%	100%
  PreK-Primary	100%	100%
  Music	100%	67%
  English/ESOL	100%	100%
  Social Science	100%	100%
  Middle Grades General Science	33%	67%
  Middle Grades Math	83%	67%
  Math	100%	100%
  Chemistry	N/A	N/A
  Biology	100%	100%
  Physics	N/A	N/A

   

  Advanced Programs

  M.Ed School Leadership candidates take the Florida Educational Leadership Examination (FELE), which consists of three subtests: Leadership for Student Learning, Organizational Development, Systems Leadership (includes a written performance). A passing score on the FELE exam is required to graduate. Results represent a Best Attempt pass rate.

  Program	FELE Exam Pass Rate
  School Leadership	100 %

• Measure #4: Ability of Completers to be Hired in Education Positions for Which They Have Been Prepared (Initial & Advanced)

  Measure #4 - Ability of Completers to be Hired in Education Positions for Which They Have Been Prepared (Initial and Advanced)

  Initial Licensure Programs

  Employed completers by program placed in 2021-22 or 2022-23 that were reported on the 2024 FLDOE Annual Program Performance Report (2024 APPR).

  Program	Number of Completers	Number of Completers Employed
  Biology Education	12	5
  Chemistry Education	1	1
  Deaf Education	16	4
  Elementary Education	157	84
  English Education	24	22
  Exceptional Student Education	23	18
  Mathematics Education	3	3
  Music Education	23	17
  Middle Grades Math/Science Education	7	7
  PreK-Primary Education	12	7
  Social Science Education	11	6

   

  Advanced Programs

  The following table displays leadership positions held by 2021-2022 graduates of the M.Ed. in Educational Leadership program as reported in the 2023 Florida Department of Education Final Employment Report and the 2024 Preliminary Florida Department of Education Employment Report. It should be noted that students who enter the M.Ed, Educational Leadership program already work in schools, typically in instructional positions, and may not transition into a leadership position for a year or more after the completion of their degrees due to additional local school district requirements for internal district level training and expectations. Assistant principal training programs may vary by school district but are typically a year in length.

  9/15 (60%) completers are serving in a leadership capacity in local districts.

  Position Held	# of Positions
  Leadership-Curriculum Specialist	1
  Leadership- Executive/General Director Instruction/Curriculum	1
  Leadership-Assistant Principal Position	7