|Recommend This Page to a Friend||Printable Version|
|www.education-consumers.com||Phone & Fax - (423) 282-6832|
|March 2001||Volume 1, Number 3|
Charles Arthur, M.S.Ed. /
President and Executive Director / Mastery Learning Institute / Portland, OR Virginia P. Baxt, Ed.D. /
President / Education Agenda, Inc. Wayne Bishop, Ph.D. /
Professor of Mathematics / Department of Mathematics / California State University-Los Angeles William L. Brown, Ph.D. /
Director of Institutional Assessment / Lansing Community College Guy Bruce, Ed.D. /
President, APEX Consulting / Assistant Professor, St. Cloud State University Louis Chandler, Ph.D. /
Professor & Chairman / Department of Psychology in Education / University of Pittsburgh Andrea Clements,Ph.D. /
Professor / College of Education / East Tennessee State University Donald Crawford, Ph.D. /
Education Specialist / Otter Creek Institute Nathan Crow, B.A. /
School Administration Consultant / Education Consumers Consultants Network George K. Cunningham, Ph.D. /
Professor / School of Education / University of Louisville Mary Damer, M.Ed. /
Instructor & Student Teaching Supervisor / Northern Illinois University Jerome Dancis, Ph.D. /
Associate Professor / Department of Mathematics / University of Maryland-College Park Edwin J. Delattre, Ph.D. /
Professor / College of Arts & Sciences / Professor & Dean Emeritus / School of Education / Boston University Benjamin F. Eller, Ed.D. /
School of Education / Western Carolina University Lucien Ellington, Ed. D. /
Professor & Co-director, Asia Program / College of Education and Applied Prof. Services / University of Tennessee at Chattanooga John Eshleman, Ed.D. /
Apex Consulting David R. Feeney, Ed.D. /
Director of Digital Education / Fox School of Business & Management / Temple University Carol C. Gambill, M.Ed. /
Director-Special Projects / Curriculum & Instruction / Tennessee Department of Education Patrick Groff, Ed.D. /
Professor of Education Emeritus / San Diego State University Bonnie Grossen, Ph.D. /
Professor, College of Education / University of Oregon Richard Gruetzemacher, Ed.D. /
Director / Planning, Evaluation, and Institutional Research / University of Tennessee at Chattanooga Mark Y. Herring, Ed. D. /
Professor & Dean of Libraries / Winthrop University
Evaluation and Student Achievement
By James H. Stronge & Pamela D. Tucker
Everyone wants to reward good teaching, but how to fairly and objectively measure it? Clearly, good teaching boosts student achievement but so does a student's home life and neighborhood. The key is to measure the teacher's contribution separately-isolated from these other influences?
According to James Stronge and Pamela Tucker, two experts in the field of teacher evaluation, good teaching can be identified through value-added assessment--a statistical process that analyzes year-to-year student achievement scores. Identifying good teachers on the basis of actual student achievement is more direct and therefore more accurate than even the latest teacher examinations such as the PRAXIS.
Agreeing with parents and policymakers, Stronge and Tucker believe that teaching effectiveness cannot be accurately measured without looking at results. In their view, even "best practice" teaching is effective only if appropriately applied. Thus teacher evaluation must consider both means and ends. However unlike parents and policymakers, they consider student achievement to be only one among many elements of "good teaching," not the primary and indispensable outcome.
Teacher Evaluation and Student Achievement discusses four methods of assessing teacher performance but only two emphasize objectively measured annual achievement gains. Of the two, the Tennessee Value-Added Assessment System (TVAAS) is conceptually the simpler and more accurate. "Unlike the Dallas system, which compares student growth to the growth of other students with similar characteristics (e.g., gender and ethnicity), TVAAS compares each individual student's growth to his or her previous growth rate."
TVAAS has been used successfully statewide in Tennessee for several years. It measures whether teachers bring about achievement gains that are equal to or greater than those earned by the same students under previous teachers.
"The sophisticated statistical methodology of the Tennessee Value-Added Assessment System [TVAAS] offers a number of advantages over other approaches . . . ." Used in conjunction with Tennessee's TCAP exam, it both permits objective assessment of teacher effectiveness and provides the data necessary to evaluate programs at the school and district level. For example, by examining TVAAS data, researchers discovered that students with a three year succession of effective teachers gained nearly 60 percent greater achievement than those who had a succession of ineffective teachers.
Perhaps the greatest advantage of TVAAS is its ability to identify teachers who are doing a great job of helping low achieving students. Teacher accountability systems that consider only achievement scores, instead of gains in achievement, cause teachers who have high scoring students to appear effective no matter how much or how little their teaching contributes to student growth. By highlighting gain, TVAAS identifies good teachers who are successful with low achievers and poor teachers who permit high achievers to "coast"--both with equal ease.
TVAAS enables fair comparisons among teachers by removing all pre-existing differences among students. Studies have found gains to be unrelated to racial composition of schools, to percent of free and reduced lunch, and to entry achievement levels.
TVAAS annual reports contain norm-referenced levels of achievement in addition to gains, and by examining the gap between a school's achievement levels and national norms, an estimate can be made of the annual gain necessary to bring students up to national averages in a given number of years. For example, a school with a high percentage of disadvantaged 3rd grade students might have to gain 110 percent annually to bring its students to the national norms by the 8th grade.
Value-added data can be no better than the curriculum and the test on which it is based; therefore, selection of a well-validated test is critical. Tennessee's TCAP test is a customized version of McGraw-Hill's Terra Nova, and it uses fresh, equivalent, non-redundant items every year to discourage teaching to the test.
Although statistically sophisticated, TVAAS is simple to use and costs less than 1 percent of per-pupil expenditure. In Tennessee, educators are gaining confidence in the use of TVAAS; but any assessment system is subject to misunderstanding and misuse, thus Stronge and Tucker list several cautions.
Assuring that both teachers and administrators have a stake in improving learning outcomes is an item that should be added to their list. If all boats rise and fall with the same tide, everyone has a stake in careful and accurate interpretation of the results
The Education Consumers Consultants Network is an alliance of experienced and credentialed educators dedicated to serving the needs of parents, policymakers, and taxpayers for independent and consumer-friendly consulting. For more information, contact J. E. Stone, Ed.D., at (423) 282-6832, or write: firstname.lastname@example.org
Daniel Hursh, Ph.D. /
Professor of Educational Psychology / College of Human Resources & Education / West Virginia University Carol Jago, M.A. /
English Teacher, Santa Monica High School / Director, California Reading & Literature Project / UCLA Jerry Jesness, M.A. /
ESL Teacher & Author / Los Fresnos (TX) Schools Daniel Konieczko, M.Ed. /
Science Teacher, Brunswick High School / Brunswick, ME Martin Kozloff, Ph.D. /
Watson Distinguished Professor / School of Education / University of North Carolina at Wilmington Rob Kremer, M.B.A. /
President / Oregon Education Coalition Elaine K. McEwan-Adkins, Ed.D. /
Author & Consultant / McEwan-Adkins Group Richard P. Phelps, Ph.D. /
Economist & Author Michael Podgursky, Ph.D. /
Professor and Chairman / Department of Economics / University of Missouri J. Martin Rochester, Ph.D. /
Curator's Distinguished Teaching Professor / Department of Political Science / University of Missouri-St. Louis Linda Ross, Ph.D. /
Director & Instructional Design Specialist / Archimedia eLearning Solutions Valerie Copeland Rutledge, Ed.D. /
Associate Professor / College of Education / University of Tennessee at Chattanooga / Member, Tenessee Board of Education Douglas Sears, Ph.D. /
Professor & Dean / School of Education / Boston University Mark C. Schug, Ph.D. /
Professor & Director / Center for Economic Education / University of Wisconsin-Milwaukee Lewis Solmon, Ph.D. /
Dean Emeritus / UCLA Graduate School of Education / Executive Vice President, Education / Director, Teacher Advancement Program / Milken Family Foundation Robert Spangler, Ed.D. /
President / Spangler & Associates, LLC J. E. Stone, Ed.D. /
Professor / College of Education / East Tennessee State University Sara Tarver, Ph.D /
Professor / School of Education / University of Wisconsin-Madison John Towner, Ph.D. /
Professor Emeritus / Woodring College of Education / Western Washington University Herbert Walberg, Ph.D. /
Research Professor of Education & Psychology / Emeritus / College of Education / University of Illinois-Chicago John T. Wenders, Ph.D. /
Professor of Economics, Emeritus / University of Idaho Richard Western, Ph.D. /
Professor (retired) / School of Education / University of Wisconsin-Milwaukee