Friday, August 15, 2008

Superintendent Horne on the AIMS Test

NOTE: As I am attempting to answer the 474+ emails in my legislative inbox, I came across this letter from Tom Horne, Arizona's Superintendent of Public Instruction. The letter is dated July, 9, 2008 ~ about a week or so after session ended.

OPEN LETTER TO STATE LEGISLATORS REGARDING THE AIMS TEST

I. The AIMS Test is Our Only Mechanism for Holding Schools Accountable.

In a poll required and financed by the state legislature, the public was asked “Do you favor or oppose using statewide tests to determine how schools are performing?” Sixty-six percent favored, 30 percent opposed, and 4 percent had no opinion. Carolyn Warner[1] had CUES, Diane Bishop* dumped that and started ASAP, Lisa Graham Keegan* dumped that and started AIMS. When you keep dumping what you have and start something new, there are enormous start up costs each time, there is no opportunity for stability and continuous improvement, and teachers take nothing seriously because they know it will soon be replaced. We have now had AIMS for 12 years, and have the opportunity for continuous improvement.

AIMS is the Arizona Instrument to Measure Standards. To understand AIMS, one must understand the standards movement throughout the country.

II. The Standards Movement.

The quality of public education in the United States began sinking in the 1960s, and the downward trend accelerated. One of the great qualities of a representative republic is its capacity for self correction. The public noticed how little high school graduates knew, and demanded a change. That change was the standards movement.

Standards are developed by teachers brought together from around the state, and ultimately approved by the State Board. They set out in detail what every student should know and be able to do in a given subject at a given grade level. You can review the performance objectives for any grade in any subject at our website www.azed.gov, click on “Standards.” Teachers are now teaching the academic standards to their students.

Every question on the AIMS test is a measurement of a performance objective. This is what makes AIMS unique. AIMS is the only test where you know the students have been taught the subject of the test questions, because the teachers have agreed to teach the standards, and every question is a measurement of a standard. That is why AIMS is the only test that can fairly hold schools, teachers, and students accountable.

AIMS is no longer a secret test. You can take a sample AIMS test by going to www.azed.gov “AIMS – Take the Test.”


III. Was the AIMS Test “Dumbed Down?”

Some people charged that the AIMS has lost value because it has been “dumbed down.” But last year there were 3,000 students whose teachers had given them passing grades, and who had the credits to graduate, but who could not pass the AIMS test after five tries. The same people who claim that AIMS has lost value because it has been dumbed down, often support the decision of the governor to sign a bill that permitted these same students to graduate with “augmentation” using the subjective grades that they received from teachers. You can’t have it both ways. If the AIMS test is too easy, or was dumbed down, then the governor should not have signed a bill permitting graduation by the students who could not pass an objective test, based on subjective grades given by teachers.

The difficulty of the test has not been changed since 2005. In 2005, the AIMS tests had to be revised because for the first time we had standards for every grade level, and needed new AIMS tests to assess these new standards. That is the only change since the test started in 1996, except high school math in 2001.

The method used to determine the cut scores (the percentage of right answers needed to pass) had to follow certain standards, as required by the federal government. The determinations were initially made by task forces of teachers drawn from all over the state, who decided what level of difficulty constituted “proficient.” This then had to be approved by the State Board.

The level of difficulty for grades three through seven did not change significantly. Eighth grade math had always had a much higher failure rate than all other grades, (including high school) and its failure rate was brought into line with the other grade levels. In high school math, I thought the recommendation of the teachers reduced the level of difficulty too much and recommended to the State Board that a higher level be applied. The vote was eight to one against me. The other eight board members wanted to follow the process that had been set up with the teachers, and I can understand their position. I still believe I was right. But understand that if the Board voted as I recommended, the number of students with the credits to graduate who could not graduate because they did not pass the AIMS test would have been higher than 6,000. Here again, no one can consistently criticize the Board’s decision, yet support the governor’s decision to allow students to graduate who had not passed the AIMS test.

The only way I could have seen to it that the level of difficulty was higher in the recommendation that went to the State Board would have been to limit the task force to a group of elite teachers, rather than the diverse group that we did use. I believe that would have been wrong.

IV. Is AIMS a “Bad” Test?

Some people have been quoted as saying that AIMS is a “bad” test. There is absolutely no basis for their saying that, and it is a totally false statement. Although Arizona teachers write the questions, the psychometrics are validated by one of the largest two companies in the country in that field. Knowing that we could be sued over students not graduating, as many other states have been, we have had a national advisory board of the very top national leaders in psychometrics approve every step that we take. Under No Child Left Behind, the federal government must approve the standards-based test (in our case AIMS) that every state must have. Arizona was one of the first ten states approved out of 50 states. The Fordham Foundation is the principal institution for ranking standards. Arizona standards ranked 7th out of 49 states. Arizona ranks first out of 50 states in the category “curricular content, standards-based reform, and school choice.”

V. AIMS Rewards Not Only Proficiency, But Also Excellence.

To be a highly performing or excelling school, the school must have not only a given percentage of students proficient, but also a given percentage of students as exceeding proficiency. Students who exceed on all three AIMS tests, and meet certain other academic requirements, receive a full tuition scholarship at our state universities. 3,800 students now receive this benefit, and I believe their families are appreciative.

VI. 2:00 A.M. Legislation Is Not Good Public Policy.

At approximately 2:00 A.M. the night that the Senate passed its budget, a provision was added regarding the AIMS test. It called for a task force to study switching from AIMS to something new called AAAT. It would combine current AIMS questions with the ACT college entrance test, as is now done in Michigan. It prohibited the State Board from entering into any contracts for the AIMS test for more than one year.

Representative Crandall, a member of the governor’s P-20 Council, has bragged to the media that he got the Senate to add this provision to the budget at about 2:00 A.M. He has bragged further that he had previously met with education stakeholder groups about this provision, but carefully kept it secret from the Department of Education, because he feels that I am an obstructionist. I am not a committee chair, and I do not have the power to obstruct anything. I only have the power to give you information, because the Department of Education has detailed information that can be valuable to you in making decisions about education. His purpose was to keep you ignorant of the information that I could have provided you, and that you could have considered before making a decision. This is not good public policy making.

Here is what I could have told you had I been given the opportunity.

First, there was no need to restrict the State Board from entering into a contract for more than one year for AIMS. Even if you were to decide to adopt the AAAT test, the fastest that it could be implemented would be 2012 (see Exhibit A, showing the time line).

Second, we are in the fifth year of our current five-year contract for the AIMS test. We were ready to send out bids for a new five-year contract. When the bid can only be for one year, the costs become prohibitively high. Asking vendors to submit a bid every year means the vendor will have to charge much more to recoup the costs of developing and managing the test.

Third, Arizona’s cost for all of its statewide tests (both AIMS and TerraNova) is about $11 per student. Michigan, the state that the 2:00 A.M. provision seeks to copy, anticipates its cost next year at $115 per student – TEN TIMES AS MUCH. (See Exhibit B, document received from the Michigan Department of Education.)

Fourth, Michigan made a presentation to the Council of Chief State School Officers regarding this combining of the statewide test with the ACT. Exhibit C is a copy of one of the pages from the Michigan PowerPoint. It states:
Sticker Shock

· Lobbying claims
· ACT-based NCLB test will be less expensive
· Better aligned to Michigan standards
· Take less time to administer

· Reality
· More than triple the cost
· Requires significant augmentation
· Takes significantly more time to administer

I do not deny that there can be benefits from combining the statewide test with the ACT. I believe that reasonable people can differ about it, and I am certainly willing to study it with an open mind. But making a policy decision like this, which ties the Board’s hands to a one-year contract and thereby makes Arizona’s cost skyrocket, at 2:00 A.M. so that legislators can be kept ignorant of any input from the Department of Education, is not good public policy making.


Tom Horne Superintendent Tom Horne Arizona Department of Education 1535 W. Jefferson Street, Bin #2 Phoenix, AZ 85007 (602) 542-5460 (602) 542-5440 Email: tom.horne@azed.gov

[1] For the more youthful readers: these are former state school superintendents.

Medical Malpractice Legislation

I want to give you some background of our malpractice statutes in Arizona.

According to A.R.S. Section 12-542, there is a two year statute of limitation for medical malpractice cases. Defendants are proportionally liable for damages in direct proportion to their percentage of fault, unless the defendant acted in concert with another person (A.R.S. Section 12-2506). Also, the Constitution prohibits any limits on damages (Article 2, Section 31).
Sen. Allen has run legislation for several years that would have established statutory elements of proof for medical malpractice cases related to emergency health care professionals or hospitals. The bills have either been vetoed by the Governor, died in the process or used as vehicle bills somewhere in the process. Inevitably, the bill always dies.

In 2005, the Legislature added Laws 2005, Chapter 183, Section 1 (now A.R.S. Section 12-2604), which outlined the requirements of medical expert witnesses in medical malpractice cases. On June 17, 2008, the Court of Appeals, Division 1 held A.R.S. Section 12-2604(A) was unconstitutional because the statute "cannot be harmonized" with A.R.S. Rules of Evidence, Rule 702, which was established by the Arizona Supreme Court. Rule 702 relates to testimony by experts and the court felt that A.R.S. Section 12-2604(A) precluded witnesses that were otherwise qualified under Rule 702 from testifying in a malpractice case unless that witness met the additional criteria established in A.R.S. Section 12-2604(A).

Additionally, in 2007 Senator Leff sponsored SB 1505 which would have prohibited the admission of scientific opinion testimony in an action for person injury, death or damage to property unless the court determined that the expert's opinion is reliable and useful, based on the consideration of criteria that were outlined in the bill. The bill died in the Senate when it was Third Read. It is my understanding that the bill had similar issues as those of A.R.S. Section 12-2604(A). Some felt that the bill was unconstitutional and that it was really a separation of powers issue. It was mentioned that by establishing certain criteria, some testimony would be excluded.

Attached are the relevant statutes, sections of the Constitution, bill summaries.

Please let me know if you have any further questions.
http://www.azleg.gov/FormatDocument.aspinDoc=/ars/12/00542.htm&Title=12&DocType=ARS
http://www.azleg.gov/FormatDocument.aspinDoc=/ars/12/02604.htm&Title=12&DocType=ARS
http://www.azleg.gov/FormatDocument.aspinDoc=/ars/12/02506.htm&Title=12&DocType=ARS
http://www.azleg.gov/FormatDocument.asp?inDoc=/const/2/31.htm

http://www.azleg.gov/FormatDocument.aspinDoc=/legtext/47leg/2r/summary/h.sb1351_04-17-06_asengrossedandaspassedhouse.doc.htm

http://www.azleg.gov/FormatDocument.aspinDoc=/legtext/47leg/1r/summary/h.sb1036_04-20-05_astransmittedtogovernor.doc.htm

http://www.azleg.gov/FormatDocument.aspinDoc=/legtext/48leg/1r/summary/s.1505ced_caucus-floor.doc.htm

Immigration = Global Warming

New findings from the Center for Immigration Studies:

The findings of a new study indicate that future levels of immigration will have a significant impact on efforts to reduce global CO2 emissions. Immigration to the United States significantly increases world-wide CO2 emissions because it transfers population from lower-polluting parts of the world to the United States, which is a higher-polluting country.

Perhaps this is the argument we need to use with "certain folks".


Wind Turbine Syndrome

This is an excerpt of testimony from a physician-scientist appearing before New York State Legislature's Energy Committee:

Three doctors that I know of are studying the Wind Turbine Syndrome: myself, one in England, and one in Australia. We note the same sets of symptoms. The symptoms start when local turbines go into operation and resolve when the turbines are off or when the person is out of the area. The symptoms include:
1) Sleep problems: noise or physical sensations of pulsation or pressure make it hard to go to sleep and cause frequent awakening.
2) Headaches which are increased in frequency or severity.
3) Dizziness, unsteadiness, and nausea.
4) Exhaustion, anxiety, anger, irritability, and depression.
5) Problems with concentration and learning.
6) Tinnitus (ringing in the ears).

Her research says wind turbines should never be built closer than two miles from homes. . . .

Your thoughts?

Disheartening, Frustrating, and Unbelievable

Chandler police have arrested this man who was caught shoplifting shrimp and octopus by stuffing them down his pants. Ugghhh! REALLY? DISGUSTING!

When the police asked him for identification, he gave them a false name. When he did produce ID, police were able to ascertain that the man had one outstanding misdemeanor warrant and two outstanding felony warrants. The shoplifter, who was caught wearing a false beard and mustache, has several aliases.

An illegal immigrant, the man has already been deported once! HEY FEDS! LISTEN UP! CLOSE THE @#%^&*^# BORDER!

Fraternal Order of Police Endorsement

Today I received a letter from Bryan Soller, the President of the Arizona State Lodge Fraternal Order of Police. He was writing to inform me that they have endorsed my candidacy for the state legislature.

Endorsement by the Fraternal Order of Police signifies that the FOP, Arizona's largest police organization, believes that I support Arizona's law enforcement officers and their mission.

The Fraternal Order of Police is the largest organization of sworn law enforcement officers in Arizona, with more than 6500 members state-wide. The Arizona Fraternal Order of Police represents the interest of professional law enforcement officers. Many of the benefits and rights afforded to Arizona Law Enforcement are the results of efforts by the Fraternal Order of Police.

Thanks, Mr. Soller! I proudly accept the endorsement of the FOP!

Quick Facts on K-12 Education

Hey folks...I just recieved an email from majority staff at the Arizona House of Representatives that included some interesting facts and I thought that I would pass them along. As usual, I welcome your input or comments on these numbers.

Per pupil K-12 education funding from all sources has increased from $5,721 per pupil in FY 1998 to almost $9,400 in FY 2007. This per pupil amount reflects an increase of funding equal to approximately 64%. Over this same timeframe, average daily membership pupil counts for K-12 education have increased from 770,013 to an estimated 1,030,811, reflecting a pupil count increase of approximately 34%. Sources of estimated FY 2007 funding:

State Funding FY 2007 estimated

Basic State Aid (BSA) $3,505,087,300

Additional State Aid $323,961,600

Other Formula Programs $35,915,200

Non-Formula Programs $91,226,300

ADE Administration $11,164,700

BSA--Permanent State School Fund $45,220,700

SFB--New School Facilities $250,000,000

SFB--Building Renewal $86,283,500

Proposition 301--Classroom Site Fund $440,190,800

Proposition 301--Other $102,780,500

Subtotal $4,891,830,600

County and Local (formula and non-formula) $3,530,596,100

Federal $1,261,734,506

Total $9,684,161,206