Abstract Based on Rasch model, we studied the rater effect of operational skill test in chemical experiment. The rules of leniency, internal consistency, external consistency of raters and the deviation between raters and examineeswere researchedthrough analyzing Infit, Outfit, t, White charts and leniency fluctuation charts and so on. A series of suggestions to weaken the rater effect of operational skill test in chemical experiment were obtained.