Thursday, April 8, 2006

NBUA Evaluation Policy Updated

By Gary Coy
Evaluation Chairman

(Editor's Note: the following is the a new section of the NBUA's policies and procedures. It is being reprinted here so you don't have to dig for it!)

The purpose of the NBUA Evaluation Program is to identify a standard of performance, establish criteria for proper tier placement, provide feedback to the umpires, and to improve individual umpires and therefore the Association.

As the years go by, the evaluations committee continues to evaluate our performance and make changes based on need and the input from the membership to make our evaluation program more meaningful. It's also important to assure the system is one that the membership can have faith in.

For the 2006 season, we will implement the following points:

1. The evaluation committee will implement "targeted" evaluations.
2. This means that the top ¼ and bottom ¼ of the A and B tier umpires, and the top ¼ of the C tier umpires based on the previous year's aggregate score will receive a full evaluation.
3. Umpires not in the "targeted" groups may request an evaluation.
4. All college umpires will be evaluated on either a college game or PIL game.
5. With the exception of college umpires, evaluations will not be performed until an umpire has worked at least 5 games.
6. With the exception of the "C" tier and "1 st year" umpires, all umpires will provide all partners with a peer score regardless of what tier the umpire is in.
7. "C" tier umpires will provide peer scores only to other "C" tier umpires and 1 st year umpires.
8. A special training session will be held to ensure consistency in the way evaluations are performed. All evaluators must attend.
9. The head of the evaluations committee may initiate "at large" evaluations of umpires.
10. Generally, promotions are made at the end of each season, although tier adjustments may occasionally be made during the season.
11. All evaluators are expected to make themselves available to provide a "partner evaluation" for each partner they work with. Evaluators are not paid for these types of evaluations and these count no more than a regular peer score.

PROCESS ---

Formal Evaluations :

Umpires may receive formal evaluations by requesting such through the NBUA website. .This type of evaluation involves an evaluator sitting in the stands for the entire game, giving a thorough post game review, providing a written report on the NBUA evaluation form, and entering the information in the evaluation section of the NBUA website. Formal evaluations are included in the over-all post season assessment and will be restricted to no more than two (2) per season. Formal evaluations can also be initiated by the evaluations chairman or tier coordinator.

In most cases, the evaluator will complete the evaluation form and have the umpire sign it before they leave. By signing the evaluation form, the umpire attests the evaluation was conducted per the evaluation program. It does not necessarily indicate the umpire agrees with the assessment of the evaluator. In some instances (darkness, inclement weather), the evaluation form may be completed at a later time and mailed to the umpire. This is to be done within two (2) days of the evaluation. In all instances, a critique will be conducted immediately following the game. For full and blind evaluations, the evaluator must give a score in each of the six (6) categories on the evaluation form, even if the score is N/A. The results of the evaluation will be shared with the umpire immediately following the game. The evaluator will enter the evaluation information onto the NBUA website within two (2) days of the evaluation.

Partner Evaluations :

Any umpire, when working with an umpire who is an evaluator, may request that that umpire provide them with a partner evaluation.These types of evaluations are not as thorough as a formal evaluation and count no more than a regular peer score. However, a thorough post game review is to be provided to the umpire.

Peer Scoring:

All umpires, regardless of tier, WILL provide their partner with a peer score. The exception is that "C" umpires will only provide peer scores for other "C" tier and "1 st year" umpires that they work with. First year umpires will not provide any peer scores. Neither "C" tier nor 1 st year umpires will provide peer scores for "B", "A" and "College" umpires they work with. Umpires will enter these peer scores in the evaluation section of the NBUA website. Umpires are to use the criteria of what is expected of each tier on the NBUA website when determining the score to give to their partner.

The Evaluations Chairman may initiate "Blind Evaluations" and / or "Observations" for any umpire. This is generally conducted when there is reason to believe an umpire may not be in the proper tier.

FAILURE TO SUBMIT PEER SCORES FOR YOUR PARTNERS IN A TIMELY MANNER MAY RESULT IN POSSIBLE ELIMINATION FROM CONSIDERATION FOR PROMOTION TO THE NEXT TIER.

Scoring:

The scoring method for evaluations and peer scores is the same. The only difference is that in a peer evaluation, the umpire is scored on the game as a whole, whereas in written formal evaluations, the evaluator is scoring each individual category. The scores and what they mean are as follows and are based on the expectations of each tier from the NBUA website.

A + : Umpire performed at a level consistent with what is expected of an umpire above      the "A" tier. Performed as a college umpire would be expected to perform.

A:     Umpire performed at a level consistent with what is expected of an umpire in the "A" tier.

Low A / High B : Umpire performed at a level exceeding what is expected of an average "B" tier umpire but not at a level of what is expected of an "A" tier   umpire.

B:      Umpire performed at a level consistent with what is expected of an umpire in the "B" tier.

Low B / High C: Umpire performed at a level exceeding what is expected of an average "C" tier umpire but not at a level of what is expected of a "B" tier umpire.

C: Umpire performed at a level consistent with what is expected of an umpire in the "C" tier.

Low C: Umpire failed to perform at even the very basic level.

Four-Tier System:

Game assignments are based on the following general guidelines. All umpires in a given tier may work any level of game up to and including the level listed for his / her tier.

Requesting an Evaluation:

If you wish to be evaluated, as soon as you have your schedule, Log onto the evaluation section of the NBUA website and follow the prompts. An evaluator will then be assigned to conduct an evaluation.

At the conclusion of the season, each umpire will receive a personalized report identifying their average peer score, average evaluation score, and aggregate score.

Evaluations will be heavily weighted toward formal and partner evaluations. An umpire's aggregate score will be 65% from full evaluations and 35% from peer scores.

Limitations:

An umpire may not receive more than a total of two (2) formal evaluations per season. Special approval must be obtained from the evaluations chairman prior to receiving more than two (2) formal evaluations. Those umpires being granted more than the two (2) allotted evaluations will forfeit the game fee to cover the cost of the evaluation.

Promotions:

At the end of each season, the evaluations committee meets to determine who to recommend for promotion. Promotions are generally recommended at the end of the season, however, promotions MAY be recommended to the full board mid-season. All recommendations are presented to the full board for ratification. New umpires are generally not promoted following their first season with NBUA. However, the evaluation committee may recommend first year umpires for promotion on a case by case basis.

Please direct any questions about this program to:

Gary Coy, Evaluations Chairman: (206) 683-2349 or gary901c@comcast.com

CONTACTS:

College Tier Coordinator: Tim Stevens - tstevens@wiaa.com

A Tier Coordinator: Gavin Anderson -   refgav@yahoo.com

B Tier Coordinator: Richard Leetz - rkleetz@comcast.net