Tuesday, November 11, 2010

NBUA Evaluation Process

By John Philbeck
Evaluations Committee Chairman

A phrase heard repeatedly from all corners of the association has been “How do promotions work in the NBUA?” Often this phrase is preceded by the inquiry, "Can I get an evaluation for the purpose of promotion?”
 
To answer the second question, there is no such thing in the NBUA as an “evaluation for the purpose of promotion.”  This is a myth.  It is a misconception.  This does not happen.  There are no evaluations for the purpose of promotion.  T’ain’t true.  Cain’t happen!
 
Consideration for promotion is a process and is comprised of many factors.  Some of these factors are quantifiable and easily defined.  Some of these factors are not quantifiable and are far less easily defined (for those of you that have worked with me, just envision my strike zone!).
 
The first step that must be reviewed and quantified is simply the number of games worked by the member. An apprentice must work a minimum of 15 games to qualify as a C Tier member the following year.  Less than 15 games that first season and the member must return to apprentice training and rank the next season.
 
For every tier after Apprentice the bylaws require the member to work a minimum of 30 games before they can be considered for promotion.  This is 30 paid games assigned by and completed for the association.  Games worked in other associations, even those wonderful volunteer games for our regional Little League associations, are not included in this minimum game requirement.
 
Beyond this minimum requirement the number of games worked by a member is a minor consideration, but it is a factor.
 
The reason behind this requirement is both a function of “experience” and “dedication to the association.”
 
The “experience” factor has to do with your familiarity with our members, customers, mechanics and expectations as well as the familiarity of our members, customers and abilities that you provide to the association (the proverbial two way street).
 
The “dedication to the association” factor has to do with your availability and support of NBUA and our programs. Are you a resource and are you willing to dedicate reasonable time and effort for your fellow members, the assignor and our customers?
 
Going beyond the number of games worked for the association the process for promotion follows this pattern.
 
Near the end of the season all of the peer ccores are compiled for every member (6,000, YIKES!). These scores are put into a spreadsheet array and reviewed for significant deviations. The average peer score is then tabulated.
 
Next, all staff evaluations are compiled, arrayed, reviewed for deviations and averaged for each member.
 
Following that, and prior to making any other information available, each Evaluation Staff person is asked to simply provide an opinion score for every member they have current (within the last season) familiarity with.  These staff opinion scores are compiled, arrayed reviewed for deviations and averaged.
 
All of this data is then combined using a weighted formula of 55 percent for evaluations, 30 percent for peer scores and 15 percent for staff opinion scores.
 
All of this data is then sorted by the composite score across all members as well as the composite score for each tier separately. This multipage spreadsheet is then distributed to the Evaluation Committee and the Board of Directors.
 
The entire Evaluation Staff is then invited to an open meeting.  At this meeting every staff member is given the charge and the opportunity to discuss any member for the purpose of consideration. This conversation is without restrictions and all staff members are welcome to contribute any information. Often a staff member will be asked for details or specifics for their opinion or comment and this is critical to the process. (Small weapons are discouraged but occasionally allowed.)
 
Once all staff members have had full opportunity to discuss any member this meeting is adjourned and the Evaluation Committee immediately convenes. In this meeting the committee compiles a list of members that are recommended for promotion the next year.
 
The recommended list is distributed to the full board for consideration and discussion at the next board meeting.  At this meeting the list is again discussed, adjustments (both additions and deletions) are suggested and finally, the list is approved by the board.
 
Every member on the list has been considered individually for their displayed abilities, qualifications, experience, comparative competence to all of our members, loyalty to the association and any number of additional “special” considerations that may impact that member (again, this can be either good or not so good).
 
I hope at least some of you have been able to follow this long answer all the way through to this point. Your indulgence is appreciated.  Even more appreciated is you understanding that the NBUA does have a process and is trying very hard to make this as open and democratic as humanly possible.