Appendix III: Methodology
The study used two survey instruments: one for student athletes and one for coaches and administrators. The surveys were mailed directly to all respondents. The survey returned a standard response rate of 23% on the average over all respondents: student athletes, coaches, and administrators. The surveys were optically scanned at National Computer Systems, Inc., and the database transferred onto a secure server at Alfred University.
Survey Instruments
Two survey instruments were developed: for student athletes and for senior administrators and coaches. The surveys were nearly identical, with editorial changes appropriate to the respondents and with minor differences in selected questions. Each survey includes four sections:
- Background. This section included questions on the demographic background of the individual and the campus, including participation in Greek social organizations, sports coached or played, and whether the campus is in a state with an anti-hazing law.
- Hazing. This section opened with a definition of hazing given for respondents to use in answering the questions: Hazing is any activity expected of someone joining a group that humiliates, degrades, abuses, or endangers, regardless of the person's willingness to participate. This does not include activities such as: rookies carrying the balls, team parties with community games, or going out with your teammates, unless an atmosphere of humiliation, degradation, abuse, or danger arises. Respondents were asked a number of questions: the attitude of the athletic department towards hazing, if they had ever been involved in hazing, and how pervasive they felt hazing is on campus. They were also asked whether they would report hazing, and, if not, why.
- Team-building and Initiation Activities. Student athletes were asked if they were involved in or suspected any of twenty-four specific initiation activities. Administrators were asked if they have known about or suspected any of these same activities. All respondents were asked if they thought that the activities were traditional, required, appropriate, inappropriate, or done when drinking alcohol.
- Strategies for Preventing Hazing. Respondents were asked if any of 11 specific hazing prevention strategies were used on their campus and how effective they rated each of these strategies. An open-ended question requested suggestions for alternative bonding and recognition activities or hazing prevention strategies considered most effective.
Respondents
The NCAA provided the names and addresses of the athletic directors, senior women's administrators, and their National Student Athlete Advisory Committee members. Higher Education Publications, Inc., provided the names and addresses of the senior student affairs officers from their 1999 Higher Education Directory. Collegiate Directories, Inc. provided a national random sample of coaches of NCAA sports teams. Presidents of all NCAA institutions were invited to join in this study by providing a contact person from whom to obtain the names and addresses of student athletes on their campus. Although the letter went out at a difficult time of year - early December 1998- nearly one-fourth of all NCAA institutions (224) provided athletes' names and addresses by the deadline of January 20, 1999. An additional 120 institutions wished to participate but were not able to provide student names and addresses by the given deadline.
The survey reflected the full range of institutions across the nation, from large public universities to small private colleges. The distribution of NCAA institutions that provided student athlete names and addresses paralleled the national distribution of all NCAA institutions across all three NCAA divisions. Southern Division I participation was slightly lower than the national percentage and Eastern Division III participation was slightly higher.
Region | Division I | Division II | Division III | Total |
---|---|---|---|---|
Eastern | 7% | 6% | 21% | 34% |
Midwestern | 5% | 5% | 9% | 19% |
Southern | 12% | 11% | 6% | 29% |
Western | 6% | 7% | 5% | 18% |
Total | 30% | 29% | 41% | 100% |
Region | Division I | Division II | Division III | Total |
---|---|---|---|---|
Eastern | 6% | 5% | 26% | 37% |
Midwestern | 5% | 4% | 9% | 18% |
Southern | 8% | 13% | 8% | 29% |
Eastern | 6% | 5% | 5% | 16%> |
Eastern | 25% | 27% | 48% | 100% |
The 224 institutions submitted the names of 61,258 male and female students. A national random sample of 10,000 student athletes was taken from this pool. Each selected athlete was mailed a survey form and a no-postage-necessary, business reply envelope. Only one mailing went out to ensure no duplication in the respondents. Anonymous direct mail was critical to this study since many people hesitate to report experiences they think will reflect badly on them, their team, or their school. Surveys were mailed January 26-29, 1999, to the groups listed below.
Respondents | # Sent | # Returned |
---|---|---|
All NCAA Athletic Directors | 1,014 | 304 / 30% |
All VPs or Dean of Student Affairs for institutions | 1,034 | 228 / 22% |
All NCAA Student Athlete Advisory Committee members | 86 | 27 / 31% |
All NCAA Senior Women's Administrators | 234 | |
Random sample of all NCAA coaches | 3,000 | 939 / 29% |
Random sample of student athletes from 223 NCAA institutions | 10,000 | 2,009 / 20% |
Total surveys | 15,368 | 3,507 / 23% |
Response Rates and Distribution of Student Athletes
Response rates shown above were respectable at 20% - 31%. The student response rate of 20% was quite high given that students move frequently, many surveys were returned, and more were certainly undelivered. The response rate from senior student affairs officers at 22% was standard for direct mail surveys. Response rates from athletic directors and NCAA National Student Athlete Advisory Committee members were high at 30% and 31% respectively.
The response rates for coaches and senior women's administrators were merged. Surveys were sent to all 234 senior women's administrators registered with the NCAA and to a national random sample of 3,000 coaches. The response from senior women's administrators was 204 and from coaches was 735. We assume that many of the coaches identified themselves as senior women's administrators, but were not necessarily registered with the NCAA as such. Because of this we merged these two groups. This added 10% non-random selection of 234 names to the random sample of coaches. Descriptive results were still of interest. Of the two groups combined, the 29% response rate was high.
The student athlete sample was large enough to contain a strong representation of both gender and NCAA division. Response rates for men and women, however, were inverted: men composed 43% of the respondents as opposed to 61% of the population of student athletes, and women composed 57% of the respondents as opposed to 39% of the population of student athletes. Response rates were also inverted for Division I and Division III: Division I comprised 29% of the respondents as opposed to 42% of the population of student athletes, and Division III comprised 49% of the respondents as opposed to 37% of the population of student athletes. These inversions were taken into account throughout the analysis.
Division | Male | Female | Total | % | Male | Female | Total | % |
---|---|---|---|---|---|---|---|---|
I | 84507 | 52154 | 136661 | 42% | 219 | 351 | 570 | 29% |
II | 43713 | 26162 | 69875 | 21% | 195 | 221 | 416 | 22% |
III | 72407 | 49893 | 122300 | 37% | 425 | 525 | 950 | 49% |
Total | 200627 | 128209 | 328836 | 839 | 1097 | 1936 | ||
61% | 39% | 43% | 57% |
Student athlete response rates by sport generally matched the distribution of athletes across sports. Many institutions noted that they did not include the track team in the January 20th submission deadline for the survey, since it's a spring sport. We knew representation in track would be low. Football and cross-country were the only fall sports for which the response rate was lower than their proportional share. This low response rate calls into question a response bias for football and cross country teams. As secretive as hazing can be, underreporting is a real concern and possibility. The response rate for swimming was quite high. Soccer was also somewhat high.
Population | Sample | |||||||
---|---|---|---|---|---|---|---|---|
Sport | Male | Female | Total | % | Male | Female | Total | % |
Baseball | 24442 | 0 | 24442 | 7.56 | 121 | 0 | 121 | 5.42 |
Basketball | 15141 | 13392 | 28533 | 8.83 | 55 | 119 | 175 | 7.79 |
Cross Country | 10271 | 10141 | 20412 | 6.32 | 101 | 101 | 202 | 9.04 |
Fencing | 657 | 558 | 1215 | 0.38 | 3 | 4 | 7 | 0.31 |
Football | 53984 | 0 | 53984 | 16.7 | 208 | 0 | 208 | 9.31 |
Golf | 7197 | 2323 | 9520 | 2.95 | 46 | 29 | 75 | 3.36 |
Gymnastics | 413 | 1311 | 1724 | 0.53 | 0 | 14 | 14 | 0.63 |
Ice Hockey | 3608 | 436 | 4044 | 1.25 | 12 | 11 | 23 | 1.03 |
Lacrosse | 5705 | 4068 | 9773 | 3.02 | 32 | 47 | 79 | 3.54 |
Rifle | 408 | 0 | 408 | 0.13 | 2 | 0 | 2 | 0.09 |
Rowing | 1820 | 3951 | 5771 | 1.79 | 12 | 54 | 66 | 2.95 |
Skiing | 575 | 455 | 1030 | 0.32 | 4 | 12 | 16 | 0.72 |
Soccer | 17053 | 14829 | 31882 | 9.78 | 105 | 180 | 285 | 12.76 |
Softball | 0 | 13167 | 13167 | 4.07 | 0 | 146 | 146 | 6.54 |
Swimming | 7508 | 8745 | 16253 | 5.03 | 66 | 124 | 190 | 8.59 |
Tennis | 7999 | 8223 | 16222 | 5.02 | 30 | 73 | 104 | 4.66 |
Track | 35262 | 28639 | 63901 | 19.76 | 153 | 51 | 302 | 13.52 |
Volleyball | 1052 | 12284 | 13336 | 4.13 | 5 | 160 | 165 | 7.36 |
Water Polo | 893 | 452 | 1345 | 0.42 | 7 | 11 | 18 | 0.81 |
Wrestling | 6219 | 0 | 6219 | 1.92 | 37 | 0 | 37 | 1.66 |
Totals | 200207 | 122974 | 32181 | 100 | 719 | 893 | 2234 | 100 |