BIA and DOD Schools: Student Achievement and Other		 
Characteristics Often Differ from Public Schools' (28-SEP-01,	 
GAO-01-934).							 
								 
Unlike public schools, where federal funding constitutes a small 
portion of total resources, the Bureau of Indian Affairs (BIA)	 
and the Department of Defense (DOD) school systems depend almost 
entirely on federal funds. Although the two school systems have  
this feature in common, their histories and settings are quite	 
different.  The academic achievement of many BIA students as	 
measured by their performance on standardized tests and other	 
measures is far below the performance of students in public	 
schools. BIA students also score considerably below national	 
averages on college admissions tests. BIA school officials	 
indicate that nearly all BIA teachers are fully certified for the
subjects or grade levels they teach, although officials said that
some schools experience considerable difficulties recruiting and 
retaining qualified staff. In terms of educational technology,	 
access levels to computers and the Internet reported by BIA	 
school administrators exceeded those of public schools, but	 
technical support to maintain computers and to assist teachers	 
with using technology in the classroom was more limited. Problems
with school facilities were reported by many school		 
administrators. Estimated per-pupil expenditures for BIA schools 
vary widely by school type (for example, day or boarding), but	 
are generally higher than for public schools nationally. The	 
academic achievement of DOD students, as measured by their	 
performance on standardized tests and their plans for enrolling  
in college, generally exceeds that of elementary and secondary	 
students nationwide. On college admission tests, DOD students	 
score at or near national averages. DOD school administrators	 
indicated that nearly all their teachers are fully certified for 
the subjects or grade levels they teach, and about two-thirds	 
have advanced degrees. Access levels to computers and the	 
Internet were better than public schools, and nearly all	 
administrators reported that technical support is available in	 
their school. Many DOD administrators reported some problems with
their school facilities, but overall the conditions of their	 
buildings did not vary greatly from those reported by public	 
schools in 1999. Estimated per-pupil expenditures at DOD schools 
located overseas were higher than expenditures for those located 
in the U.S.  DOD records show that a substantial part of the	 
difference is related to moving and housing costs for teachers	 
and staff in overseas schools. DOD's domestic schools, which	 
generally do not have these expenses, are much closer to national
per-pupil expenditures. 					 
-------------------------Indexing Terms------------------------- 
REPORTNUM:   GAO-01-934 					        
    ACCNO:   A01447						        
  TITLE:     BIA and DOD Schools: Student Achievement and Other       
Characteristics Often Differ from Public Schools'		 
     DATE:   09/28/2001 
  SUBJECT:   Academic achievement				 
	     Comparative analysis				 
	     Computers						 
	     Educational facilities				 
	     Elementary schools 				 
	     Federal funds					 
	     Public schools					 
	     Secondary schools					 
	     Teachers						 
	     American College Test				 
	     Dept. of Education National Assessment		 
	     of Educational Progress				 
								 
	     Dept. of Education Safe and Drug-Free		 
	     Schools and Communities Program			 								 
	     Dept. of Education Title I Program 		 
	     National School Breakfast Program			 
	     National School Lunch Program			 
	     Scholastic Assessment Test 			 

******************************************************************
** This file contains an ASCII representation of the text of a  **
** GAO Testimony.                                               **
**                                                              **
** No attempt has been made to display graphic images, although **
** figure captions are reproduced.  Tables are included, but    **
** may not resemble those in the printed version.               **
**                                                              **
** Please see the PDF (Portable Document Format) file, when     **
** available, for a complete electronic file of the printed     **
** document's contents.                                         **
**                                                              **
******************************************************************
GAO-01-934
     
BIA AND DOD SCHOOLS

Student Achievement and Other Characteristics Often Differ from Public
Schools? Report to Congressional Requesters

United States General Accounting Office

GAO

September 2001 GAO- 01- 934

Page i GAO- 01- 934 BIA and DOD Schools Letter 1

Results in Brief 2 Background 3 The BIA School System 12 The DOD School
System 34 Agency Comments 45

Appendix I Scope and Methodology 47 Student Achievement 48 Teacher Staffing
and Educational Technology 50 Facilities 51 Estimated Per Pupil Expenditures
53

Appendix II Comments from the Department of Defense 56

Appendix III Comments from the Department of the Interior 57 GAO Comments 68

Appendix IV GAO Contacts and Staff Acknowledgments 74 GAO Contacts 74 Staff
Acknowledgments 74

Tables

Table 1: Performance of Students in BIA and Public Schools on State
Assessments in School Year 1999- 2000 13 Table 2: 1999- 2000 BIA Graduates?
Performance on SAT and ACT

Compared With National Averages 14 Table 3: Technology Statistics for BIA
and Public Schools 20 Table 4: Reported Facility Deficiencies for BIA
Schools and

Dormitories and Public Schools 25 Table 5: Selected Reported Deficiencies
and Estimated Repair

Costs for BIA Schools and Dormitories 29 Table 6: Comparison of Per- Pupil
Expenditures at BIA and Public

Schools, 1997- 98 32 Table 7: National Percentile Rankings for Students in
DOD Schools

on the TerraNova Multiple Assessments Standardized Tests for School Year
1999- 2000 35 Contents

Page ii GAO- 01- 934 BIA and DOD Schools

Table 8: Average SAT and ACT Scores for DOD and Public School Students
Graduating in 2000 36 Table 9: Median Class Sizes at DOD Schools 38 Table
10: Technology Statistics for DOD and Public Schools 39 Table 11: Reported
Facilities Deficiencies for DOD and Public

Schools 42 Table 12: Selected Reported Deficiencies and Estimated Repair

Costs for DOD Schools 44 Table 13: Comparison of Per- Pupil Expenditures at
DOD and

Public Schools, 1997- 98 45

Figures

Figure 1: Locations of BIA Schools in School Year 1999- 2000 4 Figure 2:
Locations of DOD Europe Area Schools in School Year

1999- 2000 7 Figure 3: Locations of DOD Pacific Area Schools in School Year

1999- 2000 8 Figure 4: Locations of DOD Domestic and Cuba Schools in School

Year 1999- 2000 9 Figure 5: Percentage of BIA Schools Reporting That a
Majority of

Teachers Received Various Types of Training 17 Figure 6: Percentage of BIA
Schools Reporting That a Majority of

Teachers Assign Students Computer or Internet Work at Least Once Per Week
for Various Classroom Activities 22 Figure 7: Percentage of BIA Schools
Reporting That Various Work

Spaces and Equipment Are Insufficient 27 Figure 8: Percentage of DOD Schools
Reporting That a Majority of

Teachers Received Various Types of Training 37 Figure 9: Percentage of DOD
Schools Reporting That a Majority of

Teachers Assign Students Computer or Internet Work At Least Once Per Week
for Various Classroom Activities 40 Figure 10: Percentage of DOD Schools
Reporting That Various

Work Spaces and Equipment Are Insufficient 43

Abbreviations

ACT American College Test AIMS Arizona Instrument to Measure Standards AME
Applied Management Engineering, Inc. BIA Bureau of Indian Affairs

Page iii GAO- 01- 934 BIA and DOD Schools

DOD Department of Defense DODEA Department of Defense Education Activity
NAEP National Assessment of Educational Progress NCES National Center for
Education Statistics NRC National Research Council OIEP Office of Indian
Education Programs SAT Scholastic Assessment Test USDA U. S. Department of
Agriculture

Page 1 GAO- 01- 934 BIA and DOD Schools

September 28, 2001 The Honorable Robert C. Byrd The Honorable Ben Nighthorse
Campbell The Honorable Byron L. Dorgan The Honorable Daniel K. Inouye United
States Senate

The federal government has direct responsibility for two school systems
serving elementary and secondary students- the Bureau of Indian Affairs
(BIA) and the Department of Defense (DOD) school systems. Unlike public
schools, where federal funding constitutes a small portion of total
resources, the BIA and DOD school systems depend almost entirely on federal
funds. Although the two school systems have this feature in common, their
histories and settings are quite different. Because these school systems are
a federal responsibility, the Congress is interested in ensuring that
children attending BIA and DOD schools are receiving a quality education.

To better understand the quality of the educational environments in BIA and
DOD schools, you asked us to provide information about several aspects of
both school systems. Our study provides information on student academic
performance, teacher staffing, access to educational technology, the
condition of facilities, and expenditure levels for each system. This study
also provides comparative data for public schools when these data were
available.

The scope of our review included BIA day schools and boarding schools, and
DOD schools located both in the United States and overseas. To the extent
possible, we excluded from our analyses BIA peripheral dormitories on
reservations- which house Indian students who attend nearby public schools-
because they generally do not have academic programs. Information for this
review was gathered primarily from agency data obtained from BIA and DOD,
and from a mail survey of administrators at all BIA and DOD schools covering
the 1999- 2000 school year. Survey response rates were 81 percent and 92
percent for BIA and DOD schools, respectively. We also obtained data on
student performance on achievement tests and college entrance examinations
from states and college testing organizations for students in BIA schools.
Data needed to precisely compute per- pupil expenditures for both BIA and
DOD schools were not available. Therefore, our calculations are estimates
based on BIA and DOD agency data and federal expenditure information from
tribal

United States General Accounting Office Washington, DC 20548

Page 2 GAO- 01- 934 BIA and DOD Schools

audit reports submitted under the Single Audit Act. We also conducted site
visits to nine BIA schools located in South Dakota, Arizona, Minnesota, and
Washington, and seven DOD schools located at three military installations in
the United States- Maxwell Air Force Base, in Alabama; and Fort Benning and
Robins Air Force Base, in Georgia. For further details about our scope and
methodology, see appendix I. We did not verify information collected for
this study but obtained supporting documentation where appropriate. We
conducted our work between June 2000 and July 2001 in accordance with
generally accepted government auditing standards.

The academic achievement of many BIA students as measured by their
performance on standardized tests and other measures is far below the
performance of students in public schools. BIA students also score
considerably below national averages on college admission tests. Academic
performance has been strongly associated with educational and income levels
of parents, and students in BIA schools often come from family settings
where education, employment, and earning levels are lower than the national
average. BIA school administrators indicate that nearly all BIA teachers are
fully certified for the subjects or grade levels they teach, although
several officials said that some schools experience considerable
difficulties recruiting and retaining qualified staff. In terms of
educational technology, access levels to computers and the Internet reported
by BIA school administrators exceeded those of public schools, but technical
support to maintain computers and to assist teachers with using technology
in the classroom was more limited than in public schools. Problems with
school facilities were reported by many school administrators. For example,
administrators at more than 60 percent of responding BIA schools reported
having at least one building in inadequate condition compared with about a
quarter of administrators at public schools surveyed by the Department of
Education (Education) in 1999. Finally, our estimated per- pupil
expenditures for BIA schools vary widely by school type (for example, day or
boarding), but are generally higher than for public schools nationally. A
number of factors distinguish BIA schools from public schools, which may add
to their costs. For example, a high proportion of BIA students have special
needs, and BIA schools support a broader infrastructure (such as sewer and
water systems) than most public schools.

The academic achievement of DOD students, as measured by their performance
on standardized tests and their plans for enrolling in college, generally
exceeds that of elementary and secondary students nationwide. Results in
Brief

Page 3 GAO- 01- 934 BIA and DOD Schools

On college admission tests, DOD students score at or near national averages.
DOD school administrators indicated that nearly all their teachers are fully
certified for the subjects or grade levels they teach, and about two- thirds
have advanced degrees. Access levels to computers and the Internet reported
by these administrators were better than public schools, and nearly all
administrators reported that technical support is available in their school.
Many DOD school administrators reported some problems with their school
facilities, but overall the conditions of their buildings did not vary
greatly from those reported by public schools in 1999. Our estimated per-
pupil expenditures at DOD schools located overseas were higher than
expenditures for those located in the U. S. DOD records show that a
substantial part of the difference is related to moving and housing costs
for teachers and staff in overseas schools. DOD?s domestic schools, which
generally do not have these expenses, are much closer to national per- pupil
expenditures.

The BIA and DOD school systems are unlike public school systems in a number
of ways and are also distinct from each other. Information on the schools,
the students and families they serve, the settings in which they operate,
and other fundamental aspects of these systems helps put our findings into
context.

BIA schools serve less than 10 percent of all Indian students enrolled in
elementary and secondary schools in this country. 1 In school year 1999-
2000, the total enrollment was 47,080 students in the 171 2 schools funded
by BIA. BIA schools are located in 23 states; however, over 70 percent of
the schools are in four states- Arizona, New Mexico, North Dakota, and South
Dakota (see fig. 1). The schools are located primarily in rural areas and
small towns and serve Indian children living on or near reservations.
Individual school enrollments range in size from 14 to over 1,000 students,
but a little over half of the schools enroll fewer than 250 students; most
are combined schools spanning both elementary and secondary grades. A

1 According to the National Center for Education Statistics (NCES),
approximately 541,000 American Indian/ Alaska Native children were enrolled
in public elementary and secondary schools in the 50 states and the District
of Columbia in school year 1999- 2000.

2 In addition, BIA supports 14 peripheral dormitories which served 1,689
children in school year 1999- 2000. Two of the 14 peripheral dormitories
offered kindergarten- only programs in school year 1999- 2000. We considered
peripheral dormitories to be outside the scope of this report and excluded
them from our analyses where possible. Background

BIA Schools

Page 4 GAO- 01- 934 BIA and DOD Schools

unique feature of the BIA school system is that almost one- third of the
schools have a residential component; that is, they board at least a portion
of the students who attend the school. In total, about 17 percent of BIA
students reside in school dormitories. Some students board because their
homes are so far away or inaccessible that daily transportation is
impractical. However, an increasing proportion of students reside in the
dormitories for other reasons; for example, some students live in boarding
schools to separate them from dysfunctional or severely impoverished home
environments.

Figure 1: Locations of BIA Schools in School Year 1999- 2000

Source: Data are from BIA?s Office of Indian Education Programs. School
locations are indicated by stars, but some stars represent more than one
school.

Education programs and activities of BIA schools are administered by the
BIA?s Office of Indian Education Programs (OIEP); however, in general, the
organization of BIA schools is highly decentralized. Each school is

Page 5 GAO- 01- 934 BIA and DOD Schools

governed by its own independent school board, which has authority over
functions such as hiring personnel, adopting budgets, and setting policy.
Another important aspect of the BIA school system is the agency?s support
and encouragement of tribal control of school programs. In school year 1999-
2000, 108 schools, or about two- thirds of all BIA- funded schools, were
operated by tribes or tribal organizations under grants, contracts, or
compacts with BIA; the remainder were operated by BIA.

In fiscal year 2001, BIA received a total of $777.6 million to support the
operations of its schools and address educational facility needs. 3 This
represented a substantial (30 percent) increase over fiscal year 2000
funding levels. Nearly all of the increase was for repair or replacement of
school facilities; funding for school operations increased only moderately.
4 Like many public schools, BIA schools also receive funding from Education
programs, such as Title I and Safe and Drug Free Schools and Communities.
Funds from these programs are provided to BIA and passed through to schools.
5 Fiscal year 2000 funding from Education programs totaled $132 million. BIA
schools also participate in the U. S. Department of Agriculture?s (USDA)
child nutrition programs, such as the National School Lunch and Breakfast
programs, which provide free or reducedprice meals for children living in
families earning below certain income levels.

DOD operates schools for the children of military and civilian DOD personnel
overseas and on certain military bases in the United States. 6 In total, DOD
operated 224 elementary and secondary schools in school year 1999- 2000,
with an enrollment of almost 108,000 students. A little over

3 Funding for BIA schools comes primarily from two BIA appropriations:
Operation of Indian Programs and Construction. 4 Funding for school
facilities repair and replacement- which comprises a smaller portion of
BIA?s education budget- increased by 121 percent. Funding for school
operations, the majority of the budget, increased by about 5 percent. Taken
together these increases in fiscal year 2001 raised funding 30 percent over
the previous year.

5 Under an agreement with Education, BIA receives flow through funds for
several Education programs and is permitted to retain 1. 5 percent of these
funds to perform administrative responsibilities similar to those performed
by state education agencies.

6 The schools are organized into two separate but parallel systems:
Department of Defense Dependents Schools overseas, and the Department of
Defense Domestic Dependent Elementary and Secondary Schools in the United
States. We refer to schools in both systems as DOD schools. DOD Schools

Page 6 GAO- 01- 934 BIA and DOD Schools

two- thirds of DOD schools are located overseas, concentrated in several
countries in Europe and in Japan, Korea, and Cuba (see figs. 2 and 3). About
74,280 students were enrolled in DOD overseas schools in school year 1999-
2000. 7 The domestic schools are located on military bases in seven states
concentrated in the Southeast and in Guam and Puerto Rico (see fig. 4) and
enrolled about 33,690 students in school year 1999- 2000. 8 Individual
school enrollments range in size from 32 to over 1,300 in the two DOD
systems, with the median school size being about 450 students. According to
a DOD official, nearly all eligible children of military parents overseas
attend DOD schools. However, most children of military parents in the U. S.
attend public schools. DOD officials estimate that about 15 percent of
school age military dependents in total attend DOD schools abroad and in the
United States.

7 In addition, DOD pays tuition for about 2, 080 eligible students overseas
to attend non- DOD schools in countries where no DOD schools are available.
8 In addition, DOD pays tuition and/ or transportation costs for
approximately 2, 085 DOD students enrolled in public schools operated by the
local education agency in four states.

Page 7 GAO- 01- 934 BIA and DOD Schools

Figure 2: Locations of DOD Europe Area Schools in School Year 1999- 2000

Source: Data are from DODEA 1999- 2000 Accountability Report. (Arlington,
Va.: Department of Defense Education Activity (DODEA)). Some locations may
have more than one school.

AFRICA EUROPE

A T L A N T I C O C E A N

Page 8 GAO- 01- 934 BIA and DOD Schools

Figure 3: Locations of DOD Pacific Area Schools in School Year 1999- 2000

Source: Data are from DODEA 1999- 2000 Accountability Report. Some locations
may have more than one school.

A S I A

P A C I F I C O C E A N

Page 9 GAO- 01- 934 BIA and DOD Schools

Figure 4: Locations of DOD Domestic and Cuba Schools in School Year 1999-
2000

Source: Data are from DODEA 1999- 2000 Accountability Report. Some locations
may have more than one school.

Cuba Guam Puerto Rico

Page 10 GAO- 01- 934 BIA and DOD Schools

Education programs and activities of DOD schools are managed and directed by
the Department of Defense Education Activity (DODEA). The overseas and
domestic schools are organized into 24 districts, each managed by a
superintendent and other district staff, such as curriculum coordinators and
maintenance supervisors.

In fiscal year 2001, DOD schools received a total of $1.3 billion to support
school operations and address facility needs. 9 Overall, this represented
level funding since fiscal year 2000, although funding for school operations
and maintenance rose slightly while funding for school construction
decreased. DOD schools are not authorized to receive grants from federal
programs, including those administered by Education; however, DOD schools do
participate in the USDA child nutrition programs.

While the federal government has responsibility for both the BIA and DOD
school systems, the two systems are very distinct from each other,
particularly with respect to the types of students and families they serve.
The proportion of students who have special needs is much higher in BIA
schools than DOD schools. For example, according to agency records, about 1
in every 5 BIA students is enrolled in special education, compared with 1 in
every 12 DOD students; and nearly 60 percent of BIA students have limited
English proficiency compared with just 6 percent of DOD students. Students
in the two systems also differ in terms of their economic need. Eligibility
for the USDA?s free or reduced- price lunch programs is often used as an
indicator of poverty. While data on the proportion of children eligible for
free or reduced- price lunch were not complete for BIA schools, available
data for 123 of the 171 schools showed that over 80 percent of students were
eligible, compared with about onethird of students at DOD schools.

Specific information on the education levels and employment status of
parents of BIA and DOD students was not available, but other information
suggests significant differences between the two. For example, unemployment
on or near Indian reservations is very high- over 40 percent in 1999. In
contrast, students attending DOD schools are generally military dependents
and, by virtue of that fact, have at least one parent

9 Funding for DOD schools comes from Military Construction Appropriations,
DefenseWide; and Defense Appropriations- Operations and Maintenance,
Defense- Wide, and Procurement, Defense- Wide. Characteristics of BIA and

DOD Students and Their Families Differ

Page 11 GAO- 01- 934 BIA and DOD Schools

who is employed. With respect to education, about one- third of Indian
adults do not have high school diplomas, according to Census Bureau data for
1990; in contrast, nearly all DOD active military personnel have completed
high school. Moreover, a number of factors can affect parental involvement
in BIA schools, including long distances between home and school, language
barriers, and parents? poor associations with schools due to past federal
policies emphasizing the assimilation of Indian children. In comparison,
military communities have a tradition of supporting military families, and
this support extends to their schools. Parental involvement is highly
emphasized in DOD schools, with some base commands providing release time to
military personnel to volunteer in schools.

At various times, the Congress has considered the question of whether there
is a need for BIA and DOD schools in locations where public school systems
are close by. Since 1794, when the first treaty providing for any form of
Indian education was signed, the federal government has provided education
services for Indian children, and has carried it out almost exclusively
through the BIA. However, in the 20th century, the states began providing
for Indian education and currently provide schooling for the majority of
Indian elementary and secondary students. During the latter part of the
1970s, the Congress reviewed the need to construct certain BIA schools close
to public schools to determine if BIA was properly ranking schools on its
school construction list. Though Indian families can choose where to send
their children to school, BIA?s policy at that time was to have children
attend nearby public schools with adequate facilities instead of building
new BIA schools to serve these students. However, in 1988, the Congress
decided that proximity to a public school could not be the primary reason
for rejecting a BIA school construction project.

The need for DOD domestic schools also has been reviewed a number of times,
specifically to determine whether transferring schools to nearby public
school districts is feasible. DOD domestic schools were established to
provide education to military children in communities where the local
schools were deemed unable to provide a suitable education. After 1950,
schools were added to the system to allow military children to attend
integrated schools in locations where local schools remained segregated.
Since that time, however, more and more schools have been transferred to
public school districts, in part because of the integration of public
schools and Education?s emphasis on state and local responsibility for the
education of military children. Thus, while at one time there were about 100
installations with DOD- operated schools, now there are 14 located in Need
for BIA and DOD

Schools

Page 12 GAO- 01- 934 BIA and DOD Schools

the 50 states. According to a DOD official, most children of military
parents in the U. S. attend public schools.

The academic achievement of many BIA students falls far below that of public
school students. As in most public schools, nearly all BIA teachers are
certified and class sizes in BIA schools are smaller than national averages,
even though officials report some difficulty recruiting staff. BIA students
have greater access to computers and Internet connections than public school
students generally, though a smaller proportion of BIA schools than public
schools has technology support staff to maintain equipment and assist
teachers in integrating technology into classrooms. BIA administrators
report extensive facilities problems and agency records show a deferred
maintenance and repair backlog approaching $1 billion. Estimated per- pupil
expenditures vary widely among different types of BIA schools, such as
boarding schools and day schools, and are higher than per- pupil
expenditures at public schools. It is difficult to draw conclusions about
differences in expenditure levels between BIA and public schools, in part
because of cost factors that affect some BIA schools, such as higher
proportions of students who have special needs, broader infrastructure
responsibilities, longer distances to transport children, and the cost of
residential programs in boarding schools.

In school year 1999- 2000, BIA students scored far below public school
students on state assessments in North Dakota, South Dakota, and Arizona-
three states with large numbers of BIA schools. 10 As shown in table 1, the
average national percentile rankings for BIA students on North Dakota?s
statewide assessment, for all grades and subject areas tested, ranged from
the 25th to the 33rd percentiles in school year 1999- 2000. (By definition,
the national average on the norm- referenced tests used in North Dakota and
South Dakota is the 50th percentile.) The corresponding averages for public
school students in North Dakota ranged between the 64th and 71st
percentiles. Similarly, in South Dakota, the average national percentile
rankings for BIA students on South Dakota?s statewide assessment were much
lower than the averages for public school students

10 We were able to obtain data for all BIA schools in North Dakota and South
Dakota and for 19 of the 50 BIA schools in Arizona that participated in the
state?s assessment program. About 36 percent of all BIA students attend the
schools to which our data relate. Data were not available for BIA schools in
New Mexico, which has about one- quarter of all BIA students. The BIA School

System Academic Performance of Many BIA Students is Below That of Public
School Students

Page 13 GAO- 01- 934 BIA and DOD Schools

in the state, both overall and for specific skill areas such as language
arts, reading, and math. Finally, in Arizona, a smaller proportion of BIA
students met state standards than public school students. In school year
1999- 2000, in reading, writing, and math, at each grade level tested, the
proportion of BIA students who met or exceeded the standards was far lower
than the proportion of public school students. (See table 1.)

Table 1: Performance of Students in BIA and Public Schools on State
Assessments in School Year 1999- 2000

Average performance of BIA students Average performance of public

school students

North Dakota a 25th- 33rd percentile 64th- 71st percentile South Dakota b
25th- 28th percentile 60th- 67th percentile Arizona c 0- 27 percent met or
exceeded

standards 15- 71 percent met or exceeded standards

Note: The table shows the range of scores on these assessments for all grade
levels and subject areas tested. a North Dakota uses the TerraNova Basic
Multiple Assessments as an assessment tool at grade 4, and the TerraNova
Complete Battery Plus at grades 6, 8, and 10. Scores shown are total scores.
b South Dakota uses the Stanford Achievement Test as an assessment tool at
grades 2, 4, 8, and 11.

Scores shown are for the complete battery. c Arizona uses an assessment test
called the Arizona Instrument to Measure Standards (AIMS) in

grades 3, 5, 8, 10, and 11. AIMS classifies students into four categories in
relation to the standards- Falls Far Below, Approaches, Meets, or Exceeds.

For Arizona and North Dakota, data for public school students by ethnicity
were available. These data indicate that Indian students in public schools
in these two states score below state averages but higher than BIA students
in those states.

In addition to standardized testing, BIA schools assess students?
proficiency in language arts and math using a combination of other measures
including ?authentic assessment.? Authentic assessment involves evaluating
student achievement based on a review of multiple items such as portfolios
illustrating students? work, grades, and work samples as well as teacher
observations. Many school districts and states have been incorporating
aspects of authentic assessment into their student assessment programs.
Authentic assessment often requires students to demonstrate problem- solving
skills and is thought to reflect real- world situations. Some researchers
consider authentic assessment more appropriate for minority students than
standardized testing because standardized tests have been criticized as
being culturally biased. In particular, because of the diversity of
languages and cultures among

Page 14 GAO- 01- 934 BIA and DOD Schools

Indian students, some educators have found these authentic assessment
methods more useful. These assessments are reported annually by all
BIAfunded schools. Using authentic assessment approaches, about half of BIA
students have been assessed as proficient or advanced, in both math and
language arts, each year over the last 3 years.

Other measures often used as indicators of students? academic success
include dropout rate, college admissions test scores, and the proportion of
students planning to attend college. On these measures, BIA students perform
less well than public school students. For example, in their annual reports,
BIA high schools report dropout rates- the proportion of high school
students who leave school and do not enroll in another school during the
year- averaging about 10 percent. This is higher than the national average
dropout rate (about 5 percent) and slightly higher than dropout rates for
other ethnic minority groups. In addition, BIA students score significantly
below national averages on college admission tests. As shown in table 2, BIA
students who take the Scholastic Assessment Test (SAT) and the American
College Test (ACT)- two widely used college entrance examinations- score
below students nationally in both verbal/ English and math assessments. They
also score below students from low- income families on these tests. Finally,
in our survey, BIA school officials estimated that about 28 percent of their
graduates planned on enrolling in college after graduation, about evenly
split between 4- year and 2- year colleges. Nationally, in 1999, a little
less than two- thirds of high school graduates were enrolled in college the
year after they completed high school- about 40 percent in 4- year colleges
and 24 percent in 2- year colleges. For students from low- income families,
the percentage who were enrolled in college the year after they graduated
was around 50 percent.

Table 2: 1999- 2000 BIA Graduates? Performance on SAT and ACT Compared With
National Averages

SAT scores a ACT scores b Verbal Math English Math

BIA students 383 382 14.7 15.9 National average 505 514 20.5 20.7

Note: A small number of BIA seniors (fewer than 70) take the SAT. Far more
BIA students (about 800) take the ACT because BIA schools are located in
areas of the country where the ACT is the predominant college admission
test. a Data provided by the College Board.

b Data provided by the American College Testing Service.

Page 15 GAO- 01- 934 BIA and DOD Schools

While the academic achievement of BIA students is low relative to students
nationally, to some extent the performance of BIA students may be associated
with conditions that are beyond a school system?s control. Higher student
outcomes have been strongly associated with higher educational and income
levels of parents. BIA students come from environments where family
education levels are low and unemployment and poverty rates are high. For
example, 1990 Census Bureau data show that one- third of Indians age 25 or
older do not have high school diplomas compared with one- quarter of all
adults nationally; and for Indians living on reservations or trust lands,
the proportion of adults who are not high school graduates is over 45
percent. Indians living on or near reservations also experience high rates
of unemployment. Data from BIA?s Indian Labor Force Report show that 43
percent of the potential labor force living on or near reservations remained
unemployed in 1999. Poverty rates are also high among Indian families, with
27 percent having incomes below the poverty level, compared with 10 percent
of all families. Other data suggest that the proportion of families with
incomes below the poverty level is even higher for those living on
reservations and trust lands. Finally, the issue of alcohol and substance
abuse is significant for Indian communities; the death rate due to
alcoholism is about 7 times higher for Indians than for all races. Parental
substance abuse has been identified as an environmental risk factor
associated with learning problems, learning disabilities, and developmental
delays in children. In a previous Education survey, almost 60 percent of BIA
teachers considered parental alcohol or drug abuse a serious problem in
their schools, compared with about 13 percent of teachers in public schools
with low Indian student enrollment. 11

BIA officials noted that the agency has developed programs to begin to
moderate the influences of economic and family conditions on students?
academic performance. These include early childhood and family literacy
programs as well as a therapeutic residential model aimed at achieving
positive changes in attitude, behavior, and the academic performance of
students attending boarding schools. In addition, in its Annual Performance
Plan, BIA has established several goals that address student academic
performance. These goals concern student proficiency in language arts and
math, student attendance, teacher proficiency in new assessments and
technology, school accreditation, and number of degrees

11 NCES, Characteristics of American Indian and Alaska Native Education:
Results From the 1990- 91 and 1993- 94 Schools and Staffing Surveys, NCES
97- 451 (Washington D. C.: U. S. Department of Education, March 1997).

Page 16 GAO- 01- 934 BIA and DOD Schools

conferred on Indian students at tribally controlled community colleges and
at BIA?s two post- secondary schools. 12

According to the National Center for Education Statistics (NCES), one of the
major elements that characterizes teacher quality is teacher preparation and
qualifications. This refers to certification, education, and continuing
learning. Results from our survey indicate that nearly all teachers in BIA
schools were certified in school year 1999- 2000. Typically, about 95
percent of teachers in BIA schools were fully certified in the subjects or
grades they taught and another 3 percent had temporary or provisional
certification. About 92 to 93 percent of public school teachers in general
were fully certified in the subjects they taught. 13 Teachers in BIA-
operated schools were slightly more likely to be fully certified than
teachers in tribally operated schools. In addition to certification,
teachers are being encouraged to pursue advanced degrees in order to gain a
more advanced understanding of their discipline. About one- fourth of
teachers in BIA schools had advanced degrees, compared to about 46 percent
of public school teachers generally. 14 The proportion of teachers with
advanced degrees in BIA- operated schools was about 33 percent, while in
tribally operated schools it was about 21 percent.

BIA teachers have access to various kinds of professional development and
BIA schools support professional development in several ways. For example,
93 percent of the BIA schools that responded to our survey reported that the
majority of their teachers received in- service training provided by the
school during the 1999- 2000 school year. Other types of training widely
used included in- service training provided by the agency and workshops
provided by professional associations, as shown in figure 5.

12 BIA receives funds for two post- secondary schools: Haskell Indian
Nations University and the Southwestern Indian Polytechnic Institute. 13
1998 data as reported in The Condition of Education 2000, Table 47- 3, NCES
(Washington, D. C.: U. S. Department of Education, June 2000). 14 1998 data
from Fast Response Survey System as reported in The Condition of Education
2000, Table 47- 1, NCES (Washington, D. C.: U. S. Department of Education,
June 2000). Teacher Staffing at BIA

Schools Is Comparable to That of Public Schools Despite Some Recruiting
Difficulties

Page 17 GAO- 01- 934 BIA and DOD Schools

Figure 5: Percentage of BIA Schools Reporting That a Majority of Teachers
Received Various Types of Training

Source: GAO survey.

BIA schools facilitate their teachers? professional development in a variety
of ways. The following supports were each reported by nine out of ten survey
respondents: permitting time off to participate in training, setting days
aside for training, paying travel or per diem for training, and paying
tuition or fees. Such training and supports for professional development are
comparable to the situation for public school teachers generally, nearly all
of whom report having some professional development in the previous year
with similar kinds of support from their schools. 15

While nearly all teachers at BIA schools were certified, officials at some
schools we visited, particularly tribally operated schools, recounted some
difficulties recruiting and retaining qualified staff. At one tribally
operated school in Washington, the chief school administrator said it was
difficult to attract teachers because the school could not compete with

15 NCES, Schools and Staffing Survey, 1993- 94, a national sample survey
(Washington, D. C.: U. S. Department of Education).

010 20 30 40 50 60 70 80 90100 College Courses in Teaching Methods

or Assessment College Courses in Subject Matter

Professional Association Workshop In- Service Provided by Agency

In- Service Provided by School 93 66 38 11 13 Percentage of Schools Type of
Training

Page 18 GAO- 01- 934 BIA and DOD Schools

compensation packages offered by nearby urban districts. 16 The 2000- 2001
school year was the first year the school was able to pay teachers at the
state salary scale, but the school offered limited retirement benefits. As a
result, the administrator said the school tended to attract beginning
teachers or retired teachers who had pensions from their public school
careers. Other officials noted that the remote locations of some schools
hinder recruiting. Many BIA schools are located in settings with few
amenities to attract teachers and other staff. For example, at one school we
visited in Arizona, the closest town offering major shopping and banking
services was 96 miles away, and the principal said the community?s isolation
and lack of amenities contributed to teacher turnover. In many locations,
basic housing is not even available for staff to purchase or rent, so BIA
has constructed employee quarters for which staff pay rent. About one- third
of all BIA schools and 45 percent of tribally operated schools had teacher
turnover rates of 25 percent or higher in school year 1999- 2000; the
average turnover rate was 18 percent. Nationwide, about 87 percent of full-
time public school teachers remain at the same school from one year to the
next, implying a turnover rate of about 13 percent. 17

A teacher?s ability to effect student learning may be influenced by the
number of students in the classroom, and various studies have associated
smaller class sizes with higher student achievement. Class sizes reported by
BIA administrators are generally smaller than national averages, with
tribally operated schools reporting smaller classes than BIA- operated
schools. Nationally, in 1998 the average class size for general elementary
classrooms was 23 students and in departmentalized settings (those in which
a teacher?s main assignment is in one particular subject area, such as
English or social studies) it was 24 students. 18 The median number of
students per classroom reported by BIA- operated schools was about 20 to 22
in grades K through 8 and about 17 in grades 9 through 12. Tribally operated
schools had about 17 to 18 students per classroom in grades K

16 BIA- operated schools use a uniform salary schedule comparable to the
salary schedule used by the Department of Defense. This was implemented in
part in an effort to recruit and retain quality staff. However, tribally
operated schools determine salaries independently and there are no summary
data available about their teachers? salaries.

17 NCES, Schools and Staffing Survey, 1993- 94 and Teacher Follow- up
Survey, 1994- 95

(Washington, D. C.: U. S. Department of Education). 18 NCES, Teacher
Quality: A Report on the Preparation and Qualifications of Public School
Teachers, NCES 1999- 080 (Washington, D. C.: U. S. Department of Education,
Jan. 1999). Departmentalized settings are most often at the secondary level.

Page 19 GAO- 01- 934 BIA and DOD Schools

through 6 and about 16 students per classroom in grades 7 through 12. Our
survey did not ask specifically about multiple grades in a classroom.
However, some BIA schools are very small and have fewer full- time teachers
than grade levels taught in the school. For example, there are five BIA
schools with 51 or fewer students in grades ranging from K to 6 and K to 12.
Four of these five schools have fewer full- time teachers than the number of
grades in the school, suggesting that multiple grades are being taught in
some classrooms.

BIA schools appear to be in step with schools around the country in making
technology available as an integral tool for learning. Based on our survey
results, BIA students have greater access to computers than public school
students nationwide. BIA administrators reported having about 1
instructional computer for every 3.5 students overall, although access
levels varied somewhat from school to school, ranging from 1 computer for
every student to 1 computer for every 18 students. In comparison, the
national average for public schools is 1 computer for every 5 students, as
reported by NCES for 2000. 19 A major goal set by Education is that schools
have 1 modern multimedia computer for every 5 students. 20 We do not know
about the quality or capacity of the computers in BIA or public schools, but
46 percent of the computers in BIA schools were reported to be 3 years old
or older.

In some respects BIA schools provide their students with greater access to
the Internet than public schools. According to a BIA official, all 171 BIA
schools are connected to the Internet. Nationally, nearly all public schools
now have Internet access. However, BIA school officials reported that 1
computer with Internet access was available for every 4.3 students, a ratio
appreciably better than the 1 to 7 ratio for public schools nationwide. Some
policymakers have stressed the importance of not only connecting every
school to the Internet but eventually connecting every classroom. A little
over 80 percent of BIA instructional rooms have at least one computer with a
connection to the Internet. This number is also slightly above the national
average for public schools. However, as with some public schools, some BIA
schools still use the lowest- speed connections

19 NCES, Internet Access in U. S. Public Schools and Classrooms: 1994- 2000,
NCES 2001071 (Washington, DC: U. S. Department of Education, May 2001). 20
U. S. Department of Education, 1999 Performance Report and 2001 Annual Plan

(Washington, D. C.: 2000). Access to Computers and

the Internet Reported by BIA Schools Is Greater Than Public Schools, but
Technology Support Is More Limited

Page 20 GAO- 01- 934 BIA and DOD Schools

for their primary connection to the Internet, and thus cannot access complex
computer applications and resources. Table 3 summarizes the information on
students? access to technology at BIA schools based on our survey and for
public schools nationally.

Table 3: Technology Statistics for BIA and Public Schools BIA schools a
Public

schools b

Number of students per instructional computer 3.5 5 Number of students per
instructional computer with Internet access 4.3 7 Percentage of schools
connected to the Internet 100 98 Percentage of instructional rooms with
Internet access 81 77 Percentage of schools using dial- up connections to
the Internet c 10 11 a Data for BIA schools come from GAO?s survey, with the
exception of the percentage of schools connected to the Internet, which was
provided by a BIA official. Data represent technology access in BIA schools
at the time of our survey, which was administered in Nov. 2000. b Public
school data are for school year 1999- 2000 and come from NCES? Internet
Access in U. S.

Public Schools and Classrooms: 1994- 2000, NCES 2001- 071 (Washington, D.
C.: U. S. Department of Education, May 2001). c Other types of connections
schools may be using include dedicated line, cable modem, and wireless
connection.

While computers and the Internet are generally available at BIA schools, a
smaller proportion of the schools have paid (versus volunteer) technology
support staff than public schools. In a survey conducted by Education,
nearly all (95 percent) of public schools reported having some paid staff,
either full- or part- time, to support advanced telecommunications (for
example, networked computers and computer hardware and software) in their
school in 1999. In our survey, we asked whether schools had (1) staff who
provided technical support or performed maintenance on computers and (2)
staff who assisted teachers in using computer software or the Internet to
instruct students. The results indicated that more than onequarter of BIA
schools did not have paid technical support and about onethird did not have
paid staff to help teachers use computers for instruction in 2000. Evidence
suggests that technology support of this kind has a positive impact on
teacher use of technology in the classroom. 21 According to an NCES report,
research in general shows that public school teachers

21 A. Ronnkvist, S. Dexter, and R. Anderson, Technology Support: Its Depth,
Breadth, and Impact in America?s Schools, Teaching, Learning and Computing:
1998 National Survey

(Irvine, Calif.: June 2000).

Page 21 GAO- 01- 934 BIA and DOD Schools

view the lack of technology support for integrating telecommunications into
the classroom and the lack of technical assistance in schools to be
obstacles to their effective use of technology. 22 Our survey results show
that these areas of support are not available in many BIA schools. One
reason why technology staff is more limited in BIA schools, according to one
BIA official, is that the high turnover rate for technology coordinators is
a problem throughout the BIA school system. He indicated that these
technology coordinators often receive training for the work and then leave
the schools for higher- paying positions.

BIA school administrators reported that their computers are used regularly
for learning activities. Although there is evidence to suggest that the
effective use of technology in the classroom can improve student learning,
the research on what types of classroom activities are best served by
technology applications is not conclusive. 23 Nonetheless, studies on the
uses of technology in schools tend to distinguish more basic uses of
computers- such as for drill and practice, which the research shows can be
effective for learning- from more pedagogically complex uses of computers-
such as using the Internet in small groups for class projects, where the
research data are less extensive. In our survey, we asked school
administrators to estimate the portion of their teachers who routinely
engaged their students in the use of computers for certain activities. As
shown in figure 6, many of the teachers at BIA schools regularly engage
students in the use of computers for practice drills and for learning
subject matter. Fewer BIA teachers are using them on a regular basis for
student research or to develop student skills in problem solving.

22 NCES, Teachers? Tools for the 21st Century, A Report on Teachers? Use of
Technology,

NCES 2000- 102 (Washington, D. C.: U. S. Department of Education, Sept.
2000). 23 H. Wenglinsky, Does It Compute? The Relationship Between
Educational Technology and Student Achievement in Mathematics (Princeton, N.
J.: Educational Testing Service, Sept. 1998).

Page 22 GAO- 01- 934 BIA and DOD Schools

Figure 6: Percentage of BIA Schools Reporting That a Majority of Teachers
Assign Students Computer or Internet Work at Least Once Per Week for Various
Classroom Activities

Source: GAO survey.

BIA schools appear to be making substantial investments in school
technology. Administrators reported to us that in 1999- 2000 they spent an
average of $401 per student to support educational technology in their
schools. In comparison, according to a national survey, public school
districts planned to spend $113 per student on educational technology in the
2000- 2001 school year. 24 These expenditures covered all aspects of
supporting educational technology, such as purchasing computer hardware and
software, installing and upgrading local and wide area networks, paying for
technical support and training for teachers, and paying for
telecommunications access.

24 Quality Education Data, Inc., Technology Purchasing Forecast 2000- 2001,
6th Edition

(Denver, Colo.: 2000).

010 20 30 40 50 60 70 80 90100 Problem Solving or Data Analysis

Research Learning Subject Matter

Computer Applications Practice Drill Work 40

38 52 32 17 Percentage of Schools Classroom Activities

Page 23 GAO- 01- 934 BIA and DOD Schools

Most of the BIA school administrators responding to our survey reported
significant problems with the condition of their facilities. They noted
problems with specific building features, such as roofs and plumbing, and
with certain environmental conditions, such as indoor air quality. In
addition, they indicated that work spaces for teachers and students, such as
classrooms and libraries, were insufficient. The extent of the concerns they
reported in the survey are reflected in BIA?s backlog of maintenance and
repair needs. Among the backlog of such needs, which was recently verified
by an independent engineering firm, is more than $960 million in needed
repairs for school facilities and dormitories. A contributing factor to the
facility needs of BIA schools is their isolation. Many schools are located
in remote areas where, in addition to maintaining school buildings and
grounds, facilities managers must also maintain other components of the
infrastructure such as water and sewer systems, electric utilities, and fire
stations- systems normally provided by local municipalities for most public
schools. The Congress has recently increased funding used to address the
backlog. However, budget allocations for the maintenance and repair of
facilities have generally been less than amounts recommended by national
guidelines.

Compared to an earlier survey of administrators in public schools,
significantly more BIA school administrators responding to our survey
reported that the overall condition of their buildings and specific building
features was inadequate. As shown in table 4, administrators at 65 percent
of BIA schools reported that one or more of their school buildings was in
less- than- adequate condition and 76 percent of boarding schools reported
the same for their dormitory buildings. 25 In comparison, in a 1999
Education survey on the condition of public school buildings, 26
administrators at about one- quarter of public schools reported that one or
more of their buildings was in less- than- adequate condition. Looking back

25 Our survey asked school administrators to rate the condition of original
buildings, attached or detached permanent additions to original buildings,
and temporary buildings such as portables or trailers.

26 NCES, Condition of America?s Public School Facilities: 1999, NCES 2000-
32 (Washington, D. C.: U. S. Department of Education, June 2000). Extensive
Problems With

BIA School Facilities Reported

BIA School Buildings, Features, and Work Spaces Reported To Be Less Than
Adequate

Page 24 GAO- 01- 934 BIA and DOD Schools

to reported conditions in 1994, the conditions of both BIA and public
schools appear to have generally improved. 27

Administrators also reported that specific features of school buildings and
dormitories, such as the plumbing system or roof, needed substantial repair
or replacement. Overall, more than 70 percent of responding BIA schools
reported that one or more of the features of school buildings was in less-
than- adequate condition and 87 percent of boarding schools reported the
same for dormitory buildings. In contrast, administrators at half of public
schools reported that one or more of the features in their school buildings
was inadequate. As shown in table 4, for many of the features listed, BIA
administrators were at least twice as likely as public school administrators
to report that their school buildings and dormitories had inadequate
building features.

27 GAO conducted a survey of public school and BIA school building
conditions in 1994. Our current survey (2000) asked questions similar to
those used in our 1994 survey and Education?s 1999 survey of public schools.
For results from our previous study, see School Facilities: Condition of
America?s Schools (GAO/ HEHS- 95- 61, Feb. 1995) and School Facilities:
Reported Condition and Costs to Repair Schools Funded by the Bureau of
Indian Affairs (GAO/ HEHS- 98- 47, Dec. 1997). It should be noted that the
results of our 1994 study of BIA schools reflect the reported conditions of
responding schools; survey response rates were too low (41 percent) to
permit generalization to all BIA schools.

Page 25 GAO- 01- 934 BIA and DOD Schools

Table 4: Reported Facility Deficiencies for BIA Schools and Dormitories and
Public Schools Percentage of schools reporting inadequacy Building
deficiencies BIA schools a BIA dormitories a Public schools b Onsite school
buildings

One or more buildings in less- than- adequate condition (original buildings,
additions to original buildings, and temporary buildings) 65 76 24

Features of onsite buildings

One or more inadequate building features 72 87 50 Roofs 48 50 22 Framing,
floors, foundation 41 61 14 Exterior walls, finishes, windows, doors 49 57
24 Interior finishes, trim 39 58 17 Plumbing 47 66 25 Heating, ventilation,
air conditioning 54 76 29 Electric power 43 66 22 Electrical lighting 34 65
17 Safety features such as sprinklers, fire alarms, smoke detectors 37 53 20

a Source: GAO survey. b Source: NCES, Condition of America?s Public School
Facilities: 1999, NCES 2000- 32 (Washington, D. C.: U. S. Department of
Education, June 2000).

Administrators responding to our survey also indicated that some
environmental conditions were a problem in their schools. For example, over
40 percent reported unsatisfactory indoor air quality, acoustics or noise
control, or physical security in their buildings. Administrators at over 70
percent of responding boarding schools reported the same for dormitory
buildings. In comparison, these environmental conditions were a problem for
20 percent or less of public schools in 1999.

During our site visits, school officials indicated various problems with
their school buildings. For example, the principal of a school in Washington
said that in one portable classroom building the roof and windows leaked,
and in two buildings there was a continuous problem with mold in the walls,
which was difficult to control due to the wet climate. She said that the
mold was a health problem for children with certain allergies. In a South
Dakota school, a teacher expressed concerns about aging asbestos floor tiles
in her classroom that had to be partially removed due to cracking, leaving
other tiles exposed. Asbestos floor tiles, which are present in more than 90
of BIA?s schools, can be a threat to the

Page 26 GAO- 01- 934 BIA and DOD Schools

health of students and staff if the asbestos fibers are disturbed, released
into the air, and inhaled. 28

In addition to questions about the condition of buildings and aspects of
their environment, our survey asked administrators about the sufficiency of
work spaces for students and teachers, such as classrooms, libraries, labs,
and eating areas. We also asked whether some of these work spaces were
adequately equipped- for example, whether libraries had sufficient numbers
of books or whether buildings were adequately wired to support technology
needs. As shown in figure 7, many BIA school administrators responding to
our survey reported that various work spaces and equipment were insufficient
at their school. For example, administrators at 55 percent of responding
schools reported that the number of classrooms was insufficient and over 60
percent reported the space in their libraries was a problem. Insufficient
classroom space was noted by officials at some schools we visited. For
example, at a large K- 12 school in South Dakota, officials said that the
number of students in the high school building exceeded capacity. According
to school officials, the building was intended to house 250 students, but
they currently had about 400 students enrolled. In an Arizona school,
because there was no other space, the school held special education classes
in an area previously used for storage and teachers used partitions to
separate the different groups of students.

28 Asbestos is a fibrous mineral that was used widely from the 1950s through
the early 1970s in construction materials, such as shingles for roofing and
siding, pipe and boiler insulation, floor tiles, ceiling panels, coatings,
and gaskets. It is present in most BIA schools in the form of floor tiles
and/ or insulation. A danger occurs when tiny asbestos fibers are released
into the air and can be inhaled or swallowed, increasing the potential for
conditions such as lung cancer.

Page 27 GAO- 01- 934 BIA and DOD Schools

Figure 7: Percentage of BIA Schools Reporting That Various Work Spaces and
Equipment Are Insufficient

Source: GAO survey.

A large proportion of BIA schools (60 percent) also reported that the
capacity of the building?s telephone and electrical wiring systems to
support computers, the Internet, and telephones was inadequate for their
buildings. For BIA schools with insufficient telephone and electrical
wiring, the age of the buildings may be a factor. Almost half of the
buildings are more than 30 years old and almost 15 percent are between 50
and 100 years old. The principal of an Arizona school built in the 1930s
said that most of the electrical wiring in the school is original and as new
technology has been added, they have had frequent problems with system
overloads. He said that this is likely to get worse as more new technology
is added.

010 20 30 40 50 60 70 80 90100 Telephone and Electrical Wiring

Size of Eating Area Number of Science Labs

Number of Computer Labs Number of Library Books

Library Space Size of Classrooms

Number of Classrooms 55 29

62 64 38 31

44 60

Percentage of Schools Work Space and Equipment

Page 28 GAO- 01- 934 BIA and DOD Schools

Administrators? concerns about the condition of their facilities are
reflected in the BIA backlog of deferred maintenance and repairs. 29 This
backlog is a catalog of deficiencies- related to buildings, surrounding
grounds, and other infrastructure- identified by architects, engineers,
facilities managers, and safety officers over the years. The inventory
describes in detail individual work items required in schools to meet
national standards and codes such as the Uniform Building Code and National
Fire Codes. The backlog contains a description of the work that needs to be
done and the estimated cost for each item. The deficiencies may involve
safety and health, access for persons with disabilities, or noncompliance
with building codes. Recently, BIA?s backlog was validated by an independent
engineering firm. 30 According to BIA officials and representatives from the
engineering firm, this process included on- site inspections of each BIA
school building. Based on their inspections, the engineers validated current
projects and their cost estimates, removed items that had already been
addressed, and added new deficiencies they identified.

As of February 2001, BIA?s backlog for educational facilities totaled $962
million 31 -an increase of almost $270 million (in current dollars), or 39
percent, since October 1997. 32 Table 5 shows estimated costs from BIA?s
backlog to address deficiencies related to certain building features at BIA
schools. BIA school administrators often indicated problems with these
features in our survey. For example, the cost to address all deficiencies

29 Maintenance is generally defined as the upkeep of property and equipment
and includes the adjustment, cleaning, or lubrication of equipment;
replacement of parts; painting; and other actions to assure continuing
service and prevent breakdown. Deferred maintenance is maintenance that was
not performed when it should have been or when it was scheduled to be and
which, therefore, is put off or delayed for a future period. Repair is work
to restore damaged or worn- out property to a normal operating condition.
Repairs are curative, while maintenance is preventive.

30 The review of BIA?s backlog was conducted by Applied Management
Engineering, Inc. (AME). In addition to the validation of the backlog, AME
developed a process for BIA to ensure the consistency and quality of
information going into the backlog. AME is also conducting a study on the
adequacy of operations and maintenance funding for BIA schools and an
assessment of their facilities with respect to educational program needs,
according to AME?s general manager.

31 According to a BIA official, in some cases, the backlog may include both
the deficiencies for a certain building and the estimated cost for planning,
design, and/ or construction to replace that same building.

32 See School Facilities: Reported Condition and Costs to Repair Schools
Funded by Bureau of Indian Affairs (GAO/ HEHS- 98- 47, Dec. 31, 1997). BIA
Reports Needing More

Than $960 Million To Address Educational Facilities Deficiencies but Funding
Has Been Increasing

Page 29 GAO- 01- 934 BIA and DOD Schools

related to heating, ventilation, and air conditioning systems in schools
totaled more than $63 million at the time of this review. Administrators at
more than half of the schools responding to our survey indicated problems
with these systems. One school we visited in Arizona did not have a central
cooling system, so each classroom had an air conditioner or evaporative
cooling unit. The principal said the units were quite old and so noisy that
they disrupted the students? learning environment. 33

Table 5: Selected Reported Deficiencies and Estimated Repair Costs for BIA
Schools and Dormitories

Building features often indicated as inadequate a Estimated cost to repair
related

deficiencies b (dollars in millions)

Heating, ventilation, air conditioning $63.2 Plumbing 31.6 Roofs 24.5 a
Source: GAO survey.

b Source: BIA backlog data as of February 2001.

More than $127 million of the backlog total represents deficiencies related
to the health and safety of students, and a significant portion of this ($
44 million) relates to fire safety alone. For example, the backlog lists
buildings at more than 100 schools that need to have their fire alarm
systems replaced or upgraded because they are old, not working, or missing.
At one school we visited, the facilities manager said that the fire alarm
system on the school campus was no longer reliable, and that it was so old
that buying replacement parts was becoming difficult. With respect to
sprinkler systems, the BIA Chief of Safety and Risk Management said that it
is BIA?s goal to have sprinkler systems and smoke detectors in all
dormitories to ensure the safety of the residents. However, at the time of
our review, the backlog showed that more than half of the 54 boarding
schools? dormitories needed sprinkler systems either to be installed or
upgraded. None of the boarding schools we visited had sprinkler systems in
student dormitories. In addition, a dormitory at one school was closed due,
in part, to fire- related safety deficiencies, according to the school
superintendent.

33 Some studies have concluded that school facility conditions, such as
inadequate ventilation, faulty heating systems, and excessive noise, can
affect student learning as well as the health and morale of staff and
students. However, overall, the research is inconclusive and many scholars
say that more research is needed to establish a link between school facility
conditions and student performance.

Page 30 GAO- 01- 934 BIA and DOD Schools

A contributing factor to BIA school facility needs and the backlog is that
BIA schools have to support a more extensive infrastructure than most public
schools. Because many BIA schools are located in isolated areas, they
maintain their own water and sewer systems, electric utilities, fire
stations, and other important services that are generally provided to public
schools by municipalities. Among the 171 BIA schools and 14 peripheral
dormitories, 146 sites (79 percent) had responsibility for maintaining some
kind of water infrastructure such as wells, water distribution lines, and/
or water treatment facilities; 138 (75 percent) had responsibility for sewer
infrastructure, such as sewage lagoons and sewage lines; and 52 schools (30
percent) operated and maintained fire trucks.

BIA officials indicated that providing and maintaining this additional
infrastructure was a considerable drain on resources. For example, at a K- 8
school we visited in Arizona, the facilities manager said that his staff
must maintain a water system that includes five wells with distribution
lines, pumps, pump houses, and water storage tanks; a sewer system that
includes sewer lines, a lagoon, and a lift station; a fire station, fire
truck, and hydrants; and a landfill. The facilities manager said the school
has chronic problems with the sewer system, and an independent engineering
firm has recommended that the sewer mains and service lines be replaced. For
water and sewer systems alone, deficiencies in BIA?s backlog for educational
facilities totaled almost $56 million.

BIA?s infrastructure also includes dormitory facilities for boarding
students and housing for staff and their families. In total, BIA schools
support 157 dormitory buildings for students and 1,879 single- family
quarters and 194 apartment buildings for employees. However, we did not
include employee housing in the scope of our study because the rent paid by
staff is meant to cover the upkeep of these facilities.

Funding from BIA?s construction budget that is used largely to address the
backlog was increased substantially by the Congress last year. This funding
more than doubled from $40 million in fiscal year 2000 to $110 million in
fiscal year 2001. BIA uses this funding to support a wide range of facility-
related activities, including minor projects, such as the replacement of
boiler systems, and major projects, such as the replacement of a natural gas
line or the renovation of a school office building. In addition, the
Congress provided even greater increases for replacement school construction
the last 2 years. Funding rose from $17 million in fiscal year 1999 to $141
million in fiscal year 2001. This funding can reduce the backlog when new
facilities are constructed to replace

Page 31 GAO- 01- 934 BIA and DOD Schools

those that cannot accommodate current education programs or are beyond
repair.

While funding has increased during the last few years for certain
facilityrelated line items in BIA?s budget, we attempted to look more
closely at funding available specifically for maintenance and repair needs.
Adequately funding maintenance and repair is important because deferral of
these tasks can increase the backlog. One guideline set forth by the
National Research Council (NRC) 34 considers maintenance and repair budgets
in terms of the current replacement value of buildings. 35 The NRC has
recommended that budget allocations for routine maintenance and repair be in
the range of 2 to 4 percent of the current replacement value of buildings.
36

Using NRC?s definitions, we extracted and combined pieces of BIA?s budget to
identify funding available for the maintenance and repair of buildings and
other infrastructure and determined that funding levels were below those
recommended by the NRC. From 1997- 2000, funding requested for and allocated
to the maintenance and repair of BIA schools was between 1.5 percent and 1.8
percent- below the lower end of the recommended range of 2 to 4 percent.
Funding increased in fiscal year 2001, resulting in maintenance and repair
budget allocations providing about 2.5 percent of current replacement value
that year. However, based on discussions with recognized experts in
budgeting and facilities operations and maintenance, even with this
increase, budget allocation levels over the past 5 years have been too low.
37 These experts suggested that because of the extensive infrastructure
beyond buildings that BIA must support, the isolation of the schools which
dramatically increases maintenance and repair costs, and the age of BIA
facilities, BIA schools

34 NRC is the principal operating agency of both the National Academy of
Sciences and the National Academy of Engineering in providing advisory
services in science and technology to the federal government and other
entities.

35 Current replacement value is the amount in current dollars it would cost
to duplicate the facility. 36 NRC, Committing to the Cost of Ownership:
Maintenance and Repair of Public Buildings (Washington, D. C.: National
Academy Press, 1990). 37 The experts we spoke with included a member of the
National Academy of Engineering, two engineering consultants, and a retired
director of facilities for a historical society with past experience
developing capital and facilities operations budgets for the Congress. BIA
Funding for Maintenance

and Repair Is Less Than National Guidelines

Page 32 GAO- 01- 934 BIA and DOD Schools

likely require maintenance and repair funding in the range of 4 to 6 percent
of current replacement value.

Estimated per- pupil expenditures for BIA day schools were $9,647 in 1997-
98. 38 In comparison, the national average per- pupil expenditure for public
schools was $6,189 in 1997- 98, the latest year for which national data were
available at the time we did our work. It is important to note that per-
pupil expenditures can range widely. Within the 50 states, per- pupil
expenditures for public schools in 1997- 98 ranged from $4,288 in
Mississippi to $9,643 in New Jersey.

Estimated per- pupil expenditures at BIA schools also varied widely
depending upon the type of school. As shown in table 6, BIA boarding school
expenditure estimates were almost $2,000 more per pupil than BIA day schools
overall; the additional estimated expenditures for the boarding schools were
likely due to their residential components. Among BIA day schools, estimated
expenditures per pupil were higher for tribally operated schools than BIA-
operated schools.

Table 6: Comparison of Per- Pupil Expenditures at BIA and Public Schools,
1997- 98 BIA- funded schools

Estimated per pupil expenditure Public schools Per- pupil

expenditure b

Day schools $9,647 All schools $6,189 BIA- operated 7,677 Rural schools
5,817 Tribally operated 10,423 Large city schools 6,293 Boarding schools a
$11,643 a Includes BIA- operated and tribally operated boarding schools.

b Data are from the National Public Education Financial Survey, Fiscal Year
1998, as cited in NCES?

Statistics in Brief: Revenues and Expenditures for Public Elementary and
Secondary Education: School Year 1997- 98, NCES 2000- 348 (Washington, D.
C.: U. S. Department of Education, May 2000).

One reason for the difference between estimated per- pupil expenditures for
day schools operated by BIA and those by tribes is that tribally operated
schools bear higher administrative costs- each school must

38 Our analysis of expenditures at BIA schools considered expenditures from
federal funding sources alone. According to BIA officials, federal funds
constitute by far the largest part of funding for BIA schools. The national
per- pupil expenditure figures include funding from federal, state, local,
and private sources. Estimated Expenditures

Per Pupil for BIA Schools Are Higher Than Public Schools?, and Vary
Substantially Between Categories of Schools

Page 33 GAO- 01- 934 BIA and DOD Schools

provide its own accounting and other support services that otherwise would
be provided by BIA for a comparable BIA- operated school. To support these
additional operating expenses, BIA provides administrative cost grants to
tribally operated schools, which averaged about $1,400 per student in 1997-
98.

In comparing BIA and public school per- pupil expenditures, it is difficult
to draw meaningful conclusions because the many factors that distinguish BIA
schools from public schools may add to their educational costs. Special-
needs students generally require additional educational resources and, as
mentioned previously, a high proportion of BIA students have special needs.
For example, according to BIA records for the 2000- 2001 school year, about
21 percent of BIA students are enrolled in special education compared with
13 percent of public school students, and 58 percent of BIA students have
limited English proficiency, compared with 8 percent of public school
students. 39 Available data also indicate that a high proportion of BIA
students are poor. 40 The student populations of BIA schools in fact may be
more similar to those of large city or rural public schools, where higher
proportions of students tend to have special needs.

Other characteristics of BIA schools may lead to increased expenditures. The
isolation that results in additional infrastructure needs for BIA schools
also results in higher costs in other areas, such as transportation. For
example, the number of miles transported per student for BIA schools in
school year 1999- 2000 was about 296, while that of public schools was about
165 for school year 1998- 1999. Many of the miles traveled by BIA students
are on unimproved roads or roads in poor condition, which increases wear and
tear on vehicles. BIA also provides long- distance transportation four times
a year for many of the 8,000 students living in boarding schools. Because
BIA schools are generally small and often far

39 Data on the proportion of public school students in special education are
for 1998- 99 and are from Digest of Education Statistics 2000 (Washington,
D. C.: U. S. Department of Education, Jan. 2001). Data on the proportion of
public school students who are considered to have limited English
proficiency are for 1996- 97 and are from the National Clearinghouse for
Bilingual Education Summary Report of the Survey of the States? Limited
English Proficient Students and Available Educational Programs and Services
1996- 97 (Washington, D. C.: George Washington University, Graduate School
of Education and Human Development, Sept. 1998).

40 As noted earlier, available data for 123 of the 171 BIA schools show that
over 80 percent of students were eligible for free or reduced- price lunch
for school year 1999- 2000. According to data from USDA, about 40 percent of
students enrolled in schools nationwide are approved for free or reduced-
price lunch.

Page 34 GAO- 01- 934 BIA and DOD Schools

from each other, it can be difficult for them to achieve economies of scale.
Many, for example, must have their own facility maintenance shops and
garages; in contrast, public school districts generally have such facilities
that serve several schools.

DOD students? academic achievement generally exceeds that of elementary and
secondary students as measured by national standardized tests. DOD school
administrators indicated that nearly all teachers in DOD schools are
certified in the subjects or grades they teach, and the majority of teachers
hold advanced degrees- this proportion is greater than the national average
for public school teachers. Students? access to computers reported by DOD
school administrators is greater than that reported for public schools
nationwide. In addition, the vast majority of DOD schools provide their
teachers with technical and instructional assistance for using computers in
the classroom. Many DOD school administrators reported some problems with
their school facilities and some reported that work spaces for teachers and
students were not adequate. However, overall the conditions of facilities
reported by DOD schools and public schools in 1999 were not substantially
different. The estimated per- pupil expenditure for DOD schools is higher
than the national average, and the estimated per- pupil expenditure is
higher for overseas schools than for domestic schools.

On standardized achievement tests, DOD students on average score at or above
national norms. DOD schools use the TerraNova Multiple Assessments to assess
students in grades 3 through 11. In math and language arts, DOD students?
average national percentile rankings ranged from the 61st percentile to the
72nd percentile (see table 7). Overseas and domestic schools scored in a
comparable range. By definition, the national average is the 50th
percentile. At most grade levels, the rankings for overseas schools were a
few points higher than those for domestic schools. For both boys and girls,
and for various ethnic groups, DOD students were at or above national
averages. On the National Assessment The DOD School

System Academic Performance of DOD Students Exceeds That of Students
Nationally

Page 35 GAO- 01- 934 BIA and DOD Schools

of Educational Progress (NAEP), another standardized test, DOD students
scored at or above national benchmarks. 41

Table 7: National Percentile Rankings for Students in DOD Schools on the
TerraNova Multiple Assessments Standardized Tests for School Year 1999- 2000

National percentile rankings Grade Language arts Math

3 6361 4 6464 5 6463 6 6865 7 6665 8 6862 9 7066 10 72 72 11 68 67

Source: DOD data.

On other measures that are often used as indicators of students? academic
achievement, such as college admissions tests and plans to attend college,
DOD students generally perform as well as or better than public school
students. A high proportion of DOD students take college admissions tests,
scoring at or near national averages. (See table 8.) In addition, DOD school
administrators reported that about three- quarters of DOD graduates plan to
pursue higher education. Nationally, just under two- thirds of high school
graduates are enrolled in college the year after they complete high school.
DOD administrators responding to our survey also estimated that about 60
percent of their graduates planned to enter 4- year colleges and another 15
percent planned to enter 2- year colleges. Nationally, about 40 percent of
high school graduates enroll in 4- year colleges the year after they
graduate and about 24 percent enroll in 2- year colleges.

41 The NAEP is a nationally administered test that assesses students?
proficiency in different subject areas, such as reading, math, and writing,
in different years. We examined DOD data on students? performance on the
NAEP in math (1996), reading (1998), and writing (1998).

Page 36 GAO- 01- 934 BIA and DOD Schools

Table 8: Average SAT and ACT Scores for DOD and Public School Students
Graduating in 2000

SAT scores ACT scores Verbal Math English Math

DOD students 504 500 21.3 20.8 National average 505 514 20.5 20.7

Source: DOD data.

The academic achievement of DOD students may be influenced by socioeconomic
factors and a ?common culture? engendered by military service. Education
research has strongly associated student academic achievement with parental
education, income levels, and family structure. In each of these areas,
military families fare relatively well. For example, nearly all military
enlistees are high school graduates and relatively high proportions of the
parents of DOD students have attended or graduated from college. Moreover,
while a considerable portion of children in DOD schools are eligible for
free or reduced- price lunch programs (32 percent), this is less than the
proportion in public schools (40 percent); in addition, military families
receive benefits, such as tax- free housing allowances or free housing on
base, that are not considered in eligibility determinations for the lunch
programs. Finally, nearly 90 percent of military school- age children reside
in two- parent families compared with 70 percent of children in public
schools, although DOD families are affected by the absence of parents
deployed away from home.

In addition to these socioeconomic factors, DOD schools receive unique
support from the military and its culture. Military commands support the
schools in their jurisdictions and encourage their staffs to do so as well-
for instance, by making parent- teacher conferences a duty or fostering
volunteer work in the schools. Staff at DOD schools are sensitive to the
unique circumstances of military families, such as the deployment of
military parents away from home and frequent family moves to new duty
stations. According to a recent study, military children move through an
average of six school districts between kindergarten and the completion of
high school. Therefore, DOD is developing standardized curricula in its
schools that are intended to help overcome some problems associated with
high student mobility.

Page 37 GAO- 01- 934 BIA and DOD Schools

Administrators responding to our survey indicated that virtually all
teachers in DOD schools are certified in the subjects or grades they teach,
both in domestic and overseas schools. About two- thirds of teachers in DOD
schools have advanced degrees compared to about 46 percent of public school
teachers generally. Again, this proportion was about the same for both
domestic and overseas schools.

DOD teachers have access to various kinds of professional development, and
DOD schools support professional development in several ways. For example,
95 percent of the DOD schools that responded to our survey reported that the
majority of their teachers received in- service training provided by the
school during the 1999- 2000 school year. Other types of training are shown
in figure 8.

Figure 8: Percentage of DOD Schools Reporting That a Majority of Teachers
Received Various Types of Training

Source: GAO survey.

DOD schools facilitate their teachers? professional development in several
ways. Nearly all DOD schools reported allowing time off to participate in
training and setting days aside for training. In addition, nearly nine out
of ten schools reported paying travel or per diem for training; about half
reported paying tuition or fees. These types of training and supports for
DOD Teachers Are

Certified and Most Have Advanced Degrees

010 20 30 40 50 60 70 80 90100 College Courses in Teaching Methods

or Assessment College Courses in Subject Matter

Professional Association Workshop In- Service Provided by District

In- Service Provided by School 95 71 6 7 5 Percentage of Schools Type of
Training

Page 38 GAO- 01- 934 BIA and DOD Schools

professional development are comparable to those for public school teachers
generally, nearly all of whom reported having some professional development
with similar kinds of support from their schools. 42

DOD officials related few problems attracting teachers to domestic schools
but noted that recruiting was somewhat more difficult in certain overseas
locations, particularly in parts of Asia. To ease recruiting, DOD often pays
moving expenses for teachers it hires in the U. S. to work in overseas
schools. DOD provides transportation for the employees and their family
members, and ships their household goods to and from the overseas area.
Applicants recruited in the U. S. for overseas posts also receive housing
allowances to cover rent and utility costs. 43

Class sizes reported by DOD administrators are close to national averages
with no consistent pattern between domestic and overseas schools.
Nationally, in 1998, the average class size was 23 students for general
elementary classrooms and 24 students for teachers in departmentalized
settings. The median number of students per classroom reported by DOD
schools was in the low 20s in grades K through 8 and in the high teens in
grades 9 through 12, as shown in table 9.

Table 9: Median Class Sizes at DOD Schools Median number of students per
class Grades

K to 3 Grades

4 to 6 Grades

7 to 8 Grades

9 to 12

Overseas schools 22 24 20 19 Domestic schools 20 23 23 19

Source: GAO survey.

Beginning in school year 1999- 2000, DOD obtained additional funding to
reduce class sizes in grades 1 through 3 in order to enhance learning
opportunities and improve the quality of instruction. The target is a
pupilteacher ratio of 18 to 1. Reduced class sizes were to be implemented in
18 overseas schools and 25 domestic schools, with all DOD schools phased in
over the next 6 years.

42 NCES, Schools and Staffing Survey, 1993- 94 (Washington, D. C.: U. S.
Department of Education). 43 According to a DOD official, a small number of
staff in DOD overseas schools live in government- provided quarters, but the
majority receive allowances intended to cover the cost of housing in the
areas where they choose to live.

Page 39 GAO- 01- 934 BIA and DOD Schools

Based on the responses of DOD school officials to our survey, DOD students
appear to have greater access to computers, including computers connected to
the Internet, than do public school students nationwide. These
administrators reported having about 1 instructional computer for every 3.7
students. This ratio is slightly better than the national average reported
by NCES for 2000. (See table 10.) We do not know about the quality or
capacity of computers in DOD schools, but a significant portion of these
computers (59 percent) are 3 years old or older.

Administrators at DOD schools reported that students had 1 computer
connected to the Internet available for every 4.8 students. This ratio also
is better than the ratio for public schools nationwide (1 computer for every
7 students). In addition, DOD administrators reported that almost 90 percent
of instructional rooms in their schools have at least one computer with a
connection to the Internet. This figure exceeds the national average in 2000
by more than 10 percentage points.

Table 10: Technology Statistics for DOD and Public Schools DOD schools a
Public

schools b

Number of students per instructional computer 3.7 5 Number of students per
instructional computer with Internet access 4.8 7 Percentage of schools
connected to the Internet 100 98 Percentage of instructional rooms with
Internet access 89 77 Percentage of schools using dial- up connections to
the Internet c 5 11 a Data for DOD schools come from GAO?s survey, with the
exception of the percentage of schools

connected to the Internet, which was provided by a DOD official. Data
represent technology access in DOD schools at the time of our survey, which
was administered in Nov. 2000. b Public school data are for school year
1999- 2000 and come from NCES? Internet Access in U. S. Public Schools and
Classrooms: 1994- 2000, NCES 2001- 071 (Washington, D. C.: U. S. Department
of Education, May 2001). c Other types of connections schools may be using
include dedicated line, cable modem, and wireless

connection.

DOD schools also appear to have greater staff support for technology than
public schools nationwide. Almost all DOD school administrators reported
that in 2000 they had paid (versus volunteer) staff that maintained
technology and provided technical assistance. In addition, 98 percent of DOD
schools have paid staff to support teachers in using technology for
instruction. In a survey conducted by Education in 1999, 95 percent of
public schools reported having some paid staff to support advanced
telecommunications in their school. A school technology administrator at
Technology Access and

Support Reported by DOD Schools is on Average Greater Than Public Schools

Page 40 GAO- 01- 934 BIA and DOD Schools

one Army base told us that each school on the base has a technologist
available to instruct teachers on how to use technology in the classroom,
and that, as a result, teachers were integrating the technology into the
curriculum on a daily basis. At one school in this district, first graders
were learning how to create and deliver PowerPoint presentations.

As previously noted, though research suggests that effective use of
technology in the classroom can improve student learning, research is
inconclusive concerning what types of classroom activities are best served
by technology. In responding to our questions concerning teachers? use of
computers in the classroom, about half of DOD school administrators reported
that the majority of their teachers regularly engage students in the use of
computers to learn subject matter, conduct research, and learn computer
applications. Fewer DOD administrators reported that a majority of their
teachers are routinely using computers to develop student problem- solving
or data- analysis skills or for drill and practice purposes. (See fig. 9.)

Figure 9: Percentage of DOD Schools Reporting That a Majority of Teachers
Assign Students Computer or Internet Work At Least Once Per Week for Various
Classroom Activities

Source: GAO survey. 010 20 30 40 50 60 70 80 90100

Problem Solving or Data Analysis Research

Learning Subject Matter Computer Applications

Practice Drill Work 40 47

54 48 25 Percentage of Schools Classroom Activities

Page 41 GAO- 01- 934 BIA and DOD Schools

DOD schools appear to be making significant investments in educational
technology. According to agency records and estimates, the DOD school system
obligated about $356 per student for educational technology in fiscal year
2000 for domestic and overseas schools. By comparison, according to a
national survey, public school districts planned to spend $113 per student
on educational technology in the 2000- 2001 school year. 44

Many DOD school administrators responding to our survey reported problems
with their school facilities but, for the most part, their responses were
not substantially different from those reported nationally by public school
administrators in 1999. 45 As shown in table 11, 32 percent of the school
administrators reported that they had one or more buildings in less than
adequate condition; in 1999, 24 percent of public school administrators
responding to a national survey reported that they had one or more buildings
in less than adequate condition. Looking at specific building features, such
as roofs and plumbing, administrators at about half of both DOD and public
schools reported having at least one inadequate feature. For many features,
about the same proportion of DOD and public schools reported problems. For
some features, including electric power, electrical lighting, and safety
features, fewer DOD schools reported problems than public schools.

44 Quality Education Data, Inc., Technology Purchasing Forecast 2000- 2001,
6th Edition

(Denver, Colo.: 2000). 45 NCES, Condition of America?s Public School
Facilities: 1999, NCES 2000- 32 (Washington, D. C.: U. S. Department of
Education, June 2000). Administrators Report

Some Problems With DOD School Facilities

Page 42 GAO- 01- 934 BIA and DOD Schools

Table 11: Reported Facilities Deficiencies for DOD and Public Schools
Percentage of schools reporting

inadequacy DOD schools a Public

schools b Building deficiencies Onsite school buildings

One or more buildings in less than adequate condition (original buildings,
additions to original buildings, and temporary buildings)

32 24

Features of onsite buildings

One or more inadequate building features 52 50 Roofs 21 22 Framing, floors,
foundation 15 14 Exterior walls, finishes, windows, doors 20 24 Interior
finishes, trim 14 17 Plumbing 22 25 Heating, ventilation, air conditioning
29 29 Electric power 14 22 Electrical lighting 11 17 Safety features such as
sprinklers, fire alarms, or smoke detectors 14 20 a Source: GAO survey.

b Source: NCES, Condition of America?s Public School Facilities: 1999, NCES
2000- 32 (Washington, D. C.: U. S. Department of Education, June 2000).

When asked about the condition of certain environmental factors in DOD
schools, such as indoor air quality, again about the same proportion of
administrators at DOD schools as public schools reported unsatisfactory
conditions. About 20 percent or less of administrators at DOD and public
schools reported that indoor air quality, acoustics or noise control, or
physical security were inadequate in their buildings.

Some DOD schools reported that various work spaces and equipment for
students and teachers were insufficient at their schools: 29 percent of
schools reported that the number of classrooms was insufficient; about the
same proportion reported inadequate library space (see fig. 10). The
principal of a 40- year- old school we visited that had not been renovated
said that the lack of space for storage was a major problem. In addition, 40
percent of DOD schools reported that the telephone and electrical wiring in
their facilities was inadequate. The problems with inadequate telephone and
electrical wiring may be due to the age of DOD education facilities. About
60 percent of the DOD school buildings are 30 to 70 years of age,

Page 43 GAO- 01- 934 BIA and DOD Schools

and as the level of technology introduced into the schools has increased, so
have the demands on the telephone and electrical systems.

Figure 10: Percentage of DOD Schools Reporting That Various Work Spaces and
Equipment Are Insufficient

Source: GAO survey.

DOD estimates that about $529 million is needed to improve its educational
facilities, as of May 2001. This estimate comes from the 5- Year Facilities
Plan for DOD schools. This plan lists projects for repair and improvement
identified by school engineers and principals. 46

Each year, each DOD school principal and a DOD school district facilities
engineer inspect the school facilities and grounds to validate existing
projects on the plan, identify new projects, coordinate routine maintenance,
identify construction projects, and discuss prioritization. Headquarters-
level facilities officials prioritize the projects for DOD schools
systemwide and determine which projects will be funded based on

46 The 5- Year Facilities Plan for DOD schools also includes the cost to
replace some schools. At the time of this review, the plan included the
costs to replace six schools. DOD Reports Needing More

Than $500 Million to Improve Educational Facilities

010 20 30 40 50 60 70 80 90100 Telephone and Electrical Wiring

Size of Eating Area Number of Science Labs

Number of Computer Labs Number of Library Books

Library Space Size of Classrooms

Number of Classrooms 29 24

28 16

14 18

28 40

Percentage of Schools Work Space and Equipment

Page 44 GAO- 01- 934 BIA and DOD Schools

the availability of funds. Included on this list are repair and maintenance
requirements that cost more than $25,000 for domestic schools and $10,000
for overseas schools. Projects below these levels are funded centrally out
of school or district operations and maintenance budgets, according to the
DOD?s chief of school facilities. DOD school superintendents/ principals and
facilities managers at the schools we visited indicated that they were
generally able to meet the repair and maintenance needs of their facilities
with these funds.

Table 12 shows DOD?s estimated costs to address deficiencies related to
certain building features at DOD schools. DOD school administrators often
indicated problems with these features in our survey. For example, the cost
to address all deficiencies related to heating, ventilation, and air
conditioning systems in schools totaled more than $44 million at the time of
this review. Administrators at almost 30 percent of schools responding to
our survey indicated problems with these systems. During our site visits to
seven DOD schools in Alabama and Georgia, the condition of the heating,
ventilation, and cooling systems was the most common complaint about school
facilities.

Table 12: Selected Reported Deficiencies and Estimated Repair Costs for DOD
Schools

Building features often indicated as inadequate a Estimated cost to repair
related

deficiencies b (dollars in millions)

Heating, ventilation, and air conditioning $44.5 Roofs 29 Playground
surfaces and equipment 21 a Source: GAO Survey.

b Source: 5- Year Facilities Plan for DOD schools, May 2001.

Funding to address projects in the 5- year plan comes primarily from repair
and maintenance and minor construction allocations from the operation and
maintenance budget for DOD schools, according to a DOD official. These
allocations have decreased from about $71 million in fiscal year 1998 to $40
million in fiscal year 2000. According to agency officials, these decreases
were implemented in part to help pay for escalating payroll costs at DOD
domestic schools. In addition to allocations from the operation and
maintenance budget, funding from the construction budget for DOD schools is
used for projects in the 5- year plan. The construction budget has
fluctuated over the last several years. In fiscal year 1999, the
construction budget for DOD schools totaled $44 million; in fiscal year

Page 45 GAO- 01- 934 BIA and DOD Schools

2000, this amount rose to $82 million; and in fiscal year 2001, it decreased
to $36 million.

Estimated per- pupil expenditures for DOD domestic and overseas schools were
above the national average for 1997- 98 (see table 13), and DOD schools?
estimated expenditures per pupil vary depending on their locations. 47
Schools located overseas tend to have substantially higher estimated per-
pupil expenditures ($ 10, 097) than DOD domestic schools ($ 7,725). Much of
this difference, according to DOD data, reflects the added costs of having
teachers and other school- related staff overseas. 48 These costs include
such things as benefits paid to employees in connection with moves to
overseas locations and allowances to compensate for substantially higher
living costs outside the United States.

Table 13: Comparison of Per- Pupil Expenditures at DOD and Public Schools,
1997- 98

DOD schools Estimated

per pupil expenditure Public schools Per- pupil expenditure

Domestic $7,725 All schools $6,189 a Overseas 10,097 a Data are from the
National Public Education Financial Survey, Fiscal Year 1998, as cited in
NCES?

Statistics in Brief: Revenues and Expenditures for Public Elementary and
Secondary Education: School Year 1997- 98, NCES 2000- 348 (Washington, D.
C.: U. S. Department of Education, May 2000).

We provided officials at DOD, Education, and the Department of the Interior
(Interior), which oversees BIA, an opportunity to comment on a draft of this
report. In its written comments, DOD concurred with the content of the
report and had no technical comments. DOD?s letter is printed in appendix
II. Education found the report to be helpful and informative and provided
technical comments which we incorporated into the report when data were
available. Interior provided written comments and agreed with many aspects
of our report. However, the agency pointed

47 DOD does not have readily available expenditure data to determine per-
pupil expenditures. Therefore, we used obligation data as a proxy for
expenditures. 48 Although there are some such costs associated with teachers
and school- related staff in Guam and Puerto Rico, they are much less than
those for overseas schools because there are fewer schools in these
locations than overseas. Estimated Expenditures

Per Pupil for DOD Schools Are Higher Than Public Schools? and Vary
Substantially Between Domestic and Overseas Schools

Agency Comments

Page 46 GAO- 01- 934 BIA and DOD Schools

out that BIA?s students and schools are very different from those in the
public school system and stated that in some cases GAO had made
inappropriate comparisons between BIA schools and the public school system.
Interior stressed this most with respect to measures we used to consider the
academic performance of BIA students and our calculation of expenditures per
pupil. However, we believe that we have provided a framework for our
analysis that shows a sensitivity to these issues and that our analysis is a
fair and balanced representation of the achievement of and expenditures for
BIA students. We discuss Interior?s comments in appendix III following the
agency?s printed letter. Interior also provided technical corrections which
we incorporated where appropriate.

As agreed with your offices, unless you publicly release its contents
earlier, we will make no further distribution of this report until 30 days
after its issue date. At that time, we will send copies of this report to
the Honorable Gale A. Norton, Secretary of the Interior; Neal McCaleb,
Assistant Secretary of Indian Affairs, Department of the Interior; the
Honorable Donald H. Rumsfeld, Secretary of Defense; John M. Molino, Deputy
Assistant Secretary of Defense for Military Community and Family Policy; the
Honorable Roderick R. Paige, Secretary of Education; appropriate
congressional committees; and other interested parties. Please call me at
(202) 512- 7215 if you or your staff have any questions about this report.
Key contacts and staff acknowledgments for this report are listed in
appendix IV.

Marnie S. Shaul Director, Education, Workforce,

and Income Security

Appendix I: Scope and Methodology Page 47 GAO- 01- 934 BIA and DOD Schools

This appendix discusses in more detail the scope and methodology for
examining the following aspects of Bureau of Indian Affairs (BIA) and
Department of Defense (DOD) school systems: (1) student achievement, (2)
teacher staffing, (3) access to educational technology, (4) condition of
school facilities, and (5) expenditure levels.

The scope of our review included BIA day schools and boarding schools, and
DOD schools located both in the United States and overseas. To the extent we
could, we excluded from our analyses BIA peripheral dormitories, which house
Indian students on reservations who attend nearby public schools and
generally do not have academic programs. Our focus was the 1999- 2000 school
year, and most of the data we collected relate to that year.

A major source of information for this review was a mail survey of
administrators at all BIA and DOD schools. We pretested a draft
questionnaire at eight schools and revised it based on their comments. In
November 2000, we mailed the final questionnaire to all 171 BIA schools and
224 DOD schools. We did follow- up mailings in January and March 2001 and
accepted returns through early May 2001, yielding response rates of 81
percent for BIA schools and 92 percent for DOD schools. We did not
independently verify the accuracy of the information provided in the
questionnaire responses. In addition to information collected through the
survey, we obtained budget, facilities, and other data from BIA and DOD, and
testing data from state departments of education and college testing
organizations. We obtained and reviewed supporting documentation for some
budget and expenditure data but otherwise did not verify this information.

In the course of this review, we interviewed various staff at BIA?s Office
of Indian Education Programs and DOD?s Department of Defense Education
Activity who are responsible for education programs, budgets, technology,
and facilities. As shown below, we also conducted site visits to nine BIA
schools located in South Dakota, Arizona, Minnesota, and Washington and
seven DOD schools located in the United States at three military
installations- Maxwell Air Force Base in Alabama and Fort Benning and Robins
Air Force Base in Georgia. At these schools, we toured the school facilities
and met with a variety of officials, including principals, superintendents,
education specialists, and facilities management staff. The BIA schools we
visited were

 Greasewood Springs Community School, Ariz.,

 Hopi Day School, Ariz., Appendix I: Scope and Methodology

Appendix I: Scope and Methodology Page 48 GAO- 01- 934 BIA and DOD Schools

 Muckleshoot Tribal School, Wash.,

 Chief Leschi School, Wash.,

 Flandreau Indian Boarding School, S. Dak.,

 Pine Ridge School, S. Dak.,

 Loneman Day School, S. Dak.,

 Fond du Lac Ojibwe School, Minn., and

 Nay- Ah- Shing School, Minn. The DOD schools we visited were

 Maxwell AFB Elementary School, Maxwell AFB, Ala.,

 Dexter Elementary School, Fort Benning, Ga.,

 Faith Middle School, Fort Benning, Ga.,

 Loyd Elementary School, Fort Benning, Ga.,

 White Elementary School, Fort Benning, Ga.,

 Linwood Elementary School, Robins AFB, Ga., and

 Robins Elementary School, Robins AFB, Ga. We obtained data on public
schools from readily available sources, typically from Department of
Education (Education) studies.

We conducted our work between June 2000 and July 2001 in accordance with
generally accepted government auditing standards.

To provide an indication of BIA and DOD students? academic achievement, we
reviewed their performance on standardized tests and state assessments. We
also obtained data on their performance on college entrance examinations,
namely the Scholastic Assessment Test (SAT) and the American College Test
(ACT). In addition, our survey asked administrators to report on the post-
high- school plans of graduating seniors.

For BIA schools, we attempted to collect data on BIA students? performance
on state assessments from four states that account for more than 70 percent
of all BIA schools- Arizona, New Mexico, North Dakota, and South Dakota. We
were able to obtain data for all BIA schools in North Dakota and South
Dakota and for 19 of 50 BIA schools in Arizona that participated in
Arizona?s state assessment program. No data were available for BIA schools
in New Mexico, which has about one- quarter of all BIA students. In total,
about 36 percent of BIA students attend the Student Achievement

Appendix I: Scope and Methodology Page 49 GAO- 01- 934 BIA and DOD Schools

schools to which our data relate. All data obtained were for school year
1999- 2000.

From the North Dakota Department of Public Instruction, we obtained data on
students? performance on the statewide assessment. North Dakota uses the
TerraNova Basic Multiple Assessments to assess students in grade 4 and the
TerraNova Complete Battery Plus to assess students in grades 6, 8, and 10.
The state provided data on statewide averages for students? performance on
the test, a breakdown of these scores by student ethnicity, and the scores
for all BIA schools. We focused on students? total scores on the test and
reported the range of scores across all grades. In South Dakota, schools use
the Stanford Achievement Test to assess students in grades 2, 4, 8, and 11.
From South Dakota?s Department of Education, we obtained the average scores
for students statewide, and the scores for all BIA schools on the complete
battery and for specific skill areas such as language arts, reading, and
math. 1 We reported specifically on the range of scores on the complete
battery across all grades. Arizona uses an assessment test customized for
its standards, called the Arizona Instrument to Measure Standards (AIMS), in
grades 3, 5, 8, 10, and 11. AIMS classifies students into four categories in
relation to the standards: Falls Far Below, Approaches, Meets, or Exceeds.
The Arizona Department of Education provided us with statewide averages for
students? performance on the AIMS, including a breakdown of statewide scores
by ethnicity, and the scores for participating BIA schools. We reported the
range for the proportion of children who met or exceeded the state
standards, across all grades and across all subjects (reading, writing, and
math).

We requested data on the performance of BIA students on the SAT and ACT from
the respective college testing organizations. With BIA?s approval, the
testing organizations provided us data on the scores for BIA students who
graduated in 1999 or 2000. It should be noted that a small number of BIA
graduates (fewer than 70) take the SAT. Far more BIA students (about 800)
take the ACT because BIA schools are located in areas of the country where
the ACT is the predominant college admissions test.

BIA also provided the annual reports for virtually all BIA- funded schools,
which include data on the proficiency of students as assessed by schools.

1 The complete battery score is a composite score that includes all subject
areas tested.

Appendix I: Scope and Methodology Page 50 GAO- 01- 934 BIA and DOD Schools

These assessments are based on multiple measures, which in addition to
students? performance on standardized tests can include measures such as
portfolios illustrating students? work, grades, teacher observations, and
work samples.

DOD students in both overseas and domestic schools are assessed using the
TerraNova Multiple Assessments in grades 3 through 11. We obtained data from
DOD on students? performance for school year 1999- 2000 and focused on
students? scores in language arts and math. We reported the range of scores
for students in all grades, across both language arts and math, and across
students in both overseas and domestic schools. We also obtained data from
DOD on students? performance on the National Assessment of Educational
Progress (NAEP). The NAEP is a nationally administered test offered in
different subject areas, such as reading, math, science, and writing, in
different years. We examined DOD data on students? performance on the NAEP
in math (1996), reading (1998), and writing (1998). We reviewed overall
averages for DOD students in both overseas and domestic schools and compared
these scores with national averages. Finally, we obtained SAT and ACT
results from DOD for students graduating during the 1999- 2000 school year.

Nearly all information about BIA and DOD teacher qualifications and training
was obtained through GAO?s survey. Some information on teacher turnover
rates and staff tenure was obtained from agency records. To determine class
sizes, we asked administrators on the survey to report the average number of
students in a classroom for grades K- 3, 4- 6, 7- 8, and 9- 12.

Nearly all information on BIA and DOD students? access to technology in
schools, technology staffing levels, and how technology is used in the
classroom was obtained through the survey. We calculated student- tocomputer
ratios systemwide for BIA and DOD schools by dividing the total number of
computers reported by responding schools by the total number of students at
the schools. For individual schools in the BIA and DOD systems, student- to-
computer ratios varied somewhat from the ratio for the systems overall. With
respect to technology spending, DODEA provided us with estimates of how much
the agency spent to support Teacher Staffing and

Educational Technology

Appendix I: Scope and Methodology Page 51 GAO- 01- 934 BIA and DOD Schools

educational technology programs in its schools for the 1999- 2000 school
year. BIA schools provided this information to us through the survey.

We gathered information on the condition of BIA and DOD school buildings
primarily through the survey. We asked school administrators to report on
the physical condition of buildings and on specific building features, such
as roofs and plumbing. We also asked about whether certain environmental
conditions were satisfactory, such as indoor air quality and acoustics or
noise control, and whether working facilities for teachers and students,
such as classrooms, libraries, and computer labs, were sufficient. Many of
the questionnaire items were based on those used in two previous surveys: a
1999 Education survey on the condition of school buildings, which was
conducted on a nationally representative sample of public schools; 2 and a
1994 GAO survey on the condition of school buildings, conducted on a
nationally representative sample of public schools and all BIA schools. 3 We
asked administrators to report separately on the condition of school
buildings and on the condition of dormitory buildings.

As a further indication of the condition of schools, we reviewed BIA and DOD
agency data on needed maintenance and repairs at school facilities. In
reviewing BIA?s backlog of deferred maintenance and repairs, we first
excluded data for buildings not related to schools, such as administrative
buildings, employee quarters, and buildings supporting law enforcement
services. We then looked at estimated costs to address certain types of
deficiencies according to categories used by BIA- for example, those related
to student and staff safety; environmental needs, such as asbestos and radon
testing; and energy- related needs. Finally, we asked BIA officials to
conduct searches on the backlog database for deficiencies related to certain
items asked about on our survey- for example, roofs; plumbing; fire safety;
handicapped access requirements; sewer and water infrastructure; asbestos;
heating, ventilation, and air conditioning; and playground surfaces and
equipment- and then totaled the estimated costs

2 National Center for Education Statistics (NCES), Condition of America?s
Public School Facilities: 1999, NCES 2000- 32 (Washington, D. C.: U. S.
Department of Education, June 2000).

3 School Facilities: Condition of America?s Schools (GAO/ HEHS- 95- 61, Feb.
1995). Facilities

Condition Backlogs of Maintenance and Repair Needs

Appendix I: Scope and Methodology Page 52 GAO- 01- 934 BIA and DOD Schools

for these deficiencies. We also obtained the 5- Year Facilities Plan for DOD
schools, which includes a total for the estimated amount needed to address
all identified items. It should be noted that the 5- year plan does not
include repair projects costing under $25,000 for domestic schools and
$10,000 for overseas schools. We reviewed the 5- year plan data for specific
building deficiencies that were noted more often as problems by DOD schools
in our survey: roofs; heating, ventilation, and air conditioning; and
playground surfaces and equipment.

To assess maintenance and repair funding levels for BIA schools, we measured
funding against guidelines set by the National Research Council (NRC). The
NRC has recommended that budget allocations for maintenance and repair be
between 2 and 4 percent of current replacement value. 4 We first determined
the current replacement value of BIA schools by multiplying the square
footage of the schools by the cost to construct a new school per square
foot. We obtained BIA?s total education facility square footage for
maintained buildings for 1997- 2001. (These data included 14 peripheral
dormitories and two colleges, which account for about 11 percent of BIA?s
total education facility square footage.) We then obtained data on the
average cost per square foot of a new school for each year from 1997 through
2000, from annual education construction reports published by American
School and Universities. 5 (The average cost per square foot of a new school
was not yet available for 2001, so we used the average amount per square
foot reported for 2000 for this year.) Then, for each year from 1997 to
2001, we multiplied BIA?s educational facility square footage by the average
cost per square foot to construct a school that year.

To identify BIA budget allocation categories that met the NRC?s definition
of maintenance and repair, we reviewed BIA documents describing the
categories and discussed these with experts. Once we identified the
appropriate categories, we obtained the amounts BIA requested and allocated
for these categories for fiscal years 1997- 2001. Then for each year, we
determined the percentage that the requested and allocated

4 NRC, Committing to the Cost of Ownership: Maintenance and Repair of Public
Buildings (1990). 5 J. Agron, 24th, 25th, 26th and 27th Annual Official
Education Construction Reports,

(Overland Park, Kan.: American School and University, May 1998, May 1999,
May 2000, and May 2001). BIA?s Allocations for

Maintenance and Repairs of Schools as a Percentage of Replacement Value

Appendix I: Scope and Methodology Page 53 GAO- 01- 934 BIA and DOD Schools

amounts represented of the current replacement value and compared these with
NRC guidelines.

To calculate estimated per pupil expenditures for DOD and BIA schools that
would be comparable to public school figures, we followed guidelines for
identifying expenditures set forth by the National Center for Education
Statistics (NCES) in its National Public Financial Education Survey. 6 The
results of this survey are used to develop the national per- pupil figure.
National per- pupil expenditure figures reflect current expenditures from
federal, state, local and private sources, at the district level for
prekindergarten through grade 12. Current expenditures include salaries,
benefits, purchased services, and supplies for the following functions:
instruction; support services; noninstructional services, such as food
services; and direct program support, such as state contributions to
employee retirement funds. Long- term expenditures such as capital outlay,
debt service, facilities acquisition and construction services, and property
expenditures (for example, for equipment and vehicles) are excluded from
current expenditures by NCES and, in most cases, by our evaluation. At the
time we did our work, the latest school year for which national public
school per- pupil expenditures were available was 1997- 98.

Data needed to precisely compute per- pupil expenditures for both BIA and
DOD schools were not available. Therefore, our calculations are estimates
based on BIA and DOD agency data and federal expenditure information from
tribal audit reports submitted under the Single Audit Act. Because BIA and
DOD data were generally not available by categories specified by NCES, we
used agency or tribal expenditure or obligation data for programs or budget
line items which included these categories. Using this approach we were able
to include expenditures for salaries, benefits, purchased services, and
supplies for the categories included in the national per- pupil expenditure:
instruction, support services, and noninstructional services. Direct program
support generally did not apply. Similarly, we were generally able to
exclude expenditures for capital outlay, debt service, and facilities
acquisition and construction services by excluding budget line items that
contain these expenditures. In some

6 NCES, The National Public Education Financial Survey Instruction Booklet,
January 1999 (Washington, D. C.: U. S. Department of Education). Because
1997- 98 was the latest year for which national public school per- pupil
expenditures were available at the time we did our work, we used the
guidelines dated January 1999, since these guidelines applied to the 12-
month period beginning July 1, 1997, and ending June 30, 1998. Estimated Per
Pupil

Expenditures

Appendix I: Scope and Methodology Page 54 GAO- 01- 934 BIA and DOD Schools

cases, we were not able to extract specific expenditures or obligations
relating to property expenditures within selected programs; however, these
amounts were likely to be relatively small.

For BIA schools, we developed estimated per- pupil calculations for (1) BIA-
operated day schools, (2) tribally operated day schools, (3) day schools
overall, and (4) boarding schools. For BIA- operated schools, we obtained
expenditure information from the Department of the Interior?s (Interior)
financial system based on codes indicating programs that support
kindergarten through grade 12. We were not able to identify expenditures for
administrative services provided by Interior for BIAoperated schools, such
as payroll and procurement. We used fiscal year 1998 data. A fiscal year
reasonably approximates the period July 1, 1997, and ending June 30, 1998,
used by NCES. For tribally operated schools, we relied primarily on federal
expenditure information from audit reports submitted under the Single Audit
Act. These reports were generally for the period July 1, 1997, through June
30, 1998. We were able to obtain expenditure information for 54 of the 98
schools that were tribally operated that year. We could not obtain
expenditure information for the remaining 44 schools because, in some cases,
the school expenditure information in the audit report was included with
other expenditure information for tribal or other organizations and could
not be readily extracted, or because related audit reports were not
available.

For both BIA- operated and tribally operated schools, we considered
expenditures from federal funding sources only, which, according to BIA
officials, represent by far the greatest source of funding for BIA schools.
This included expenditure data for Education programs, such as Title I; and
the Department of Agriculture?s (USDA) child nutrition programs, such as the
National School Lunch and Breakfast programs. The per- pupil expenditure
figures for public schools nationally consider funding from all sources.
Most funding for public schools comes from state, intermediate, and local
sources.

In order to determine overall estimated per- pupil expenditures for day and
boarding schools, we weighted the calculated estimated per- pupil
expenditures for BIA- operated and tribally operated schools of both types,
according to the number of students attending each type of school. We used
student enrollment figures from BIA internal reports for each school type.

In order to calculate DOD overseas and domestic estimated per- pupil
expenditures, we used obligations from DOD internal financial reports for

Appendix I: Scope and Methodology Page 55 GAO- 01- 934 BIA and DOD Schools

fiscal year 1998 as a proxy for expenditures, since DOD does not maintain
expenditure information in the detail necessary for this type of analysis.
We also used fiscal year 1998 data since, similar to other federal agencies,
DOD tracks obligations by fiscal year and not for other periods. For student
enrollment figures, we relied on data from DOD internal reports for domestic
and overseas schools. We also obtained information for the value of USDA?s
child nutrition programs, such as the National School Lunch and Breakfast
programs, for fiscal year 1998, which we included in the estimated
expenditure per pupil calculation.

Appendix II: Comments from the Department of Defense

Page 56 GAO- 01- 934 BIA and DOD Schools

Appendix II: Comments from the Department of Defense

Appendix III: Comments from the Department of the Interior

Page 57 GAO- 01- 934 BIA and DOD Schools

Appendix III: Comments from the Department of the Interior

Appendix III: Comments from the Department of the Interior

Page 58 GAO- 01- 934 BIA and DOD Schools

See comment 3. See comment 2.

See comment 1.

Appendix III: Comments from the Department of the Interior

Page 59 GAO- 01- 934 BIA and DOD Schools

See comment 6. See comment 5.

Now on p. 12. See comment 4.

Now on p. 10.

Appendix III: Comments from the Department of the Interior

Page 60 GAO- 01- 934 BIA and DOD Schools

See comments 8 & 9. Now on p. 14. See comment 7.

Appendix III: Comments from the Department of the Interior

Page 61 GAO- 01- 934 BIA and DOD Schools

Now on p. 19 See comment 10.

Now on pp. 17- 18.

Appendix III: Comments from the Department of the Interior

Page 62 GAO- 01- 934 BIA and DOD Schools

See comment 12. See comment 11.

Appendix III: Comments from the Department of the Interior

Page 63 GAO- 01- 934 BIA and DOD Schools

Now on p. 28. Now on p. 31. See comment 13.

Appendix III: Comments from the Department of the Interior

Page 64 GAO- 01- 934 BIA and DOD Schools

Now on p. 32. See comment 16.

See comment 15. See comment 14.

Appendix III: Comments from the Department of the Interior

Page 65 GAO- 01- 934 BIA and DOD Schools

See comment 17. See comment 18. See comment 17.

Appendix III: Comments from the Department of the Interior

Page 66 GAO- 01- 934 BIA and DOD Schools

See comment 19. Now on p. 33.

Appendix III: Comments from the Department of the Interior

Page 67 GAO- 01- 934 BIA and DOD Schools

Appendix III: Comments from the Department of the Interior

Page 68 GAO- 01- 934 BIA and DOD Schools

1. We stated that BIA?s funding for school operations and facilities needs
increased 30 percent from fiscal years 2000 to 2001. Interior suggested that
GAO differentiate the actual amount of the increase between the Operation of
Indian Programs and Construction appropriation accounts, initially stating
that each account had increased by 25 percent. Based on our calculations, we
added information to the report specifying that funding for Operation of
Indian Programs increased by about 5 percent and funding for Construction
increased 121 percent between fiscal years 2000 and 2001. This supports our
statement that nearly all the increase was for the repair and replacement of
school facilities while funding for school operations received only a modest
increase.

2. Interior commented that our report should acknowledge that the Department
of Education (Education) funding that BIA schools receive is available to
all public schools across the country. Interior specifically noted that
public schools that educate Indian children on or near Indian reservations
receive Impact Aid Funds from Education. We added text to the report
indicating that like BIA schools, many public schools also receive funding
from Education.

3. Interior noted that in an agreement with Education, BIA serves as a state
education agency and is authorized to receive flow through funds from
Education. We have added this information in the report.

4. Interior suggested that we provide some examples to further highlight
differences between BIA and DOD schools. Interior stated that the DOD school
system has no schools with small enrollments or combinations of grades like
those in the BIA school system. The DOD school system does have several
schools with enrollments under 100 students and schools that span both
elementary and secondary grades, but we agree that these types of schools
are less prevalent in DOD?s school system. Interior also said that it would
have been helpful for GAO to provide an example of how BIA schools are less
able to take advantage of economies of scale and that this would help
explain the school system?s per- pupil expenditure. In our report section on
per pupil expenditures, we describe a situation that illustrates how
difficult it can be for BIA schools to achieve economies of scale. Finally,
Interior stated that the report could comment on how the physical conditions
found in BIA schools could affect student outcomes. Thus, we added a note to
the report stating that though some studies conclude that school facility
conditions- such as GAO Comments

Appendix III: Comments from the Department of the Interior

Page 69 GAO- 01- 934 BIA and DOD Schools

inadequate ventilation or faulty heating systems- can affect student
learning, the research is inconclusive overall.

5. Regarding the performance of BIA students on state assessments, Interior
argued that state standardized tests may be culturally biased and may be a
less reliable measure for Indian students than other minorities. In the
report we acknowledged that standardized tests have been criticized as being
culturally biased, and we therefore provided information on authentic
assessments of BIA students. However, we are not aware of any research that
shows standardized tests are less reliable for Indian students than other
minority students.

6. Interior said GAO should have compared BIA student achievement with
public schools serving large numbers of Indian students in rural areas. We
agree that these would be worthwhile analyses. However, the additional audit
work and data required to perform these analyses did not allow us to include
them in this report.

7. Interior noted BIA?s efforts to address differences in student
achievement through programs designed to moderate the effects of poor
economic and family conditions on student achievement. The agency also noted
that BIA had established long term goals that address student performance.
We have added information to the report to acknowledge BIA?s efforts in
these areas.

8. Interior questioned our comparison of BIA students? plans to attend
college and performance on college entrance examinations with those of
students nationally. The agency argued that the economies of rural areas,
where most BIA schools are located, do not offer jobs that require post-
secondary education, and for this and other reasons, less cultural emphasis
is placed on BIA students to perform well on tests like the SAT and to
attend college. The agency stated that BIA students generally expect to go
to tribal colleges that do not require college entrance examinations, such
as the SAT. We believe that these measures are appropriate given that one of
the Office of Indian Education Program?s goals is to increase post-
secondary enrollment rates. Also, a significant number of BIA students take
the SAT and ACT, perhaps to enter colleges that require these examinations.

9. Interior also said that we should have compared BIA students? plans to
attend college and their performance on college entrance examinations with
students from other rural regions of the U. S. or students in public schools
on Indian reservations. Some data are

Appendix III: Comments from the Department of the Interior

Page 70 GAO- 01- 934 BIA and DOD Schools

available for students living in rural areas but these are not specifically
focused on Indian students. For example, data from 1993- 94 show that on
average 54 percent of 12th graders living in small towns or rural areas
applied to college, compared with BIA school administrators? estimates that
28 percent of graduating seniors planned to enroll in college. With regard
to the SAT, for students graduating in 2000, rural students received an
average total score of 992 on the verbal and math sections of the SAT,
compared with 1,019 for students nationally, and 765 for BIA students.

10. Interior stated that teacher turnover correlates with reduced student
achievement, but did not provide support for this statement. We were not
able to identify any studies establishing a link between teacher turnover
and student achievement.

11. Interior noted that in fiscal year 2000, BIA conducted a census of
personal computers in BIA schools and concluded that the school system had a
ratio of 1 computer for every 3.3 students. BIA added, however, that 30
percent of these computers are for administrative usage and that almost half
are reaching or have surpassed their life cycle usefulness. Our survey asked
school administrators about computers used specifically for instructional
purposes. Using these data, we determined that the school system had a ratio
of 1 computer for instructional purposes for every 3.5 students.

12. Interior said that we had failed to address the fact that state
legislatures have appropriated funds for school technology and that these
funds are not included in district funding appropriations and therefore are
not included in calculations of expenditures per pupil by NCES. We contacted
NCES and were told that state funding for educational technology should be
included in the data that states report to NCES for expenditure per pupil
calculations. Thus, based on this information, we did not modify our report.
Interior also noted that the Office of Indian Education Programs had to rely
on private partnerships and grants to provide enough resources to place
technical capabilities in all its schools. (It should be noted that these
additional resources were not identified during our review and therefore
were not included in our expenditure per pupil calculation for BIA schools.)
In addition, Interior stated that our report was unclear about the resources
DOD uses to support technology in its schools. In our report we provided an
estimate for the amount of money the DOD school systems obligated per
student for educational technology in fiscal year 2000, which was less than
the amount BIA schools spent per student

Appendix III: Comments from the Department of the Interior

Page 71 GAO- 01- 934 BIA and DOD Schools

based on our survey results. This funding comes from DOD appropriations.

13. With respect to housing for teachers and staff, Interior said that we
had assumed that rents collected from teachers living in employee housing
covered the cost of maintaining this housing and had not realized that
schools end up covering these costs out of their facilities maintenance
funds. Interior argued that school maintenance funding diverted for teacher
housing should not have been included in our calculation of expenditures per
pupil. Interior also stated that staff in DOD schools live in government
provided quarters expense free. Early in our review, BIA officials informed
us that rents paid by teachers and staff did not cover the full cost of
maintaining employee housing. However, when requested, BIA was unable to
identify expenditures made by schools for such purposes. More importantly,
Interior noted in its comments that providing housing is necessary for
maintaining a qualified teaching staff. Because of this, we believe that
expenditures to maintain employee housing are part of the cost of providing
instruction for these schools. An NCES official agreed and stated that
expenditures from school facilities maintenance funds used to maintain
employee housing should be included in the calculation of expenditures per
pupil. For the same reason, we included DOD schools? expenditures for
housing allowances provided to overseas staff in our calculation of
expenditures per pupil. We have also added a footnote stating that a small
number of staff in DOD schools overseas live in government- provided
quarters; most receive housing allowances intended to cover the cost of
housing in the areas where they choose to live.

14. Interior commented that our report failed to address the adequacy of
funding for facilities operations. We were not able to identify a widely
used benchmark to assess the sufficiency of BIA?s facilities operations
funding. We were only able to compare BIA?s obligations for both facilities
operations and maintenance with similar expenditures for public schools. We
found that BIA?s obligations per square foot of building space were higher
than the national median for public schools. However, it was difficult to
draw conclusions from these calculations as they do not consider the
additional infrastructure BIA schools operate and maintain. Also, this
analysis does not examine the adequacy of BIA?s funding for operations and
maintenance, it merely compares the amounts used by BIA and public schools
for these purposes. Further, we were aware at the time we conducted our work
that BIA had contracted with a private engineering firm to assess the

Appendix III: Comments from the Department of the Interior

Page 72 GAO- 01- 934 BIA and DOD Schools

adequacy of BIA?s facilities operations and maintenance funding. This work
may provide a clearer picture of BIA?s needs. This report is expected to be
completed in Fall 2001.

15. Interior commented that the cost of operating facilities could be
reduced if school replacement construction funding covered the cost of
demolishing and removing old structures. Currently, BIA provides for the
security of these idle structures out of operations funding until a decision
is made on their disposal. This issue may be worthy of attention, but BIA?s
own budget formula for determining operations and maintenance needs suggests
that this is not a major expense.

16. Interior noted that BIA, DOD, and public schools define and account for
maintenance funds and expenditures differently, and these differences make
?a straight across the board comparison? difficult. We determined that it
would be challenging to complete such an analysis within the timeframe of
this review. Thus, we did not attempt to compare maintenance budgets or
expenditures among these school systems. Rather, we analyzed BIA?s and DOD?s
maintenance and repair backlogs and provided information on the amount of
funding allocated to address them and school construction.

17. Interior commented that our estimates of expenditures per pupil were not
adjusted to reflect differences between students in day schools and in
residential schools. We did calculate separate per- pupil expenditures for
day schools and residential schools and did not combine them. Interior also
stated that we did not adjust our per- pupil expenditure estimates for
students with special education needs or for the costs of small schools in
sparsely populated areas. The agency recommended that we use an alternative
approach for calculating expenditures per pupil that takes into account
differences in student and school needs. Interior pointed to funding
allocation systems used by some states where students are weighted
differently based on the additional education resources they may require.
For example, a student requiring special education services may be counted
as 1.5 students in determining state aid. Interior argued that we should
have used a weighted count of its students to calculate expenditures per
pupil, since a high proportion have special needs. Such a calculation may be
useful, but comparisons with public schools would not be possible since NCES
does not calculate the national expenditure per pupil using a weighted
student count.

Appendix III: Comments from the Department of the Interior

Page 73 GAO- 01- 934 BIA and DOD Schools

18. Interior stated that we should have compared BIA expenditures per pupil
with that of school districts with similar student populations. Interior
suggested several school districts with similar student populations in South
Dakota and New Mexico that could be used for comparison with BIA?s per-
pupil expenditure. We obtained the perpupil expenditures for these districts
from NCES and found they ranged from $4,979 to $8, 706 in 1997- 98, all
below BIA?s estimated expenditure per pupil of $9,647.

19. Interior recommended that we should not have included administrative
cost grants for tribally operated schools in our expenditure per pupil
calculation. The agency argued that these grants are for the purpose of
administering the schools and carrying out support functions that are not
part of the basic academic instruction, such as fiscal and personnel
activities. According to an NCES official, these expenditures should be
included as they fall into the category of general administration
expenditures, which is included in the national per pupil expenditure
calculation.

Appendix IV: GAO Contacts and Staff Acknowledgments

Page 74 GAO- 01- 934 BIA and DOD Schools

Karen A. Whiten, (202) 512- 7291 Linda Y. A. McIver, (206) 287- 4821

In addition to the individuals named above, Mary E. Abdella, Beverly G.
Burke, Julianne Hartman Cutts, Eric M. Eliasen, Kopp F. Michelotti, Nancy R.
Purvine, Joel I. Grossman, Elsie M. Picyk, Stanley G. Stenersen, and James
P. Wright made key contributions to this report. Appendix IV: GAO Contacts
and Staff

Acknowledgments GAO Contacts Staff Acknowledgments

(102002)

The first copy of each GAO report is free. Additional copies of reports are
$2 each. A check or money order should be made out to the Superintendent of
Documents. VISA and MasterCard credit cards are also accepted.

Orders for 100 or more copies to be mailed to a single address are
discounted 25 percent.

Orders by mail:

U. S. General Accounting Office P. O. Box 37050 Washington, DC 20013

Orders by visiting:

Room 1100 700 4 th St., NW (corner of 4 th and G Sts. NW) Washington, DC
20013

Orders by phone:

(202) 512- 6000 fax: (202) 512- 6061 TDD (202) 512- 2537

Each day, GAO issues a list of newly available reports and testimony. To
receive facsimile copies of the daily list or any list from the past 30
days, please call (202) 512- 6000 using a touchtone phone. A recorded menu
will provide information on how to obtain these lists.

Orders by Internet

For information on how to access GAO reports on the Internet, send an email
message with ?info? in the body to:

Info@ www. gao. gov or visit GAO?s World Wide Web home page at: http:// www.
gao. gov

Contact one:

 Web site: http:// www. gao. gov/ fraudnet/ fraudnet. htm

 E- mail: fraudnet@ gao. gov

 1- 800- 424- 5454 (automated answering system) Ordering Information

To Report Fraud, Waste, and Abuse in Federal Programs
*** End of document. ***