Defense Technologies: DOD's Critical Technologies Lists Rarely Inform Export Control and Other Policy Decisions (28-JUL-06, GAO-06-793). Major acquisitions in the Department of Defense's (DOD) force transformation rely on maintaining technological superiority to ensure U.S. military dominance. Failure to identify and protect critical technologies makes U.S. military assets vulnerable to cloning, neutralization, or other action that degrades current and anticipated capabilities. To help minimize these risks, DOD's Militarily Critical Technologies Program developed and periodically updates two lists of technologies--the Militarily Critical Technologies List (MCTL) and the Developing Science and Technologies List (DSTL). While the lists are primarily intended to inform U.S. export control decisions, they can also inform counterintelligence activities, research plans, and technology protection programs, making MCTL and DSTL fundamental resources for security decisions. To ensure these lists are informative, GAO assessed the Militarily Critical Technologies Program's process for updating the MCTL and DSTL and determined how the lists are used to inform export control and DOD policy decisions. -------------------------Indexing Terms------------------------- REPORTNUM: GAO-06-793 ACCNO: A57626 TITLE: Defense Technologies: DOD's Critical Technologies Lists Rarely Inform Export Control and Other Policy Decisions DATE: 07/28/2006 SUBJECT: Critical technologies Defense industry Defense procurement Export regulation Military intelligence Military policies Military research and development Program evaluation Program management Militarily Critical Technologies List Developing Science and Technologies List ****************************************************************** ** This file contains an ASCII representation of the text of a ** ** GAO Product. ** ** ** ** No attempt has been made to display graphic images, although ** ** figure captions are reproduced. Tables are included, but ** ** may not resemble those in the printed version. ** ** ** ** Please see the PDF (Portable Document Format) file, when ** ** available, for a complete electronic file of the printed ** ** document's contents. ** ** ** ****************************************************************** GAO-06-793 * Results in Brief * Background * DOD's Updates of the MCTL and DSTL Produces Lists of Limited * Validation Process Provides Little Assurance That Lists Are * MCTL and DSTL Lack Currency * Agencies Tend to Rely on Information Other than the MCTL and * MCTL Rarely Informs Export Control or DOD Policy Decisions * DSTL Is Seldom Used and May Be Eclipsed by More Extensive Ef * Conclusions * Recommendations for Executive Action * Agency Comments and Our Evaluation * Scope and Methodology * GAO Contact * Staff Acknowledgments * GAO's Mission * Obtaining Copies of GAO Reports and Testimony * Order by Mail or Phone * To Report Fraud, Waste, and Abuse in Federal Programs * Congressional Relations * Public Affairs Report to the Committee on Armed Services, House of Representatives United States Government Accountability Office GAO July 2006 DEFENSE TECHNOLOGIES DOD's Critical Technologies Lists Rarely Inform Export Control and Other Policy Decisions GAO-06-793 Contents Letter 1 Results in Brief 2 Background 3 DOD's Updates of the MCTL and DSTL Produces Lists of Limited Value 6 Agencies Tend to Rely on Information Other than the MCTL and DSTL to Support Decisions about Critical Technologies 11 Conclusions 16 Recommendations for Executive Action 16 Agency Comments and Our Evaluation 17 Scope and Methodology 18 Appendix I Agency Comments 20 Appendix II GAO Contact and Staff Acknowledgments 24 Related GAO Products 25 Tables Table 1: Most Recent Updates by Fiscal Year for MCTL Categories, as of April 30, 2006 9 Table 2: Most Recent Updates by Fiscal Year for DSTL Categories, as of April 30, 2006 10 Figures Figure 1: Comparison of the MCTL and DSTL 5 Figure 2: Categories of Technologies Covered by the MCTL and DSTL 6 Figure 3: Reviewers of Proposed Updates to the MCTL and DSTL 7 Abbreviations DOD Department of Defense DSTL Developing Science and Technologies List MCTL Militarily Critical Technologies List This is a work of the U.S. government and is not subject to copyright protection in the United States. It may be reproduced and distributed in its entirety without further permission from GAO. However, because this work may contain copyrighted images or other material, permission from the copyright holder may be necessary if you wish to reproduce this material separately. United States Government Accountability Office Washington, DC 20548 July 28, 2006 July 28, 2006 The Honorable Duncan L. Hunter Chairman The Honorable Ike Skelton Ranking Minority Member Committee on Armed Services House of Representatives The Honorable Duncan L. Hunter Chairman The Honorable Ike Skelton Ranking Minority Member Committee on Armed Services House of Representatives Technological advantage is fundamental to U.S. military dominance in 21st-century warfare. Major acquisitions in the Department of Defense's (DOD) ongoing force transformation-including manned and unmanned aircraft systems, networkcentric communications systems, and air and ground weapons-rely on maintaining technological superiority. Failure to identify and protect critical technologies makes U.S. military assets vulnerable to cloning, neutralization, or other action that degrades current and anticipated capabilities. Technological advantage is fundamental to U.S. military dominance in 21st-century warfare. Major acquisitions in the Department of Defense's (DOD) ongoing force transformation-including manned and unmanned aircraft systems, networkcentric communications systems, and air and ground weapons-rely on maintaining technological superiority. Failure to identify and protect critical technologies makes U.S. military assets vulnerable to cloning, neutralization, or other action that degrades current and anticipated capabilities. To help minimize these risks, DOD's Militarily Critical Technologies Program developed and periodically updates two lists of technologies-the Militarily Critical Technologies List (MCTL) and the Developing Science and Technologies List (DSTL)-each consisting of 20 sections. These lists are primarily intended to inform U.S. export control decisions, but can also help inform counterintelligence activities, research plans, and technology protection programs. As such, the MCTL and DSTL are considered fundamental to identifying technologies critical to national security that can help inform decisions to ensure U.S. technological advantage for the warfighter. To help minimize these risks, DOD's Militarily Critical Technologies Program developed and periodically updates two lists of technologies-the Militarily Critical Technologies List (MCTL) and the Developing Science and Technologies List (DSTL)-each consisting of 20 sections. These lists are primarily intended to inform U.S. export control decisions, but can also help inform counterintelligence activities, research plans, and technology protection programs. As such, the MCTL and DSTL are considered fundamental to identifying technologies critical to national security that can help inform decisions to ensure U.S. technological advantage for the warfighter. Redefined national security threats, rapid technological advances, and increasing efforts by adversaries to gain access to U.S. military weapon system technology heighten the need to identify and protect militarily critical technologies. Given the importance of the MCTL and DSTL, you asked us to (1) assess the Militarily Critical Technologies Program's process for updating the MCTL and DSTL and (2) determine how the lists are used to inform export control and DOD policy decisions. Redefined national security threats, rapid technological advances, and increasing efforts by adversaries to gain access to U.S. military weapon system technology heighten the need to identify and protect militarily critical technologies. Given the importance of the MCTL and DSTL, you asked us to (1) assess the Militarily Critical Technologies Program's process for updating the MCTL and DSTL and (2) determine how the lists are used to inform export control and DOD policy decisions. To assess how the lists are updated, we met with officials from the Militarily Critical Technologies Program and the Institute for Defense Analyses-the contractor that develops list updates-and also reviewed relevant program guidance, directives, and applicable statutory provisions. Using program guidance, we evaluated how the last five section updates to To assess how the lists are updated, we met with officials from the Militarily Critical Technologies Program and the Institute for Defense Analyses-the contractor that develops list updates-and also reviewed relevant program guidance, directives, and applicable statutory provisions. Using program guidance, we evaluated how the last five section updates to the MCTL and DSTL were conducted. We identified 20 DOD components responsible for validating updates prior to issuance and interviewed 19. We compared when sections of the MCTL and DSTL were last updated over the past 10 years with stated program goals for updating the lists. We identified intended uses of the MCTL and DSTL through interviews with program officials and review of program documents and applicable law. To determine how the lists are used, we interviewed officials from various DOD organizations within the offices of the Under Secretary of Defense for Acquisition, Technology, and Logistics and the office of the Under Secretary of Defense for Policy, military services, several combatant commands, Defense Intelligence Agency, as well as officials from the Department of Commerce. In addition, we identified other mechanisms DOD has used to identify critical technologies and determined how these efforts are coordinated with the MCTL and DSTL process. We conducted our work from October 2005 to June 2006 in accordance with generally accepted government auditing standards. Results in Brief The Militarily Critical Technologies Program's updates of the MCTL and DSTL have generated lists that are of limited value because they are not appropriately validated and are largely out of date. Tasked by DOD, the Institute for Defense Analyses developed a process for updating the lists by creating technology working groups of experts from government, industry, and academia to identify militarily critical technologies. There are a number of inherent challenges to the process. For example, expert participation in the working groups is voluntary, so some experts chose not to participate or do not participate fully in the process. These inherent challenges increase the importance for DOD to validate section updates-a critical check to ensure the lists are complete and accurate. However, the validation process provides little assurance that the lists are of value. For example, more than one-third of the reviewers stated they do not have the technical expertise necessary to validate the updates. Further, DOD assumes that reviewers concur with the updates if it receives no comments-yet one-quarter of the reviewers did not review the lists. At the same time, the lists have not been kept up to date. For example, 9 of the 20 MCTL sections-including technologies related to weapons, communications, and biological warfare-have not been updated for 10 years, although a stated program goal calls for these lists to be completely updated at least every 4 years. The DSTL is similarly out of date; nearly half of the sections have not been updated in the past 5 years. The MCTL and DSTL have generally not been used to inform export control decisions as originally intended as well as DOD policy decisions. According to DOD and Commerce export control officials, the MCTL is not used to develop export control proposals or to inform individual export licensing decisions because the list is too broad and out of date. In fact, in 1996, the Air Force instructed its personnel not to use the MCTL because of concerns about its accuracy and reliability. Military officials involved in anti-tamper decisions associated with weapon system development agree that the MCTL's usefulness is limited for these reasons. The DSTL is also seldom used-in part because many of the DOD components we interviewed were not aware of the list. For those components that were aware of the DSTL, some found it only marginally useful because, like the MCTL, it is out of date. Some DOD and military services have developed efforts to track global technologies similar to the DSTL. However, these efforts are more expansive, further eclipsing the value of the list. For example, the Army established international technology centers dedicated to identifying international cooperative opportunities as well as to maintain knowledge of foreign research efforts to avoid technological surprises for the warfighter. We are recommending that the Secretary of Defense take several actions to include determining user requirements, reassessing and clarifying the MCTL's purpose based on those requirements, determining an approach and implementation plan that meets user needs, and considering the utility of the DSTL. DOD concurred with our recommendations. However, it does not plan to take any action beyond what it has already completed or planned to do. We believe DOD needs to take additional steps to implement our recommendations. Background DOD considers maintaining military superiority a key priority and has established an agencywide policy to treat defense-related technology as a valuable, limited national security resource that should be invested in and protected to pursue national security objectives.1 Many DOD organizations and other federal agencies have a need to know what is militarily critical to assist in planning program activities related to technology and to help inform decision making. Within DOD specifically, knowledge about militarily critical technologies is needed for such activities as o consideration of anti-tamper protection of critical technologies on defense systems, o counterproliferation programs and activities, and o research and development planning. 1 DOD Directive 2040.2, January 17, 1984. Similarly, other federal agencies depend on DOD to identify militarily critical technologies. For example, the Departments of Commerce and State rely in part on DOD's input on what is militarily critical to inform export control decisions. The Federal Bureau of Investigation also needs to be aware of DOD-identified critical technologies to determine which technologies need protection from being acquired or exploited by foreign intelligence collection efforts. In response to the Export Administration Act of 1979,2 which governs the exports of items with both military and civilian applications, DOD established the Militarily Critical Technologies Program in 1980 to periodically identify and assess technologies that are critical to retaining dominance for the warfighter. The Militarily Critical Technologies Program produces a restricted and a public version of both the MCTL and the DSTL. DOD has contracted with the Institute for Defense Analyses, a federally funded research and development center, since the inception of the program to furnish scientific and technical support in developing and maintaining the lists. The MCTL covers technologies that are of concern in the near term, while the DSTL covers those in the longer term. (See fig. 1 for comparison of the lists.) Program oversight is provided by DOD's Office of International Technology Security.3 Over the past 5 years, DOD has provided approximately $2 million annually to support the Militarily Critical Technologies Program. 2 50 U.S.C. app. S: 2401 et seq. Authority granted by the Act expired on August 20, 2001. Executive Order 13222 continues the export control regime established under the Act and the Export Administration Regulations. 3 The Office of International Technology Security has been under the Directorate for Defense Research and Engineering since fiscal year 2004. In prior years, the office was under the Defense Threat Reduction Agency. Figure 1: Comparison of the MCTL and DSTL The lists are divided into 20 technology sections (see fig. 2), and each section is developed and updated by a technology working group led by a chair and cochair and composed of experts. Each working group identifies militarily critical technologies and the parameters at which they are critical, based on definitions of what is militarily critical established by the Export Administration Act.4 Each working group is responsible for one MCTL and one DSTL section covering the same topic, such as aeronautics technology. The Institute for Defense Analyses has established broad guidance for the chairperson of the technology working groups to use regarding the update process. This guidance in part indicates that working groups should consist of experts from government, industry, and academia and that they should reach consensus on what is critical. 4 The Export Administration Act established a process for the Secretary of Defense to identify militarily critical goods and technologies that should be considered by the Secretary of Commerce for inclusion on the Commerce Control List. To identify critical technologies, DOD is required to consider (1) arrays of design and manufacturing know-how; (2) keystone manufacturing, inspection, and test equipment; (3) goods accompanied by sophisticated operation, application, or maintenance know-how; and (4) keystone equipment which would reveal or give insight into the design and manufacture of a U.S. military system. Figure 2: Categories of Technologies Covered by the MCTL and DSTL DOD's Updates of the MCTL and DSTL Produces Lists of Limited Value In updating the MCTL and DSTL, the technology working groups face several challenges, including identifying and engaging experts in the process and interpreting the definition of militarily critical. These challenges increase the importance of DOD's validation process-a critical check to ensuring the lists are complete and accurate. However, this process is not adequate to provide this assurance. At the same time, the lists are significantly out of date. As a result, the lists are of questionable value. Validation Process Provides Little Assurance That Lists Are Complete and Accurate Working group chairs face two key challenges in identifying and selecting experts to participate in the technology working groups that update the MCTL and DSTL. First, participation in the working groups is voluntary, and according to several chairs we spoke with, engaging the experts-including those employed by DOD-can be challenging since some selected experts participate only informally or are unable to participate at all because of competing work priorities. Second, according to DOD and Institute for Defense Analyses officials, it is challenging to determine the parameter at which a particular technology becomes militarily critical and is therefore subject to interpretation by the working group. One chair defines "militarily critical" for the working group, while others rely on the individual interpretations and judgments of the working group members. These inherent challenges in the process place greater importance on the need to validate the lists. To ensure the lists are complete and accurate, DOD components review and validate the working groups' updates- a process DOD program officials consider a critical check of the working groups' efforts. Figure 3 lists the DOD reviewers. Figure 3: Reviewers of Proposed Updates to the MCTL and DSTL However, we found a number of weaknesses in this critical check. First, reviewers are unclear about how to validate proposed updates or what factors to consider when reviewing proposed updates. For example, one reviewer indicated that the purpose of the MCTL is to inform decisions on technologies that may need to be export controlled, but was unsure whether the review should validate that the technologies in proposed updates need to be controlled or whether to ensure that parameters of technologies listed are accurate. Reviewers stated that they are not informed as to what is added, deleted, or otherwise changed from one update to the next. Without instruction or information on the updates, validation of the changes to the lists may be little more than a reviewer's guess. Two reviewers were unsure how to interpret "militarily critical" when reviewing the proposed updates and therefore did not know how to comment. In addition, no guidance is provided to reviewers on factors to consider during the validation process. Second, the reviewers may not have the technical knowledge to validate the updates. Eight reviewers stated they or their organizations lack the necessary expertise to determine whether the lists were complete or accurate. Program officials stated they do not currently have a process to determine whether they have the proper reviewers or if these reviewers are adequately validating proposed updates. Finally, program officials assume concurrence with the lists if reviewers have not provided feedback within 30 days. According to program officials, the process is working well because reviewers seldom provide feedback or comments on proposed MCTL or DSTL updates. However, one-quarter of the reviewers did not review the lists. Specifically, five reviewers told us that they receive MCTL and DSTL updates but do not comment on them. In addition, according to our analysis of the last five updates to the MCTL and DSTL, eight reviewers have provided comments to at least one update. MCTL and DSTL Lack Currency A Militarily Critical Technologies Program goal is to completely update the MCTL and DSTL at least every 4 years by updating about 5 sections of each list every year. According to program officials, this goal was set to keep the lists as current as possible within budget limitations. However, this goal has not been met. The Institute for Defense Analyses produced only one update of the MCTL in fiscal year 2004 and four updates in fiscal year 2005 (see table 1). Furthermore, 9 of 20 MCTL sections have not been updated since 1996-the last time the MCTL was completely updated. Table 1: Most Recent Updates by Fiscal Year for MCTL Categories, as of April 30, 2006 Technology 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 Aeronautics Armament and energetics Biological Biomedicala Chemical Directed and kinetic energy Electronics Energy systems Ground systems Information security Information systems Lasers and optics Marine systems Materials and processing Nuclear Positioning, navigation, and time Processing and manufacturing Signature control Space systems Weapons effects Source: DOD. aThe biomedical section of the MCTL has not yet been created. The DSTL is also out of date. The institute did not update any sections in fiscal year 2004 and produced only one update in fiscal year 2005. Over the past 5 years, only half of the DSTL sections have been updated (see table 2). Table 2: Most Recent Updates by Fiscal Year for DSTL Categories, as of April 30, 2006 Technology 1999 2000 2001 2002 2003 2004 2005 2006 Aeronautics Armament and energetics Biological Biomedical Chemical Directed and kinetic energy Electronics Energy systems Ground combat systems Information security Information systems Lasers and optics Manufacturing and fabrication Marine systems Materials and processing Nucleara Positioning, navigation, and time Signature control Space systems Weapons effects Source: DOD. aThe nuclear section of the DSTL has not yet been created. Program officials explained that delays were in part the result of internal disruptions to the program due to frequent changes in senior leadership, but were unable to provide information on how they monitor or measure whether goals for updating the lists are being met. Regardless, program officials stated they are satisfied with how the process for updating the lists is working and noted that the lists are available on the Web site for public comment. In 2005, program officials held forums to obtain feedback from list users and participants in the technology working groups about the process for updating the lists. In response to user feedback expressing concern about the process, program officials developed an action plan that in part called for an independent assessment of the MCTL and DSTL process for updating the lists, which was not completed. Instead, a program official began an internal review, concluding that problems stemmed from funding constraints and a lack of senior DOD leadership to support the program. Agencies Tend to Rely on Information Other than the MCTL and DSTL to Support Decisions about Critical Technologies While the MCTL was created to help determine items that need to be controlled, the list has generally not been used to inform export control and DOD policy decisions. Several DOD components have developed their own efforts to catalog critical technologies to meet their needs. The DSTL is also seldom used and may be eclipsed by more extensive DOD efforts. MCTL Rarely Informs Export Control or DOD Policy Decisions A number of DOD components, including the armed services, as well as the Department of Commerce, do not rely on the MCTL to inform export control or DOD policy decisions. While the MCTL is expected to inform review of export license applications or export control decisions, the Defense Technology Security Administration-which represents DOD on export control decisions-does not use the MCTL for export licensing decisions or to inform DOD's input to U.S. government export control proposals that are considered by the multilateral export control regime known as the Wassenaar Arrangement.5 Instead, the Defense Technology Security Administration relies on other sources of information, including technology-specific information from subject matter experts associated with the Institute for Defense Analyses, who may also participate in MCTL updates. According to Defense Technology Security Administration officials, the MCTL is too broad, out of date, and difficult to navigate to be an effective tool for informing export licensing decisions or export control proposals. 5 The Wassenaar Arrangement is an agreement among 40 nations to promote transparency and greater responsibility in transfers of conventional arms and dual-use goods and technologies. Officials from the key export control regulatory agencies6 agreed that the MCTL lacks the specificity and currency needed for export control decisions. These have been long-standing issues. In 1982, we reported that the Departments of Commerce and State and private industry were concerned that the MCTL was not specific enough to be useful as a practical daily guide for export control decisions.7 Presently, Commerce officials expressed additional concerns that because of delays in updating sections of the MCTL, the list contains items that they have already determined need not be controlled or limited. Further, the chair for the Militarily Critical Technologies Program's electronics technical working group acknowledged that microprocessors are included as militarily critical on the MCTL at parameters no longer controlled on Commerce's control list. Because of the lack of specificity and lack of currency, Commerce officials told us that they do not use the MCTL to inform items to control. Instead, they rely on the judgment of the Defense Technology Security Administration. The military services also seldom use the MCTL when reviewing export license applications. In 1996, the Air Force issued guidance instructing personnel not to use the MCTL to inform export control and other decisions. This guidance, which is still in effect today, specifically prohibits the Air Force's export control specialists, intelligence analysts, investigators, system security engineers, operations security officers, and public affairs officers from using the MCTL to inform export decisions or to determine the importance of military-related technologies. The guidance further states that because the MCTL is out of date, its utility is substantially limited and it may only serve as a desk reference or dictionary to obtain a description of a particular dual-use technology. While Navy officials responsible for export control decisions stated that the MCTL occasionally serves as the starting point to inform decisions, they rely on their own export licensing databases for export control policy. In addition, a senior Navy official stated that even though extensive time and effort go into the development and maintenance of the MCTL, the list does not provide significant value. Navy officials also noted that the MCTL is out of date and raised concerns regarding its accuracy. The Army Director of Policy for Security Cooperation, Resources, and Exports similarly stated the MCTL is inappropriate for being used to inform export control decisions because the lists are too component- and material-focused and do not list specific systems. 6 Regulation of the U.S. export control system is primarily divided between the Departments of State and Commerce. DOD is a reviewer of both State and Commerce export license applications. 7 GAO, Comptroller General: Export Control Regulation Could Be Reduced without Affecting National Security, GAO/ID-82-14 (Washington D.C.: May 26, 1982). As with export control decisions, we found that the MCTL is seldom used to inform various DOD policy decisions, including those related to identifying and protecting critical technology on weapon systems, counterintelligence efforts related to critical technologies, and programs reporting on the protection of the defense industrial base. For example, DOD officials stated that they do not directly use the MCTL to inform decisions related to determining whether to use anti-tamper protections.8 Yet the MCTL is intended to be a primary resource in DOD's process for identifying critical technologies in defense systems that may require anti-tamper protections to discourage or delay reverse engineering. While officials stated that the MCTL is a starting point to select critical technologies for protection, the MCTL's limitations-including the fact that it is out of date and does not incorporate previously identified critical technologies or anti-tamper decisions-led the anti-tamper executive agent to develop a more comprehensive tool for identifying and tracking critical technologies that may need anti-tamper protection. The MCTL is intended to be used as a reference for counterintelligence initiatives throughout the DOD intelligence community. Counterintelligence program officials need to know what technologies are critical and which ones are being targeted through foreign intelligence collection activities. Some counterintelligence entities, including the Defense Intelligence Agency and Army Counterintelligence, indicated that the MCTL informs decisions about technologies that should be examined to ensure that each military service protects them in a consistent manner, but have found limitations in using the list. For example, officials from Army Counterintelligence stated that the MCTL is not current enough to inform decisions needed to help the military services consistently track and protect their current technologies. Due to the difficulties in using the MCTL, the Army has developed a program to identify technologies that are critical to individual Army acquisition programs. Defense Intelligence Agency officials stated that the taxonomy of the MCTL technology categories is useful. However, officials have found that some MCTL sections must be augmented with more current critical technology information to help inform decisions. Outside of DOD counterintelligence activities, Militarily Critical Technologies Program officials stated that they are entering into an agreement with the Federal Bureau of Investigation to provide support to the bureau's critical national assets program. 8 For more information on DOD's anti-tamper program, see GAO, Defense Acquisitions: DOD Needs to Better Support Program Managers' Implementation of Anti-Tamper Protection, GAO-04-302 (Washington, D.C.: Mar. 31, 2004). The MCTL is also intended to inform decisions made by the Committee on Foreign Investment in the United States, an interagency committee responsible for reviewing foreign acquisitions of U.S.-based companies to determine whether the proposed acquisition could pose a threat to national security.9 DOD, which is a member of the committee, provides input through its Office of the Deputy Under Secretary of Defense for Industrial Policy on decisions related to proposed transactions that may involve technologies critical to DOD interests. According to a DOD official, the MCTL is not used to inform these decisions. Instead, DOD relies on input from technical experts in the Directorate for Defense Research and Engineering, who may use the MCTL as one of their many sources of information. In addition, DOD Industrial Policy officials have created a Defense Industrial Base Capabilities Study Series,10 which in part identifies critical technologies and companies that produce them to help inform DOD input to Committee on Foreign Investment in the United States decisions as well as other DOD policy decisions. The Defense Industrial Base Capabilities Study Series was completed in June 2005 and lists over 1,400 critical technologies. The study series notes that it includes examples of critical technologies that the MCTL should consider incorporating. However, Militarily Critical Technologies Program officials said that the series uses a different definition of critical technology and has not coordinated the MCTL and the series' lists of critical technologies. 9 In 1988, Congress enacted the Exon-Florio amendment to the Defense Production Act, which authorized the President to investigate the impact of foreign acquisitions of U.S. companies on national security. The President delegated the authority to conduct investigations to the interagency Committee on Foreign Investment in the United States, which is chaired by the Secretary of the Treasury. For more information on the committee see, GAO, Defense Trade: Enhancements to the Implementation of Exon-Florio Could Strengthen the Law's Effectiveness, GAO-05-686 (Washington D.C.: Sept. 28, 2005). 10 The Office of the Deputy Under Secretary of Defense for Industrial Policy Directorate published five reports under the Defense Industrial Base Capability Study Series from 2004 through 2005. The studies identified critical enabling technologies that support Joint Chiefs of Staff's operational requirements and the industrial base capabilities needed to meet the requirements. DSTL Is Seldom Used and May Be Eclipsed by More Extensive Efforts Many DOD officials we spoke with were either not aware of the DSTL or seldom used it. For example, officials from the Office of Naval Research and the Naval Research Labs were unaware of the DSTL. Officials from the Army's Office of the Deputy Assistant Secretary for Research and Technology/Chief Scientist, who were aware of the existence of the DSTL, stated that the DSTL is not useful for informing science and technology decisions because it is overly broad, its taxonomy does not align with Army Research and Technology taxonomy, and its assessments are rarely in consonance with Army Research and Technology subject matter experts. Furthermore, the Army's Deputy Assistant Secretary for Research and Technology/Chief Scientist maintains sufficient in-house expertise for all required program planning activities and does not require the DSTL to complete mission requirements. In addition, Defense Advanced Research Projects Agency officials indicated that the DSTL has limited applicability to the agency's research efforts. The DSTL is intended to forecast worldwide technology capabilities that could threaten U.S. technological superiority or surprise warfighters in theater as well as to assist DOD science and technology planning. However, the Defense Technology Security Administration has developed a "Top Ten Technologies" list that identifies emerging technologies. According to Defense Technology Security Administration officials, the Top Ten list is designed to help DOD identify paradigm-shifting technologies on or approaching the horizon to provide a basis for defense proposals on how these technologies should be controlled and to inform decisions on how these technologies might benefit the military. In addition, officials who represent the military services and DOD research and development components have established more extensive efforts to aid science planning and track developing and future technologies. For example, both the Army and the Navy maintain offices and technology centers worldwide to monitor and assess research efforts of foreign governments and industries to both inform science and technology planning and identify rapidly evolving or breakthrough technologies. Army officials explained that the Army's science and technology research activities, with a fiscal year 2005 annual budget of approximately $1.7 billion, have more expertise to comprehensibly track all areas of developing global technology than the Militarily Critical Technologies Program, which has an average annual budget of $2 million. At the same time, the Directorate for Defense Research and Engineering has developed a Global Technology Knowledge Base, which incorporates the DSTL along with other information provided by the military services. Like the DSTL, the Global Technology Knowledge Base is intended to serve as a broad-based evaluation of foreign technology and an assessment of foreign technology development efforts to assist in the planning of DOD's science and technology efforts and offers insight into potential collaboration opportunities with foreign entities or utilization of foreign technologies. Although the knowledge base incorporates DSTL information, a Directorate for Defense Research and Engineering official responsible for the knowledge base told us that the DSTL's value to the database is limited because of currency and reliability issues. Conclusions DOD has widespread requirements to know what critical technologies are needed to ensure a technological edge for the warfighter. These requirements demand that DOD leadership develop a solid framework for identifying the technologies that will guide critical decisions on what to control and protect. Relying on militarily critical technology lists that are of questionable value is risky-especially in an environment of rapid technological change and redefined national security threats. Without clear and current information on what items are militarily critical, many DOD components have developed their own mechanisms for identifying and tracking critical technologies. While these separate efforts may satisfy parochial concerns, they do not ensure an effective approach for identifying and coordinating information on critical technologies needed to inform decisions on how to protect U.S. security interests. Recommendations for Executive Action Given the need of numerous programs to know what is militarily critical, we recommend that the Secretary of Defense direct the Director for Defense Research and Engineering to determine users' requirements and on the basis of those requirements, reassess and clearly define the MCTL's purpose. If the purpose deviates from its original intent to inform export control decisions, DOD should seek necessary legislative relief. To ensure that users' requirements are met, we recommend that the Secretary of Defense direct the Director for Defense Research and Engineering, in conjunction with the Under Secretary of Defense for Acquisition, Technology, and Logistics, to o examine existing efforts within the department to catalog critical technologies and determine best practices for identifying technologies; o using these best practices, develop an approach that best meets user requirements in a timely manner; o on the basis of the new approach, identify duplicative efforts, if any; ensure the efficient use of resources; and determine what level of funding is appropriate; o develop an implementation plan for the approach, including timelines for execution and implementing guidance or directives; and o establish an oversight mechanism to ensure that user needs are met. Given the more expansive existing efforts in DOD to track global science and technology efforts, we also recommend that the Secretary of Defense direct the Director for Defense Research and Engineering to determine the utility of continuing to maintain the DSTL. Agency Comments and Our Evaluation We provided a draft of this report to DOD and Commerce. DOD concurred with our recommendations. However, it does not plan to take any action beyond what it had already completed or planned to do. DOD asserts that the International Technology Security's 2005 action plan, developed prior to our review, addresses most of our seven recommendations. DOD also maintains that the MCTL is the only list that assesses technologies from an export control viewpoint. DOD's comments do not recognize that identifying militarily critical technologies serves multiple interests and that many DOD organizations and other federal agencies have a need to know what is militarily critical. Our findings show that shortcomings in the program have led to products that are not adequately validated as well as too broad and out of date to satisfy users' needs. DOD's action plan, which in part discussed steps to meet users' requirements, was limited. For example, DOD, in the development of the plan, did not include Defense Technology Security Administration or the Department of Commerce--two key agencies that program products are intended to inform for export control decisions. Further, DOD does not see the possibilities of how examining efforts in the department to catalogue critical technologies and determine best practices could benefit the program. By leveraging knowledge and potential best practices from other efforts, DOD would have an opportunity to take a strategic approach to identify and coordinate information on critical technologies that satisfy users' needs. Therefore, DOD will need to take additional steps to implement our recommendations. DOD's letter is reprinted in appendix I. We incorporated DOD technical comments as appropriate. Commerce did not provide formal comments but submitted one technical comment, which we addressed. Scope and Methodology To assess how the lists are updated, we met with officials from the Militarily Critical Technologies Program and the Institute for Defense Analyses and reviewed relevant program documents, task orders, guidance, directives, and applicable statutory provisions. Using program guidance and documents, we evaluated how the last five updates to the MCTL and DSTL were conducted. Specifically, we reviewed program information on the number and types of experts used to conduct the updates. We interviewed technology working group chairs responsible for 10 MCTL and DSTL sections to determine how experts are engaged in the process for identifying critical technologies as well as how the definition of "militarily critical" is applied to specific technology areas. We identified 20 DOD components responsible for validating updates prior to issuance. We interviewed officials from 19 of the 20 components and determined how they reviewed and validated the updates. We also compared MCTL and DSTL updates over the past 10 years with program-stated goals for updating the lists. To determine how the lists are used, we first identified the uses of the MCTL and DSTL through interviews with program officials and review of program documents and applicable statutory provisions. We discussed uses of the lists with officials from the Office of Industrial Policy, Defense Technology Security Administration, military services, Executive Agent for Anti-tamper, Defense Intelligence Agency, Defense Security Service, Missile Defense Agency, Defense Security Cooperation Agency, Defense Threat Reduction Agency, Joint Chiefs of Staff, Joint Forces Command, Special Operations Command, Strategic Command, and Transportation Command, Defense Directorate for Research and Engineering's Office of International Programs and Science and Technology, Defense Logistics Agency, Pentagon Force Protection Agency, Defense Contract Management Agency, Office of Special Operations and Low Intensity Conflict, Defense Advanced Research Projects Agency, as well as officials from the Departments of Commerce and Homeland Security. In addition, through interviews with some of these organizations and review of documents they provided, we identified other mechanisms DOD has used to identify critical technologies and determined how these efforts are coordinated with the MCTL and DSTL update process. We are sending copies of this report to interested congressional committees, as well as the Secretaries of Defense, Commerce, and Homeland Security; the Director, Office of Management and Budget; and the Assistant to the President for National Security Affairs. In addition, this report will be made available at no charge on the GAO Web site at http://www.gao.gov. Please contact me at (202) 512-4841 or [email protected] if you or your staff have any questions concerning this report. Contact points for our Offices of Congressional Relations and Public Affairs may be found on the last page of this report. GAO staff who made major contributions to this report are listed in appendix II. Ann Calvaresi-Barr Director Acquisition and Sourcing Management Appendix I: Agency Comments Appendix II: GAO Contact and Staff Acknowledgments GAO Contact Ann Calvaresi-Barr (202) 512-4841 or [email protected] Staff Acknowledgments In addition to the contact named above, Anne-Marie Lasowski, Assistant Director; Noah Bleicher; Andrew Edelson; W. William Russell IV; Karen Sloan; Hai Tran; and Joseph Zamoyta made key contributions to this report. Related GA Related GAO Products Defense Trade: Enhancements to the Implementation of Exon-Florio Could Strengthen the Law's Effectiveness. GAO-05-686 . Washington D.C.: September 28, 2005. Industrial Security: DOD Cannot Ensure Its Oversight of Contractors under Foreign Influence Is Sufficient. GAO-05-681 . Washington D.C.: July 15, 2005. Defense Trade: Arms Export Control Vulnerabilities and Inefficiencies in the Post-9/11 Security Environment. GAO-05-468R . Washington, D.C.: April 7, 2005. Defense Trade: Arms Export Control System in the Post-9/11Environment. GAO-05-234 . Washington, D.C.: February 16, 2005. Defense Acquisitions: DOD Needs to Better Support Program Managers' Implementation of Anti-Tamper Protection. GAO-04-302 . Washington, D.C.: March 31, 2004. Nonproliferation: Strategy Needed to Strengthen Multilateral Export Control Regimes. GAO-03-43 . Washington, D.C.: October 25, 2002. Export Controls: Processes for Determining Proper Control of Defense-Related Items Need Improvement. GAO-02-996 . Washington, D.C.: September 20, 2002. Defense Trade: Mitigating National Security Concerns under Exon-Florio Could Be Improved. GAO-02-736 . Washington, D.C.: September 12, 2002. Export Controls: Department of Commerce Controls over Transfers of Technology to Foreign Nationals Need Improvement. GAO-02-972 . Washington, D.C.: September 6, 2002. Export Controls: More Thorough Analysis Needed to Justify Changes in High Performance Computer Controls. GAO-02-892 . Washington, D.C.: August 2, 2002. Export Controls: Issues to Consider in Authorizing a New Export Administration Act. GAO-02-468T . Washington, D.C.: February 28, 2002. Export Controls: Clarification of Jurisdiction for Missile Technology Items Needed. GAO-02-120 . Washington, D.C.: October 9, 2001. (120486) GAO's Mission The Government Accountability Office, the audit, evaluation and investigative arm of Congress, exists to support Congress in meeting its constitutional responsibilities and to help improve the performance and accountability of the federal government for the American people. GAO examines the use of public funds; evaluates federal programs and policies; and provides analyses, recommendations, and other assistance to help Congress make informed oversight, policy, and funding decisions. GAO's commitment to good government is reflected in its core values of accountability, integrity, and reliability. Obtaining Copies of GAO Reports and Testimony The fastest and easiest way to obtain copies of GAO documents at no cost is through GAO's Web site ( www.gao.gov ). Each weekday, GAO posts newly released reports, testimony, and correspondence on its Web site. To have GAO e-mail you a list of newly posted products every afternoon, go to www.gao.gov and select "Subscribe to Updates." Order by Mail or Phone The first copy of each printed report is free. Additional copies are $2 each. A check or money order should be made out to the Superintendent of Documents. GAO also accepts VISA and Mastercard. Orders for 100 or more copies mailed to a single address are discounted 25 percent. Orders should be sent to: U.S. Government Accountability Office 441 G Street NW, Room LM Washington, D.C. 20548 To order by Phone: Voice: (202) 512-6000 TDD: (202) 512-2537 Fax: (202) 512-6061 To Report Fraud, Waste, and Abuse in Federal Programs Contact: Web site: www.gao.gov/fraudnet/fraudnet.htm E-mail: [email protected] Automated answering system: (800) 424-5454 or (202) 512-7470 Congressional Relations Gloria Jarmon, Managing Director, [email protected] (202) 512-4400 U.S. Government Accountability Office, 441 G Street NW, Room 7125 Washington, D.C. 20548 Public Affairs Paul Anderson, Managing Director, [email protected] (202) 512-4800 U.S. Government Accountability Office, 441 G Street NW, Room 7149 Washington, D.C. 20548 www.gao.gov/cgi-bin/getrpt? GAO-06-793 . To view the full product, including the scope and methodology, click on the link above. For more information, contact Ann Calvaresi-Barr at (202) 512-4841 or [email protected]. Highlights of GAO-06-793 , a report to the Committee on Armed Services, House of Representatives July 2006 DEFENSE TECHNOLOGIES DOD's Critical Technologies Lists Rarely Inform Export Control and Other Policy Decisions Major acquisitions in the Department of Defense's (DOD) force transformation rely on maintaining technological superiority to ensure U.S. military dominance. Failure to identify and protect critical technologies makes U.S. military assets vulnerable to cloning, neutralization, or other action that degrades current and anticipated capabilities. To help minimize these risks, DOD's Militarily Critical Technologies Program developed and periodically updates two lists of technologies-the Militarily Critical Technologies List (MCTL) and the Developing Science and Technologies List (DSTL). While the lists are primarily intended to inform U.S. export control decisions, they can also inform counterintelligence activities, research plans, and technology protection programs, making MCTL and DSTL fundamental resources for security decisions. To ensure these lists are informative, GAO assessed the Militarily Critical Technologies Program's process for updating the MCTL and DSTL and determined how the lists are used to inform export control and DOD policy decisions. What GAO RecommendsGAO is recommending that DOD take several actions to better ensure that efforts to identify critical technologies meet user requirements. DOD concurred with our recommendations. The Militarily Critical Technologies Program's process for updating the MCTL and DSTL has generated lists that are of questionable value. To update the lists, working groups of experts from government, industry, and academia identify militarily critical technologies. However, participation in the working groups is voluntary, and some experts choose not to participate or do not participate fully. Validation of the updates-a critical check to ensure the lists are complete and accurate-also provides little assurance that the lists are of value. More than one-third of the reviewers acknowledged they do not have the technical expertise necessary to validate the updates, and one-quarter did not review the lists. The lists are also out of date. Although a stated program goal calls for all 20 sections of the lists to be completely updated at least every 4 years, about half of the sections on the MCTL-including technologies related to weapons, communications, and biological warfare-have not been updated for 10 years. The DSTL is also out of date; almost half of the sections have not been updated in the past 5 years. With the limited value of the MCTL and DSTL, agencies tend to rely on other information sources to inform export control and DOD policy decisions. According to DOD and Department of Commerce export control officials, the MCTL is too broad, difficult to use, and out of date to inform export control proposals or export licensing decisions. Concerned about the MCTL's accuracy and reliability, the Air Force instructed its personnel not to use the MCTL. The DSTL is also seldom used-in part because some DOD components were not aware of the list. For those components that were aware of the DSTL, some found it only marginally useful because it too is out of date. Several DOD components have developed their own efforts to track global technologies. For example, the Army established international technology centers dedicated to identifying international cooperative opportunities as well as to maintain knowledge of foreign research efforts to avoid technological surprises for the warfighter. Most Recent Updates by Fiscal Year for MCTL and DSTL Sections as of April 30, 2006 *** End of document. ***