DTIC ADA306931: Guidelines For Adaptive Aid Design: Hypertext Reference .

Transcription

Contract No. F33615-88-C-3612Report No. NAWCADWAR-92087-60GUIDELINES FOR ADAPTIVE AID DESIGN:HYPERTEXT REFERENCE SYSTEM FUNCTIONALSPECIFICATIONRobert C. Andes, Jr.SEARCH TECHNOLOGY, INC.4725 Peachtree Corners Circle, Suite 200Norcross, GA 30092-255325 NOVEMBER 1991Interim ReportPeriod Covering 22 July 1991 to 25 November 1991Approved for Public Release: Distribution Is Unlimited.19960419 118Prepared forAir Vehicle and Crew Systems Technology Department (Code 6021)NAVAL AIR WARFARE CENTER - AIRCRAFT DIVISION WARMINSTERP.O. 00X5152Warminster, PA 18974-0591

NOTICESREPORT NUMBERING SYSTEM - The numbering of technical project reports issued by theNaval Air Warfare Center, Aircraft Division, Warminster is arranged for specific identificationpurposes. Each number consists of the Center acronym, the calendar year in which the number wasassigned, the sequence number of the report within the specific calendar year, and the official 2digit correspondence code of the Functional Department responsible for the rep it For example.Report No. NAWCADWAR-95010-4.6 indicates the tenth Center report for the ye 1995 andprepared by the Crew Systems Engineering Department. The numerical codes are as follows.CodeDepartment4.1Systems Engineering Department4.2Cost Anaiysis Department4.3Air Yehicie Department4.4Propulsion and Power Department4.5Avionics Department4.6Crew Systems Engineering Department4.10Cone. Analy., Eval. and Plan (CAEP) DepartmentPRODUCT ENDORSEMENT - The discussion or instructions concerning commercial productsherein do not constitute an endorsement by the Government nor do they convey or imply the licenseor right to use such products.Date:Reviewed By:Author/COTRReviewed By:LEVEL III Manager /s)

Form ApprovedREPORT DOCUMENTATION PAGE0MB No. 0704-0188PudIic reoon nc turoe " ctrciiecticn cf .nforraticn is esurnateo \0 a -erace i fiour per 'eiocrse, including the time fcr reviewing ;''struaicns. iearcning existing data sources,:;3ther:rig and namtaming 'he data neecea, and ccrroleting anc »-evieAing the'codectionmforT.ation, Send comments reaarcing this burden estimate or any other aspect of thisccllectiori cf in ormation. nctudmg suggesticr s for reducing this burcen, to A'ashmgton Headouarters Services, Direcorate f or information Operations and Reports, 1215 JeffersonDavis Highway. Suite 12C4. Arlington. VA 22202-3302. and to the Office of Management and Budget, Paperwork Reduaion Project {07CA-01SS), ’A'ashmgton, DC 20503.1. AGENCY USE ONLY (Leave blank)3. REPORT TYPE AND DATES COVERED2. REPORT DATE25 November 1991Interim T/22/91 - 11/25/915. FUNDING NUMBERS4. TITLE AND SUBTITLEGUIDELINES FOR ADAPTIVE AIDING DESIGN:HYPERTEXTREFERENCE SYSTEM FUNCTIONAL SPECIFICATIONC: F33615-88-C-3612Subcontract:111 66. AUTKOF.(S)Robert C. Andes, Jr.8. PERFORMING ORGANIZATIONREPORT NUMBER7. PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES)!1SEARCH TECHNOLOGY, INC.4725 Peachtree Corners Circle, Suite 200Norcross, GA 30092-2553STI TR-9103-00210. SPONSORING/MONITORINGAGENCY REPORT NUMBER9. SFONSORING/MONITORIN’G AGENCY NAME(S) AND ADDRESS(ES)Air Vehicle and Crew Systems Technology Department(Code 6021)NAVAL AIR WARFARE CENTER-AIRCRAFT DIVISION WARMINSTERP.O. Box 5152Warminster, PA 1897 -0591NAWCADWAR-92087-60j11. SUPPLEMEN'TARY NOTESNAWCADWAR POC:LT Meagan Carmody (Code 6021)1 12b. DISTRIBUTION CODE12e. DISTRIBUTION .'AVAILABILITY STATEMENTApproved for Public Release; Distribution is Unlimited.13. ABSTRACT ('v'rar/.7iL'.'n2C0ivcrc'j;Preliminary specifications for a hypertext-based adaptive aiding design referenceare given.The system will provide a repository for the design and empiricalvalidation of adaptive aiding system designs.Particular emphasis is placed onhighlighting design guidelines and empirical support for aiding recommendations.The specification aims to capitalize on design information and guidelinesextracted under another AFAIC task.Data types, input/output, and informationseeking behavior by designers consulting with the hypertext system are addressed.Particular emphasis is placed on extensibility of the system as more researchis conducted in adaptive aiding.User profiles, and recommended hardware andsoftware for system implementation are discussed.A preliminary implementationschedule is provided.15. NUMBER OF PAGES14. SUBJECT TERMSadaptive automation, adaptive aiding, hypertext referencesystem for the sesign of adaptive aiding17.SECURITY CLASSIFICATIONCF .RErO-.TI UNCLASSIFIEDNSN 7540-01-280-550018.SECURITY CLASSIFICATIONCF Ti-::s FACEm CLASSIFIED 19.SECURITY CLASSIFICATIONOF .AESTRACT2516. PRICE CODE 20. LIMITATION OF ABSTRACTUNCLASSIFIEDStandard Form 298 (Rev. 2-89)p''?scrib d by ansi Std29S- G2Z39*'8

Contract No. F33615-88-C-3612Report No. NAWCADWAR-92087-60TABLE OF CONTENTSIntroduction.11.1Background.!! !. ! .11.2Purpose of this Document. .!!! !l1.3System User Profiles. .21.3.1Primary User Profile.21.4Implications of User Profile on System Requirements.42.0Hardware and Software Requirements.62.1Reviewed Environmenta.62.1.1Madntosh Hypertext ftware Tools . is2.1.2Persona! Computer Hypertext Software Tools.72.2Development Environment.82.2.1Recommended Hardware.82.2.2Recommended Software.93.0 System Data.103.1Data Types and Filea.103.1.1Enhanced Bibliographic Reference.103.1.2Design Guidelines.113.1.3Lessons Learned and Material Summary.123.1.5Notes List.134.0Functional Description.144.1Basic Concept of Operation.144.2 Top-Level Functions.154.3 User Interaction Example.155.0Specification of Functions.175.1Navigation and Information Retrieval.! 175.1.1Browsing.175.2User riks.195.3 Create, Save, Manage, and Integrate Files.205.3.1Open System.205.3.2Close System . .205.3.3Select/Mark Material for EdK Files.205.4.1Integrate MaterialAJnks.215.4.2Construct Unks.215.5 User Interface Management Functions.215.5.1Window Management.215.5.2Material Views.216.0Program Plan.227.0Summary.238.0References.24Notes.251.0i

Contract No. F33615-88-C-3612Report No. NAWCADWAR-92087-60HYPERTEXT REFERENCE SYSTEM FUNCTIONAL SPECIRCATION1.0 INTRODUCTION1.1BackgroundInterest in computerized aidino systems to assist the operator of complexsystems (e.g., process control, tactical aircraft) has been increasing steadily over thelast ten years (Rouse, 1988). This trend has been due to the increasing capabilitiesof control systems and complexity of operation. A type of automated task executionassistance, knovm as adaptive aiding, has been introduced as a way to help theoperator execute tasks in these high workload environments.Adaptive aiding technology -- flexible, computerized aiding systems that adaptto the human operator's needs according to the current operating demands - isdeveloping in response to increasing control and monitoring demands on theoperator.Recently, the conceptual viability of adaptive aiding has beendemonstrated (Rouse, 1988). However, given the lack of fielded systems and only asmall number of research results, a starfdard approach to aid design has not beenestablished.Search Technolog/s current effort on the Adaptive Fur ction Allocation InIntelligent Cockpits (AFAIC) program, of which this present effort is a part, is tocatalogue the relevant literature from various disciplines (e.g., human performance,engineering psychology, systems design, human factors, etc.) and extract validguidelines and lessons learned from adaptive aiding efforts. The current undertakingis an effort to transform adaptive aid system research into the realm of engineeringdesign, rather than allow it to remain in a form only understood by basic researchers.In addition, a supporting goal of this effort is to Identify where necessary basic andapplied research ought to be conducted to fill in the knowledge required to produceuseful, reliable adaptive aidng systems in various operating domains.1.2Purpose of this DocumentThis document describes functional specifications for a computer-basedguideline reference system product intended to serve as a repository for informationcompiled during the AFAIC effort. The product is a hypertext database systemcontaining literature references, design guidelines extracted from the references,lessons learned, and supporting empirical data relevant to aiding systems design.This product Is designed to be a comprehensive reference system for aiding systemsdesigners, in which all infonikation affectir g an aid design effort can be retrieved in acomplete, logical, and easily navigated format.Several core design documents have been reviewed to date. The completebibliography of material to be contained in the first prototype of this system can befound in the literature review providing the initial information source for this system1

Contract No. F33615-88-C-3612Report No. NAWCADWAR-92087-60(see: "Guidelines for Adaptive Aid Design : A Review of the Literature", Anoskey andAndes, 1991). Primary value added of the current effort is to arranoe the guidelines,lessons learned, design implications, and empirical support into a format that wouldincrease the likelihood that this information will be considered by the designer at theappropriate stage in the aid production process.This document describes the Adaptive Aiding Design Reference System infunctional terms. Implementation details shall be disclosed in a detailed designdocument.1.3System User ProfilesThere are several levels of user possible for this system. For the firstprototype, however, we will only focus on one user group. This user profile isdescribed in this section.The primary market for this product is the engineering design and behavior science communities collaborating in the design of adaptive aiding systems. This isa highly limited market; however, functionality can be expanded for other markets asdesign knowledge is gained and more aiding systems are implemented. Thefollowing user description focuses on members of this market segment only.1.3.1 Primary User Profile1.3.1.1Educational BackgroundProfessionals who we expect to be primary users play a significant role inboth top-level aiding systems design and generation of empirical results influendngthe top-level designs. As such, we expect that these professionals will have attainedat least a Master of Science Degree in either behavioral sdence or an engineeringdiscipline. Perhaps up to 50% of the users will also hold PhD degrees. Basicknowledge of computers is assumed, given the feature of the technology.The possible range of users suggested in the previous paragraph suggeststhat users will be generally familiar with all areas relevant to adaptive aiding design(e.g., workload, human factors, human performance, intelligent systems), but notspecifically in the area of adaptive aiding.1.3.1.2Knowledge and SkillsIt is anticipated that users will only possess moderate familiarity with thebreadth and focus of the material contained within the product. As mentionedearlier, it is anticipated that the typical user will most likely be a specialist in one ofthe subfields contributing to the knowledge necessary for successful implementationof aiding systems.That fact notwithstanding, users of the tool will need to know which guidelinesfrom other contributing fields -- in addition to guidelines unknown in their spedal field " affect the design problem at hand. This knowl e must be characterized interms that the user can understand. Without a priori knowledge of each possibleuser's backgrourd, the knowledge contained within the tool mu assume a mediumfamiliarity with engineering terminology and also be (somewhat) familiar with jargon2

Contract No. F33615-88-C-3612Report No. NAWCADWAR-92087-60indigenous with human performance and perception. A glossary of terms shouldresolve any misunderstandir gs at this level.System designers often consider themselves to be representatives of the enduser community. Through introspection, personal requirements, and empiricalresults, they make their design decisions. This perspective must be considered inthe design of the tool. Design approaches to implementing specific aid functions canbe presented as lists of alternatives, or rather " uivalent" approaches that serve asadvice instead of prescriptive information. In essence, the knowledge would beavailable as the oridge from concept to implementation with several possibleapproaches to the design available. In this way, the designer can evaluateartematives without needlessly constraining the design before it is completelyformed. This will facilitate the creative process necessary for new designs. Theapproach given here would be particularly valuable to the Highly educated designerdescribed in previous sections.Users will most likely possess medium to high computer literacy. The literacywill not be evenly distributed over types of computing or operating systems. Themajority of users will be familiar with PC environments for general user tasks andapplications. Having this experience, the users will be more familiar with conceptsand operations of the PC genre of computing environments.The projected user population will probably want to import information(pertaining to known guidelines or missing information relevant to aiding (e.g., newempirical results, expansion of established concepts). In order to do this, thecomputing platform and operating environment must be familiar to them. Most of theusers will probably not be regular Macintosh users. However, the growing number ofPC based products with graphical interfaces and Mac-like features may dissolve thelarge interface and operations differences between the two platforms over a short(Period of time.1.3.1.2User requirementsProjected users of this product will seek information at two levels:0Information and guidelines directly afpplicable to the design problemat hand, and0Information, guidelines, and empirical su(P Port for particular conceptsrelevant to design of state-of-the-art aiding systems.Although at first these user requirements appear completely disparate, closerexamination shows that the primaiy distinction is one of information depth. Theformer requirement is concerned with accepted rules and practices to be used in acurrent design; the latter is concerned with the verification and validation of thesepractices. The latter is also concerned with furthering the state of the art. Bothinformation seeking behaviors should be considered in the tool since the user willprobably engage in both types of behavior given a different puqpose for access to thetool. Also, a user may require greater depth of information about a guideline if hequestions its validity in design.3

Contract No. F33615-88-C-3612Report No. NAWCADWAR-92087-601.3.1.3 Summary User Profile The previous discussion about user population yields the following summafy profile:Educational BackgroundLevel of education.Master of Sderce or equivalentProfessional specialty.Behavioral science.Engineering {system design)Work EnvironmentOrgar ation.Govemn ent or aerospace engneeririgRole.Member of techrical staffSoda! environment.Team memberResource environment.Moderate to extensive corr wtir resourcesKnowledge and SkillsArea specialty.One of: human/machine interface cosigner, humanfactors, human performance, systems engneeringComputer Bteracy:,,. Hardware/software - general.MecSum to very high PC-general.MedumtohighMacintosh.Low to rr iumGraphical interfaces.Medum to highHypertext interfaces.Low to medium1.4Implications of User Profile on System RequirementsBased on the Summary User Profile, the following system requirementsemerge:1.2.3.Information and guidelines about human behavior in complex controltasks should be highlighted at engineering (rather than research)level.All guidelines should have supporting empirical evidence and relatedinformation readily available with easy access (where possible).This is necessary to ensure that substantiated guidelines pplantuser's personal opinions and experience when valid empincallybased guidelines exist.A glossary or dictionary should be provided to reduce confusion dueto "jargonization".4r iru -

Contract No. F33615-88-C-3612Report No. NAWCADWAR-92087-604.The guidelines and information contained within the tool isaugmentable with user's personal, domain, and problem specificknowledge.5.The system should be easily expandable with new research results.6.The tool should support export of information for design reviews.7.Relevant Mil-Star dards should be included where applicable. Thistool will be used by government employees arxl aerospacedesigners who must observed applicable standards for design.5

Contract No. F33615-88-C-3612Report No. NAWCADWAR-92087-602.0 HARDWARE AND SOFTWARE REQUIREMENTS2.1Reviewed Envlronrr ntsThe hypertext reference system should be developed and delivered on apersonal (e.g., PC-class or Macintosh) computing system. This approach will allowa large number of users to employ the system without requiring mainframe access.In acfdition, learning a new system (e.g., hypertext-based reference) will not involvelearning a new operating system as well.Two such platforms were reviewed: the DOS-based personal computer, andMacintosh running under the MultiRnder operating system. Hypertext developmentproducts meeting the criteria set below were reviewed for each platform. This is notan exhaustive review:The focus of this section is on low-cost hypertextdevelopment tools, rather than high-end hardware platforms and customapplications.The top two hypertext development tools on each platform are describedbelow. These choices are based on Glushko’s (1990) article entitled "Using Off-theshelf Software to Create a Hypertext Electronic Encyclopedia". Other informationwas ascertained from programmers possessing programming experience wthhypertext development tools. Requirements for the software product included: price,searching and browsing features, ease of use, link programming, user interface, andprogramming features of the product (some of the information is taken directly fromGlushko, 1990). Basic hardware configuration for the recommended platform isgiven in the next section.2.1.1Macintosh Hypertext Software ToolsThe most popular hypertext tools fqr the Macintosh environment areHyperCard (Apple Computer) and SuperCarcp (Silicon Beach). They both exploitthe desktop metaphor interface of the Macintosh, and as such, appear to beindigenous software systems on the Mac.In part, this is true. HyperCard was originally packaged with the Madntosh; itwas further enhanced with the release of HyperCard 2.0. SuperCard, on the otherhand, was produced by Silicon Beach Software to overcome some of the limitationsof HyperCard. It is more of a software development environmerit, complete withmultiple window support, programming project maintenance facilities and betterimporting facilities than HyperCard. Both of these products are low-cost hypertexttools, but are only available for Macs. They are reviewed below.HyperCard 2.0 - HyperCard is an obje S-oriented programming product thatallows a user to easily translate an Idea into a working computer prototype. It wasthe first widely used hypertext product. HyperCard uses a "card stack" metaphorresembling an electronic version of a staw of index cards. Users can construct"stacks" for virtually any subject from address Irxiexes to complex hyper xtimplementations. HyperCard uses (In rever aggr ation order) stacks ofcards, buttons, fields, and icons to Integrate into t ons. What makes HyperCardso attractive is that the user can do as little or as much programmirig as de red.Several example stacks, buttons, fields, etc. are available for t and paste. Thehypertext capabilities of HyperCard consist primarily of the ability to link cards tocards, fields to fields, and also other combinations of HyperCard objects.6

Contract No. F33615-88-C-3612Report No. NAWCADWAR-92087-60Built-in visual effects like dissolves, zooms, and wipes enable a kind ofanimation when cards are displayed in rapid sequence. HyperCard Is supported byan object-oriented programming language called HyperTalk. It can be extended byany utility that runs on a Madntosh.In HyperCard, there are no limitations on the number or size of units. WithHyperCard 2.0, multiple cards can be displayed at once (in contrast with HyperCard1.2) but links cannot be made between all object types. For example, scrolling textcannot contain "hot" (clickable) terms, nor can scrolling text be linked to other cards.This limits the size of text per unit.HyperCard can also integrate text and non-textual components. Bit-mappedgraphics can be placed onto cards easily. Any part of a card can be the source of alink. Selecting a link can also enable sound, animation, etc. as well, givingHyperCard multimedia capabilities. It supports a limited (and slow) search fadlity,however this can be overcome with external products. It provides built-in navigationvia "previous" and "next" buttons as well as irxJex and a graphical representation ofthe most "recent" cards visited. Bookmarks, notes, help etc. can all be supported.The major limitation to HyperCard is its ability to handle large applications. Itis a complete programming environment with multi-media suppyort, but requires anexperienced programmer to customize it for a specific application. As such, "it is asuperb prototyping tool for user interfaces and much less suited as a deliveryplatform for large hypertexts" (Glushko, 1990).SuperCard - SuperCard, on the other hand, does not use the card metaphor,and anything can be a button. SuperCard "projects" (series of files, etc.) containwindows (scrolling windows, title box, dialog box, etc.) and windows contain cards.With SuperCard, the user is not limited to one stack of cards. A number of windowscarl be contained in each project. SuperCard has more extensive import and exportfadiities, in addition to better text, window, and graphics editing. The extensions tothe HyperTalk language indude a number of ways to reference an object (previouslya problem), better handling of resources and no window formatting limitations. Themost attractive features of SuperCard are that independent Madntosh applicationscan be built (not on top of HyperCard, etc.), compiled, and run. Editors enable theprogrammer to debug animations, import and enhance graphics, etc. SuperCardshould be run on at least a Madntosh il (for speed).2.1.2 Personal Computer Hypertext Software ToolsGuide - Guide WL Internationa!) Is available as both a PC/AT version anda Madnt h version. Only the former is considered in this description. Guide is aWindows (Microsoft) application, so it can exploit the interface and mouse supportof Windows.Guide looks like Windows due to its interface requirements. The desktopmetaphor of Windows applies completely to Guide. Articles (or separate text theme)are separate files (limited only by DOS file size) and can contain bit-mappedgraphics. Graphics can be combined and be "exploded" to provide more detail.However, this capability is of limited value to the current system.Guide’s strong suit is a rich set of link types. Unk types are represented bytext attributes, cursor shape, or by explicit markers (Glushko, 1990). Hierarchicaldisclosure, or replacement of text with explanation, for example, is supported.7

Contract No. F33615-88-C-3612Report No. NAWCADWAR-92087-60Reference links are supported for direct access, as are rwte links for detail.Command links activate a command hidden in a definitions window, while expansionlinks allow the display of hidden ’detail" information about a higher level topic. Twoversions of Guide are present: one for authoring, one for just navigating. It is aample matter to switch from one to the other.Guide supports tables of contents, and hierarchical organization of documentsand ideas. Limited string search and full-text search are available but are ratherslow. Guide maintains a stacic of areas visited and provide navigation assistance tothe user. Navigation within Guide is limited however, bookmarks on documents arefX)t supported. Nonetheless. Guide has some of the best features found in a PCproduct.Two programming languages are available in Guide: Logiix and OPCL3.OPCL3 is designed to handle general Guide document handling (e.g., automaticdocument close, auto reformat etc.). Logiix, on the other hand, is a more powerfullanguage. It allows the programmer to activate data exchange between applications,write complex scripts (like HyperTalk), run dialogue, etc.One particular capability of the current release of Guide makes it attractive:automatic import and basic in( xing of dBase files (i.e., the current Adaptive AidingGuidelines Database is in ’.DBF format). This feature allows the implementor todirectly import the work that has been completed thus far. Though a great deal ofwork must be conducted to complete the product. Guide's import fadlity allows theteam to build on complete work rather than beginning over. A major drawback toGuide is document access speed. Additionally, a powerful hardware platform isnecessary for user acceptance.ToolBook - Toolbook (Asymetrix Corp.) is basically a PC-based version ofHyper/SuperCard (several of the HyperCard features discussed earlier also apply toToolBook). It too runs under Windows 3.0. ToolBook uses a book metaphor as itsbasis. The user opens a ’book", and each separate segment of data or graphics iscontained on a "page". Tables of contents are easily done, as are simplenavigational aids, very much like HyperCard. The scripting langu e available inToolBook resembles both HyperTalk and Visual Basic.Toolbook’s strong suits are its rapid prototyping (like HyperCard), graphicsimport, and scripting capabTrties. It also imports dBase files, but with limitedfunctionality. Complex cursor control arxl access speed are drawbacks.2.2Development EnvironmentThe following development and delivery platform is recommended:2.2.1Recommended Hardware0Personal Computer 386 PC (or 100% compatible)minimum 25 MHz clock speed01 MB RAM or higher0VGA graphics afepter and card8

Contract No. F33615-88-C-3612Report No. NAWCADWAR-92087-600Standard keyboard0Microsoft (or equivalent) mouse01 - 720 Kb Roppy Disk Drive01-40 MB Hard Disk Drive (2.5 MB for hypertext tool)2.2.2 Recommended Software0DOS 5.00Guide (version 3.01) 495. Requires Windows 3.0.0Windows 3.0 ( 90)This configuration is specified for the following reasons:1.The PC platform is most commonly used and understood personalsystem in use.2.The Wndows desktop metaphor is familiar to most computer users.3.Guide is a highly flexible development environment spedficaJlydesigned for hypertext applications. As such. It supports productdevelopment and has better programming features. Environmentsupport provides many of the desired system functions withoutfurther programming.4.Guide is portable to many other hardware ar d software platforms(e.g., Unix operating system, mini-computers, etc.), ft can interfacedirectly with many other software tools as well (e.g., dBase, Oracle,Sybase, etc.). We may desire to provide direct input to the systerrifrom on-line databases in the future.9

Contract No. F33615-88-C-3612Report No. NAWCADWAR-92087-603.0 SYSTEM DATA3.1Data Types and FilesFive basic data types will be contained in the Adaptive Aiding Hypertextreference system. Three types are primarily design reference information Enhanced Bibliographic References, Extracted Design Guidelines, and Materia!Summaries written from a design expert’s p erspective. This information will initiallybe directly imported from the database source files containing the information (thisprocess has already been completed).The last two types of information are system databases containing navigationand operational information. In the links database, all of the object links, by link type,present within the system are catalogued for fast reference and also used for systemlink verification when new material is added. The notes database catalogues all ofthe annotations present in the system and also contains run-time loaded, user addedannotations to assist in interface customization. Term definitions are considerednotes and are not a separate data type. All data types are explained in the followingsections.3.1.1Enhanced Bibliographic ReferenceThe main objects within the system are the bibliographic references for eacharticle included. Standard database record information is contained within eachreference (e.g., full title, source, authors, abstract, etc.), in addition, the referencedata contains information about the nature of the article (i.e., empirical investigation,concept development, etc.) and other insightful categorizations that will be helpful forthe designer. The complete record information is given below. For each data item,the name, types, and other relevant information are listed. (This is based ondatabase record format constructed during the literature review task).The following information is assodated with each record in the bibliographicdatabase:Data TypesData DescriptionData NameIDUr ue identification syrrt)ol (systemspecificpointerTitleFull title of articlecharacter string ( 255 characters)Date {xiblishedYearcharacter stringUt typeSource literature typecharacter string:BookJournal articleConference proceedingTech refillApplication domain of materialcharacter strir :Aerospace or r»n-aerospace10

Contract No. F33615-88-C-3612Report No. NAWCADWAR-92087-60Subject typeThe primary theme of the materialcontained in the articlecharacter string:Concept or architecturedescriptionImptementationEmpirical investigationLiterature reviewEvaluation of system orarchitectureBibIio refFull bibliographic refererxx sourcecharacter stringPagesNumber of pagesinteger3.1.2 Design GuidelinesThe most useful information within the reference system are the designguidelines that have been extracted from reviewed articles, this information will beus

Warminster, PA 18974-0591 . NOTICES REPORT NUMBERING SYSTEM - The numbering of technical project reports issued by the Naval Air Warfare Center, Aircraft Division, Warminster is arranged for specific identification . herein do not constitute an endorsement by the Government nor do they convey or imply the license . or . right to use such .