US 6962277 B2
An apparatus and method for using a wearable computer in testing applications that uses a probe, a display, an audio communication device, a computer adapted to receive data from the probe, exchange data with the display, exchange data with the audio communications device, and exchange data using wireless communication, a battery, and a harness for securing the probe, display, computer, and battery to a person's body.
1. A system including a wearable apparatus for on-site testing and diagnostic analysis of a device, the system comprising:
a computer for storing and processing data;
a data acquisition device adapted to communicate with the computer, wherein said data acquisition device is connected to the device to collect Property Data and to provide the collected Property Data to the computer for onsite testing and diagnostic analysis of the device;
a first camera, in communication with the computer, for collecting image data of the device and providing the image data to the computer;
a display, in communication with the computer, for displaying visual data from the computer;
a microphone, in communication with the computer, for providing first audio data to the computer;
a speaker, in communication with the computer, for providing second audio data from the computer to a user of the wearable apparatus;
a power source, in communication with the wearable apparatus, for providing a source of power to the wearable apparatus; and
a harness, adapted to support at least the computer, the harness being adapted to be worn on a body of the user as a part of the wearable apparatus;
wherein the computer is adapted to provide testing and diagnostic capability to the user based on the collected Property Data.
2. The system of
a remote expert location, in wireless communication with the computer, enabling real-time collaboration between the user of the wearable apparatus and a remote expert who can advise the user regarding the on-site testing or diagnostic analysis of the device.
3. The system of
a remote expert location, in wireless communication with the computer, enabling real-time collaboration between the user of the wearable apparatus and a remote expert who can advise the user regarding the on-site testing or diagnostic analysis of the device;
wherein the system is enabled for an exchange of real time streaming video, allowing the remote expert to advise the user while the user is at a location of the device.
4. The system of
a remote expert location, in wireless communication with the computer, enabling real-time collaboration between the user of the wearable apparatus and a remote expert who can advise the user regarding the on-site testing or diagnostic analysis of the device;
wherein the system is enabled for annotation of images by the remote expert or user, thereby facilitating the on-site testing or diagnostic analysis of the device.
5. The system of
6. The system of
7. The system of
8. The system of
9. The system of
10. The system of
a second camera, in communication with the computer, for collecting image data of the device and providing the image data to the computer;
wherein the first camera is an inspection camera and the second camera is an infrared camera.
11. The system of
12. The system of
13. The system of
14. The system of
15. An apparatus for use by a technician to facilitate at least one of testing and diagnosing the condition of a device, comprising:
a computer adapted to store and to process data and adapted to be worn on a user's body;
a data acquisition device in communication with the computer, wherein the data acquisition device connects to the device to collect Property Data describing at least one property of the device for testing and diagnosing the condition of the device;
a first camera in communication with the computer and adapted to obtain first imagery relevant to the device;
a second camera in communication with the computer and adapted to obtain second imagery relevant to the device;
a microphone in communication with the computer;
a speaker in communication with the computer;
a display unit in communication with the computer; and
a battery adapted to provide power to at least one of the display unit and the computer.
This application is directed to subject matter that is related to the subject matter of U.S. patent application Ser. No. 09/696,758 for “Apparatus and Method for Using a Wearable Personal Computer” filed Oct. 25, 2000 and U.S. patent application Ser. No. 09/721,091 for “Apparatus and Method for Using a Wearable Computer In Collaborative Applications” filed Nov. 22, 2000.
1. Field of the Invention
The present invention relates generally to wearable computers, and more particularly to a wearable computer for use in testing and diagnostic applications.
2. Description of the Related Art
The need to conduct tests and other diagnostic procedures upon electrical, electronic, mechanical, and electromechanical devices is omnipresent in today's world. From the corner auto garage to U.S. Naval ships, there is a constant need to perform testing and other diagnostic procedures both to ensure that components are operating properly and to determine the precise cause of a problem when a malfunction occurs. There are numerous individual testing and diagnostic components that must be used when conducting these tests and diagnostic procedures. There are countless technical manuals and other sources of information that must be referenced by the individual conducting these tests and other diagnostic procedures. In addition, the individual conducting the tests and other diagnostic procedures must be trained to properly operate the testing and diagnostic devices.
As an example, the United States Navy presently uses over 300 pieces of General Purpose Electronic Test Equipment on its AEGIS class destroyers. Some of this equipment is quite large and cumbersome, yet must be transported to the device that requires servicing. In addition, the individual who uses the test and diagnostic equipment must be properly trained regarding the operation of the test equipment and must transport technical information regarding the equipment to be tested. In addition to this example, there are numerous other situations where a wide variety of test equipment must be kept on hand and transported to the device requiring servicing.
Wearable computers are computers that may be physically worn on the body of the person operating the computer. Wearable computers are preferred when there is insufficient space to set up a lap top or desk top computer. Wearable computers have been used for report preparation and other data gathering activities. However, the use of a wearable computer only for data gathering functions does not meet the needs of conducting testing and other diagnostic applications. In addition, even if a wearable computer that had the requisite technical information regarding the testing and diagnostic applications were available on site, it would be of limited use absent the ability to collaborate with one or more other individuals who could offer expertise and insight into the testing or diagnostic application being conducted.
Therefore, it would be desirable to provide an on-site technician with the ability to use a wearable computer that combines numerous pieces of testing and diagnostic equipment into a single component, makes available all technical information that may be required by the technician while on-site, and facilitates real time collaboration between the technician and one or more individuals at any location who can assist the technician and provide additional information and advice.
The present invention is a method and apparatus for using a wearable computer in on-site testing and diagnostic analysis applications. For example, the present invention may be used in manufacturing, maintenance, and repair applications as well as any other industrial, manufacturing, or construction applications where electrical, electronic, mechanical, and/or electromechanical components are tested or otherwise analyzed. The present invention permits an on-site technician or other individual (“technician”) to collect data regarding the quantifiable properties of an object of interest; collaborate in real time with a remote subject matter expert or other individual who can assist the technician (“remote expert”); collect video, detailed imagery, and/or infrared imagery data regarding the object of interest and transmit this data in real time; access technical manuals and/or other information while on-site; and transmit data using wireless communication. The quantifiable property data (“Property Data”) that can be collected from the object of interest includes, without limitation, voltage, resistance, current, temperature, frequency, revolutions per minute (“RPM”), vibration, viscosity, pressure, and any other quantifiable property of an electrical, electronic, mechanical, and/or electro-mechanical device. In addition, the technician may use the present invention in a “store and forward” manner in which Property Data is collected and stored locally by the technician and later uploaded or transferred, as required, to another computer for storage and/or further analysis.
The present invention overcomes the limitations of conventional testing and diagnostic equipment and procedures by combining the numerous individual conventional testing and diagnostic devices that are generally used into a single compact unit that is portable. In addition, the present invention permits real time collaboration between the on-site technician and the remote expert. Through the use of real time streaming video and real time streaming infrared video, the remote expert is able to provide real time “over the shoulder” advice to the technician while the technician is still on-site. The present invention also permits the technician and remote expert to annotate images and other data in real time to further improve the efficiency and effectiveness of the technician's performance while on-site. The present invention likewise permits the technician to access technical information while on-site. This technical information includes, without limitation, blueprints, interactive troubleshooting and maintenance procedures, electrical schematic diagrams, fault logic diagrams, fault isolation processes, and troubleshooting routines.
The substantial versatility of the present invention and its ability to facilitate real time collaboration enable the present invention to be used in a large variety of different applications and environments. In addition, the present invention may be used in training applications where one or more technicians may conduct training exercises with one or more remote experts. In addition, the present invention may be used to create training materials based upon the data collected and stored by either the technician, remote expert, or both.
The present invention preferably comprises a probe, a general inspection camera, a detailed inspection camera, a headset, a computer, and a harness that is used to support the foregoing components from the body of the person wearing the present invention. In another embodiment, the present invention may further comprise an infrared camera that can be used in lieu of or in conjunction with the detailed inspection camera.
Computer 5000 preferably utilizes software that permits numerous data collection and analysis applications to be run using a common component, namely computer 5000. The software used preferably permits the data collection and other analysis capabilities of numerous conventional “stand alone” testing and analysis devices to be incorporated into computer 5000. The software used according to the present invention preferably is characterized by the functionality of “stand alone” components that include, but are not limited to, a digital multi meter, oscilloscope, dynamic signal analyzer, arbitrary waveform generator, function generator, counter/timer, logic analyzer, waveform editor, device calibrator, data logger, and any other device that may be used to collect quantifiable data from an electrical, electronic, mechanical, and/or electro-mechanical device. The use of such software preferably provides flexibility regarding the testing and analysis capabilities that are required or desired for a specific testing and/or analysis project.
The software used according to the present invention preferably is also characterized by functionality including, without limitation, a “soft front panel” that permits interactive measurements to be made using “virtual knobs and buttons” present on display 4000 that permit the present invention to be operated in a manner similar to conventional testing and analysis components; the capability to log and/or store data; and the capability to customize and/or save specific instrument configurations. This software preferably also is characterized by functionality that provides report-generation capabilities that can include, without limitation, time-stamps, measurements, user names, and comments, all of which may be included to supplement the raw data that is collected.
In a preferred embodiment, the software used with the present invention is Virtual Bench, available from National Instruments Corp., 11500 N. Mopac Expy., Austin, Tex., 78759-3504. In addition, any software that is suitable for meeting any or all of the above described characteristics may be used.
In another embodiment which can expand the capability of the testing and diagnostic capabilities of computer 5000 according to the present invention, wireless and wired network access protocols that include, without limitation, general purpose interface base (“GPIB”), ethernet, 802.11(x) and Bluetooth are used to access installed test equipment or network stand-alone instruments that possess increased functionality over conventional equipment and instruments. In this embodiment, the components to be tested can transmit Property Data to computer 5000 using the previously described wireless and wired network access protocols rather than requiring a direct physical connection to computer 5000 using probe 1000. This embodiment preferably is used when an increased level of sophistication is required to conduct analyses of complex and/or high frequency waveforms. In this embodiment, control of access to and dissemination of the data collected by the present invention would be controlled by a data administration workstation (not shown).
While numerous wearable computers may be used as computer 5000, computer 5000 preferably is a ViA IIB or ViA IIC (Transmeta processor) wearable computer, available from ViA, Inc., 12550 West Frontage Road, Ste. 201, Burnsville, Minn. 55337, or a ViA IIR wearable computer, available from General Dynamics Information Systems, 8800 Queen Avenue South, Bloomington, Minn., 55431. The ViA IIR is a modified version of the ViA IIB.
The ViA IIB is preferable as computer 5000 because it uses a Cyrix processor, which generally consumes less power and generally has a cooler operating temperature than processors available from Intel and AMD. The ViA IIB preferably is used for computer 5000 because it possesses the following capabilities. The ViA IIB is Microsoft Windows 9X compatible and currently uses Windows 98 as its operating system. The ViA IIB has two internal PCMCIA slots that may accommodate a 100 mW wireless LAN card and other components. Using, for example, an Aironet wireless communication system, available from Cisco Systems, Inc., 170 West Tasman Drive, San Jose, Calif., 95134, computer 5000 is able to transmit and receive data over a WLAN connection using the IEEE 802.11(x) protocol.
In another preferred embodiment of the present invention, computer 5000 may be the ViA IIC, which incorporates a Transmeta Crusoe processor. Like the ViA IIB, the ViA IIC has two PCMCIA slots to accommodate wireless communication and other components. The ViA IIC is desirable because it uses a faster processor, provides increased RAM, provides increased hard-drive space, provides an increased Level II cache, produces less heat, and is capable of using a variety of operating systems including Windows 95, Windows 98, Windows 2000, Windows NT 4.0, and Sun, Hewlett-Packard, Apple Macintosh, and IBM operating systems.
In yet another embodiment of the invention, a ViA IIR may be used as computer 5000. The ViA IIR is desirable because it is “ruggedized” to withstand a greater shock than a conventional wearable computer can be expected to withstand. The ViA IIR takes the basic core unit of a commercial ViA IIB and consolidates it into a 3.8″×5.9″×1.6″ box machined from a solid block of aluminum that is sealed to be water tight and able to withstand shock. A hollow cell is machined into the box containing the motherboard, processor, chipset, RAM and all other associated electronic components. This cell is waterproof and the motherboard is designed to use the thermal mass of its container as a heat sink.
To further enhance high heat performance, a cooling tunnel, located adjacent to the processor cell, is incorporated into the design of the ViA IIR. The tunnel contains a large aluminum heat sink and a compact cooling fan generating a steady air stream over its fins. In order to facilitate air exchange, the cooling tunnel is not sealed. The cooling fan is rugged enough to withstand repeated exposures to water and can be easily replaced if it is damaged. Preferably, a cooling fan providing greater airflow than the fan used in a standard ViA IIB is used to provide increased cooling capacity, thus allowing the ViA IIR to operate in a high temperature environment. A Cyrix or Transmeta processor preferably is used in the ViA IIR because of their relatively low power draw, thus allowing longer battery life and cooler running temperatures. This makes the ViA IIR preferable over other conventional wearable personal computers that use Intel and AMD processors that generally consume more power than the Cyrix processor.
The ViA IIR preferably may be used for computer 5000 because it possesses the following capabilities. The ViA IIR is Microsoft Windows 9X compatible, and cuffently uses Windows 98 as its operating system. In addition, the ViA IIR is also capable of using Windows NT 4.0 as its operating system. The ViA IIR has an internal PCMCIA slot that may accommodate a 100 mW wireless LAN card and other components. Using, for example, an Aironet wireless communication system, available from Cisco Systems, Inc., 170 West Tasman Drive, San Jose, Calif., 95134, computer 300 is able to transmit and receive data over a WLAN connection using the IEEE 802.11 protocol. The ViA IIR is modified for use according to the present invention to accommodate two PCMCIA cards.
Computer 5000 preferably includes an adaptor (not shown) to facilitate the exchange of data between probe 1000 and computer 5000. The adaptor (not shown) used may be a common computer adaptor that is characterized by PCMCIA, PCI, and PXI cardbus technology. The adaptor (not shown) may also by characterized by any other technology that will facilitate the exchange of data between probe 1000 and computer 5000. The use of PCMCIA technology generally will facilitate most data collection and analysis applications including, without limitation, the testing and analysis applications performed on board a ship. However, when dealing with high voltages and frequencies, the use of PCMCIA technology may be limited because of size restrictions and the ability of PCMCIA technology to dissipate heat. In applications involving high voltages and frequencies, PCI technology preferably is used. In this embodiment, a CardBus extender can be placed in the PCMCIA slot of computer 5000 and then connected to an external PCI card carrier (not shown) that can be powered by a DC battery power supply. The CardBus-PCI extender used in this embodiment can be supplied by Magma, Inc., 9918 Via Pasar, San Diego, Calif., 92126. In addition, any CardBus-PCI extender suitable for use with the present invention may be used.
In another embodiment of the present invention, as would be known to those skilled in the art, probe 1000 may be connected to computer 5000 using a USB, PCI, PXI, serial, or PCMCIA interface and any modifications necessary to allow computer 5000 to use a desired access protocol. In this embodiment, the USB interface and probe 1000 can be supplied by Intelligent Instrumentation, 3000 East Valencia Road, Suite 100, Tucson, Ariz. 85706. In addition, any other desired access protocol suitable for use with the present invention can be used.
The present invention may use wireless communication to permit collaborative data gathering and/or problem resolution between the technician wearing the present invention and the remote expert. The present invention permits the remote expert to provide real time “over the shoulder” advice as the technician engages in applications including, without limitation, problem identification, source or location identification, formulation of a corrective solution, and returning the object of interest to its original operating condition. The transmission of real time video data to the remote expert can facilitate “wordless communication,” which permits the remote expert to interpret the situation encountered by the technician without any explanation from the technician. The present invention can also be used by the technician and/or remote expert to examine and analyze the Property Data that has been collected from the object of interest while still on-site. In addition, while remaining on-site, the technician can access technical information including, without limitation, blueprints, electrical schematic diagrams, fault logic diagrams, fault isolation processes, and troubleshooting routines.
The following is an example of how the technician and remote expert may collaborate in real time. After arriving at the location of interest and/or locating the object of interest, the technician may use wireless communication to transmit real time video using general inspection camera 2000 and exchange audio data using headset 3000 with the remote expert. In addition, the technician can transmit real time infrared video using infrared camera 2900. The real time video is transmitted using wireless communication from computer 5000 to the computer system being used by the remote expert. Computer 5000 may use software such as Netsnap, available from PeleSoft, Inc., 2115 Palm Bay Rd., N.E., Palm Bay, Fla. 32905, for the streaming of video using wireless communication. The use of real time video can permit the remote expert to assist the technician in selecting a suitable data source point on the object of interest, or assist in selecting an alternate data source point on the object of interest if the initial Property Data that is collected is irregular.
If desired, the technician may then collect high-resolution imagery snapshots of the object of interest using detailed inspection camera 2500 and download the snapshots to computer 5000. In addition, the technician can collect infrared images using infrared camera 2900 and download the infrared snapshots to computer 5000. The technician may then review the downloaded snapshots on display unit 4000 and make annotations to the snapshots using the “whiteboarding” feature of Microsoft Netmeeting. The annotations may be viewed by the remote expert in real time using whiteboarding. The remote expert likewise may make additional annotations to the snapshots using “whiteboarding” that can be viewed by the technician in real time. These annotations may then be stored by either the technician, remote expert, or both for future reference.
Computer 5000 can also be used to provide technical information to the technician or to exchange technical information between the technician and remote expert. This technical information includes, without limitation, blueprints, electrical schematic diagrams, fault logic diagrams, fault isolation processes, and troubleshooting routines. In addition, the technician could open a CAD application such as Autocad, available from Autodesk, Inc., 111 McInnis Parkway, San Raphael, Calif., and, if desired, select to share this application while using Netmeeting, causing the AutoCAD application to “pop-up” on the remote expert's conferencing window. The remote expert may then take control of the Autocad application that is being hosted on computer 5000 and exhibit the design plan views in a manner that will assist the technician and any other persons participating in the “Netmeeting.” The Netmeeting application also permits instant text messaging, which would enable the technician to contact and collaborate with the remote expert online rather than using wireless audio communication. Netmeeting also permits files to be transferred between computer 5000 and the remote expert's computer. In addition to AutoCAD, any other suitable software package featuring “application sharing” may be used according to the present invention. One such software package is Visualizer, available from Parametrics Technology Corp., 128 Technology Drive, Waltham, Mass., 02453. The Virtual Bench software available from National Instruments can also be shared by the technician, remote expert, and others using Netmeeting or any other “application or desktop sharing” software package.
In addition to collaboration through “whiteboarding,” the technician and remote expert may also collaborate using a more sophisticated version of “whiteboarding” known as “redlining.” “Redlining” generally allows users to mark up vector based images (and certain bitmap formats such as CALS C4) using software applications such as Autodesk's Volo View, TMS View Director, available from TMSS Headquarters, 206 W. 6th Ave., Stillwater, Okla., 74074, Intergraph's ImageR, available from Integraph, Inc., 8252 Hwy. 20 West, Madison, Ala., and CPC View, available from Cartesian Products, Inc., 30 Wesley Street, Ste. 2, Newton, Mass. 02458. Product View, available from Parametric Technology Corp., may also be used for redlining applications or any other type of application sharing. “Redlining” is usually focused on the mark up of technical drawings because it can facilitate CAD and Computer Aided Engineering (“CAE”) options such as layer assignment, revision history, dimensioning, and dynamic panning and zooming. Layers preferably can be designated so that another individual cannot override the changes made by the technician or remote expert. In addition to collaborating with the remote expert using the above applications, the technician preferably may likewise independently access these applications before collaborating with the remote expert.
In another embodiment of the present invention, software can be used to compress the real time video data in environments where the bandwidth available for data transmission is limited. This software can be used in conjunction with Netmeeting and other video conferencing software. In one embodiment of the present invention, the video compression software used is Wavelet 2000, available from Pegasus Imaging Corp., 4522 Spruce Street, Suite 200, Tampa, Fla., 33607. In addition, any other software application suitable for compressing real time video data can be used.
In another embodiment of the present invention, digital signature verification software, such as Sign-It for Microsoft Word and Adobe Acrobat 4.0, available from Communication Intelligence Corp., 275 Shoreline Drive, Suite 500, Redwood Shores, Calif., 94065-1413, may be used with the present invention.
In situations where wireless communication is unavailable or becomes temporarily disabled, the technician may collect data for later use, which is commonly referred to as “store and forward.” When wireless communication becomes available, the technician preferably may retrieve the stored data and collaborate with the remote expert.
In addition to the above listed applications, computer 5000 may use any other software applications that facilitate collaboration between the technician and remote expert. Software applications that may be used with the present invention preferably include some or all of the following features: whiteboard, redlining, video and voice over internet protocol (“VoIP”) technology, information sharing, and peer to peer file transfer. Software such as Microsoft Exchange may be used as the collaborative software according to the present invention. Computer 5000 may also be used to store voice and video data for future reference.
At locations where the use of a WLAN is not feasible or available, long range wireless LAN communication, as available from BreezeCom, 5858 Edison Place, Carlsbad, Calif., 92008, for example, may be used to establish wireless communication. If long range wireless LAN communication is not available, satellite based communication, as available from DirecPC, 11717 Exploration Lane, Germantown, Md., 20876, for example, may be used to establish wireless communication. In addition to these examples, any other type of wireless communication may be used with the present invention.
As shown in
The Property Data collected from the object of interest using probe 1000 preferably is first transmitted through a fusable link adaptor (“FLA”) 1500 before transmission to computer 5000. FLA 1500 preferably is used to isolate both the technician using the present invention and computer 5000 from any harmful or potentially dangerous voltages or other harmful and/or dangerous conditions that may be encountered while collecting data from the object of interest. In a preferred embodiment of the present invention, FLA 1500 is supplied by National Instruments Corp. However, any device suitable for isolating the technician and computer 5000 from harmful and/or dangerous voltages or other conditions may be used as FLA 1500.
In another embodiment of the present invention, computer 5000 will be capable of interacting with an object of interest using the RF spectrum and installed PCMCIA radio wireless LAN cards. In this embodiment, computer 5000 will be capable of interfacing with various Bluetooth and 802.11(x) sensors and devices. The primary purpose will be to extend the system's capability to extract data from the object of interest without direct physical connection. The data that may be collected using this embodiment includes, without limitation, parametric and other pertinent machinery performance information. This embodiment can further permit the technician and/or remote expert to respond to information received from anomalous indications.
As shown in
In another embodiment of the present invention, detailed inspection camera 2500 preferably is used to collect detailed “snapshots.” Detailed inspection camera 2500 preferably is stored in camera storage case 2700 when not in use. Camera storage case 2700 preferably is secured to harness 8000, as will be discussed further below.
When detailed imagery snapshots are desired, the technician preferably removes detailed inspection camera 2500 from camera storage case 2700, powers up camera 2500 if the power is not already turned on, and takes the desired snapshots. After the desired snapshots are taken, the snapshots are downloaded to computer 5000 using video cable 2510. Camera 2500 can have its own power source, or it can be powered by battery 6000. If camera 2500 uses its own power source, video cable 2510 does not need to be connected to camera 2500 while the snapshots are taken. In this embodiment, the snapshots may be reviewed by the technician before they are downloaded to computer 5000 and then transmitted using wireless communication. This embodiment preferably is used to ensure that confidential or otherwise restricted access information is not accidentally downloaded or transmitted. If camera 2500 receives its power from battery 6000, such power can be provided via video cable 2510 connecting camera 2500 to computer 5000, which in turn is connected to battery 6000 via cable 6100. In this embodiment, camera 2500 is connected to computer 5000 while the snapshots are taken.
Once the desired snapshots are taken, the snapshots can be downloaded to computer 5000. Once the snapshots are downloaded to computer 5000, the technician may view the snapshots on display unit 4000. The technician can then annotate the snapshots using a touch screen display unit 4000. For example, the snapshots taken with the detailed inspection camera 2500 can be annotated using the Netmeeting software application, available from Microsoft, Inc., One Microsoft Way, Redmond, Wash., 98052-6399. Netmeeting is preferred because of its “whiteboarding” feature, which permits individuals using the Netmeeting software to bring up a bitmap image, e.g., the snapshot taken by the detailed inspection camera 2500, and share the ability to mark-up and annotate the image. In the present invention, the use of this “whiteboarding” feature permits live collaboration and allows the technician and remote expert to mark-up and annotate the snapshot in real time, thus allowing both the technician and remote expert to view the annotations as they are made. For example, the remote expert could highlight areas of concern or point out a desired location to position probe 1000 on the snapshot while the snapshot is being viewed by the technician. The annotations made to the snapshots may then be stored for future reference.
In addition to Netmeeting, any other software application that allows the annotation of images in real time including, without limitation, PlaceWare, available from PlaceWare, Inc., 295 N. Bernardo Ave., Mountain View, Calif., and Microsoft Exchange, may be used in the present invention. Another software application that may be used for live collaboration is Infoworkspace, available from General Dynamics Electronic Systems, 100 Ferguson Drive, P.O. Box 7188, Mountain View, Calif., 94039-7188, which is a java-based software application that allows the use of a “thin-client” so that specialized collaboration software does not have to reside on computer 5000 and can be installed as needed.
In another embodiment of the present invention, the technician may use infrared camera 2900 to collect real time infrared video imagery and infrared images. These images may be downloaded and annotated in the same manner described above for the images taken with detailed inspection camera 2500. When infrared camera 2900 is used in lieu of detailed image camera 2500, infrared camera can be stored in case 2700. When infrared camera 2900 is used in conjunction with detailed inspection camera 2700, both cameras 2700 and 2900 may be stored in a single large case (not shown) supported from harness 8000 or infrared camera 2900 may be stored in a separate case 2200 that can be supported from harness 8000. Infrared camera 2900 used in this embodiment may be either Heat Find or Video Therm series cameras available from Monroe Infrared Technologies, 62 Portland Road, Suite 6, P.O. Box 1058, Kennebunk, Me. 04043. Other suitable infrared cameras also may be used.
In a preferred embodiment of the present invention, the remote expert may use a touch sensitive smart board (not shown) available from SMART Technologies, Inc., Suite 600, 1177-11th Ave. S.W., Calgary, Alberta, Canada (or a similar device), to annotate images.
In a preferred embodiment of the present invention, the detailed inspection camera 2500 is a 990 Nikon Cool Pix, available from Nikon, Inc., 1300 Walt Whitman Road, Melville, N.Y., 11747-3064. The 990 Nikon Cool Pix preferably is used as detailed inspection camera 2500 because of its sophisticated auto-flash capability, battery life, 3.3 Megapixel resolution, and USB output. However, any digital camera that is capable of taking high resolution still and video imagery, has low light sensitivity, has a long battery life, is rugged and water resistant, and preferably capable of sharing the power source of computer 5000 may be used as detailed inspection camera 2500.
In another embodiment of the present invention (not illustrated), a single camera used in place of camera 2000 and/or camera 2500 can be integrated into display unit 4000.
As shown in
Display unit 4000 is used to provide data to the technician and to exchange data between the technician and the remote expert. For example, after the technician has frozen images taken with camera 2000 or taken snapshots of the object of interest using detailed inspection camera 2500 and downloaded the images to computer 5000, display unit 4000 may be used to view the images. When display screen 4010 uses a TFT touch sensitive display surface, the technician may use the “whiteboarding” feature of Microsoft Netmeeting to make annotations using pen stylus 4020 on the image that can be viewed by the remote expert in real time. The data from the real time collaboration also may be stored for future reference.
Display unit 4000 may also be used by the technician to view technical manuals or other information regarding the object of interest. This technical information can include, without limitation, blueprints, interactive troubleshooting and maintenance procedures, electrical schematic diagrams, fault logic diagrams, fault isolation processes, and troubleshooting routines. Display unit 4000 may also be used by the technician to view the Property Data collected from the object of interest.
In a preferred embodiment of the present invention, display unit 4000 is a ViA II PC Pen Tablet with an Indoor Readable display, available from ViA, Inc., 12550 West Frontage Road, Ste. 201, Burnsville, Minn. 55337. The Indoor Readable display is preferred because of its backlight feature. A Sunlight Readable display, also available from ViA, Inc., may be used as display 4000 in situations where the present invention is being used outdoors where sunlight may interfere with the ability of the technician to view display screen 4010. In another embodiment of the present invention, a transflective screen, available from ViA, Inc., or a Hewlett Packard No Power display, available from Hewlett Packard, 3000 Hanover Street, Palo Alto, Calif. 94304-1185, may be used as display unit 4000.
As shown in
Also as shown in
Although not shown in
In another preferred embodiment of the present invention, a head mounted display 3300 may be used in lieu of or in conjunction with display 4000. As shown in
The present invention likewise may incorporate a wrist mounted keyboard (not shown), a wrist mounted finger mouse (not shown), or any other ergonomically adapted keyboard or mouse (not shown).
In a preferred embodiment, headset 3000 is an ANC100, available from Andrea Electronics Corp., 45 Melville Park Road, Melville, N.Y., 11747. In one embodiment, an analog audio cable (not shown) is used to connect headset 3000 to computer 5000. In another embodiment, a USB adaptor, preferably a C1-10166004, available from Andrea Electronics Corp., is used to permit headset 3000 to interface with computer 5000 using a USB interface. This embodiment uses digital audio, which can improve audio quality. In addition, any headset suitable for exchanging audio communication may be used as headset 3000.
As shown in
Accessory pouch 7200 preferably is an “accordion” pouch with two pockets and a hook and pile fastener tape flap. In addition to hook and pile fastener tape, any suitable fastening means including, without limitation, buttons, snaps, hooks, and clips may be used to close accessory pouch 7200.
Probe 1000, cameras 2000, 2500, and 2900, display unit 4000, computer 5000, battery 6000, and accessory pouch 7000 may be supported from outer belt 8200 by running outer belt 8100 through support loops (not shown) located on the inside surfaces of probe case 1200, camera cases 2200 and 2700, display housing 4200, computer housing 5200, battery housing 6200, and accessory pouch 7200. In a preferred embodiment of the present invention, hook and pile fastener tape patches sewn onto the support loops located on the inside surfaces of probe case 1200, camera cases 2200 and 2700, display housing 4200, computer housing 5200, battery housing 6200, and accessory pouch 7200 prevent the various components from sliding about inner belt 8200 because the hook and pile fastener tape patches on the support loops adhere to the outer hook and pile fastener tape surface of inner back support belt 8100. This preferred embodiment has the added benefit of allowing other components such as additional storage pockets to easily be supported from outer belt 8200. In addition, this embodiment allows for the reconfiguration, addition, or deletion of various components depending upon the technician's needs. In addition to this preferred embodiment, any fastening means including snaps, buttons, zippers and clips may be used to support the components from harness 8000.
As shown in
As shown in
Cable conduits 8610, 8620, and 8630 preferably are constrncted from two-sided hook and pile fastening tape. One edge of the tape is secured to harness 8000 using stitching or any other suitable fastening means including, without limitation, snaps, buttons, zippers, or clips. The other edge of the tape preferably remains free. The cable to be passed through the conduit preferably is rolled into the tape, enclosing the cable in the conduit. An advantage of using the hook and piling fastening tape in this embodiment is the ability to create an aperture at any point along the conduit to permit the cable to exit the conduit. Corresponding apertures may be made at other location throughout the cable conduits to permit the cables to be appropriately positioned.
In addition to the above example, any other suitable material may be used to construct cable conduits 8610, 8620, and 8630, and cable conduit may be positioned at any appropriate location on harness 8000.
Harness 8000 as shown in
Whereas the present invention has been described with respect to specific embodiments thereof, it will be understood that various changes and modifications will be suggested to one skilled in the art and it is intended that the invention encompass such changes and modifications as fall within the scope of the appended claims.