|Publication number||US6975898 B2|
|Application number||US 09/850,594|
|Publication date||Dec 13, 2005|
|Filing date||May 7, 2001|
|Priority date||Jun 19, 2000|
|Also published as||US20010055462, WO2001097902A2, WO2001097902A3, WO2001097902A9, WO2001097902B1|
|Publication number||09850594, 850594, US 6975898 B2, US 6975898B2, US-B2-6975898, US6975898 B2, US6975898B2|
|Inventors||Eric J. Seibel|
|Original Assignee||University Of Washington|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (23), Referenced by (202), Classifications (60), Legal Events (5)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This application is based on prior copending provisional patent application Ser. No. 60/212,411, filed on Jun. 19, 2000, the benefit of the filing date of which is hereby claimed under 35 U.S.C. § 119(e).
The present invention generally relates to an optical fiber system that conveys light to and from a region of interest (ROI) on or within a living body, and more specifically, to a system that is selectively used for both imaging the ROI to facilitate a diagnosis, and for delivering therapy to the ROI.
The burgeoning field of minimally invasive medical procedures (MIMPs) has increased the demand for systems that produce less tissue damage and trauma, faster recovery times, and lower risks to the patient. Ideally, the practitioner of MIMPs requires smaller instruments that perform a greater variety of functions. Furthermore, a “one-instrument-does-all” approach must add simplicity, not complexity, by ensuring that it is easy to use, minimizing the time required to master its operation.
The instruments used by practitioners of MIMPs typically include several different discrete systems for optical imaging, monitoring, maneuvering, sizing, diagnosis, biopsy, therapy, surgery, and non-visual monitoring/sensing. It would be preferable to combine the functions provided by these instruments in a single compact device to reduce the number of surgical ports that are currently required for a plurality of single-function tools. By employing an integrated multi-functional tool so that only one small port is used, the risks associated with repeatedly removing and inserting surgical tools can be dramatically reduced. Since most MIMPs require the practitioner to constantly monitor the procedure visually, optical imaging is considered a requirement for any fully integrated system for MIMPs. Thus, an appropriate multifunction instrument will most likely include an optical imaging system, and the imaging system should be integrated with one or more diagnostic, and/or therapeutic tools.
The current tools used for MIMPs cannot readily be integrated without increasing the size of the resultant instrument to an excessive degree. All commercial optical imaging systems that include a maneuverable flexible shaft must maintain a certain size (diameter) in order to preserve image quality. Currently, flexible scopes cannot be made smaller than this limit unless image field of view (FOV) or resolution is sacrificed. Although imaging and some diagnostic capability can be integrated into existing scopes, such as standard tissue imaging in combination with fluorescence for early detection of cancers, the optical systems of current flexible scopes cannot provide integrated diagnoses and therapies at the required degrees of performance, size, and price that will be demanded in the future by medical practitioners.
Current Technology Used for MIMPs
Presently available flexible scope designs use either a bundle of optical fibers (optical waveguides) and/or one or more cameras having an array of detectors to capture an image. Thus, the diameter of these flexible scopes employed for remote imaging cannot be reduced to smaller than the image size. Ignoring the optical fibers used for illumination, the scope diameter is therefore limited by the individual pixel size of a camera or by the diameter of optical fibers used to acquire the image. Currently, the smallest pixel element is determined by the size of the end of an optical fiber, which has a minimum core diameter of about 4 μm. To propagate light through an optical fiber, a surrounding cladding layer is required, increasing the minimum pixel size to more than 5 μm in diameter. If a standard VGA image is desired (e.g., with a resolution of 640×480 pixels), then a minimum diameter required for just the image optical fiber is more than 3 mm. Therefore, resolution and/or FOV must be sacrificed by having fewer pixel elements in order to achieve scopes with less than 3 mm overall diameter. All commercially available scopes suffer from this fundamental tradeoff between high image quality and small size.
Thus, it would be desirable to add diagnostic and therapeutic or surgical capability to a remote imaging system for the purpose of reducing the overall size of the instrument used for MIMPs. Since, for the reasons noted above, the current design for flexible scopes cannot readily be reduced in size without reducing imaging performance, the options for integrating diagnostic and therapeutic applications with an imaging system would appear to require an increase in the size of the instrument or use of separate instruments for each function. For example, a high intensity light source might be added to a general endoscopic surgical system to carry out photodynamic therapy (PDT) or laser surgery, or a polarized light source or other special light source might be needed for diagnosis and/or sensing a condition of an ROI. However, the white light illumination for standard endoscopic imaging is typically provided through an optical fiber bundle that diffusely illuminates the tissue and is incapable of providing a directed optical energy at high intensity and resolution to produce effective optical therapies, and will often not have the characteristics required for diagnostic processes. Therefore, any optical therapies that require directed illumination of high intensity light, such as PDT and laser surgery, or any diagnostic processes that also require a special light source cannot use existing optical designs for flexible imaging scopes, but instead, must rely on a second optical pathway and separate control mechanisms.
To perform diagnostic or therapeutic MIMPs, one or more separate instruments are used within the FOV of a standard endoscopic imager, and any additional separate instrument often must be held and maneuvered by a second medical practitioner. Typically, the second instrument provides a high intensity point source of light for optical therapies, a hot-tipped probe for thermal therapies, or a trocar used for mechanical cutting. The second instrument is moved to the surface of the tissue and usually moved within or across the surface of the tissue, covering the area of interest as the tool is scanned and manipulated by hand. These secondary instruments are inserted into the patient's body through a separate port, and thus, while being used, are viewed from a different point of view in the visual image. Furthermore, the therapeutic instrument often blocks the practitioner's direct view of the ROI with the imaging tool, making highly accurate therapies quite difficult for the medical practitioner to achieve. Significant amounts of training and practice are required to overcome these difficulties, as well as the capability to work with a reduced sense of touch that is conveyed through the shaft of an instrument having friction and a non-intuitive pivot at the point of entry. Thus, to work effectively with current imaging and therapeutic technologies, the practitioner of MIMPs must be highly trained and skilled.
Clearly, there is a need for an instrument that integrates imaging, diagnostic, and therapeutic functions, delivers these functions through a relatively small diameter, and is sufficiently intuitive to use as to require little training or skill. Ideally, the instrument should be implemented using a single optical fiber, but should still be capable of providing a sufficient FOV, good image size, and resolution, and should ensure that the ROI within a patient's body while administering therapy corresponds to that during imaging. Currently, none of the instruments available provide these capabilities and cannot be easily modified to provide such capabilities.
In accord with the present invention, apparatus is defined for selectively providing imaging, monitoring, sensing, screening, diagnosis, and therapy for an ROI in a patient. The apparatus preferably includes at least one light source. For example, a light source may be used to provide both an illumination light for imaging light, while another light source produces light of a substantially different characteristic than the imaging light for other uses. Or, the same light source can be used for both imaging and the other purpose. Also included is a light guide having a proximal end and a distal end. (Note that in the claims that follow, the term “light guide” or its plural form is used, and these terms will be understood to encompass optical fibers, thin film optical paths, and other devices and constructs for conveying light along a desired path.) The one or more light sources are optically coupled to the proximal end of the light guide, and the distal end of the light guide is adapted to be positioned adjacent to an ROI. A scanning actuator is disposed adjacent to the distal end of the light guide and causes the light from the one or more light sources that are conveyed through the light guide to scan the ROI. A light detector receives light from the ROI, producing a signal corresponding to an intensity of the light for use in producing an image of the ROI. Also included are a display on which the image of the ROI can be visualized by a user, and a control circuit that is operatively coupled to control the scanning actuator, the one or more light sources, and the light guide. The control circuit selectively energizes the one or more light sources to image the ROI and render at least one other function to the ROI. The other functions include diagnosing a condition, rendering therapy, sensing a condition, and monitoring a medical procedure—all in regard to the ROI.
In one embodiment of the present invention, a plurality of light sources emit light of different colors. The apparatus then further includes a combiner that combines the light of different colors emitted by the plurality of light sources for input to the proximal end of the light guide. Also, for this embodiment, the light detector includes a plurality of light sensors that are each sensitive to one of the different colors of light emitted by the plurality of light sources. In one form of this embodiment, the plurality of light sensors are disposed adjacent to the distal end of the light guide, while in another form of the embodiment, a plurality of light guides convey the imaging light reflected from the ROI to the plurality of light sensors. A quasi-stereo image of the ROI can be visualized by a user, by employing different portions of the plurality of light guides to convey the light reflected from spaced-apart areas in the ROI. A stereo display is then preferably included to enable a user to visualize the quasi-stereo image of the ROI.
One form of the scanning actuator includes a pair of electromechanical actuators that respectively move the distal end of the light guide in substantially transverse directions. In another embodiment, the scanning actuator comprises a piezoceramic actuator that is energized at a harmonic of a resonant frequency of the distal end of the light guide or electromechanical actuator.
In one configuration, the light guide comprises an optical fiber, and the distal end of the optical fiber is tapered to a substantially smaller cross-sectional size than a more proximal portion of the optical fiber, producing a tapered end that emits light having a substantially smaller point spread function (PSF) than light that would be emitted from a non-tapered end of an optical fiber.
In most embodiments of the present invention, at least one lens is disposed between the distal end of the light guide and the ROI, for focusing the imaging light and the light produced by the therapy light source onto the ROI. Preferably, to provide high resolution and a good FOV, a lens is mounted on the distal end of the light guide in one embodiment. In this configuration, as the scanning actuator drives the distal end of the light guide in a resonance mode to scan the ROI, the lens that is mounted on the distal end of the light guide has sufficient mass so that the lens generally rotates about a center of the lens as the light guide moves. The movement of the light guide changes the direction in which light is emitted from the lens, to scan the ROI.
In yet another embodiment, the light guide comprises a thin film optical waveguide that is optically coupled to the distal end of the light guide so that light emitted by the at least one light source is directed onto the ROI. The scanning actuator is then disposed adjacent to the thin film optical waveguide and moves the thin film optical waveguide, to cause the light to scan the ROI. Preferably, the thin film optical waveguide has a cross-sectional size less than 0.01 mm. It is also contemplated that a plurality of thin film optical waveguides can be used in parallel to convey light to and from the ROI.
In one embodiment, a polarizing filter is disposed between the at least one light source and the ROI, so that the ROI is illuminated with a polarized illumination light. For this embodiment, the light detector detects polarized light having a predefined axis of polarization.
In still another embodiment, the at least one light source provides one or more of a visible light, an ultraviolet (UV) light, and an infrared (IR) light as the illumination light. In connection with this embodiment, the light detector is responsive to a corresponding one or more of the visible light, UV light, and/or IR light. In regard to another alternative embodiment, the light detector is responsive to light emitted from the ROI due to either a phosphorescence or a fluorescence.
Either a spectrophotometer or a spectrum analyzer are preferably coupled to the light detector for use in determining a condition of the ROI. Optionally, a thermal detector (which may be an optical type of detector) is coupled to one of the proximal and distal ends of the light guide for use in monitoring a temperature in the ROI.
The apparatus also preferably includes means adapted for guiding and maneuvering the distal end of the light guide to the ROI within a patient. In some cases where it is necessary to stabilize the distal end of the light guide, a balloon disposed adjacent to the distal end of the light guide is inflated in a cavity or passage within a patient's body.
The foregoing aspects and many of the attendant advantages of this invention will become more readily appreciated as the same becomes better understood by reference to the following detailed description, when taken in conjunction with the accompanying drawings, wherein:
Prior Art Imaging Endoscopes
With reference to
A time series pixel endoscope 32, which is shown in
Scanning Devices Used in the Present Invention
In contrast to the prior art devices illustrated in
In addition, therapy can be rendered using scanning optical fiber 42. For example, by illuminating the points scanned by it using a relatively high powered laser, high intensity light PDT, or thermotherapy can be applied to the ROI. Since the signals produced by the RGB photon detectors correspond to successive points in the ROI, the image resulting from the signal that they produce is based upon a time series accumulation of image pixel data. Scanning optical fiber 42 is preferably a single mode or hollow optical fiber, of telecommunications grade or better. One significant advantage of this integrated system is that the mechanisms employed for generating the visual image are the same used for diagnostic, therapeutic, and surgical procedures. The method for imaging not only can match the image quality requirements for MIMPs, but can also achieve higher resolutions in a smaller package than existing imaging technology, so that a single, smaller, and more flexible system can be used for MIMPs. The relatively smaller scanning system reduces tissue trauma and expands the reach of MIMPs for use within adult, pediatric, and small animals. The directed optical illumination employed for image acquisition enables the most sophisticated diagnoses and therapies to be integrated into this single imaging system, (sharing the scan engine, display, and user interface). Integration may actually lower the cost of the equipment that would otherwise be required and/or decrease the time required to perform endoscopic MIMPs. The same benefits apply to each of the embodiments of the scanning system disclosed herein.
At the illumination plane, the beam of optical radiation is focused to achieve maximum intensity and/or optical quality, which is the goal for all modes of scanning. When tissue is coincident with the illumination plane, the optical irradiance is a function of the optical power and size of the light spot on the tissue. Thus, with regard to imaging, diagnoses, and therapy, the resolution of the MIMP is determined by this spot size at the image plane. With regard to image acquisition, the image resolution is determined by the illumination spot size, detector bandwidth (and scan rate), and signal-to-noise ratio (illumination intensity and collection efficiency), while image resolution is not limited by the physical size or number of the photon detectors.
Since diagnoses and therapies require accurate spatial discrimination, there is a need for directed illumination that is pre-calibrated before delivery. By integrating the optical imaging with diagnostic and therapeutic scanning, a medical practitioner can easily see the spatial discrimination of the optical scanning by viewing the displayed image before proceeding to diagnostic or therapeutic applications. Finally, the integration of computer image capture electronics and image processing software enables the image, diagnostic, and therapeutic data to be analyzed on a pixel-by-pixel basis. Since each pixel corresponds to the same area or volume of tissue, the single fiber integrated system maintains spatial registration for all three functions, imaging, diagnosis, and therapy. Consistent spatial registration from the same point of view for all three functions makes the single fiber system highly accurate and easy to use by medical practitioners of minimally invasive procedures.
The advantages afforded by using the integrated scanning device of the present invention for MIMPs are:
Externally, the illumination optics are supplied light from illumination sources and modulators as shown in a block 56. Further details concerning several preferred embodiments of external light source systems for producing RGB, UV, IR, and/or high intensity light conveyed to the distal end of an optical fiber system are disclosed below. A block 58 indicates that illumination sources, modulators, filters, and detectors are optionally coupled to the electromechanical scan actuator(s) inside the patient's body and to the scanner control actuators. Scanner motion detectors are used for controlling the scanning and produce a signal that is fed back to the scanner actuators, illumination source, and modulators to implement scanning control.
In a block 60, image signal filtering, buffering, scan conversion, amplification, and other processing functions are implemented using the electronic signals produced by the imaging photon detectors and for the other photon detectors employed for diagnosis/therapy, and monitoring purposes. Blocks 56, 58, and 60 are interconnected bi-directionally to convey signals that facilitate the functions performed by each respective block. Similarly, each of these blocks is bi-directionally coupled in communication with a block 62 in which analog-to-digital (A/D) and digital-to-analog (D/A) converters are provided for processing signals that are supplied to a computer workstation user interface employed for image acquisition, processing, for executing related programs, and for other functions. Control signals from the computer workstation are fed back to block 62 and converted into analog signals, where appropriate, for controlling or actuating each of the functions provided in blocks 56, 58, and 60. The A/D converters and D/A converters within block 62 are also coupled bi-directionally to a block 64 in which data storage is provided, and to a block 66. Block 66 represents a user interface for maneuvering, positioning, and stabilizing the end of the scanning optical fiber within a patient's body. Further description of a system for providing the stabilizing functions performed in this block are discussed below.
In block 64, the data storage is used for storing the image data produced by the detectors within a patient's body, and for storing other data related to the imaging and functions implemented by the scanning optical fiber. Block 64 is also coupled bi-directionally to the computer workstation and to interactive display monitor(s) in a block 70. Block 70 receives an input from block 60, enabling images of the ROI to be displayed interactively. In addition, one or more passive video display monitors may be included within the system, as indicated in a block 72. Other types of display devices, for example, a head-mounted display (HMD) system, can also be provided, enabling medical personnel to view an ROI as a quasi-stereo image.
Cantilevered Scanning Optical Fibers
A “zigzag” or rectilinear scanning optical fiber 80 is shown in
The zigzag or rectilinear embodiment shown in
Scanning actuators other than piezoelectric actuators can be employed to cause an optical fiber to move in a scanning mode. For example,
The cantilevered optical fiber emits light that passes through an imaging lens 104 and is focused on an imaging plane 106 corresponding to the ROI within a patient's body, producing a PSF 108 as indicated. As the cantilevered optical fiber is caused to move by electromechanical actuator 110, a PSF 108′ is formed at a different location on imaging plane 106.
Scanning Thin Film Light Waveguide Embodiments
It should be apparent that it is desirable to produce a scanning optical fiber with a smaller cross-sectional area than that shown in the embodiments of
In the thin film optical device, an optical fiber 144 having a cladding 142 is actuated using an electrostatic actuator 156. However, in this case, instead of causing an optical fiber to scan, electrostatic actuators 156 act on a thin film optical waveguide 150 that is supported on a raised ledge 148. A distal portion 152 of the thin film optical waveguide is thus caused to scan in the two orthogonal directions indicated by the curved arrows in
Tapered and Other Scanning Optical Fibers
Other techniques can also be used to produce a relatively small illumination PSF. For example, as shown in
As shown in
Other modes of scanning can also be achieved that differ from the linear mode, or the rectilinear or zigzag mode noted above.
A series of variable radii circles are produced in a circular scan mode, while in a spiral scan mode, the optical fiber produces a spiral scan in which the radius alternately increases and decreases. In either the circular or spiral scan modes, the distal end of optical fiber 208 scans an ROI to image the region and also renders therapy and/or diagnostic functions over the ROI. The whirling motion of the cantilevered optical fiber is controllably driven larger or smaller in diameter by increasing or decreasing the voltage applied to the four individual quadrants of piezoceramic tube actuator 206. A “propeller” scan mode 216 is illustrated in FIG. 5E. In this scanning mode, the scanning optical fiber moves back and forth along different diameters of a circle, scanning the ROI. The rotation of the linear scan can be generated from the two axis piezoceramic tube actuator or by simply rotating a single-axis actuator about the longitudinal axis of the optical fiber.
To achieve a maximum numbers of pixels across the widest FOV, for imaging, diagnosis, and therapy, a diffraction-limited spot of illumination must be formed by the lens system. Assuming an ideal scanning optical fiber, the spatial resolution of the delivered illumination is limited by the projected optical point source size and the diffraction-limited or aberration-limited performance of the lens system. When an optical system is aberration-limited, the main purpose of a secondary imaging lens or a small lens 228 at the fiber tip in
Theoretically, only a single light detector is required to collect the backscattered scanned light, to generate a monochrome or black and white image. A simple method for generating a full-color image is to use three light detectors (as noted above), each covered with a different filter selected for blue, green, or red light transmission. Silicon-based semiconductor photodiodes (such as Si-PIN type) are preferred for visible and near IR light detection because of their high sensitivity, low cost, small size, high speed, and ruggedness. Photodiodes used routinely in the telecommunications industry, such as InGaAs material photodiodes, are preferred for embodiment of the present invention that use IR optical detection. Since the resolution of the integrated optical scanning technique does not depend on size and number of light detectors, all available space at the distal end of the optical fiber assembly can be covered with light detectors for the purpose of increasing and discriminating between signal levels. As will be more apparent from the discussion that follows, the light detectors are preferably provided in stereo-pairs about the optic axis so that topographical features (e.g., shadows) of the ROI can be enhanced and glare from spectral reflections can be diminished. If IR radiation is used in conjunction with visible light, then light detectors of different light-sensitive materials can be used without filters (not shown). An alternative method for separating the spectral response of a light detector that is not filtered requires synchronizing the detector signal in time with an appropriate illumination source having a pulsed output. For example, the same visible light detector can be used without any filters if the RGB laser or other light sources are individually pulsed in rapid time series and in synchronicity with the processing of signals received from the light detectors.
Leads 234 extend from each of the light detectors to the proximal end of the optical fiber, which is external to the patient's body, to convey the electrical signals from the light detectors to the external instrumentation, as discussed above. Actuator 224 is driven with an electrical signal supplied through leads 236.
Further details helping to explain the motion of an optical fiber 244 that is driven into vibration by an actuator such as actuator 224 are shown in
Optical Fiber Systems for Imaging and Spectral or Polarized Light Analysis
Another system 271 in accord with the present invention is illustrated in FIG. 6B. In system 271, an optical fiber bundle 250 is arrayed concentrically around optical fiber 256 and is coupled to a spectrophotometer 272 that uses a prism/grating and an array of spectral detectors to measure the spectra of light received from the ROI. The output signals from spectrophotometer 272 are input to a computer workstation and spectrum analyzer 274, which produces a full color image on an RGB video display 276. Also, computer workstation and spectrum analyzer 274 is connected to a spectral display 278 that can be employed for spectral analysis and diagnoses of the ROI. An integrated display of both a standard endoscopic image and spectral mapping, and any additional diagnostic/screening information can be shown together in a multitude of modalities 279, such as text, pseudo-color overlays, audio enhancement, stereoscopic viewing, etc. As in system 266, a portion of the optical fiber system that is disposed within a patient's body is indicated within a dash line rectangle.
To control optical fiber scanning, additional light detectors and emitters can be employed adjacent (along or adjacent) to the scanning optical fiber to detect the motion and position (or frequency and speed) of the optical fiber distal tip over time. As shown in
Spatial resolution of the scanning optical fiber system that produces directed illumination for therapy depends on the number of distinguishable spots of light that can be projected onto the illumination image plane. The resolution depends on the minimum spot size while FOV depends on the maximum scan angle (total number of distinguishable spots). When acquiring images, spatial resolution also depends on the bandwidth of the photon detectors, (assuming sufficient signal-to-noise ratio), and the total number of pixels available in the display system. By operating within bandwidth limitations of the scanning system components, the resolution and FOV can be changed dynamically, enabling features such as zooming or dynamic magnification of the ROI. In many applications, both the ROI and the single optical fiber system are stationary (other than the scanning distal end of the optical fiber), reducing the likelihood of introducing any blurring from scanning well below the refresh rate of the display device. By scanning slower than standard video rates, the optical system can deliver higher power levels for optical therapies and allow longer times for signal integration from weak-signal fluorescence diagnoses. Thus, the dynamic range of the scanning optical system can be optimized according to the system components and application requirements.
Illumination may only occur in one or a few pixels per frame. For example, real-time optical biopsies can be carried out with the present invention at single points in an ROI, enabling very bright flashes of light excitation to be used and providing time for spectroscopic acquisition and spectral mapping over the normal image.
A schematic diagram illustrating a light source system 340 for producing light of different spectral composition that is coupled into an optical fiber 360 is illustrated in FIG. 7A. In this embodiment, a red light source 342, a green light source 344, a blue light source 346, and an UV light source 348 are each selectively coupled into optical fiber 360. Attenuators 350 are provided for each of the light sources so that the intensity of the light they produce can be selectively controlled. Three dichroic mirrors 352, 354, and 356 that include coatings specific to the color of light emitted by each of the corresponding green, blue, and UV light sources are positioned within the light path to reflect green, blue, and UV light, respectively, into the proximal end of optical fiber 360. Light that is outside the reflectance waveband for each of these dichroic mirrors is passed through the dichroic mirror and is focused by a lens 358 into the proximal end of optical fiber 360.
An alternative light source system 362 is illustrated in FIG. 7B. In this embodiment, red, green, and blue light sources 342, 344, and 346, respectively, are coupled through optional attenuators 350 to a series or sequence of optical couplers 366 through lenses 364. Lenses 364 focus the light from each of the different colored light sources into optical fibers 365, which convey the light to optical couplers 366. In addition, an IR source 368 transmits light through an optional attenuator 350 and a lens 364 into optical fiber 365, which conveys the IR light to the last optical coupler in the sequence. Optical detectors 370 are provided for monitoring the light intensity levels or power levels for each of the different sources of light, enabling the intensity of the various light sources to be controlled. From the last optical coupler, an optical fiber 367 conveys light to an input to optical detectors 370, while the output from the last optical coupler is input to the proximal end of optical fiber 360 for input to a patient's body. To produce the smallest affective source size, the optical fiber that would be chosen in
A multi-spectral component laser light source system 380 is illustrated in FIG. 7C. In this system, a tunable wavelength IR laser 382 produces IR light that passes through an optional frequency multiplier 384 and into a shutter and power meter 386. The shutter and power meter can be controlled to modulate the intensity of the IR light and also to control whether it is applied to the proximal end of an optical fiber 402 that leads into a patient's body. Alternatively, tunable wavelength IR laser 382 can be frequency multiplied to emit shorter wavelength light. In addition, a green laser 388 produces green coherent light that passes through one of a plurality of shutters 390, while a blue laser 392 produces blue coherent light also controlled by a shutter 390. Similarly, a red laser 396 produces red coherent light. A plurality of dichroic reflectors 394 are used to convey the light from the various laser sources through a lens 398, which focuses the light into a tapered hollow glass tube 400. The angle of the taper of the tapered hollow glass tube is such that internal reflections on its inner surface cause the light from each of the laser sources to be “funneled” into the proximal end of optical fiber 402. The funneled light of combined wavelengths can be transferred to a solid core or hollow core optical fiber for delivery to the tissue in the ROI at the distal end of the optical fiber. Although the light from each of the laser sources might well be of relatively high intensity for therapeutic or diagnostic purposes, tapered hollow glass tube 400 is easily capable of combining the high powered signals from the laser sources. Further details of the hollow glass funnel are provided in a paper entitled “Ultraviolet, Visible, and Infrared Laser Delivery Using Laser-To-Fiber Coupling Via a Grazing-Incidence-Based Hollow Taper,” by I. Ilev and R. W. Waynant, from the proceedings of the EOS/SPIE/ELA European Biomedical Optics Week—EbiOS 2000, Amsterdam, the Netherlands, Jul. 4, 2000. This paper will also be published in 2001 as Volume 4158 of the “Proceedings of the SPIE, Biomonitoring and Endoscopy Technologies.” Also see “Uncoated Hollow Taper as a Simple Optical Funnel for Laser Deliver,” by I. Ilev and R. W. Waynant, Review of Scientific Instruments, Vol. 70, No. 10, pp. 3840-3843 (1999).
Functional Block Diagrams
In addition, image analysis software for carrying out spectral and multivariate analysis and for locating and calculating the limits of regions of interest are carried out using the computer workstation or other computing device. In regard to the ROI, the computations may determine its distribution, boundary, volume, color, and optical density, and based upon the data collected from the ROI, can determine a tissue disease state, medical staging, as well as calculate and monitor therapeutic dosage. All of these functions are indicated in a block 444, which may use the normal imaging computer workstation of block 440. Block 444 is coupled to a block 446, in which additional interactive displays and image overlay formats are provided. Associated with block 444 is a block 448, which indicates that scanner power and control electronics are provided for actuating the electromechanical scanner and for receiving signals from servo sensors in a block 450, which are used for both normal image acquisition and enhancements involved in screening, monitoring, and diagnosis, as well as pixel accurate delivery of therapy.
Various embodiments of optical fiber scanning actuators have been described above. A block 454 indicates that provision is made for manual control of the distal tip of the scanning optical fiber, to enable the optical fiber to be inserted into a patient's body and positioned at a desired location adjacent an ROI. The manual control will include a turning device and servo sensors, as indicated in a block 456 to facilitate the introduction of the scanning optical fiber at the desired location. Once positioned, automatic vibration compensation is provided, as noted in a block 452 to stabilize the image in regard to biological motion (breathing and cardiovascular movement) and physical movement of the patient. In addition, other mechanisms are provided in at least one embodiment that is disclosed below for stabilizing the optical fiber where desired within a body cavity or passage within a patient's body.
Details of the various functions that can be implemented with the present invention as follows:
Integrated Imaging, Screening, and Diagnosis
It is contemplated that one of the two displays might be a touch screen monitor that enables the medical practitioner to select (draw the outline) of an ROI for laser surgery. Since the image may be moving, the touch screen monitor will require the image to be captured and frozen in time. However, once this ROI is outlined, image segmentation and object recognition algorithms may be implemented to keep the ROI highlighted during real-time image acquisition and display. The touch screen monitor can provide sidebar menus for the practitioner to set parameters for the laser therapies, such as power level and duration of laser radiation exposure. The second display would not provide interactivity, but is preferably a high resolution monitor displaying the real-time optical image in full-color or grayscale. If IR photon detectors are integrated into the endoscope, the high resolution display with pseudo-color will allow the practitioner to monitor the progress of laser therapies, such as tissue heating and/or tissue irradiation in laser surgery.
The scanning optical fiber is positioned at a desired location within the patient's body, opposite ROI 486, using guide wires or a cannula (not shown) and a manual controller that facilitates tip navigation and stabilization, as indicated in a block 466. Within ROI 486, optical biopsy “spots” 485 illustrate the spatial and temporal distribution of single-point spectral measurements to diagnose for disease. These spots are distributed much like the current practice of invasively taking tissue samples for in vitro biopsy analysis. Each spot may be analyzed spectroscopically during a frame cycle of the optical scanner, separating t1 and t2 by, for example, about 1/30 second. In addition to the image provided by the scanning optical fiber, IR thermal photodetectors (and an optional temperature monitor) as indicated in a block 468 could be included for receiving IR signals from the ROI.
To facilitate control of the motion of the scanning optical fiber or light waveguide, electrical power for microsensors and control electronics are provided, as indicated in a block 470. The signals provided by the control electronics enable amplitude and displacement control of the optical fiber when the actuator that causes it to scan is controlled by both electrical hardware and software within block 470. A spectrophotometer and/or spectrum analyzer 474 is included for diagnostic purposes, since the spectral composition of light received from ROI 486 and distribution of optical biopsy locations 485 can be used for screening and diagnosis for such diseases as cancer to a medical practitioner in evaluation of the condition of the ROI, based upon spectral photometric analysis. To illuminate the ROI so that it can be imaged, red, green, and blue light sources 476, 478, and 480 are combined and the light that they produce is conveyed through the optical fiber system to scanning optical fiber 484. The light source used for spectral analysis may be a high power pulse from one of the RGB light sources (e.g., lasers), or a secondary laser or white light source. Since signal strength, time, and illumination intensity are limiting, a repeated single-point spectroscopic method will be initially employed, using flash illumination. In addition, the same or a different high power laser source 482 can be employed to administer therapy, such as PDT, the laser ablation of tumors, and other types of therapy rendered with a high intensity source.
In using system 460, a medical practitioner navigates and maneuvers the flexible single scanning optical fiber component to an appropriate region of a patient's body while watching the high resolution color monitor displaying the standard, full-color endoscopic image. The search for tumors and/or pre-cancerous lesions begins by watching the monitor. A second monitor (not separately shown) included with spectrophotometer and spectrum analyzer 474 displays a fluorescence mapping in pseudo-color over a grayscale version of the endoscopic image. When an ROI is found, such as abnormal appearing tissue, the flexible endoscope is mechanically stabilized (as explained below). The ROI is centered within the FOV, then magnified using the multi-resolution capability provided by the present invention. The size of the ROI or tumor is estimated and a pixel boundary is determined by image processing either the visible image or the fluorescence image. If spectroscopic diagnosis is required, such as LIFS, the distribution of optical biopsy points is estimated along with illumination levels, The diagnostic measurements are performed by delivering the illumination repeatedly over many imaging frames automatically. The user can cease the diagnosis or have the workstation continue to improve signal-to-noise ratio and/or density of sampling until a clear diagnosis can be made. The results of diagnosis is expected to be in real-time and overlaid on top of the standard image.
If optical therapy is warranted, such as PDT, then an optical radiation exposure is determined and programmed into the interactive computer workstation controlling the scanning optical fiber system. The PDT treatment is an optical scan of high intensity laser illumination typically by high power laser source 482, pre-selected for the PDT fluorescent dye, and is controlled using dichroic filters, attenuators, and electromechanical shutters, as explained above. In a frame-sequential manner, both fluorescence images and visible images are acquired during PDT treatment. The medical practitioner monitors the progress of the PDT treatment by observing these acquired images on both displays.
With reference to
When using system 460′, a medical practitioner again searches for tumors by moving the flexible tip of single scanning optical fiber while watching high resolution color monitor 464 that shows the visible wavelength (full-color) image. When a tumor is found, the scanning optical fiber is mechanically stabilized. Again, the ROI is centered within the FOV, and then magnified with the multi-resolution capability. However, if the surrounding tissue is moving so the acquired image is not stationary, a snapshot of the image is captured and transferred to the interactive computer workstation monitor, which is a touch screen type display. The boundary of the stationary ROI is outlined on the touch screen, and a volume of the tumor is estimated from a diameter measurement in pixels and a distance measurement between the scope and the tissue using IR optical phase detector for range finding 492. An optical biopsy is taken with UV-visible biopsy light source 494, which can be a fiber-coupled arc lamp for elastic scattering spectroscopy (ESS). If warranted for this tumor, the optical radiation exposure is calculated, and a treatment protocol is programmed into interactive computer workstation monitor 462. For maintaining image stabilization, digital image processing algorithms can be calibrated for automatically segmenting this ROI or processing to eliminate motion artifacts from the acquired images in real-time, which may be equivalent or less than the display frame rate. The laser surgical treatment of cauterization can occur with high intensity laser 482 (IR) that is optically coupled with the visible optical sources. If the IR range finding option is not required, but an IR temperature monitor or laser monitor is desired, then the IR source can instead be used for these alternative monitoring functions. In a frame-sequential manner, both the IR and visible images are acquired during the laser surgery and cauterization. The IR image is either a mapping of the back scatter from the laser illumination as it scans the ROI or a thermal image of the ROI, which can be displayed on the interactive computer display as pseudo-color over a grayscale visible image. The medical practitioner monitors the progress of the IR radiation treatment by observing these acquired images on both the high resolution and touch screen display monitors.
Stabilization and Scanning Without a Lens
Since rendering therapy and diagnosis, as well as imaging an ROI requires a relatively stable platform for the scanning optical fiber, it is sometimes important to provide a mechanism for stabilizing the scanning optical fiber within a body passage 510, as shown in FIG. 10. In this view, an optical fiber assembly 500 includes an inflatable balloon 504, which is inflated through a lumen (not shown) included within the optical fiber assembly. By inflating balloon 504 so that it contacts the sides of passage 510, the disposition of optical fiber assembly 500 becomes fixed relative to the passage. An ROI 514 on a wall 512 of the passage can then be imaged. The scanning optical fiber can then image and render diagnostic, therapy, and/or monitoring functions in regard to the ROI without concern that the distal end of the optical fiber assembly may move substantially relative to the ROI. However, this method will not eliminate relative tissue motions, often produced by breathing and blood flow. An electronic method of stabilizing the ROI is to electronically freeze the image on an interactive touch-sensitive display screen, marking the boundary of the ROI on the touch-sensitive screen, and using image segmenting and processing algorithms to record threshold levels of this ROI. By running these algorithms on the acquired images and tracking the ROI, the boundary can be maintained during relative tissue motions for accurate therapeutic applications.
While the embodiments of the scanning optical fiber or light waveguide disclosed above have in each case included either an imaging or a scan lens, it is also possible to construct a scanning optical fiber that does not use either the imaging or scan lenses of these other embodiments. As shown in
Retrofitting a Rigid Endoscope with Scanning Optical Fiber System
It has been recognized that a scanning optical fiber in accord with the present invention can be implemented as a retrofit to existing high resolution rigid endoscope systems, such as an endoscope 540 shown in FIG. 12. As shown in
It will be understood that in a conventional rigid endoscope, a ring of optical fibers is typically used for providing a diffuse white light illuminating the ROI. In the retrofit endoscope of
Although the present invention has been described in connection with the preferred form of practicing it and modifications thereto, those of ordinary skill in the art will understand that many other modifications can be made to the present invention within the scope of the claims that follow. Accordingly, it is not intended that the scope of the invention in any way be limited by the above description, but instead be determined entirely by reference to the claims that follow.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4410235||Aug 7, 1980||Oct 18, 1983||Siemens Aktiengesellschaft||Device for producing a moving light beam|
|US4768513 *||Mar 30, 1987||Sep 6, 1988||Agency Of Industrial Science And Technology||Method and device for measuring and processing light|
|US5074642||Nov 14, 1989||Dec 24, 1991||Hicks John W||Multifiber endoscope with fibers having different indices of refraction|
|US5172685 *||Feb 12, 1992||Dec 22, 1992||The University Of Connecticut||Endoscope and video laser camera system therefor|
|US5247174||Apr 25, 1991||Sep 21, 1993||Scitex Corporation Ltd.||Laser scanning apparatus having a scanning beam and a reference beam|
|US5272330||Aug 4, 1992||Dec 21, 1993||At&T Bell Laboratories||Near field scanning optical microscope having a tapered waveguide|
|US5394500||Dec 22, 1993||Feb 28, 1995||At&T Corp.||Fiber probe device having multiple diameters|
|US5425123||Jul 20, 1993||Jun 13, 1995||Hicks; John W.||Multifiber endoscope with multiple viewing modes to produce an image free of fixed pattern noise|
|US5480046||May 20, 1994||Jan 2, 1996||At&T Corp.||Fiber probe fabrication having a tip with concave sidewalls|
|US5570441||May 20, 1994||Oct 29, 1996||At&T Corp.||Cylindrical fiber probes and methods of making them|
|US5703979||Oct 26, 1995||Dec 30, 1997||Lucent Technologies Inc.||Cylindrical fiber probe devices|
|US5715337||Sep 19, 1996||Feb 3, 1998||The Mirco Optical Corporation||Compact display system|
|US5727098||Jan 6, 1995||Mar 10, 1998||Jacobson; Joseph M.||Oscillating fiber optic display and imager|
|US6046720||May 4, 1998||Apr 4, 2000||University Of Washington||Point source scanning apparatus and method|
|US6091067||Jun 2, 1998||Jul 18, 2000||Science Applications International Corporation||Scanning device using fiber optic bimorph|
|US6161035||Apr 29, 1998||Dec 12, 2000||Asahi Kogaku Kogyo Kabushiki Kaisha||Fluorescence diagnostic apparatus|
|US6211904||Apr 6, 2000||Apr 3, 2001||Edwin L. Adair||Surgical devices incorporating reduced area imaging devices|
|US6294775||Oct 22, 1999||Sep 25, 2001||University Of Washington||Miniature image acquistion system using a scanning resonant waveguide|
|US6327493||Aug 27, 1998||Dec 4, 2001||Olympus Optical Co., Ltd.||Light scanning devices of a water-tight structure to be inserted into a body cavity to obtain optical information on inside of a biological tissue|
|US20010055462 *||May 7, 2001||Dec 27, 2001||Seibel Eric J.||Medical imaging, diagnosis, and therapy using a scanning single optical fiber system|
|US20020064341 *||Nov 26, 2001||May 30, 2002||Fauver Mark E.||Micro-fabricated optical waveguide for use in scanning fiber displays and scanned fiber image acquisition|
|EP1142529A1||Oct 4, 2000||Oct 10, 2001||Olympus Optical Co., Ltd.||Optical scanning probe system|
|JP2001174744A||Title not available|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7257437 *||Mar 25, 2003||Aug 14, 2007||The Regents Of The University Of California||Autofluorescence detection and imaging of bladder cancer realized through a cystoscope|
|US7315678 *||Dec 13, 2005||Jan 1, 2008||California Institute Of Technology||Method and apparatus for low-loss signal transmission|
|US7372642||Sep 8, 2006||May 13, 2008||3M Innovative Properties Company||Three-channel camera systems with non-collinear apertures|
|US7414729||Apr 12, 2006||Aug 19, 2008||President And Fellows Of Harvard College||System and method for coherent anti-Stokes Raman scattering endoscopy|
|US7435217 *||Apr 16, 2007||Oct 14, 2008||Microvision, Inc.||Scanned beam imagers and endoscopes with positionable light collector|
|US7447415||Dec 15, 2006||Nov 4, 2008||University Of Washington||Attaching optical fibers to actuator tubes with beads acting as spacers and adhesives|
|US7476197 *||Dec 4, 2006||Jan 13, 2009||Microvision, Inc.||Scanned beam imagers and endoscopes utilizing multiple light collectors|
|US7522813||Oct 4, 2007||Apr 21, 2009||University Of Washington||Reducing distortion in scanning fiber devices|
|US7558455||Jun 29, 2007||Jul 7, 2009||Ethicon Endo-Surgery, Inc||Receiver aperture broadening for scanned beam imaging|
|US7566173 *||Jul 9, 2007||Jul 28, 2009||Alcon, Inc.||Multi-spot ophthalmic laser probe|
|US7583872||Apr 5, 2007||Sep 1, 2009||University Of Washington||Compact scanning fiber device|
|US7608842||Apr 26, 2007||Oct 27, 2009||University Of Washington||Driving scanning fiber devices with variable frequency drive signals|
|US7616321 *||Jul 8, 2003||Nov 10, 2009||Infraredx, Inc.||Optical coupler for rotating catheter|
|US7634305 *||Dec 17, 2003||Dec 15, 2009||Given Imaging, Ltd.||Method and apparatus for size analysis in an in vivo imaging system|
|US7646550||Sep 8, 2006||Jan 12, 2010||3M Innovative Properties Company||Three-channel camera systems with collinear apertures|
|US7680373||Sep 13, 2006||Mar 16, 2010||University Of Washington||Temperature adjustment in scanning beam devices|
|US7713265||Dec 22, 2006||May 11, 2010||Ethicon Endo-Surgery, Inc.||Apparatus and method for medically treating a tattoo|
|US7738762||Oct 20, 2008||Jun 15, 2010||University Of Washington||Attaching optical fibers to actuator tubes with beads acting as spacers and adhesives|
|US7746568||Jun 29, 2010||3M Innovative Properties Company||Three-channel camera systems with non-collinear apertures|
|US7784697||Jan 3, 2008||Aug 31, 2010||University Of Washington||Methods of driving a scanning beam device to achieve high frame rates|
|US7785202||Jun 16, 2009||Aug 31, 2010||Sternberg Aaron B||Damage resistant manual controller|
|US7819591||Oct 26, 2010||3M Innovative Properties Company||Monocular three-dimensional imaging|
|US7889343 *||Jul 1, 2005||Feb 15, 2011||Centre National De La Recherche Scientifique (C.N.R.S.)||Method and system for optical detection of nano-objects in a light refracting medium|
|US7920312||Apr 5, 2011||Optiscan Pty Ltd.||Optical fiber scanning apparatus|
|US7925333||Aug 28, 2007||Apr 12, 2011||Ethicon Endo-Surgery, Inc.||Medical device including scanned beam unit with operational control features|
|US7952718||May 31, 2011||University Of Washington||High resolution optical coherence tomography based imaging for intraluminal and interstitial use implemented with a reduced form factor|
|US7982776||Jul 13, 2007||Jul 19, 2011||Ethicon Endo-Surgery, Inc.||SBI motion artifact removal apparatus and method|
|US7983739||Aug 27, 2007||Jul 19, 2011||Ethicon Endo-Surgery, Inc.||Position tracking and control for a scanning assembly|
|US7995045||Aug 9, 2011||Ethicon Endo-Surgery, Inc.||Combined SBI and conventional image processor|
|US8009291 *||Aug 30, 2011||Samsung Electronics Co., Ltd.||Sensor for measuring living body information and keypad assembly using the same|
|US8050520||Nov 1, 2011||Ethicon Endo-Surgery, Inc.||Method for creating a pixel image from sampled data of a scanned beam imager|
|US8078262 *||Apr 15, 2002||Dec 13, 2011||The Johns Hopkins University||Method for imaging and spectroscopy of tumors and determination of the efficacy of anti-tumor drug therapies|
|US8094354||Jul 21, 2010||Jan 10, 2012||Hoya Corporation||Scanning objective lens, scanning probe and scanning endoscope|
|US8096943||Dec 4, 2006||Jan 17, 2012||University Of Washington Through Its Center For Commercialization||Flexible endoscope tip bending mechanism using optical fiber as compression member|
|US8160678||Jun 18, 2007||Apr 17, 2012||Ethicon Endo-Surgery, Inc.||Methods and devices for repairing damaged or diseased tissue using a scanning beam assembly|
|US8175687 *||Dec 5, 2006||May 8, 2012||Korea Electro Technology Research Institute||Light source for fluorescence diagnosis and photodynamic therapy|
|US8212884||Jul 3, 2012||University Of Washington||Scanning beam device having different image acquisition modes|
|US8214010||Jul 3, 2012||Sunnybrook Health Sciences Centre||Scanning mechanisms for imaging probe|
|US8216214||Mar 12, 2007||Jul 10, 2012||Ethicon Endo-Surgery, Inc.||Power modulation of a scanning beam for imaging, therapy, and/or diagnosis|
|US8273015||May 16, 2007||Sep 25, 2012||Ethicon Endo-Surgery, Inc.||Methods for imaging the anatomy with an anatomically secured scanner assembly|
|US8285015||Jul 2, 2008||Oct 9, 2012||Lawrence Livermore Natioonal Security, LLC||Simultaneous acquisition of differing image types|
|US8305432||Jan 10, 2007||Nov 6, 2012||University Of Washington||Scanning beam device calibration|
|US8317776||Nov 27, 2012||The Invention Science Fund I, Llc||Circulatory monitoring systems and methods|
|US8332014||Apr 25, 2008||Dec 11, 2012||Ethicon Endo-Surgery, Inc.||Scanned beam device and method using same which measures the reflectance of patient tissue|
|US8348829 *||Dec 24, 2009||Jan 8, 2013||Hoya Corporation||Scanning endoscope apparatus, scanning endoscope, and scanning endoscope processor|
|US8351041||Nov 28, 2005||Jan 8, 2013||L'oreal||Method of observing biological tissue, in particular human skin|
|US8361097||Oct 19, 2011||Jan 29, 2013||Avinger, Inc.||Catheter system and method for boring through blocked vascular passages|
|US8396535||May 1, 2009||Mar 12, 2013||University Of Washington||Integrated optical scanning image acquisition and display|
|US8398240||Mar 19, 2013||Alcon Research, Ltd.||Single-fiber multi-spot laser probe for ophthalmic endoillumination|
|US8403881||May 19, 2008||Mar 26, 2013||The Invention Science Fund I, Llc||Circulatory monitoring systems and methods|
|US8409132||Apr 2, 2013||The Invention Science Fund I, Llc||Treatment indications informed by a priori implant information|
|US8411922||Nov 30, 2007||Apr 2, 2013||University Of Washington||Reducing noise in images acquired with a scanning beam device|
|US8437587||May 7, 2013||University Of Washington||Actuating an optical fiber with a piezoelectric actuator and detecting voltages generated by the piezoelectric actuator|
|US8439754||May 14, 2013||Aaron B. Sternberg||Impact resistant hand-gripped manual controller|
|US8460195||Jun 11, 2013||Sunnybrook Health Sciences Centre||Scanning mechanisms for imaging probe|
|US8466956||Dec 17, 2009||Jun 18, 2013||Hoya Corporation||Scanning endoscope processor and scanning endoscope apparatus|
|US8529441||Feb 12, 2009||Sep 10, 2013||Innurvation, Inc.||Ingestible endoscopic optical scanning device|
|US8537203||Nov 23, 2005||Sep 17, 2013||University Of Washington||Scanning beam with variable sequential framing using interrupted scanning resonance|
|US8548571||Dec 8, 2010||Oct 1, 2013||Avinger, Inc.||Devices and methods for predicting and preventing restenosis|
|US8553337||Nov 12, 2008||Oct 8, 2013||Cornell University||Multi-path, multi-magnification, non-confocal fluorescence emission endoscopy apparatus and methods|
|US8577445 *||Dec 12, 2003||Nov 5, 2013||Mauna Kea Technologies||Miniature confocal optical head with integrated scanning and confocal imaging system using same|
|US8580054||Apr 4, 2012||Nov 12, 2013||Lawrence Livermore National Security, Llc||Melt-castable energetic compounds comprising oxadiazoles and methods of production thereof|
|US8588564||May 10, 2010||Nov 19, 2013||Hoya Corporation||Confocal optical system|
|US8617058||Jul 9, 2009||Dec 31, 2013||Innurvation, Inc.||Displaying image data from a scanner capsule|
|US8626271||Apr 13, 2007||Jan 7, 2014||Ethicon Endo-Surgery, Inc.||System and method using fluorescence to examine within a patient's anatomy|
|US8636670||May 13, 2008||Jan 28, 2014||The Invention Science Fund I, Llc||Circulatory monitoring systems and methods|
|US8644913||Mar 28, 2012||Feb 4, 2014||Avinger, Inc.||Occlusion-crossing devices, imaging, and atherectomy devices|
|US8647259||Mar 28, 2011||Feb 11, 2014||Innurvation, Inc.||Ultrasound scanning capsule endoscope (USCE)|
|US8655431||May 31, 2011||Feb 18, 2014||Vanderbilt University||Apparatus and method for real-time imaging and monitoring of an electrosurgical procedure|
|US8675290||Feb 13, 2007||Mar 18, 2014||3M Innovative Properties Company||Monocular three-dimensional imaging|
|US8675291||Nov 9, 2011||Mar 18, 2014||3M Innovative Properties Company||Monocular three-dimensional imaging|
|US8693088 *||Mar 16, 2011||Apr 8, 2014||Ofs Fitel, Llc||Multicore transmission and amplifier fibers and schemes for launching pump light to amplifier cores|
|US8696695||Jan 19, 2010||Apr 15, 2014||Avinger, Inc.||Guidewire positioning catheter|
|US8712506||Jan 22, 2008||Apr 29, 2014||Sunnybrook Health Sciences Centre||Medical imaging probe with rotary encoder|
|US8774902||Apr 1, 2007||Jul 8, 2014||Passive Imaging Medical Systems Engineering Ltd. (Pims)||Method of infrared thermography for earlier diagnosis of gastric colorectal and cervical cancer|
|US8784321||Jan 22, 2008||Jul 22, 2014||Sunnybrook Health Sciences Centre||Imaging probe with combined ultrasound and optical means of imaging|
|US8792968||Sep 21, 2007||Jul 29, 2014||Song Xiao||System and method for health evaluation|
|US8801606||Jan 9, 2007||Aug 12, 2014||Ethicon Endo-Surgery, Inc.||Method of in vivo monitoring using an imaging system including scanned beam imaging unit|
|US8870813||May 22, 2008||Oct 28, 2014||The Invention Science Fund I, Llc||Circulatory monitoring systems and methods|
|US8872125||May 22, 2012||Oct 28, 2014||Lawrence Livermore National Security, Llc||Solution-grown crystals for neutron radiation detectors, and methods of solution growth|
|US8885033 *||Aug 12, 2013||Nov 11, 2014||Olympus Medical Systems Corp.||Endoscope system|
|US8894637||Jan 22, 2009||Nov 25, 2014||Board Of Regents, The University Of Texas System||Systems, devices and methods for imaging and surgery|
|US8903211 *||Jul 29, 2013||Dec 2, 2014||Ofs Fitel, Llc||Pump-combining systems and techniques for multicore fiber transmissions|
|US8915844 *||Aug 28, 2012||Dec 23, 2014||Fujifilm Corporation||Endoscope diagnostic apparatus|
|US8947514||Nov 16, 2009||Feb 3, 2015||Hoya Corporation||Endoscope system with scanning function|
|US8951244||Nov 15, 2010||Feb 10, 2015||Alcon Research, Ltd.||Multi-spot laser probe|
|US8957484||Feb 29, 2008||Feb 17, 2015||University Of Washington||Piezoelectric substrate, fabrication and related methods|
|US9014788||Feb 18, 2014||Apr 21, 2015||Vanderbilt University||Apparatus and method for real-time imaging and monitoring of an electrosurgical procedure|
|US9042967||May 20, 2009||May 26, 2015||University Health Network||Device and method for wound imaging and monitoring|
|US9066651||Sep 14, 2012||Jun 30, 2015||University Of Washington||Scanning beam device calibration|
|US9078580||Nov 6, 2013||Jul 14, 2015||Innurvation, Inc.||Displaying image data from a scanner capsule|
|US9079762 *||Sep 22, 2006||Jul 14, 2015||Ethicon Endo-Surgery, Inc.||Micro-electromechanical device|
|US9121947||Jan 15, 2013||Sep 1, 2015||Lawrence Livermore National Security, Llc||Stress reduction for pillar filled structures|
|US9125552||Jul 31, 2007||Sep 8, 2015||Ethicon Endo-Surgery, Inc.||Optical scanning module and means for attaching the module to medical instruments for introducing the module into the anatomy|
|US9125562||Jul 1, 2010||Sep 8, 2015||Avinger, Inc.||Catheter-based off-axis optical coherence tomography imaging system|
|US9161684||Sep 7, 2007||Oct 20, 2015||University Of Washington||Monitoring disposition of tethered capsule endoscope in esophagus|
|US9196056 *||Aug 15, 2014||Nov 24, 2015||Manufacturing Techniques, Inc.||Electro-optical system and method for analyzing images of a scene to identify the presence of a target color|
|US9274237||Apr 15, 2014||Mar 1, 2016||Lawrence Livermore National Security, Llc||Lithium-containing scintillators for thermal neutron, fast neutron, and gamma detection|
|US9309456||Apr 2, 2012||Apr 12, 2016||Lawrence Livermore National Security, Llc||Plastic scintillator with effective pulse shape discrimination for neutron and gamma detection|
|US9333036||Jan 21, 2011||May 10, 2016||Board Of Regents, The University Of Texas System||Systems, devices and methods for imaging and surgery|
|US20040006276 *||Mar 25, 2003||Jan 8, 2004||The Regents Of The University Of California||Autofluorescence detection and imaging of bladder cancer realized through a cystoscope|
|US20040010204 *||Mar 28, 2003||Jan 15, 2004||Pearl Technology Holdings, Llc||Electronic/fiberoptic tissue differentiation instrumentation|
|US20040082863 *||Mar 15, 2002||Apr 29, 2004||Mcgreevy James||Device and method for the photodynamic diagnosis of tumor tissue|
|US20040109636 *||Jul 8, 2003||Jun 10, 2004||Jeff Korn||Optical coupler for rotating catheter|
|US20040111032 *||Dec 4, 2002||Jun 10, 2004||Jeff Korn||Optical coupler for rotating catheter|
|US20040127785 *||Dec 17, 2003||Jul 1, 2004||Tal Davidson||Method and apparatus for size analysis in an in vivo imaging system|
|US20040236225 *||Apr 15, 2002||Nov 25, 2004||Murphy John C.||Method for imaging and spectroscopy of tumors and determination of the efficacy of anti-tumor drug therapies|
|US20050008253 *||Jul 10, 2003||Jan 13, 2005||Joseph Rozgonyi||Method and apparatus for eliminating irrelevant luminescent signals|
|US20050215861 *||May 18, 2005||Sep 29, 2005||Fuji Photo Film Co., Ltd.||Endoscope system having multiaxial-mode laser-light source or substantially producing multiaxial-mode laser light from single-axial-mode laser light|
|US20060056017 *||Dec 12, 2003||Mar 16, 2006||Mauna Kea Technologies||Miniature confocal optical head with integrated scanning and confocal imaging system using same|
|US20060165360 *||Dec 13, 2005||Jul 27, 2006||Peter Siegel||Method and apparatus for low-loss signal transmission|
|US20060239673 *||Mar 8, 2004||Oct 26, 2006||Roke Manor Research Limited||Camera illumination system|
|US20070051674 *||Nov 2, 2006||Mar 8, 2007||Bratten Jack R||Lift station and method|
|US20070060804 *||May 14, 2004||Mar 15, 2007||Thompson Marcelo S||System and method for therapy and diagnosis comprising optical components for distribution of radiation|
|US20070088219 *||Apr 12, 2006||Apr 19, 2007||Xie Xiaoliang S||System and method for coherent anti-stokes raman scattering endoscopy|
|US20070188601 *||Sep 8, 2006||Aug 16, 2007||Janos Rohaly||Three-channel camera systems with non-collinear apertures|
|US20070188769 *||Sep 8, 2006||Aug 16, 2007||Janos Rohaly||Three-channel camera systems with collinear apertures|
|US20070213618 *||Jan 17, 2007||Sep 13, 2007||University Of Washington||Scanning fiber-optic nonlinear optical imaging and spectroscopy endoscope|
|US20070216908 *||Mar 19, 2007||Sep 20, 2007||University Of Washington||Clutter rejection filters for optical doppler tomography|
|US20070244357 *||Dec 4, 2006||Oct 18, 2007||Wiklof Christopher A||Scanned beam imagers and endoscopes utilizing multiple light collectors|
|US20070244365 *||Apr 16, 2007||Oct 18, 2007||Microvision, Inc.||Scanned beam imagers and endoscopes with positionable light collector|
|US20070282190 *||Apr 1, 2007||Dec 6, 2007||D.P. Electronic Systems Ltd.||Method Of Infrared Thermography For Earlier Diagnosis Of Gastric Colorectal And Cervical Cancer|
|US20070296972 *||Jul 1, 2005||Dec 27, 2007||Centre National De La Recherche Scientifique (C.N.R.S.)||Method And System For Optical Detection Of Nano-Objects In A Light Refracting Medium|
|US20080004491 *||Jun 28, 2006||Jan 3, 2008||University Of Washington||Method for fabricating optical fiber|
|US20080039693 *||Aug 14, 2006||Feb 14, 2008||University Of Washington||Endoscope tip unit and endoscope with scanning optical fiber|
|US20080073163 *||Sep 22, 2006||Mar 27, 2008||Weir Michael P||Micro-electromechanical device|
|US20080077019 *||Sep 21, 2007||Mar 27, 2008||Song Xiao||System and method for health evaluation|
|US20080118886 *||Nov 21, 2006||May 22, 2008||Rongguang Liang||Apparatus for dental oct imaging|
|US20080125634 *||Jun 14, 2007||May 29, 2008||Cornova, Inc.||Method and apparatus for identifying and treating myocardial infarction|
|US20080132762 *||Dec 4, 2006||Jun 5, 2008||University Of Washington||Flexible endoscope tip bending mechanism using optical fiber as compression member|
|US20080167521 *||Jan 9, 2007||Jul 10, 2008||Sheetz Jane A||Method of in vivo monitoring using an imaging system including scanned beam imaging unit|
|US20080177138 *||Jan 22, 2008||Jul 24, 2008||Brian Courtney||Scanning mechanisms for imaging probe|
|US20080177139 *||Jan 22, 2008||Jul 24, 2008||Brian Courtney||Medical imaging probe with rotary encoder|
|US20080177183 *||Jan 22, 2008||Jul 24, 2008||Brian Courtney||Imaging probe with combined ultrasounds and optical means of imaging|
|US20080204900 *||May 8, 2008||Aug 28, 2008||3M Innovative Properties Company||Three-channel camera systems with non-collinear apertures|
|US20080226034 *||Mar 12, 2007||Sep 18, 2008||Weir Michael P||Power modulation of a scanning beam for imaging, therapy, and/or diagnosis|
|US20080242967 *||Mar 27, 2007||Oct 2, 2008||Ethicon Endo-Surgery, Inc.||Medical imaging and therapy utilizing a scanned beam system operating at multiple wavelengths|
|US20080252778 *||Apr 13, 2007||Oct 16, 2008||Ethicon Endo-Surgery, Inc.||Combined SBI and conventional image processor|
|US20080267472 *||Jul 2, 2008||Oct 30, 2008||Demos Stavros G||Simultaneous acquisition of differing image types|
|US20080269576 *||Dec 5, 2006||Oct 30, 2008||Uk Kang||Light Source for Fluorescence Diagnosis and Photodynamic Therapy|
|US20080275305 *||May 1, 2007||Nov 6, 2008||Ethicon Endo-Surgery, Inc.||Medical scanned beam imager and components associated therewith|
|US20080312490 *||Jun 18, 2007||Dec 18, 2008||Ethicon Endo-Surgery, Inc.||Methods and devices for repairing damaged or diseased tissue using a scanning beam assembly|
|US20090015894 *||Sep 13, 2007||Jan 15, 2009||Optiscan Pty Ltd||Optical fiber scanning apparatus|
|US20090015923 *||Jul 9, 2007||Jan 15, 2009||Auld Jack R||Multi-Spot Ophthalmic Laser Probe|
|US20090023999 *||Dec 29, 2004||Jan 22, 2009||Mauna Kea Technologies||Miniature optical head with integrated scanning for producing a homogeneous image and confocal imaging system using said head|
|US20090024191 *||Mar 3, 2006||Jan 22, 2009||University Of Washington||Multi-cladding optical fiber scanner|
|US20090033937 *||Jul 30, 2008||Feb 5, 2009||Jung-Taek Oh||Sensor for measuring living body information and keypad assembly using the same|
|US20090060381 *||Aug 31, 2007||Mar 5, 2009||Ethicon Endo-Surgery, Inc.||Dynamic range and amplitude control for imaging|
|US20090062658 *||Aug 27, 2007||Mar 5, 2009||Dunki-Jacobs Robert J||Position tracking and control for a scanning assembly|
|US20090062659 *||Aug 28, 2007||Mar 5, 2009||Weir Michael P||Medical device including scanned beam unit with operational control features|
|US20090177042 *||Jan 9, 2008||Jul 9, 2009||University Of Washington||Color image acquisition with scanning laser beam devices|
|US20090208143 *||Feb 19, 2008||Aug 20, 2009||University Of Washington||Efficient automated urothelial imaging using an endoscope with tip bending|
|US20090218641 *||Feb 29, 2008||Sep 3, 2009||Melville Charles D||Piezoelectric substrate, fabrication and related methods|
|US20090253510 *||Jun 16, 2009||Oct 8, 2009||Sternberg Aaron B||Damage resistant manual controller|
|US20090264768 *||Oct 22, 2009||Brian Courtney||Scanning mechanisms for imaging probe|
|US20090326381 *||Jun 27, 2008||Dec 31, 2009||Yuan yun-e||System and method to facilitate health evaluation and medical diagnosis of a human subject|
|US20100007718 *||Feb 13, 2007||Jan 14, 2010||Rohaly Jr Janos||Monocular three-dimensional imaging|
|US20100069760 *||Sep 17, 2009||Mar 18, 2010||Cornova, Inc.||Methods and apparatus for analyzing and locally treating a body lumen|
|US20100104880 *||Feb 13, 2008||Apr 29, 2010||Cornova, Inc.||Biocompatible polymers polymer, tie-coats-, methods of making and using the same, and products incorporating the polymers|
|US20100129027 *||Nov 9, 2009||May 27, 2010||Infraredx, Inc.||Optical Coupler for Rotating Catheter|
|US20100134608 *||Nov 24, 2009||Jun 3, 2010||Hoya Corporation||Endoscope system with scanning function|
|US20100157036 *||Dec 17, 2009||Jun 24, 2010||Hoya Corporation||Scanning endoscope processor and scanning endoscope apparatus|
|US20100168515 *||Dec 24, 2009||Jul 1, 2010||Hoya Corporation||Scanning endoscope apparatus, scanning endoscope, and scanning endoscope processor|
|US20100185099 *||Jan 18, 2010||Jul 22, 2010||Ann Johansson||System and method for therapy and diagnosis comprising in combination non-mechanical and mechanical distributors for distribution of radiation|
|US20100261958 *||Nov 12, 2008||Oct 14, 2010||Cornell University||Multi-path, multi-magnification, non-confocal fluorescence emission endoscopy apparatus and methods|
|US20100270479 *||Nov 12, 2008||Oct 28, 2010||Cornell University||Non-imaging, weakly focused fluorescence emission apparatus and method|
|US20100282954 *||Dec 22, 2008||Nov 11, 2010||Koninklijke Philips Electronics N.V.||optical probe|
|US20100286674 *||Jan 22, 2009||Nov 11, 2010||Board Of Regents, The University Of Texas System||Systems, devices and methods for imaging and surgery|
|US20100290100 *||Nov 18, 2010||Hoya Corporation||Confocal optical system|
|US20100323796 *||Aug 26, 2010||Dec 23, 2010||Sternberg Aaron B||Impact resistant hand-gripped manual controller|
|US20110019255 *||Jan 27, 2011||Hoya Corporation||Scanning objective lens, scanning probe and scanning endoscope|
|US20110106102 *||Nov 1, 2010||May 5, 2011||The Johns Hopkins University||Surgical Instrument and Systems with Integrated Optical Sensor|
|US20110122366 *||May 26, 2011||Smith Ronald T||Single-fiber multi-spot laser probe for ophthalmic endoillumination|
|US20110144627 *||Jun 16, 2011||Smith Ronald T||Multi-spot laser probe|
|US20110279888 *||Nov 17, 2011||Ofs Fitel, Llc||Multicore transmission and amplifier fibers and schemes for launching pump light to amplifier cores|
|US20120075639 *||Sep 23, 2011||Mar 29, 2012||Jeffrey Brennan||Imaging systems and methods incorporating non-mechanical scanning beam actuation|
|US20120226150 *||Nov 1, 2010||Sep 6, 2012||The Johns Hopkins University||Visual tracking and annotaton of clinically important anatomical landmarks for surgical interventions|
|US20120302828 *||Nov 29, 2012||Memorial Sloan Kettering Cancer Center||Apparatus, system and method for providing laser steering and focusing for incision, excision and ablation of tissue in minimally-invasive surgery|
|US20130053646 *||Feb 28, 2013||Hiroaki Yamamoto||Endoscope diagnostic apparatus|
|US20140036351 *||Jul 29, 2013||Feb 6, 2014||Ofs Fitel, Llc||Pump-Combining Systems And Techniques For Multicore Fiber Transmissions|
|US20140046409 *||Mar 29, 2013||Feb 13, 2014||Korea Electrotechnology Research Institute||Light source apparatus for photo-diagnosis and phototherapy|
|US20140049624 *||Aug 12, 2013||Feb 20, 2014||Olympus Medical Systems Corp.||Endoscope system|
|US20150049941 *||Aug 15, 2014||Feb 19, 2015||Manufacturing Techniques, Inc. (MTEQ)||Electro-Optical System and Method for Analyzing Images of a Scene to Identify the Presence of a Target Color|
|US20150282749 *||Apr 6, 2015||Oct 8, 2015||Surgisense Corporation||Apparatus, systems, and methods for mapping of tissue oxygenation|
|CN101485558B||Feb 27, 2009||Mar 23, 2011||浙江工商大学||Single-optical fiber multiphoton fluorescence scanning endoscope|
|CN101662980B||Jan 21, 2008||Feb 27, 2013||桑尼布鲁克健康科学中心||Scanning mechanisms for imaging probe|
|CN102124540B||May 18, 2009||Oct 23, 2013||谢菲尔德哈莱姆大学||Improvements to mass spectrometry|
|CN102770087A *||Sep 14, 2010||Nov 7, 2012||纪念斯隆-凯特林癌症中心||Apparatus, system and method for providing laser steering and focusing for incision, excision and ablation of tissue in minimally-invasive surgery|
|EP2096688A2||Feb 10, 2009||Sep 2, 2009||The University of Washington||Piezoelectric substrate, fabrication and related methods|
|EP2284593A2||Sep 14, 2007||Feb 16, 2011||Optiscan Pty Ltd||Optical fibre scanning apparatus|
|WO2007084915A2 *||Jan 17, 2007||Jul 26, 2007||University Of Washington||Scanning fiber-optic nonlinear optical imaging and spectroscopy endoscope|
|WO2007095307A1 *||Feb 13, 2007||Aug 23, 2007||3M Innovative Properties Company||Monocular three-dimensional imaging|
|WO2007121423A2 *||Apr 17, 2007||Oct 25, 2007||Microvision, Inc.||Scanned beam imagers and endoscopes with positionable light collector|
|WO2008039388A2 *||Sep 22, 2007||Apr 3, 2008||Pei Si Cai||System and method for health evaluation|
|WO2008039388A3 *||Sep 22, 2007||Dec 31, 2008||Pei Si Cai||System and method for health evaluation|
|WO2008073126A1 *||Dec 13, 2006||Jun 19, 2008||University Of Washington||Catheter tip displacement mechanism|
|WO2008077034A1 *||Dec 18, 2007||Jun 26, 2008||Ethicon Endo-Surgery, Inc||Spectral windows for surgical treatment through intervening fluids|
|WO2008086616A1 *||Jan 21, 2008||Jul 24, 2008||Sunnybrook Health Sciences Centre||Scanning mechanisms for imaging probe|
|WO2008112312A1 *||Mar 14, 2008||Sep 18, 2008||Geneva Medical Imaging, Llc||Apparatus and method for phase-space reduction for imaging of fluorescing, scattering and/or absorbing structures|
|WO2009144487A2 *||May 18, 2009||Dec 3, 2009||Sheffield Hallam University||Improvements to mass spectrometry|
|WO2009144487A3 *||May 18, 2009||Feb 11, 2010||Sheffield Hallam University||Improvements to mass spectrometry|
|WO2015147888A1 *||Apr 2, 2014||Oct 1, 2015||Gerald Mcmorrow||Optical feedback synchronization system for imaging applications|
|U.S. Classification||600/473, 600/478, 600/476|
|International Classification||G02B6/35, A61B5/00, G02B26/10, G02B6/32, G02B6/26, A61B1/00, G01N21/64, A61B1/005, A61B1/04, H04N7/18, A61N5/06, A61B5/107, G01N21/27, A61B18/20, G01Q20/02|
|Cooperative Classification||A61B1/07, A61B5/0068, G02B6/262, A61B1/0051, G02B6/241, A61B1/00048, A61B5/0066, A61B1/00193, A61B5/0084, G02B6/357, A61B1/0638, A61B5/1076, A61B1/043, A61N5/0601, A61B1/00165, A61N5/062, A61B1/00167, A61B1/0008, A61N2005/063, G02B6/3578, A61B5/0071, G02B6/3572, A61B5/0075, G02B6/32, A61B5/0062, G02B6/3502, G02B6/3566, G02B26/10, A61B1/00172, A61B1/00183|
|European Classification||A61B1/005B, A61B1/06J, A61B1/00S2B, A61B1/00S4H, A61B1/00S3, A61B1/00E4H, A61B1/00C7B2, A61B1/00S2, A61B5/00P1, G02B6/24A, G02B6/26B, G02B26/10|
|Jul 2, 2001||AS||Assignment|
Owner name: WASHINGTON, UNIVERSITY OF, WASHINGTON
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SEIBEL, ERIC J.;REEL/FRAME:011946/0196
Effective date: 20010601
|Jan 29, 2009||AS||Assignment|
Owner name: NATIONAL INSTITUTES OF HEALTH (NIH), U.S. DEPT. OF
Free format text: CONFIRMATORY LICENSE;ASSIGNOR:UNIVERSITY OF WASHINGTON;REEL/FRAME:022162/0627
Effective date: 20080627
|Apr 20, 2009||FPAY||Fee payment|
Year of fee payment: 4
|Aug 2, 2010||AS||Assignment|
Owner name: NATIONAL INSTITUTES OF HEALTH (NIH), U.S. DEPT. OF
Free format text: CONFIRMATORY LICENSE;ASSIGNOR:UNIVERSITY OF WASHINGTON;REEL/FRAME:024767/0771
Effective date: 20080627
|May 15, 2013||FPAY||Fee payment|
Year of fee payment: 8