|Publication number||US7099502 B2|
|Application number||US 10/761,938|
|Publication date||Aug 29, 2006|
|Filing date||Jan 21, 2004|
|Priority date||Oct 12, 1999|
|Also published as||US20040213446|
|Publication number||10761938, 761938, US 7099502 B2, US 7099502B2, US-B2-7099502, US7099502 B2, US7099502B2|
|Inventors||Soheil Shams, James Darrell Park, Yi-Xiong Zhou|
|Original Assignee||Biodiscovery, Inc.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (95), Non-Patent Citations (75), Referenced by (11), Classifications (14), Legal Events (3)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This application is a continuation of application Ser. No. 09/416,634, filed Oct. 12, 1999, now U.S. Pat. No. 6,731,781 and titled “System and Method for Automatically Processing Microarrays.”
The field of the present invention relates to the image processing of gene expression microarrays. In particular, the invention relates to automatically processing the information contained in a gene expression microarray.
A cell relies on proteins for a variety of its functions. Producing energy, biosynthesizing all component macromolecules, maintaining cellular architecture, and acting upon intra- and extra cellular stimuli are all protein dependent activities. Almost every cell within an organism contains the information necessary to produce the entire repertoire of proteins that that organism can specify. This information is stored as genes within the organism's DNA genome. Different organisms have different numbers of genes to define them. The number of human genes, for example, is estimated to be between 30,000 and 100,000.
Only a portion of the genome is composed of genes, and the set of genes expressed as proteins varies between cell types. Some of the proteins present in a single cell are likely to be present in all cells because they serve functions required in every type of cell. These proteins can be thought of as “housekeeping” proteins. Other proteins serve specialized functions that are only required in particular cell types. Such proteins are generally produced only in limited types of cells. Given that a large part of a cell's specific functionality is determined by the genes that it is expressing, it is logical that transcription, the first step in the process of converting the genetic information stored in an organism's genome into protein, would be highly regulated by the control network that coordinates and directs cellular activity.
The regulation of transcription is readily observed in studies that scrutinize activities evident in cells configuring themselves for a particular function (specialization into a muscle cell) or state (active multiplication or quiescence). As cells alter their state, coordinate transcription of the protein sets required for the change of state can be observed. As a window both on cell status and on the system controlling the cell, detailed, global knowledge of the transcriptional state could provide a broad spectrum of information useful to biologists. For instance, knowledge of when and in what types of cell the protein product of a gene of unknown function is expressed would provide useful clues as to the likely function of that gene. Furthermore, determining gene expression patterns in normal cells could provide detailed knowledge of how the control system achieves the highly coordinated activation and deactivation required to develop and differentiate a single fertilized egg into a mature organism. Also, comparing gene expression patterns in normal and pathological cells could provide useful diagnostic “fingerprints” and help identify aberrant functions that would be reasonable targets for therapeutic intervention.
The ability to perform studies that determine the transcriptional state of a large number of genes has, however, until recently, been severely inhibited by limitations on the ability to survey cells for the presence and abundance of a large number of gene transcripts in a single experiment. A primary limitation has been the small number of identified genes. In humans, only a few thousand of the complete set have been physically purified and characterized to any extent. Another significant limitation has been the cumbersome nature of transcription analysis. Even a large experiment on human cells can track expression of only a dozen genes, clearly an inadequate sampling to make any meaningful inferences about so complex a control system.
Two recent technological advances have provided the means to overcome some of these limitations in examining the patterns and relationships in gene transcription. The cloning of molecules derived from mRNA transcripts in particular tissues, followed by the application of high-throughput sequencing to the DNA ends of the members of these libraries has yielded a catalog of expressed sequence tags (ESTs). M. S. Boguski and GD. Schuler, “Establishing a Human Transcript Map,” Nature Genetics 10(4), 369–371 (1995). These signature sequences provide unambiguous identifiers for a large cohort of genes. At present, approximately 40,000 human genes have been “tagged” by this route, and many have been mapped to their genomic location. G. D. Schuler, M. S. Boguski, et al., “A Gene Map of the Human Genome,” Science 274(5287), 540–546 (1996).
In addition, the clones from which these sequences were derived provide analytical reagents that can be used in the quantitation of transcripts from biological samples. Specifically, the nucleic acid polymers, DNA and RNA, are biologically synthesized in a copying reaction in which one polymer serves as a template for the synthesis of an opposing strand, which is termed its complement. Even after separation from each other, these strands can be induced to pair quite specifically with each other to form a very tight molecular complex in a process called hybridization. This specific binding is the basis of most analytical procedures for quantitating the presence of a particular species of nucleic acid, such as the mRNA specifying a particular protein gene product.
Furthermore, the recent development of micro array technology, a hybridization-based process, has begun to enable the simultaneous quantitation of many nucleic acid species, even genome-wide quantitation. M. Schena, D. Shalon, R. W. Davis, and P. O. Brown, “Quantitative Monitoring of Gene Expression Patterns With a Complementary DNA Microarray,” Science 270(5235), 467–470, (1995), J. DeRisi, L. Penland, P. O. Brown, M. L. Bittner, P. S. Meltzer, M. Ray, Y. Chen, Y. A. Su, and J. M. Trent, “Use or a cDNA Microarray to Analyze Gene Expression Patterns in Human Cancer,” Nature Genetics 14(4), 457–460 (1996), M. Schena, D. Shalon, R. Heller, A. Chai, P. O. Brown, and R. W. Davis, “Parallel Human Genome Analysis: Microarray-based Expression Monitoring of 1000 Genes,” Proc. Nat. Acad. Sci. U.S.A. 93(20), 10614–10619 (1996). For mRNA expression studies, the goal is to develop microarrays that contain every gene in a genome against which mRNA expression levels can be quantitatively assessed. This technology combines robotic placement (spotting) of small amounts of individual, pure nucleic acid species on a glass slide, hybridization to this array with multiple fluorescently labeled nucleic acids, and traditionally, detection and quantitation of the resulting fluor-tagged hybrids with a scanning confocal fluorescent microscope. When used to detect transcripts, a particular RNA transcript (an mRNA) is copied into DNA (a cDNA) and this copied form of the transcript is immobilized on a glass slide. The entire complement of transcript mRNAs present in a particular cell type is extracted from cells and then a fluor-tagged cDNA representation of the extracted mRNAs is made in vitro by an enzymatic reaction termed reverse transcription. Fluor-tagged representations of mRNA from several cell types, each tagged with a fluor emitting a different color light, are hybridized to the array of cDNAs and then fluorescence at the site of each immobilized cDNA is quantitied.
The various characteristics of this analytic method make it particularly useful for directly comparing the abundance of mRNAs present in two cell types. An example of such a system is presented in
Visual inspection of the results with, for example, a scanning microscope, is adequate to analyze genes where there is a very large differential rate of expression. A more thorough study of the changes in expression requires the ability to discern more subtle changes in expression level and to determine whether observed differences are the result of random variation or whether they are characteristic of the gene being expressed. For this level of analysis, a visual inspection-based methodology is generally inadequate.
Moreover, advances in microarray technology have made using a visual inspection-based methodology even more impractical. Microarray generation systems are in place to produce over 10,000 spots on a single microscope slide. A hybridization experiment using one such slide yields an expression profile of thousands of genes. Thus, these systems produce massive amounts of information. The massive output of data makes possible high-throughput gene expression analysis at an acceptable cost and enables a more efficient study of the interaction and interrelationships of thousands of genes. If the information can be efficiently processed and analyzed, the results can potentially yield a complete understanding of the genomic functions in biological systems. Using visual inspection to quantitate the expression levels, however, is far too cumbersome, time-consuming and imprecise to effectively analyze these data-rich slides. Thus, along with the opportunities created by the rapid advancement in microarray generation technology, a management of information or “informatics” problem has arisen.
The application of digital image processing technology has largely been adopted as the avenue for solving the informatics problem. Using digital image processing, images of the microarray slides are digitally captured and analyzed using a high-speed computer. A typical microarray image depicts bright spots arranged in sets of sub-grids against a dark background. Typically, the sub-grids in a mircroarray image have the same number of rows and columns of spots. Normally, the sub-grids in a micro array image are arranged as a grid of sub-grids, or “meta-grid.”
Theoretically, processing a microarray image containing a meta-grid of spots is straightforward. First, the individual sub-grids in the meta-grid are detected. Then, for each detected sub-grid, the spots in the sub-grid are detected. Once the spots are located, their intensities reflecting the gene expression levels are measured. Finally, the reliability of the measurements for each spot and each sub-grid is assessed. Under ideal conditions, a microarray image is easily processed. These ideal conditions require that 1) the sub-grids within a meta-grid have the same dimensions, 2) the sub-grids be positioned in a predetermined location within a microarray image, 3) the sub-grids be equally spaced from each other, 4) rows and columns within a sub-grid be equally spaced from each other, 5) the spots be centered on sub-grid-line intersections, 6) the spots be of the same size and shape, 7) the spots have intensities distinguishable from the background, and 8) the slides have no contamination that appears in the microarray images. A simple software program can process a micro array image having the above “ideal” characteristics.
However, because of inherent limitations in the microarray generation hardware and process, the microarray images rarely, if ever, exhibit these conditions. For example, the pins for generating the spots in the array during the spotting process can be misaligned. Also, the spatial mapping between the slides and the scanned images can be offset. The result of these hardware imperfections is that the location of each grid in the microarray can vary from image to image and the spots will not be linearly aligned such that they are centered on grid-line intersections. Furthermore, some spots will appear to be missing from a grid entirely because of gene expression levels that are too low to be measurable.
Besides the positioning inconsistencies, the shapes and sizes of the spots vary significantly. Such variations are again due to limitations in the spotting hardware and process. In particular, the sizes of the droplets of DNA solution vary, causing the sizes of the spots to vary. Second, the concentrations of DNA and salt in the spotting solution vary over time. Consequently, the shapes of the spots will deviate over time from a circle as the density of DNA varies within a spot. Furthermore, the contact space between the tips of the pins and the slide surface varies, as do surface properties of the slide. All of the above factors perturb the shapes and sizes of the spots.
Other factors can affect the quality of the microarray image data that is generated. During the spotting process, temperature nonuniformities across a slide or between slides and accidental scrapes by pins during the spotting process can alter the results. Another issue that causes a microarray image to deviate from ideal conditions is contamination of the slide surface. For example, dust landing on the slides during the hybridization process can produce high-intensity pixels in the microarray image. In the slide-drying process, small bumps on the slide surface can appear as peculiar reflections in the microarray image. Another potential source of contamination is from accidental splashes and drips of DNA solution from the spotting pins. Thus, in any meaningful processing of a microarray image, the above factors should be accounted for and considered.
Because of these issues, previous image processing techniques for automatically processing and analyzing micro array images have been impractical. The methods used to automatically extract microarray data through digital image processing are normally classified into two groups: signal detection and signal analysis. Signal detection methods attempt to locate the spots in the microarray images. One of the early image processing-based methodologies used computer-based tools that allowed a user to direct the image processor to spot locations in the microarray images. A user applied a grid frame to an image and then resized the frame to fit the grid of spots in the image. When the spots in the image were not evenly spaced, the user would adjust the grid frame lines to align them with the spots in the image. This method, however, was prohibitively time-consuming and labor intensive for micro array images, particularly where precise grid alignment was needed before proceeding to a measurement phase for the spot signal.
Another image processing-based signal detection method automatically establishes grid lines after a user has identified the approximate location of a grid of spots in a microarray image. The user, for example, specifies the location of the four corners of the grid in the image. The spot finding method then locates the spots near the calculated grid points. The obvious problem with this method is that human involvement is still required, making analyzing large microarray prohibitively expensive.
Thus, a need exists for a system and method of automatically locating sub-grids of gene expression signals in a micro array that account for the inherent inconsistencies and errors in the microarray generation process and that do not necessitate the expense of human involvement.
Once the sub-grids in the micro array are identified, the signal analysis methods take over. In signal analysis, the gene expression spots in each sub-grid are detected and characterized. A number of signal analysis methods have been applied to extract or “segment” the gene expression signals from the spots. In a space-based signal segmentation method, for example, a circle of a predetermined size and having a location based on the most likely position of the spot signal is placed in the image to separate signal pixels from background pixels. Signal measurements are made based on the assumption that signal pixels reside inside the circle, while background pixels reside outside the circle. However, because of the high potential for microarray contamination and spot shape and location irregularity, the space-based signal segmentation method is inadequate.
Pure intensity-based signal segmentation methods have also been ineffective at obtaining accurate signal measurements for the gene expression spots. These methods use pixel intensity information to extract the signal pixels. In these methods, it is assumed that the gene expression signal pixels have intensities that are brighter than the background pixels. While being simple and fast computing, these methods have significant disadvantages. First, gene expression levels that are low will likely not be adequately characterized because the signal and background pixels cannot be separated based on intensity alone. Also, microarray images with contamination or noise are easily mischaracterized because the signal and background are not easily separated based on pixel intensity because both exhibit strong signals.
To enhance segmentation performance, methods that incorporate space and signal intensity information have been developed. In a Journal of Biomedical Optics article dated October 1997 by Yindong Chen et al. entitled Ratio-Based Decisions and the Quantitative Analysis of cDNA Microarray Images, a pixel selection method based on the Mann-Whitney test was proposed. In the method, a circle is placed in a target region that includes the region of the spot. Outside the circle, statistical properties of the assumed-to-be-background pixels are calculated. From these calculations, a threshold level is calculated to determine which pixels inside the circle are signal and which are background pixels. A problem with the method occurs when contamination is observed inside the circle whereby contamination pixels are probably classified as signal pixels. Correspondingly, contamination pixels outside the circle cause the calculated threshold level to be higher that it otherwise would be. The method also performs poorly on spots having weak signals and on microarray images that are noisy. In these situations, the intensity distributions for signal and background are overlapping. This overlapping of intensity distributions inherently limits the performance of threshold-based segmentation.
The method of trimmed measurements is another method that uses both spatial and intensity information to perform segmentation. In this method, a circle is placed around the signal region after the signal detection process. In most cases, some signal pixels will be outside the circle and some background pixels will be inside the circle. The impact on threshold calculations are removed by “trimming off’ these pixels from the intensity distributions for signal and background. A significant problem with this method, however, is the reliance on the precision of the location of the center of the circle and the determination of its radius. Small errors in either may result in the loss of significant signal information regarding the spot. Furthermore, the method incorrectly presumes that the spot is always circular. When the spot is not circular, the method again fails to identify significant signal information.
A need exists, therefore, for a robust system and method for segmenting and characterizing gene expression spots. Specifically, a need exists for a system and method that discerns contamination regions, noisy images, low signal spots, and also preserves a maximum of signal information.
The present invention is directed to an improved system and method for automatically detecting, extracting and analyzing signals of chemical materials in an array while automatically accounting for any inherent inconsistencies and errors in the array generation process. A preferred configuration includes a memory for storing a digital image of the array and a processor. The processor processes the digital image stored in the memory, detecting a signal of a chemical material, segmenting the signal, and calculating a measure of the segmented signal. Specifically, the processor identifies each of the sub-grids in the digital image, detecting in each of the plurality of sub-grids a center-representing pixel of a signal of a chemical material and an approximate radius of the signal, segmenting the signal, and calculating a measure of the segmented signal.
The above and other objects, features and advantages will become apparent to those skilled in the art from the following description of the preferred embodiments.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate presently preferred embodiments of the invention and, together with the general description given above and the detailed description of the preferred embodiments given below, serve to explain the principles of the invention.
The term “species” as used herein with respect to nucleic acids refers to a group of nucleic acid molecules, all of which comprise the same nucleotide sequence, allowing all to hybridize under stringent conditions to the same probe.
In the first step 200 of the micro array process 100, the gene expression experiment is designed. In this step 200, the genes to be tested are identified and recorded as data 202 for reference in any of the subsequent steps in the microarray process 100. Also, in this step 200, the basic design aspects of the micro array process steps that follow this step 200 are designed.
In the second step 204, the microarray is fabricated. During this step, array fabrication data 206 is collected.
Referring again to
Once the arrayer 408 places the spots to generate the microarray slide 412, the scanner 406 scans the microarray slide 412 and produces a digital image of the microarray slide 408 at its output 408. The output of the scanner 406 is a digital image in a gray scale pixel format of the microarray 408. The scanner 406 preferably includes a digital scanning sensor and an output port. The scanning sensor preferably further includes its own computing processor such as an Intel™ Pentium™ or another high-speed processor for controlling an inverted scanning fluorescent confocal microscope with a triple laser illumination system. The scanning sensor preferably performs at least 100 mm/sec scans with five-micron resolution. Scanning is done in a comb pattern with data collected in both directions. The digital data is acquired using an integrator and preferably a standard 16-bit A/D converter in the scanning sensor's processor.
Once the digital image of the microarray is output by the scanner 406, the image processing computer 401 processes the digital image 414. The image processing computer 401 is preferably electrically connected at its input port 402 to the output port of the scanner 406. The digital image 414 of the microarray slide 412 is then processed by the image processing computer 401. At the output 404 of the computer 401, the image analysis data 416 that is used to perform the gene expression analysis in the next micro array process step 216 is provided. This data generally includes measurements of the attributes that characterize the gene expression signal of each spot in the microarray.
Preferably, the digital image 414 is processed in software operating on the computer 401. A computer 401 executing software is preferably used because of the utility and flexibility in programming and modifying the software, viewing results, and running other peripheral applications. While the embodiment shown in
The basic steps for processing the microarray as a digital image in the processor 401 is shown in microarray processing sequence 500 of
The first step 501 in the microarray processing sequence 500 is the automatic detection of sub-grids in the micro array image. A hypothetical example of a microarray image is shown in
As shown in
Once the locations of the maxima and minima are determined, in the next step 806, the intensity differences between each maximum and each maximum's nearest minima on each side in the ordered horizontal vector are calculated. By calculating the intensity difference, the relative height in intensity of each maximum is established. These relative heights are the “peaks” in the horizontal vector. Next, a predetermined number, K, of the largest peaks are selected for consideration 808. For the horizontal vector, K is preferably set to the number of meta-grid columns multiplied by the number of columns in a sub-grid. Thus, K expectedly is equal to the total number of columns in the microarray. In
In the next step 814, a process is initiated in which the remaining peaks are classified based on their heights as one of three kinds: valid, invalid or ambiguous. Preferably, the classification step 814 begins by first, determining a first threshold intensity level for a valid peak. In a preferred embodiment, the first threshold level for a valid peak is equal to the median of the selected peaks multiplied by about 0.3. In the second part of the step 814, the peaks that exceed the first threshold level are classified as valid peaks. Third, a second intensity threshold is determined to classify invalid peaks. The intensity threshold for invalid peaks is preferably set at the height of the lowest of the previously selected K peaks multiplied by 0.75. In the fourth part of the classification step 814, all of the peaks falling short of this second threshold are classified as invalid peaks. Finally, the peaks below the first threshold but exceeding the second threshold are classified as ambiguous peaks.
After completing this basic peak classification step 814, the automatic sub-grid detection process 501 continues to the next step 816, wherein peaks are inserted into the ordered horizontal vector. To perform the insertion, when the distance between two adjacent peaks is more than about 1.5 times the mode distance, then a peak is preferably inserted at the midpoint between them. The inserted peak is then classified as an invalid peak. This process step 816 is preferably performed for all of the originally selected K peaks. In the next step 818, a score is computed for every set of C consecutive peaks, where C is equal to the expected number of columns in a sub-grid. The score for each set of C consecutive peaks is calculated by subtracting the number of invalid peaks from the number of valid peaks in each set. Where the total number of peaks in the vector is N, there should be N−C+1 overlapping sets of C consecutive peaks.
Once the scoring step 818 is performed, a process 820 for selecting for and eliminating from consideration sets of C consecutive peaks is initiated. First, the set of C consecutive peaks with the highest computed score is selected. Once that set is selected, the sets of C consecutive peaks that overlap with this selected set are removed from consideration. This selection/elimination process 820 continues by selecting from the remaining sets the set of C consecutive peaks with the highest score, and then removing from consideration the sets that overlap the selected set. This selection/elimination process 820 is performed until all of the sets are either removed or selected. In the end, it is expected that the number of selected sets equals the number of meta-columns in the microarray. In the next step 822, the number of selected sets is compared to the number of meta-columns. If the number of selected sets does not equal the number of meta-columns, the automatic sub-grid detection process is considered unsuccessful. If the automatic sub-grid detection process is considered unsuccessful, then the process goes to step 824 and exits. If the number of selected sets equals the number of meta-columns, the automatic sub-grid detection process is considered successful to that point and continues forward to step 826. In this successful case, the selected sets of C consecutive peaks specify all of the columns of spots in the microarray where each set corresponds to the sets of columns for each sub-grid.
According to the next step 826, the previous steps in the sub-grid region detection process 700 are repeated. This time, however, the previous steps in the sub-grid region detection process 700 are performed to identify the meta-rows in the microarray image. Finally, after all of the sets of rows and columns are determined, the microarray image is partitioned 828 into spatial regions according to the meta-row and meta-column locations found in the above process steps.
After the spatial region for each sub-grid has been partitioned, the automatic sub-grid detection process 501 proceeds to identify, as shown in
Next, new likelihood scores are provided for each grid point based on their rank order in step 1006. The new rank order-based scores for each grid point preferably being determined by: (1) assuming that the sub-grid is expected to have R rows and C columns, for grid points having the top 0.5×R×C likelihood scores, the new likelihood score is preferably set to 1.8; (2) for the remaining grid points that were in the top 0.8×R×C likelihood scores, the new likelihood scores are preferably set to 1.0; (3) for the remaining grid points with likelihood scores among the top RC likelihood scores, the new likelihood scores are preferably set to 0.5; (4) all remaining grid points, their likelihood scores are preferably set to zero. In the next step 1008, based on these newly assigned likelihood scores, candidate sets of sub-grids of dimension R×C are determined. Sub-grid scores are determined for every possible sub-grid of size R×C in the sub region. The sub-grid score for a sub-grid is calculated in step 1010 by summing the likelihood scores of every grid point in the candidate sub-grid. Then, the sub-grid with the highest likelihood score in each region is selected in step 1012 as the most likely sub-grid for that sub region. Preferably, the next step 1014 is to determine whether the selected sub-grid is “bounded.” A bounded sub-grid is one in which there are gene-expression spots in the leftmost column, the uppermost row, the rightmost column, and the lowermost row. If a sub-grid is unbounded on anyone or all of its sides, then that sub-grid is considered “free.” A determination of whether a sub-grid is bounded or free is made for the probable sub-grids in each region of the microarray.
After the bounded-or-free determination is made for the probable sub-grids, the bounded sub-grids are used to constrain or “bind” any free sub-grids in constraining step(s) 1016, 1018. Referring to
Referring again to
The next set of steps determines the radius of the spot around this determined center of the gene expression spot. In the first step 1206 of the radius finding process, the edge map pixels are pruned based on each pixel's directional offset from each pixel's direction to the identified center pixel. Preferably, if an edge pixel is outside of a +/−60-degree angle window in its direction from the direction to the center pixel, then that edge pixel is removed from consideration. For all others that remain after the pruning step is completed, a histogram is formed in step 1208 based on the distance between each edge pixel and the center pixel. Thus, the X-axis for this histogram is the distance of a given pixel from the previously identified center pixel. Once this radius histogram has been formed, the peak in the histogram is identified in step 1210. This peak expectedly corresponds to a large number of edge pixels that are about the same distance from the identified center pixel. The location of this peak on the X-axis of the histogram is preferably established as the radius of the spot in step 1212. By establishing the center and now the radius of the spot for a given grid point, the circle localization step 502 in the microarray process is completed.
Referring again to
In the next sub-step 1408, the slope on each side of the peak in the histogram is found. Preferably, the following steps, which are essentially the same for the determination of both slopes, are performed to establish the slope on the high intensity side of the peak. First, the intensity histogram is differentiated and a differential histogram is created. The peak in the differential histogram is then identified, and then all of the differential histogram bins that are larger than 0.3 times the size of the differential peak are tentatively identified. The group of connected, tentatively identified bins that includes the differential peak is then identified. Then, in the next step 1410, from the group of identified bins, a slope line is fit on the original histogram. The same basic process of fitting a slope line is applied on the low intensity side of the peak in the original histogram to complete step 1410. The two slope lines are finally extended to cross the X-axis on the original histogram.
In the next sub-step 1412, where the slope lines cross the X-axis of the histogram, the bins at these intersections are identified. An example of the result of the preceding operations on the histogram of tentative signal pixels is shown in
By so thresholding the histogram, pixels in the window are reclassified in the next step 1306 according to their spatial position and their position in the histogram, i.e., whether they are in a group between LBL and HBL, between HBL and LSL, between LSL and HSL or above HSL. The classification of pixels according to their intensity and position with respect to the circle in the window is shown in
Similarly, referring to
Finally, referring to
In one preferred method of classifying an undetermined pixel region, if the region does not touch a signal region, the region is automatically classified as a contamination region. Alternatively, if the undetermined pixel region touches a signal region but does not touch a contamination region, the undetermined region is classified as a signal region. As another alternative, if the undetermined pixel region touches both a signal region and a contamination region, the undetermined region is classified as one or the other depending on a further analysis. Preferably, if the size of the contamination region that the undetermined region touches is smaller than ⅓ the size of the undetermined region, and the contamination region shares more than two-fifths of its border with a signal region, then the undetermined region is classified as a signal region. Otherwise, the undetermined region is classified as a contamination region. Optionally, this method of identifying spatial regions is repeated for any remaining undetermined regions. The newly identified spatial regions are used in the reperformance of this process. After all of the pixels have been classified, the spot in the segmentation window is identified by the pixels that have been classified as signal pixels in step 1310.
At this stage in the microarray image process, results of the process are determined as step 506. Referring to
The quality measurements are generally one of two kinds, local and global. Local quality measurements are measurements in the window of a gene expression spot. These measurements include geometric properties of the signal and contamination regions in the window. One such measurement is the signal area referenced above. While being a signal characterization measure, signal area is also a signal quality measure. During array fabrication 204, one of the goals of automation of the microarray process 100 is the achievement of consistency in the preparation of each spot sample. While expression levels from sample to sample may vary, ideally, each sample results in a gene expression signal that circular, centered on a grid point, of a certain radius, and thereby a certain area. The particular radius preferably depends on the parameters established during the experiment design and/or the array fabrication steps 200, 204. The measurement of signal area, and in particular, its deviation from a signal's expected area as a result of the design of the overall microarray process 100, is therefore a factor that becomes relevant to any determination of confidence in the signal's measurement.
Another quality measurement that is preferably factored into any calculation of confidence is spot area. Spot area differs from signal area in that spot area includes signal pixels and non-signal pixels that are located inside a predominantly signal region.
Another quality measure that is preferably factored into a confidence determination for the output measurements and preferably additionally serves as a quality control measure for the overall microarray process 100 is ellipticity or the degree to which the signal region has the shape of an ellipse versus a circle. To make this geometric property measurement, the length of the signal region's major and minor axes are preferably determined. This measure both indicates the signal's deviation from the desired circle and the potential that the signal's elliptical shape is due to a problem in the array fabrication process 204. For example, an elliptically shaped signal is potentially due to a directional airflow over the surface of the arrayer slide that causes the sample solution to spread in one or more directions on the slide surface. Alternatively, an elliptical shape may be due to a slide that is not positioned horizontally or is uneven.
To aid in narrowing the potential causes for an elliptically shaped signal and thereby refine the contribution to the confidence determination that is subsequently calculated, the orientation of the ellipse is also determined. In particular, by calculating elliptical signal orientation, the likelihood that directional airflow may be the cause of an elliptical signal can be more precisely determined. For example, if other signals on the slide have the same orientation, directional airflow becomes a more likely cause. Conversely, if an elliptical signal's orientation is an isolated occurrence, then the cause may be more likely a local anomaly such as an artifact on the slide surface.
Another geometric property measure that is preferably calculated is the square perimeter-to-spot area ratio. This measure is suggestive of a spot's deviation from a circle and is preferably normalized to the measure's value for a circle. Because spots are preferably designed to be circular in shape, higher values for this measure preferably have a negative effect on the ultimate confidence values.
The properties of contamination regions that may be present in a signal window are also preferably calculated and incorporated into the confidence calculation for the signal. One property is the area of the contamination region. Larger areas of contamination preferably result in lower confidence values for an associated signal, and to some degree, the integrity of the signal generally may become questionable.
Another confidence measure is the difference in the average intensity for pixels in contamination regions versus the signal regions. This measure broadly indicates the confidence in the signal segmentation step 504 to distinguish between signal and contamination regions for a spot. Smaller differences between the average intensities preferably result in lower confidences in their corresponding signal measurements.
Certain geometric properties of the sub-grids are also determined to support confidence measure determinations and provide further quality control indicators for the overall microarray process 100. One such property is the deviation of a spot's center location from its spot's canonic location. This measure is calculated by determining for each spot the distance between its grid point established by the automatic sub-grid detection step 501 and the spot's center, by calculating a centroid location for the spot, or optionally, using the spot center value determined in the circle localization step 502. In confidence calculations for a signal measurement, larger differences preferably lower the confidence value to the extent that they indicate distortion in the spot placement, the existence of contamination, or an error in the performance of the automatic sub-grid detection step 501.
A quality measure that evaluates sub-grids more generally is degree of alignment between sub-grids (sub-grid alignment). This measure determines the degree to which a row or column of sub-grids are in alignment with each other. Preferably, measures of sub-grid alignment are for pairs of sub-grids that are adjacent to each other either in the same row or the same column. For example, for two sub-grids in the same column, sub-grid alignment is preferably determined by first calculating the median of the distances between columns in both sub-grids. Second, the median of the offsets between the corresponding columns in the sub-grids is calculated. Finally, the sub-grid alignment value is determined by the ratio of the median of the distances between columns to the median of the offsets. The sub-grid alignment calculation is the same for adjacent sub-grids in the same row except that median calculations are applied to successive rows rather than successive columns. A determined sub-grid alignment value is potentially indicative of a pin printing error during the array fabrication step 204, or may be indicative of the errors in the performance of the automatic sub-grid detection step 501. For sub-grid alignment values greater than 0.5, a problem in one of these two areas likely exists. For sub-grid alignment values greater than 0.3, a closer inspection of the results of the process may be required. Generally, however, the values are preferably factored into signal confidence determinations.
Another global quality measure associated with sub-grid analysis is the uniformity in the distance between sub-grids. Sub-grid distance uniformity is a measure of the regularity of the distance between corresponding rows or between corresponding columns of two or more sub-grids. In a preferred embodiment, sub-grid distance uniformity is calculated by first determining the median of the distances between corresponding rows of adjacent sub-grids in the same column or corresponding columns of two adjacent sub-grids in the same row. A median distance value is therefore found for each pair of adjacent sub-grid in the microarray. The median of the set of median distance values for the pairs of sub-grids is then determined as a global median. Finally, sub-grid distance uniformity is determined by the median distance value that has the largest absolute deviation from the global median. By calculating the sub-grid pair with the largest deviation, the calculation provides a clear warning of at least one sub-grid that is not in its expected location. Like grid alignment, sub-grid distance uniformity is potentially indicative of pin printing problems such as a bent pin in the arrayer 408 or an error in the performance of the automatic sub-grid detection step 501. Furthermore, values for sub-grid distance uniformity are preferably factored into confidence measure determinations for measured signals.
Another set of quality measures concerns the variation in the identified background. Locally, the background variation is the standard deviation in the intensity of background pixels for each window. Higher standard deviations are potentially indicative of dust or other contamination on the local area of the window or possibly artifacts in the underlying glass or substrate. A measure of background variation is also determined for the entire microarray. To make this global determination of background variation, preferably the mean of the background for each signal window is first determined. Then, the standard deviation of the accumulated background means is determined. A higher result for the standard deviation is indicative of variation or non-uniformity in large regions of the background. A likely cause of such non-uniformity is one or more large areas of contamination such as when fluorescent molecules on the slide outside a spot well become trapped between the slide and another plate, and are spread across the slide surface. Another potential cause is an error during the scanning of the microarray into a digital image. The measure of global background variation is an indicator or such an occurrence and is preferably considered in any confidence calculations.
Another determination is whether any of the sub-grids in the digital image of the microarray appear to be missing. Indications of one or more missing sub-grids suggest a contact problem associated with one or more pins of the arrayer 408 such as would be the case if a pin is bent or missing. The determination that a sub-grid is missing may also indicate an error in the automatic sub-grid detection step 501.
Another signal quality measurement measures the parallelism of rows and of columns of sub-grids. Such is measured by preferably calculating a slope for each sub-grid line in the microarray and then calculating the standard deviation of the slopes. This calculation is preferably performed for all rows and for all columns. Similarly, the orthogonality between the rows and columns of the sub-grids is determined. Orthogonality is preferably calculated by measuring the angle of the sub-grid lines at each sub-grid point intersection and determining the standard deviation of the measured angles. The measurement of both parallelism and orthogonality are indicative of potential errors in the automatic sub-grid detection step 501 or pin placement errors during array fabrication 204.
Preferably, a set of monitoring calculations is performed as an additional quality control measure for the microarray process. The monitoring calculations include determining the intensity range and standard deviation for spots of the same known signal intensity that are inserted in the microarray image. Furthermore, the microarray images are monitored by calibrating the intensity using a series of control spots at different intensity values and reporting the variances.
The various signal quality measures, while being applied to identify potential concerns in prior steps of the overall microarray process 100 or in one of the prior steps of the image analysis process 212, also preferably are combined into a function or system for determining a confidence value for each measured gene expression signal. The function may be one that is heuristically obtained based on the performance and analysis of previous results. Alternatively, the various measures are included as input nodes to an artificial neural network that refines initial functional relationships between the signal quality measures. Preferably, the confidence value is a percentage from 0 to 100 reflecting the system's confidence in the obtained signal measurement.
Although the present invention has been described with reference to preferred embodiments, it will be readily appreciated to those of ordinary skill in the art that many modifications and adaptations of the invention are possible without departure from the spirit and scope of the invention as claimed hereinafter.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4550084||Nov 18, 1983||Oct 29, 1985||Allied Corporation||Analysis system|
|US4641528||Sep 16, 1985||Feb 10, 1987||American Hospital Supply Corp.||Specimen analysis instrument assembly|
|US5121320||Oct 17, 1989||Jun 9, 1992||Hitachi Software Engineering Co., Ltd.||System for reading and displaying an edit-processed DNA pattern|
|US5134662||Mar 4, 1991||Jul 28, 1992||Cell Analysis Systems, Inc.||Dual color camera microscope and methodology for cell staining and analysis|
|US5202932||Aug 20, 1991||Apr 13, 1993||Catawa Pty. Ltd.||X-ray generating apparatus and associated method|
|US5273632||Nov 19, 1992||Dec 28, 1993||University Of Utah Research Foundation||Methods and apparatus for analysis of chromatographic migration patterns|
|US5389792||Jan 4, 1993||Feb 14, 1995||Grumman Aerospace Corporation||Electron microprobe utilizing thermal detector arrays|
|US5417923||Jan 18, 1994||May 23, 1995||Pfizer Inc.||Assay tray assembly|
|US5541064||Oct 15, 1993||Jul 30, 1996||Cell Analysis Systems, Inc.||Methods and apparatus for immunoploidy analysis|
|US5552270||Mar 18, 1992||Sep 3, 1996||Institut Molekulyarnoi Biologii Imeni V.A.||Methods of DNA sequencing by hybridization based on optimizing concentration of matrix-bound oligonucleotide and device for carrying out same|
|US5560811||Mar 21, 1995||Oct 1, 1996||Seurat Analytical Systems Incorporated||Capillary electrophoresis apparatus and method|
|US5580728||Jun 17, 1994||Dec 3, 1996||Perlin; Mark W.||Method and system for genotyping|
|US5581631||Sep 20, 1994||Dec 3, 1996||Neopath, Inc.||Cytological system image collection integrity checking apparatus|
|US5583973||Sep 17, 1993||Dec 10, 1996||Trustees Of Boston University||Molecular modeling method and system|
|US5680514||Sep 23, 1994||Oct 21, 1997||Hughes Electronics||Multiple elastic feature net and method for target deghosting and tracking|
|US5695937||Sep 12, 1995||Dec 9, 1997||The Johns Hopkins University School Of Medicine||Method for serial analysis of gene expression|
|US5720928 *||Apr 3, 1995||Feb 24, 1998||New York University||Image processing and analysis of individual nucleic acid molecules|
|US5732277||Jun 7, 1995||Mar 24, 1998||National Instruments Corporation||Graphical system for modelling a process and associated method|
|US5757954||Sep 20, 1994||May 26, 1998||Neopath, Inc.||Field prioritization apparatus and method|
|US5773218||Jun 7, 1995||Jun 30, 1998||Icos Corporation||Method to identify compounds which modulate ICAM-related protein interactions|
|US5777888||Aug 9, 1995||Jul 7, 1998||Regents Of The University Of California||Systems for generating and analyzing stimulus-response output signal matrices|
|US5785658||Jun 7, 1995||Jul 28, 1998||Sexant Medical Corporation||In vivo tissue analysis methods and apparatus|
|US5811517||Jun 7, 1995||Sep 22, 1998||Icos Corporation||ICAM-related protein variants|
|US5837475||Jan 30, 1997||Nov 17, 1998||Hewlett-Packard Co.||Apparatus and method for scanning a chemical array|
|US5851769||Sep 27, 1995||Dec 22, 1998||The Regents Of The University Of California||Quantitative DNA fiber mapping|
|US5853979||Jun 30, 1995||Dec 29, 1998||Visible Genetics Inc.||Method and system for DNA sequence determination and mutation detection with reference to a standard|
|US5865975||May 20, 1997||Feb 2, 1999||Academy Of Applied Science||Automatic protein and/or DNA analysis system and method|
|US5869262||Jun 7, 1995||Feb 9, 1999||Icos Corporation||Method for monitoring an inflammatory disease state by detecting circulating ICAM-R|
|US5876933||Jul 24, 1996||Mar 2, 1999||Perlin; Mark W.||Method and system for genotyping|
|US5880268||Jun 7, 1995||Mar 9, 1999||Icos Corporation||Modulators of the interaction between ICAM-R and αd /CD18|
|US5887074||Dec 13, 1996||Mar 23, 1999||Siemens Corporate Research, Inc.||Local principal component based method for detecting activation signals in functional MR images|
|US5916747||Jun 27, 1996||Jun 29, 1999||Visible Genetics Inc.||Method and apparatus for alignment of signals for use in DNA based-calling|
|US5945284||May 27, 1997||Aug 31, 1999||The Perkin-Elmer Corporation||Length determination of nucleic acid repeat sequences by discontinuous primer extension|
|US5945679||Aug 17, 1998||Aug 31, 1999||Hewlett-Packard Company||Apparatus for scanning a chemical array|
|US5970164||Feb 21, 1997||Oct 19, 1999||Sophisview Technologies, Ltd.||System and method for diagnosis of living tissue diseases|
|US5980096||Jan 17, 1995||Nov 9, 1999||Intertech Ventures, Ltd.||Computer-based system, methods and graphical interface for information storage, modeling and stimulation of complex systems|
|US5981190||Jan 8, 1998||Nov 9, 1999||Ontogeny, Inc.||Analysis of gene expression, methods and reagents therefor|
|US5989835||Feb 27, 1997||Nov 23, 1999||Cellomics, Inc.||System for cell-based screening|
|US6040176||Sep 12, 1996||Mar 21, 2000||Icos Corporation||Antibodies to ICAM-related protein|
|US6054270||Sep 9, 1997||Apr 25, 2000||Oxford Gene Technology Limited||Analying polynucleotide sequences|
|US6057101 *||Jun 13, 1997||May 2, 2000||Curagen Corporation||Identification and comparison of protein-protein interactions that occur in populations and identification of inhibitors of these interactors|
|US6083693 *||Jun 14, 1996||Jul 4, 2000||Curagen Corporation||Identification and comparison of protein-protein interactions that occur in populations|
|US6100383||Jun 7, 1995||Aug 8, 2000||Icos Corporation||Fusion proteins comprising ICAM-R polypeptides and immunoglobulin constant regions|
|US6103479||May 29, 1997||Aug 15, 2000||Cellomics, Inc.||Miniaturized cell array methods and apparatus for cell-based screening|
|US6127129||Aug 5, 1999||Oct 3, 2000||Wisconsin Alumni Research Foundation||Process to create biomolecule and/or cellular arrays on metal surfaces and product produced thereby|
|US6150179||Jul 11, 1996||Nov 21, 2000||Curagen Corporation||Method of using solid state NMR to measure distances between nuclei in compounds attached to a surface|
|US6185561||Jul 15, 1999||Feb 6, 2001||Affymetrix, Inc.||Method and apparatus for providing and expression data mining database|
|US6203987 *||Oct 27, 1998||Mar 20, 2001||Rosetta Inpharmatics, Inc.||Methods for using co-regulated genesets to enhance detection and classification of gene expression patterns|
|US6207958||Feb 7, 1997||Mar 27, 2001||The University Of Akron||Multimedia detectors for medical imaging|
|US6222093||Dec 28, 1998||Apr 24, 2001||Rosetta Inpharmatics, Inc.||Methods for determining therapeutic index from gene expression profiles|
|US6223186||Oct 20, 1998||Apr 24, 2001||Incyte Pharmaceuticals, Inc.||System and method for a precompiled database for biomolecular sequence information|
|US6226542||Jul 24, 1998||May 1, 2001||Biosense, Inc.||Three-dimensional reconstruction of intrabody organs|
|US6245517||Sep 28, 1999||Jun 12, 2001||The United States Of America As Represented By The Department Of Health And Human Services||Ratio-based decisions and the quantitative analysis of cDNA micro-array images|
|US6251601||Feb 2, 1999||Jun 26, 2001||Vysis, Inc.||Simultaneous measurement of gene expression and genomic abnormalities using nucleic acid microarrays|
|US6263092||Jun 23, 1998||Jul 17, 2001||R2 Technology, Inc.||Method and apparatus for fast detection of spiculated lesions in digital mammograms|
|US6263287||Nov 12, 1998||Jul 17, 2001||Scios Inc.||Systems for the analysis of gene expression data|
|US6301378||Jun 3, 1997||Oct 9, 2001||R2 Technology, Inc.||Method and apparatus for automated detection of masses in digital mammograms|
|US6303301||May 29, 1998||Oct 16, 2001||Affymetrix, Inc.||Expression monitoring for gene function identification|
|US6308170||Jul 24, 1998||Oct 23, 2001||Affymetrix Inc.||Gene expression and evaluation system|
|US6341256||Mar 31, 1995||Jan 22, 2002||Curagen Corporation||Consensus configurational bias Monte Carlo method and system for pharmacophore structure determination|
|US6345115||Jan 4, 2000||Feb 5, 2002||Imaging Research, Inc.||Digital imaging system for assays in well plates, gels and blots|
|US6349144||Feb 7, 1998||Feb 19, 2002||Biodiscovery, Inc.||Automated DNA array segmentation and analysis|
|US6351712 *||Dec 28, 1998||Feb 26, 2002||Rosetta Inpharmatics, Inc.||Statistical combining of cell expression profiles|
|US6362004||Nov 9, 1999||Mar 26, 2002||Packard Biochip Technologies, Llc||Apparatus and method for using fiducial marks on a microarray substrate|
|US6362832||Sep 1, 1999||Mar 26, 2002||Packard Bioscience Company||Method and system for overlaying at least three microarray images to obtain a multicolor composite image|
|US6381058||May 10, 2001||Apr 30, 2002||Imaging Research, Inc.||Digital imaging system for assays in well plates, gels and blots|
|US6389428||Apr 11, 2001||May 14, 2002||Incyte Pharmaceuticals, Inc.||System and method for a precompiled database for biomolecular sequence information|
|US6441973||Jan 29, 1999||Aug 27, 2002||Imaging Research, Inc.||Digital imaging system for assays in well plates, gels and blots|
|US6453241||Dec 23, 1998||Sep 17, 2002||Rosetta Inpharmatics, Inc.||Method and system for analyzing biological response signal data|
|US6462187||Jun 15, 2001||Oct 8, 2002||Millennium Pharmaceuticals, Inc.||22109, a novel human thioredoxin family member and uses thereof|
|US6470277||Jul 28, 2000||Oct 22, 2002||Agy Therapeutics, Inc.||Techniques for facilitating identification of candidate genes|
|US6475736||Oct 25, 2000||Nov 5, 2002||Variagenics, Inc.||Methods for genetic analysis of DNA using biased amplification of polymorphic sites|
|US6498690||Mar 5, 2002||Dec 24, 2002||Imaging Research, Inc||Digital imaging system for assays in well plates, gels and blots|
|US6498863||Sep 20, 2000||Dec 24, 2002||Media Cybernetics Inc.||Method, system, and product for analyzing a digitized image of an array to create an image of a grid overlay|
|US6537749||Mar 31, 1999||Mar 25, 2003||Phylos, Inc.||Addressable protein arrays|
|US6544790||Sep 18, 2000||Apr 8, 2003||Whitehead Institute For Biomedical Research||Reverse transfection method|
|US6553317||Mar 4, 1998||Apr 22, 2003||Incyte Pharmaceuticals, Inc.||Relational database and system for storing information relating to biomolecular sequences and reagents|
|US6577956||Jun 9, 2000||Jun 10, 2003||Biodiscovery, Inc.||Automated DNA array image segmentation and analysis|
|US6591196||Jun 6, 2000||Jul 8, 2003||Agilent Technologies Inc.||Method and system for extracting data from surface array deposited features|
|US6632600||Nov 15, 2000||Oct 14, 2003||Diversa Corporation||Altered thermostability of enzymes|
|US6633659||Oct 12, 1999||Oct 14, 2003||Biodiscovery, Inc.||System and method for automatically analyzing gene expression spots in a microarray|
|US6673549||Oct 12, 2001||Jan 6, 2004||Incyte Corporation||Genes expressed in C3A liver cell cultures treated with steroids|
|US6674882||Nov 16, 2001||Jan 6, 2004||Biodiscovery, Inc.||Automated DNA array image segmentation and analysis|
|US6683455||Dec 20, 2001||Jan 27, 2004||Metabometrix Limited||Methods for spectral analysis and their applications: spectral replacement|
|US6690399||May 5, 2000||Feb 10, 2004||Tropix, Inc.||Data display software for displaying assay results|
|US6714925||Aug 7, 2000||Mar 30, 2004||Barnhill Technologies, Llc||System for identifying patterns in biological data using a distributed network|
|US6731781||Oct 12, 1999||May 4, 2004||Biodiscovery, Inc.||System and method for automatically processing microarrays|
|US6760715||Aug 7, 2000||Jul 6, 2004||Barnhill Technologies Llc||Enhancing biological knowledge discovery using multiples support vector machines|
|US6789069||Aug 7, 2000||Sep 7, 2004||Biowulf Technologies Llc||Method for enhancing knowledge discovered from biological data using a learning machine|
|US6839454||Oct 12, 1999||Jan 4, 2005||Biodiscovery, Inc.||System and method for automatically identifying sub-grids in a microarray|
|US6990221||Sep 10, 2003||Jan 24, 2006||Biodiscovery, Inc.||Automated DNA array image segmentation and analysis|
|US20020052882||Jul 9, 2001||May 2, 2002||Seth Taylor||Method and apparatus for visualizing complex data sets|
|US20030100995||Nov 26, 2002||May 29, 2003||Affymetrix, Inc.||Method, system and computer software for variant information via a web portal|
|US20030148295||Mar 20, 2002||Aug 7, 2003||Wan Jackson Shek-Lam||Expression profiles and methods of use|
|WO2001016860A2||Aug 28, 2000||Mar 8, 2001||Iris Bio Technologies, Inc.||Artificial intelligence system for genetic analysis|
|1||BIO001-M. Burl, "Recognition of Visual Object Classes", Jet Propulsion Laboratory, V-0105, Mar. 30, 1996, 12 pages.|
|2||BIO002-M. Taine and A. Herment, "Extraction of Heart and Vessel Walls on Ultrasound Images Using Snake-Splines", SPIE, vol. 2434, Mar. 1995, pp. 808-816.|
|3||BIO003-M. Jolly, S. Lakshmanan and A. Jain, "Vehicle Segmentation and Classification Using Deformable Templates", IEEE, vol. 18, No. 3, Mar. 1996, pp. 293-305.|
|4||BIO004-Y. Amit and A. Kong, "Graphical Templates for Model Registration", IEEE, vol. 18, No. 3, Mar. 1996, pp. 225-236.|
|5||BIO005-B. Olstad and A. Torp, "Encoding of a Priori Information in Active Contour Models", IEEE, vol. 18, No. 9, Sep. 1996, pp. 863-872.|
|6||BIO006-A. Abrantes and J. Marques, "A Class of Constrained Clustering Algorithms for Object Boundary Extraction", IEEE, vol. 5, No. 11, Nov. 1996, pp. 1507-1521.|
|7||BIO007-A. Jain, Y. Zhong and S. Lakshmanan, "Object Matching Using Deformable Templates", IEEE, vol. 18, No. 3, Mar. 1996, pp. 267-278.|
|8||BIO008-M. Kass, A. Witkin and D. Terzopoulos, "Snakes: Active Contour Models", International Journal of Computer Vision, 1998, pp. 321-331.|
|9||BIO009-S. Shams, "Multiple Elastic Modules for Visual Pattern Recognition", Neural Networks, vol. 8, No. 9, 1995, pp. 1439-1453.|
|10||BIO010-D. Shu, J. Nash, M. Eshaghian and K. Kim, "Straight-Line Detection on a Gated-Connection VLSI Network", P IEEE Comp. Soc., Jun. 1990, pp. 456-461.|
|11||BIO011-S. Shams, "Translation-, Rotation-, Scale-, and Distortion-Invariant Object Recognition Through Self-Organization", International Journal of Neural Systems, vol. 8, No. 2, Apr. 1997, pp. 173-179.|
|12||BIO012-Yidong Chen et al., "Ratio-Based Decisions and the Quantitative Analysis of cDNA Microarray Images", Journal of Biomedical Optics, vol. 2, No. 4, Oct. 1997, pp. 364-374.|
|13||BIO013-M. S. Boguski and G. D. Schuler, "Establishing a Human Transcript Map", Nature Genetics, vol. 10, No. 4, 1995, pp. 369-371.|
|14||BIO014-G. D. Schuler, M. S. Boguski, et al., "A Gene Map of the Human Genome", Science, vol. 274, Issue 5287, Oct. 25, 1996, pp. 540-546.|
|15||BIO015-M. Schena, D. Shalon, R. W. Davis, and P. O. Brown, "Quantitative Monitoring of Gene Expression Patterns with a Complementary DNA Microarray", Science, vol. 270, No. 5235, Oct. 20, 1995, pp. 467-470.|
|16||BIO016-J. DeRisi, L. Penland, P. O. Brown, M. L. Bittner, P. S. Meltzer, M. Ray, Y. Chen, Y. A. Su, and J. M. Trent, "Use of a cDNA Microarray to Analyze Gene Expression Patterns in Human Cancer", Nature Genetics, vol. 14, No. 4, Dec. 1996, pp. 457-460.|
|17||BIO017-M. Schena, D. Shalon, R. Heller, A. Chai, P. O. Brown, and R. W. Davis, "Parallel Human Genome Analysis: Microarray-based Expression Monitoring of 1000 Genes", Proc. Nat. Acad. Sci. U.S.A., vol. 93, No. 20, Oct. 1996, pp. 10614-10619.|
|18||BIO018-Schena, "Genome Analysis with Gene Expression Microarrays", BioEssays, vol. 18, No. 5, Jan. 3, 1996, pp. 427-431.|
|19||BIO019-Lemieux, Aharoni, and Schena, "Overview of DNA Chip Technology", Molecular Breeding, 1998, pp. 277-289.|
|20||BIO020-Schena, Heller, Theriault, Konrad, Lachenmeier, and Davis, "Microarrays: Biotechnology's Discovery Platform for Functional Genomics", Tibtech, vol. 16, Jul. 1998, pp. 301-306.|
|21||BIO021-Heller, Schena, Chai, Shalon, Bedilion, Gilmore, Woolley, and Davis, "Discovery and Analysis of Inflammatory Disease-Related genes using cDNA Microarrays", Proc. Natl. Acad. Sci. USA, vol. 94, Mar. 1997, pp. 2150-2155.|
|22||BIO022-Schena and Davis, "Parallel Analysis with Biological Chips", PCR Methods Manual, pp. 445-455.|
|23||BIO023-Schena and Davis, DNA Microarray Protocols, 19 pages.|
|24||BIO024-ArrayIt, "Micro-Spotting Device for a Broad Range of Microarray Manufacturing Applications", Chip Maker 2 Handbook,Jun. 1, 1998, 8 pages.|
|25||BIO025-ArrayIt, "Micro-Spotting Device for a Broad Range of Microarray Manufacturing Applications", Chip Maker 3 Handbook, Dec. 8, 1998, 8 pages.|
|26||BIO026-ArrayIt, "High-Throughput Purification of PCR Products for DNA Microarrays, Sequencing and Other Applications in Genomics", 96 & 384 Well PCR Purification Kits, 4 pages.|
|27||BIO027-ArrayIt, "Designed for Hybridization Reactions Involving Nucleic Acid Microarray Biochips", Hybridization Cassette Handbook, 1998, 10 pages.|
|28||BIO028-ArrayIt, "Advanced Polymeric Mixture Designed to Increase the Quality of Microarray Biochip Fabrication by Improving the Surface Properties of the DNA Micro-Spotting Technologies", Micro-Spotting Solution (2X) Handbook, 1998, 8 pages.|
|29||BIO029-ArrayIt, "An Advanced Mixture of Salts, Detergents and Buffering Components . . . ", UniHyb Hybridization Solution Handbook, 1998, 8 pages.|
|30||BIO030-ArrayIt, Dye Terminator Clean-Up Kits Handbook, 1998, 13 pages.|
|31||BIO031-M-L. T. Lee, F. C. Kuo, G. A. Whitmore, J. Sklar, "Importance of Replication in Microarray Gene Expression Studies: Statistical Methods and Evidence from Repetitive cDNA Hybridizations", Proceedings of the National Academy of Science, vol. 97, No. 18, Aug. 29, 2000, pp. 9834-9839.|
|32||BIO032-Yee Hwa Yang, M. J. Buckley, Sandrine Dudoit, T. P. Speed, "Comparison of Methods for Image Analysis on cDNA Microarray Data", Technical Report #584, Department of Statistics, University of California, Berkeley, 2000, 40 pages.|
|33||BIO033-R. Adams and L. Bischof, "Seeded Region Growing", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 16, No. 6, Jun. 1994, pp. 641-647.|
|34||BIO034-I. H. Witten and E. Frank, "Data Mining, Practical Machine Learning Tools and Techniques with Java Implementations", Morgan Kaufmann Publishers, 2000.|
|35||BIO035-DeRisi et al., "Exploring the Metabolic and Genetic Control of Gene Expression on a Genomic Scale", Science, vol. 278, Oct. 24, 1997, pp. 680-686.|
|36||BIO036-Furey et al., "Support Vector Machine Classification and Validation of Cancer Tissue Samples Using Microarray Expression Data", Bioinformatics, vol. 16, No. 10, 2000, pp. 906-914.|
|37||BIO039-Schutz et al., "Spreadsheet Software for Thermodynamic Melting Point Prediction of Oligonucleotide Hybridization With or Without Mismatches", BioTechniques, vol. 27, No. 6, 1999, pp. 1218-1222.|
|38||BIO040-U.S. Appl. No. 60/306,033, 2 pages.|
|39||BIO041-U.S. Appl. No. 60/276,947, 1 page.|
|40||BIO042-Kalocsai, P., et al., "Visualization and Analysis of Gene Expression Data", JALA, vol. 4, No. 5, Nov. 1999, pp. 58-61.|
|41||BIO043-"G2 Real Time Expert System, GDA and Neur-on-line", Gensym Corporation, 1995, 5 pages.|
|42||BIO044-"Gensym Corporation Announces G2 Classic 5.2", Gensym Corporation, Article 4202, vol. 41, Issue 1, Jul. 3, 2001, 4 pages.|
|43||BIO045-"The ArrayExpress Database", European Bioinformatics Institute, Aug. 2000, 2 pages.|
|44||BIO046-Draghici, Sorin, et al., "Experimental Design, Analysis of Variance and Slide Quality Assessment in Gene Expression Arrays", BioDiscovery Inc., Current Opinion in Drug Discovery & Development, vol. 4, No. 3, May 2001, pp. 332-337.|
|45||BIO047-Comander, Jason, et al., "Argus-A New Database System for Web-Based Analysis of Multiple Microarray Data Sets", Genome Research, vol. 11, No. 9, Cold Spring Harbor Laboratory Press, Sep. 2001, pp. 1603-1610.|
|46||BIO048-Liao, Birong, et al., "MAD: A Suite of Tools for Microarray Data Management and Processing", BioInformatics Applications Note, vol. 16, No. 10, Oxford University Press, Oct. 2000, pp. 946-947.|
|47||BIO049-Young, Lynn, et al., "Microarray Analysis Using P-SCAN and F-SCAN", International Genome Sequencing and Analysis Conference, No. 12, Sep. 2000, p. 105.|
|48||BIO050-Saeed, Alexander, et al., "Data Visualization and Analysis Tools for High Density Microarrays", International Genome Sequencing and Analysis Conference, No. 12, Sep. 2000, p. 105.|
|49||BIO051-Samartzidou, Hrissi, et al., "MicroArray ScoreCard: An Integrated Analysis Tool for Evaluating Data Quality in Microarray Experiments", International Genome Sequencing and Analysis Conference, No. 12, Sep. 2000, pp. 107-108.|
|50||BIO052-Kuklin, A., et al., "High Throughput Screening of Gene Expression Signatures", Genetica, vol. 108, 2000, BioDiscovery Inc., pp. 41-46.|
|51||BIO053-Pankaj Prakash, Ph.D., and Bruce Hoff, Ph.D., "Application Note GS10: Microarray Gene Expression Data Mining with Cluster Analysis using GeneSight," BioDiscovery, Inc., 2002, 6 pages.|
|52||BIO054-SAS Procedure FASTCLUS, "SAS/STAT 9.1 User's Guide," SAS Institue Inc., 2004, available at http://support.sas.com/documentation/onlinedoc/91pdf/index<SUB>-</SUB>913.html#base.|
|53||BIO055-Javier Herrero, Alfonso Valencia and Joaquin Dopazo, "A Hierarchical Unsupervised Growing Neural Network for Clustering Gene Expression Patterns," Bioinformatics, vol. 17, No. 2, pp. 126-136, Oxford University Press, 2001, available at http://bioinformatics.oupjournals.org/cgi/reprint/17/2/126.|
|54||BIO056-Michael B. Eisen, Paul T. Spellman, Patrick O. Brown, and David Botstein, "Cluster Analysis and Display of Genome-Wide Expression Patterns," Proc. Natl. Acad. Sci. USA, vol. 95, Dec. 1998, pp. 14863-14868, available at http:www.pnas.org/cgi/content/full/95/25/14863.|
|55||BIO057-"GeneSight Users Manual," Version 1.3b, BioDiscovery, Inc., 1999, 46 pages.|
|56||BIO058-"GeneSight Users Manual," Version 2.1, BioDiscovery, Inc., 2001.|
|57||BIO059-"GeneSight Users Manual," Draft #1 for Version 3.0, BioDiscovery, Inc., Aug. 31, 2001.|
|58||BIO060-"GeneSight Users Manual," Draft #1 for Version 3.1.3, BioDiscovery, Inc., Mar. 28, 2002.|
|59||BIO061-"GeneSight Users Manual," Version 3.5, BioDiscovery, Inc., Sep. 3, 2002.|
|60||BIO062-"GeneSight Users Manual," Version 4.0, BioDiscovery, Inc., Oct. 2003.|
|61||BIO063-"GeneSight Users Manual," Version 4.1, BioDiscovery, Inc., 2003.|
|62||BIO064-Rand R. Wilcox, "Statistics for the Social Sciences", Academic Press, 1996, pp. 321-324.|
|63||BIO065-BioDiscovery ImaGene Pamphlets, date unclear (possibly 1997), distribution unclear, 8 pages.|
|64||BIO066-http://www.nhgri.nih.gov/DIR/LCG/15K/HTML/aboutmicro.html, printed Jul. 8, 1999, 1 page.|
|65||BIO067-http://www.nhgri.nih.gov/DIR/LCG/15K/HTML/img<SUB>-</SUB>analysis.html, printed Jul. 23, 1999, 5 pages.|
|66||BIO068-http://www.nhgri.nih.gov/DIR/LCG/15K/HTML/aboutreader.html, printed Jul. 8, 1999, 4 pages.|
|67||BIO070-Michael Eisen, ScanAlyze User Manual, copyright 1998-9 by Stanford University, printed from http://rana.lbl.gov/manuals/ScanAlyzeDoc.pdf, 27 pages.|
|68||BIO071-T. M. Houts, "Improved 2-Color 'Exponential' Normalization for Microarray Analyzes Employing Cyanine Dyes", In S. Lin, editor, Proceedings of CAMDA 2000, "Critical Assessment of Techniques for Microarray Data Mining", Dec. 18-19, Durham, NC, 2000, Duke University Medical Center, 1 page.|
|69||BIO072-J. Schuchhardt, D. Beule, A. Malik, E. Wolski, H. Eickhoff, H. Lehrach, and H. Herzel, "Normalization Strategies for cDNA Microarrays", Nucleic Acids Research, vol. 28, No. 10, 2000, pp. e47i-e47v.|
|70||BIO073-Kerr et al., "Analysis of Variance for Gene Expression Microarray Data", Journal of Computational Biology, vol. 7, 2000, pp. 819-837 (pp. 1-24 in the reference provided).|
|71||BIO074-Xiang et al., "cDNA Microarray Technology and Its Applications", Biotechnology Advances, vol. 18, 2000, pp. 35-46.|
|72||Final Office Action mailed May 19, 2005 in U.S. Appl. No. 10/256,101, 16 pages.|
|73||Granjeaud et al., "From Hybridization Image to Numerical Values: A Practical, High Throughput Quantification System for High Density Filter Hybridizations", Genetic Analysis Biomolecular Engineering. vol. 12. 1996. pp. 151-162.|
|74||Non-Final Office Action mailed Aug. 17, 2004 in U.S. Appl. No. 10/256,101, 11 pages.|
|75||Non-Final Office Action mailed Nov. 4, 2005 in U.S. Appl. No. 10/256,101, 13 pages.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7528374||Mar 3, 2006||May 5, 2009||Vidar Systems Corporation||Sensing apparatus having optical assembly that collimates emitted light for detection|
|US7558411 *||Aug 1, 2003||Jul 7, 2009||Ocimum Biosolutions, Inc.||Method and system for managing and querying gene expression data according to quality|
|US7858382||May 27, 2005||Dec 28, 2010||Vidar Systems Corporation||Sensing apparatus having rotating optical assembly|
|US9307115 *||May 29, 2015||Apr 5, 2016||Brother Kogyo Kabushiki Kaisha||Image processing device generating rectangular image data from intermediate image data|
|US20040181342 *||Oct 14, 2003||Sep 16, 2004||Yi-Xiong Zhou||System and method for automatically analyzing gene expression spots in a microarray|
|US20050175228 *||Aug 1, 2003||Aug 11, 2005||Michael Elashoff||Method and system for managing and querying gene expression data according to quality|
|US20060257053 *||Jun 16, 2004||Nov 16, 2006||Boudreau Alexandre J||Segmentation and data mining for gel electrophoresis images|
|US20060269450 *||May 27, 2005||Nov 30, 2006||Kim Yong M||Sensing apparatus having rotating optical assembly|
|US20070205365 *||Mar 3, 2006||Sep 6, 2007||Asbjorn Smitt||Sensing apparatus having optical assembly that collimates emitted light for detection|
|US20080123898 *||Dec 6, 2007||May 29, 2008||Biodiscovery, Inc.||System and Method for Automatically Analyzing Gene Expression Spots in a Microarray|
|US20150350489 *||May 29, 2015||Dec 3, 2015||Brother Kogyo Kabushiki Kaisha||Image processing device generating rectangular image data from intermediate image data|
|U.S. Classification||382/129, 435/6.11|
|International Classification||G06T5/50, G06T5/00, G06K9/00, G06T7/00|
|Cooperative Classification||G06T2207/30072, G06T7/0012, G06T5/50, G06K9/00, G06T2207/20068|
|European Classification||G06T5/50, G06K9/00, G06T7/00B2|
|Feb 25, 2005||AS||Assignment|
Owner name: BIODISCOVERY, INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SHAMS, SOHEIL;PARK, JAMES D.;ZHOU, YI-XIONG;REEL/FRAME:015704/0721
Effective date: 19991215
|Jan 21, 2010||FPAY||Fee payment|
Year of fee payment: 4
|Sep 5, 2013||FPAY||Fee payment|
Year of fee payment: 8