Cognitive Information Processing

Contains research objectives, summary of research and reports on four research projects.National Institutes of Health (Grant 5 PO1 GM14940-02)National Institutes of Health (Grant 5 P01 GM15006-03)Joint Services Electronics Programs (U. S. Army, U. S. Navy, and U. S. Air Force) under Contract DA 28-043-AMC-02536(E)National Institutes of Health (Grant 5 T01 GM01555-03

Automated clinical system for chromosome analysis

An automatic chromosome analysis system is provided wherein a suitably prepared slide with chromosome spreads thereon is placed on the stage of an automated microscope. The automated microscope stage is computer operated to move the slide to enable detection of chromosome spreads on the slide. The X and Y location of each chromosome spread that is detected is stored. The computer measures the chromosomes in a spread, classifies them by group or by type and also prepares a digital karyotype image. The computer system can also prepare a patient report summarizing the result of the analysis and listing suspected abnormalities

Efficiency of Manual Scanning in Recovering Rare Cellular Events Identified by Fluorescence In Situ Hybridization: Simulation of the Detection of Fetal Cells in Maternal Blood

Fluorescence in situ hybridization (FISH) and manual scanning is a widely used strategy for retrieving rare cellular events such as fetal cells in maternal blood. In order to determine the efficiency of these techniques in detection of rare cells, slides of XX cells with predefined numbers (1–10) of XY cells were prepared. Following FISH hybridization, the slides were scanned blindly for the presence of XY cells by different observers. The average detection efficiency was 84% (125/148). Evaluation of probe hybridization in the missed events showed that 9% (2/23) were not hybridized, 17% (4/23) were poorly hybridized, while the hybridization was adequate for the remaining 74% (17/23). In conclusion, manual scanning is a relatively efficient method to recover rare cellular events, but about 16% of the events are missed; therefore, the number of fetal cells per unit volume of maternal blood has probably been underestimated when using manual scanning

The effects of tactile/kinesthetic instructional strategies in the biology classroom

The purpose of this study was to determine whether the addition of tactile/kinesthetic instruction to the biology classroom could significantly increase learning. Various kinds of tactile/kinesthetic lessons were taught to three experimental groups who also received visual and auditory instruction. These tactile/kinesthetic lessons included task cards, task puzzles, manipulatives, total body movement, and large floor games. The control group only received visual and auditory instruction. The subjects were 84 College Biology students from Buena Regional High School, a school in rural South Jersey. The classes varied in gender and race. The same instructor taught all classes and the length of the study was six weeks. The content area used in this study was cellular reproduction. Tests and quizzes were used to measure the learning. Analysis of a pre study chapter test was performed using the t test. No significant differences were found at the 95% level for all class pairings. The t test was also performed on four quizzes and two tests taken during and immediately after the study. This statistical test was performed on all possible class pairings also. Only differences at the 95% level were considered. No differences were found between any of the class pairings. It was concluded that the addition of tactile/kinesthetic instruction to the biology classroom does not increase learning

Detection and pattern recognition applied to leaves and chromosomes

The Project you are about to see it is based on the technologies used on object detection and recognition, especially on leaves and chromosomes. To do so, this document contains the typical parts of a scientific paper, as it is what it is. It is composed by an Abstract, an Introduction, points that have to do with the investigation area, future work, conclusions and references used for the elaboration of the document. The Abstract talks about what are we going to find in this paper, which is technologies employed on pattern detection and recognition for leaves and chromosomes and the jobs that are already made for cataloguing these objects. In the introduction detection and recognition meanings are explained. This is necessary as many papers get confused with these terms, specially the ones talking about chromosomes. Detecting an object is gathering the parts of the image that are useful and eliminating the useless parts. Summarizing, detection would be recognizing the objects borders. When talking about recognition, we are talking about the computers or the machines process, which says what kind of object we are handling. Afterwards we face a compilation of the most used technologies in object detection in general. There are two main groups on this category: Based on derivatives of images and based on ASIFT points. The ones that are based on derivatives of images have in common that convolving them with a previously created matrix does the treatment of them. This is done for detecting borders on the images, which are changes on the intensity of the pixels. Within these technologies we face two groups: Gradian based, which search for maximums and minimums on the pixels intensity as they only use the first derivative. The Laplacian based methods search for zeros on the pixels intensity as they use the second derivative. Depending on the level of details that we want to use on the final result, we will choose one option or the other, because, as its logic, if we used Gradian based methods, the computer will consume less resources and less time as there are less operations, but the quality will be worse. On the other hand, if we use the Laplacian based methods we will need more time and resources as they require more operations, but we will have a much better quality result. After explaining all the derivative based methods, we take a look on the different algorithms that are available for both groups. The other big group of technologies for object recognition is the one based on ASIFT points, which are based on 6 image parameters and compare them with another image taking under consideration these parameters. These methods disadvantage, for our future purposes, is that it is only valid for one single object. So if we are going to recognize two different leaves, even though if they refer to the same specie, we are not going to be able to recognize them with this method. It is important to mention these types of technologies as we are talking about recognition methods in general. At the end of the chapter we can see a comparison with pros and cons of all technologies that are employed. Firstly comparing them separately and then comparing them all together, based on our purposes. Recognition techniques, which are the next chapter, are not really vast as, even though there are general steps for doing object recognition, every single object that has to be recognized has its own method as the are different. This is why there is not a general method that we can specify on this chapter. We now move on into leaf detection techniques on computers. Now we will use the technique explained above based on the image derivatives. Next step will be to turn the leaf into several parameters. Depending on the document that you are referring to, there will be more or less parameters. Some papers recommend to divide the leaf into 3 main features (shape, dent and vein] and doing mathematical operations with them we can get up to 16 secondary features. Next proposition is dividing the leaf into 5 main features (Diameter, physiological length, physiological width, area and perimeter] and from those, extract 12 secondary features. This second alternative is the most used so it is the one that is going to be the reference. Following in to leaf recognition, we are based on a paper that provides a source code that, clicking on both leaf ends, it automatically tells to which specie belongs the leaf that we are trying to recognize. To do so, it only requires having a database. On the tests that have been made by the document, they assure us a 90.312% of accuracy over 320 total tests (32 plants on the database and 10 tests per specie]. Next chapter talks about chromosome detection, where we shall pass the metaphasis plate, where the chromosomes are disorganized, into the karyotype plate, which is the usual view of the 23 chromosomes ordered by number. There are two types of techniques to do this step: the skeletonization process and swiping angles. Skeletonization progress consists on suppressing the inside pixels of the chromosome to just stay with the silhouette. This method is really similar to the ones based on the derivatives of the image but the difference is that it doesnt detect the borders but the interior of the chromosome. Second technique consists of swiping angles from the beginning of the chromosome and, taking under consideration, that on a single chromosome we cannot have more than an X angle, it detects the various regions of the chromosomes. Once the karyotype plate is defined, we continue with chromosome recognition. To do so, there is a technique based on the banding that chromosomes have (grey scale bands] that make them unique. The program then detects the longitudinal axis of the chromosome and reconstructs the band profiles. Then the computer is able to recognize this chromosome. Concerning the future work, we generally have to independent techniques that dont reunite detection and recognition, so our main focus would be to prepare a program that gathers both techniques. On the leaf matter we have seen that, detection and recognition, have a link as both share the option of dividing the leaf into 5 main features. The work that would have to be done is to create an algorithm that linked both methods, as in the program, which recognizes leaves, it has to be clicked both leaf ends so it is not an automatic algorithm. On the chromosome side, we should create an algorithm that searches for the beginning of the chromosome and then start to swipe angles, to later give the parameters to the program that searches for the band profiles. Finally, on the summary, we explain why this type of investigation is needed, and that is because with global warming, lots of species (animals and plants] are beginning to extinguish. That is the reason why a big database, which gathers all the possible species, is needed. For recognizing animal species, we just only have to have the 23 chromosomes. While recognizing a plant, there are several ways of doing it, but the easiest way to input a computer is to scan the leaf of the plant. RESUMEN. El proyecto que se puede ver a continuación trata sobre las tecnologías empleadas en la detección y reconocimiento de objetos, especialmente de hojas y cromosomas. Para ello, este documento contiene las partes típicas de un paper de investigación, puesto que es de lo que se trata. Así, estará compuesto de Abstract, Introducción, diversos puntos que tengan que ver con el área a investigar, trabajo futuro, conclusiones y biografía utilizada para la realización del documento. Así, el Abstract nos cuenta qué vamos a poder encontrar en este paper, que no es ni más ni menos que las tecnologías empleadas en el reconocimiento y detección de patrones en hojas y cromosomas y qué trabajos hay existentes para catalogar a estos objetos. En la introducción se explican los conceptos de qué es la detección y qué es el reconocimiento. Esto es necesario ya que muchos papers científicos, especialmente los que hablan de cromosomas, confunden estos dos términos que no podían ser más sencillos. Por un lado tendríamos la detección del objeto, que sería simplemente coger las partes que nos interesasen de la imagen y eliminar aquellas partes que no nos fueran útiles para un futuro. Resumiendo, sería reconocer los bordes del objeto de estudio. Cuando hablamos de reconocimiento, estamos refiriéndonos al proceso que tiene el ordenador, o la máquina, para decir qué clase de objeto estamos tratando. Seguidamente nos encontramos con un recopilatorio de las tecnologías más utilizadas para la detección de objetos, en general. Aquí nos encontraríamos con dos grandes grupos de tecnologías: Las basadas en las derivadas de imágenes y las basadas en los puntos ASIFT. El grupo de tecnologías basadas en derivadas de imágenes tienen en común que hay que tratar a las imágenes mediante una convolución con una matriz creada previamente. Esto se hace para detectar bordes en las imágenes que son básicamente cambios en la intensidad de los píxeles. Dentro de estas tecnologías nos encontramos con dos grupos: Los basados en gradientes, los cuales buscan máximos y mínimos de intensidad en la imagen puesto que sólo utilizan la primera derivada; y los Laplacianos, los cuales buscan ceros en la intensidad de los píxeles puesto que estos utilizan la segunda derivada de la imagen. Dependiendo del nivel de detalles que queramos utilizar en el resultado final nos decantaremos por un método u otro puesto que, como es lógico, si utilizamos los basados en el gradiente habrá menos operaciones por lo que consumirá más tiempo y recursos pero por la contra tendremos menos calidad de imagen. Y al revés pasa con los Laplacianos, puesto que necesitan más operaciones y recursos pero tendrán un resultado final con mejor calidad. Después de explicar los tipos de operadores que hay, se hace un recorrido explicando los distintos tipos de algoritmos que hay en cada uno de los grupos. El otro gran grupo de tecnologías para el reconocimiento de objetos son los basados en puntos ASIFT, los cuales se basan en 6 parámetros de la imagen y la comparan con otra imagen teniendo en cuenta dichos parámetros. La desventaja de este método, para nuestros propósitos futuros, es que sólo es valido para un objeto en concreto. Por lo que si vamos a reconocer dos hojas diferentes, aunque sean de la misma especie, no vamos a poder reconocerlas mediante este método. Aún así es importante explicar este tipo de tecnologías puesto que estamos hablando de técnicas de reconocimiento en general. Al final del capítulo podremos ver una comparación con los pros y las contras de todas las tecnologías empleadas. Primeramente comparándolas de forma separada y, finalmente, compararemos todos los métodos existentes en base a nuestros propósitos. Las técnicas de reconocimiento, el siguiente apartado, no es muy extenso puesto que, aunque haya pasos generales para el reconocimiento de objetos, cada objeto a reconocer es distinto por lo que no hay un método específico que se pueda generalizar. Pasamos ahora a las técnicas de detección de hojas mediante ordenador. Aquí usaremos la técnica explicada previamente explicada basada en las derivadas de las imágenes. La continuación de este paso sería diseccionar la hoja en diversos parámetros. Dependiendo de la fuente a la que se consulte pueden haber más o menos parámetros. Unos documentos aconsejan dividir la morfología de la hoja en 3 parámetros principales (Forma, Dentina y ramificación] y derivando de dichos parámetros convertirlos a 16 parámetros secundarios. La otra propuesta es dividir la morfología de la hoja en 5 parámetros principales (Diámetro, longitud fisiológica, anchura fisiológica, área y perímetro] y de ahí extraer 12 parámetros secundarios. Esta segunda propuesta es la más utilizada de todas por lo que es la que se utilizará. Pasamos al reconocimiento de hojas, en la cual nos hemos basado en un documento que provee un código fuente que cucando en los dos extremos de la hoja automáticamente nos dice a qué especie pertenece la hoja que estamos intentando reconocer. Para ello sólo hay que formar una base de datos. En los test realizados por el citado documento, nos aseguran que tiene un índice de acierto del 90.312% en 320 test en total (32 plantas insertadas en la base de datos por 10 test que se han realizado por cada una de las especies]. El siguiente apartado trata de la detección de cromosomas, en el cual se debe de pasar de la célula metafásica, donde los cromosomas están desorganizados, al cariotipo, que es como solemos ver los 23 cromosomas de forma ordenada. Hay dos tipos de técnicas para realizar este paso: Por el proceso de esquelotonización y barriendo ángulos. El proceso de esqueletonización consiste en eliminar los píxeles del interior del cromosoma para quedarse con su silueta; Este proceso es similar a los métodos de derivación de los píxeles pero se diferencia en que no detecta bordes si no que detecta el interior de los cromosomas. La segunda técnica consiste en ir barriendo ángulos desde el principio del cromosoma y teniendo en cuenta que un cromosoma no puede doblarse más de X grados detecta las diversas regiones de los cromosomas. Una vez tengamos el cariotipo, se continua con el reconocimiento de cromosomas. Para ello existe una técnica basada en las bandas de blancos y negros que tienen los cromosomas y que son las que los hacen únicos. Para ello el programa detecta los ejes longitudinales del cromosoma y reconstruye los perfiles de las bandas que posee el cromosoma y que lo identifican como único. En cuanto al trabajo que se podría desempeñar en el futuro, tenemos por lo general dos técnicas independientes que no unen la detección con el reconocimiento por lo que se habría de preparar un programa que uniese estas dos técnicas. Respecto a las hojas hemos visto que ambos métodos, detección y reconocimiento, están vinculados debido a que ambos comparten la opinión de dividir las hojas en 5 parámetros principales. El trabajo que habría que realizar sería el de crear un algoritmo que conectase a ambos ya que en el programa de reconocimiento se debe clicar a los dos extremos de la hoja por lo que no es una tarea automática. En cuanto a los cromosomas, se debería de crear un algoritmo que busque el inicio del cromosoma y entonces empiece a barrer ángulos para después poder dárselo al programa que busca los perfiles de bandas de los cromosomas. Finalmente, en el resumen se explica el por qué hace falta este tipo de investigación, esto es que con el calentamiento global, muchas de las especies (tanto animales como plantas] se están empezando a extinguir. Es por ello que se necesitará una base de datos que contemple todas las posibles especies tanto del reino animal como del reino vegetal. Para reconocer a una especie animal, simplemente bastará con tener sus 23 cromosomas; mientras que para reconocer a una especie vegetal, existen diversas formas. Aunque la más sencilla de todas es contar con la hoja de la especie puesto que es el elemento más fácil de escanear e introducir en el ordenador

Digital image analysis of mitotic chromosomes

Změny v počtu a ve struktuře chromozomů jsou příčinou řady vážných onemocnění. K odhalení chromozomálních změn slouží cytogenetická vyšetření, která nejčastěji vedou k sestavení karyotypu. Pro účely cytogenetických analýz se chromozomy vizualizují pomocí vhodných metod a nejčastěji se následně sestavují do karyotypu. Protože ruční stanovení karyotypu je časově i finančně náročné, vyvíjí se přístupy k automatickému karyotypování pomocí počítačového softwaru. Automatické karyotypovací systémy klasifikují chromozomy do tříd na základě identifikačních znaků, specifických pro každý chromozom. Automatickou klasifikaci však nejvíce limituje přítomnost překrývající se a silně ohnutých chromozomů, přítomných v téměř každé mitóze. Přesnost a spolehlivost karyotypovacích systémů stále závisí na zásahu uživatele. Cílem vývoje nových přístupů k automatickému karyotypování je tedy zejména překonání výše zmíněných problémů a dále vývoj takových klasifikačních metod, které umožňí klasifikaci chromozomů do párů bez lidské kontroly.Changes in chromosome number and structure may cause serious diseases. Cytogenetic tests leadin to set of karyotype are done for detecting these abnormalities. Chromosomes are visualised with proper methods and karyotype is made up most often. Manual karyotyping is time-consuming and expensive task. Because of this, researchers have been developing automated karyotyping systems. Karyotyping systems classify chromosomes into classes based on their characteristic features. Overlapping and bent chromosomes are limitations for automatic classification since they ocur at almost every mitosis. Accuracy and reliability of karyotyping systems still depend on the human intervention. Overcoming of these problems and development of fully automated system is the aim of modern approaches.

Biomedical applications of spacecraft image processing techniques Progress report

Spacecraft image processing techniques evaluated for biomedical application

Improvement of breast cancer diagnosis through microfluidics

In breast cancer, 15-20% of cases are reported with overexpression of human epidermal growth factor receptor 2 (HER2) that causes rapid cancer progression and poor prognosis. Fortunately, HER2-targeted therapy using specific antibodies such as Trastuzumab is effective for treating these cases. In situ hybridization (ISH) is a standard technique used for HER2 assessment. This technique locates the HER2 gene by using complementary DNA probes. Two main ISH methods are fluorescence in situ hybridization (FISH) and chromogenic in situ hybridization (CISH). However, both FISH and CISH are expensive and laborious. Moreover, they can only be assessed in a small area of the tissue and thus are prone to errors in case of HER2 intra-tumoral heterogeneity (ITH). This thesis aims to improve HER2 assessment in breast cancer through various techniques related to microfluidics. The main component of our technology is a microfluidic tissue processor. This micro-fabricated chip is clamped to a microscope slide carrying a human tissue slice, creating a chamber that accommodates the tissue and delivering reagents to stain it. Five applications of this microfluidic technology to breast cancer diagnostics are presented in the three chapters of this thesis. In chapter 1, we present a microfluidic FISH protocol for HER2 gene assessment using a standard FISH probe and demonstrate that, when applying an oscillatory flow within the chip, hybridization efficiency is increased thanks to molecular replenishment. This back-and-forth motion of the diluted FISH probe inside a thin chamber above the tissue slide is the principle of microfluidic-assistance for ISH. We thereby succeed in drastically reducing the experimental time from 2 days to 1, and the amount of the expensive probe used per test by a factor of 10. We highlight the performance and reliability of microfluidic-assistance FISH by comparing the FISH scores obtained by this method to standard FISH technique scores using several clinical tissue samples. The principle of microfluidic assistance in FISH is also applicable to other types of ISH probes, including fast FISH based on Ethylene Carbonate and CISH. In chapter 2, we describe a new microfluidic method allowing the quantification of HER2 expression levels from formalin-fixed breast cancer tissues. After partial extraction of proteins from the tissue slide, the extract is routed to an antibody microarray for HER2 titration by fluorescence. HER2-negative and positive samples can be distinguished using this simple test, and the obtained results agree with the FISH scores. In chapter 3, we establish a method allowing high content, cell-by-cell analysis of both protein overexpression and gene amplification using successive microfluidic immunofluorescence (IF) and FISH staining combined with image processing. We demonstrate that by using high-content automatic analysis, the HER2 status of the sample can be precisely assessed using both a quantitative IF technique based on HER2 and cytokeratin protein quantification and automatic scoring of HER2 loci and centromere of chromosome 17 signals in a FISH image. Furthermore, this method characterizes HER2 ITH quantitatively. In particular, heterogeneous clusters and individual cells are visualized in a reconstructed map of the tissue. We conclude that high-content IF/FISH analysis is a powerful tool that can assist clinical diagnostics in the future