A review of different deep learning techniques for sperm fertility prediction

Sperm morphology analysis (SMA) is a significant factor in diagnosing male infertility. Therefore, healthy sperm detection is of great significance in this process. However, the traditional manual microscopic sperm detection methods have the disadvantages of a long detection cycle, low detection accuracy in large orders, and very complex fertility prediction. Therefore, it is meaningful to apply computer image analysis technology to the field of fertility prediction. Computer image analysis can give high precision and high efficiency in detecting sperm cells. In this article, first, we analyze the existing sperm detection techniques in chronological order, from traditional image processing and machine learning to deep learning methods in segmentation and classification. Then, we analyze and summarize these existing methods and introduce some potential methods, including visual transformers. Finally, the future development direction and challenges of sperm cell detection are discussed. We have summarized 44 related technical papers from 2012 to the present. This review will help researchers have a more comprehensive understanding of the development process, research status, and future trends in the field of fertility prediction and provide a reference for researchers in other fields

Seleção de embriões pela análise de imagens: uma abordagem Deep Learning

Infertility affects about 186 million people worldwide and 9-10% of couples in Portugal, causing financial, social and medical problems. Evaluation of embryo quality based morphological features is the standard in vitro fertilization (IVF) clinics around the world. This process is subjective and time-consuming, and results in discrepant classifications among embryologists and clinics, leading to fail in predict accurately embryo implantation and live birth potential. Although assisted reproductive technologies (ART) such as IVF coupled with time lapse elimination of periodic transfer to microscopy assessment and stable embryo culture conditions for embryos development, has alleviated the infertility problem, there are significant limitations even considering morphokinetic analysis. Likewise, many patients require multiple IVF cycles to achieve pregnancy, making the selection of single embryo for transfer a critical challenge. Here, we demonstrate the reliability of machine learning, especially deep learning based on TensorFlow open source and Keras libraries for embryo raw TLI images features extraction and classification in clinical practice. Equally, we present a follow up pipeline for clinicians and researchers, with no expertise in machine learning, to easily, rapid and accurately utilize deep learning as a clinical decision support tool in embryos viability studies, as well in other medical field where the analysis of images is preeminentA infertilidade afeta cerca de 186 milhões de pessoas em todo o mundo e 9-10% dos casais em Portugal, causando problemas financeiros, sociais e de saúde. Constitui procedimento padrão a avaliação da qualidade dos embriões baseadas em características morfológicas. No entanto, tais avaliações são subjetivas e demoradas e resultam em classificações discrepantes entre embriologistas e clínicas causando problemas na avaliação do potencial do embrião. Embora as tecnologias de reprodução medicamente assistida, como a fertilização in vitro, acoplada à tecnologia time-lapse, tenham diminuído o problema da infertilidade, existem limitações significativas, mesmo considerando a análise morfocinética. Outrossim, muitas pacientes necessitam de múltiplos ciclos de fertilização para alcançar a gravidez, tornando a seleção do embrião com maior potencial de implantação e geração de nados vivos um desafio crítico. No presente projeto demonstramos a prova do conceito da confiabilidade de Machine Learning (aprendizagem automática), especialmente Deep Learning baseado em TensorFlow e Keras, para extrair e discriminar caraterísticas associadas ao potencial embrionário, em imagens time-lapse. Igualmente, apresentamos um pipeline para que clínicos e investigadores, sem experiência em Machine Learning, possam utilizar com facilidade, rapidez e precisão Deep Learning como ferramenta de apoio à decisão clínica em estudos de viabilidade de embriões, bem como noutras áreas médicas onde a análise de imagens seja proeminenteMestrado em Biologia Molecular e Celula

A Survey on Multi-Objective Neural Architecture Search

Recently, the expert-crafted neural architectures is increasing overtaken by the utilization of neural architecture search (NAS) and automatic generation (and tuning) of network structures which has a close relation to the Hyperparameter Optimization and Auto Machine Learning (AutoML). After the earlier NAS attempts to optimize only the prediction accuracy, Multi-Objective Neural architecture Search (MONAS) has been attracting attentions which considers more goals such as computational complexity, power consumption, and size of the network for optimization, reaching a trade-off between the accuracy and other features like the computational cost. In this paper, we present an overview of principal and state-of-the-art works in the field of MONAS. Starting from a well-categorized taxonomy and formulation for the NAS, we address and correct some miscategorizations in previous surveys of the NAS field. We also provide a list of all known objectives used and add a number of new ones and elaborate their specifications. We have provides analyses about the most important objectives and shown that the stochastic properties of some the them should be differed from deterministic ones in the multi-objective optimization procedure of NAS. We finalize this paper with a number of future directions and topics in the field of MONAS.Comment: 22 pages, 10 figures, 9 table

Sperm quality, semen production, and fertility in young Norwegian Red bulls

Ved bruk av genomisk seleksjon i storfeavlen blir eliteokser selektert basert på deres estimerte genomiske avlsverdier i stedet for ved avkomsgransking. Oksene er derfor yngre når de blir tatt i bruk i sædproduksjon enn tidligere. Hovedmålet med denne avhandlingen var å identifisere nye indikatorer for når sædproduksjonen er i gang hos unge Norsk Rødt Fe okser, og som kan måles i løpet av testperioden og gi informasjon om oksenes potensielle fremtidige sædproduksjon, aksept for semin-stasjonen samt fruktbarhet i felt. I Artikkel 1 ble flowcytometri og Computer-Aided Sperm Analysis brukt til å analysere ulike spermiekvalitetsparametere i ejakulater fra 65 okser i alderen 9-13 måneder. Sædprøver ble utsatt for stresstester og kryokonservering. Oksene ble klassifisert i tre grupper med ulik respons på spermie-stresstester. Ved å benytte spermie-stresstester, kryokonservering og morfologianalyse tidlig i testperioden, kan en få verdifull innsikt i når oksene er tilstrekkelig utviklet for sædproduksjon. Med denne tilnærmingen vil en kunne ta i bruk yngre okser i sæduttak og -produksjon, og dermed bidra til redusert generasjonsintervall og økt genetisk framgang. I Artikkel 2 ble det fokusert på å undersøke potensialet til insulin-like factor 3 som en biomarkør for å predikere når sædproduksjonen starter hos unge Norsk Rødt Fe okser. Det ble tatt blodprøver og samtidig utført målinger av skrotumomkrets på 142 okser på fire tidspunkt mellom 2 og 12 måneders alder. Studien hadde som mål å belyse sammenhenger mellom nivået av insulin-like factor 3, skrotumomkrets og ulike sædparametere. Det ble funnet en positiv korrelasjon mellom insulin-like factor 3 og skrotumomkretsen, men det ble ikke funnet signifikante sammenhenger mellom skrotumomkretsen og sædparametere. På grunn av betydelige individuelle variasjoner i den undersøkte norske okse-populasjonen, er insulin-like factor 3 foreløpig ikke en egnet biomarkør til å kunne predikere når sædproduksjonen starter hos denne rasen. I Artikkel 3 presenteres en automatisert metode for å måle skrotumomkretsen hos Norsk Rødt Fe okser ved hjelp av 3D-bilder og konvolusjonelle nevrale nettverk. 3D-bilder ble tatt samtidig som manuelle målinger av skrotumomkretsen ble utført på oksene, noe som ble gjentatt ved ulike aldere. Studien sammenlignet de manuelle og automatiserte målingene oppnådd ved semantisk segmentering. Det ble vist at de automatiserte målingene av skrotumomkretsen ga tilsvarende resultater som de manuelle målingene. Gjennomsnittlig prediksjonsfeil varierte med oksenes alder og kvaliteten på 3D-bildene. Denne nye målemetoden har potensiale til å kunne implementeres i breeding soundness evaluation ved testings- og seminstasjoner, og kan gi en rask og effektiv vurdering av skrotumomkretsen.Abstract. With the application of genomic selection in dairy cattle breeding, the choice of elite sires is based on their estimated genomic breeding values instead of progeny testing. Consequently, bulls are introduced into semen production at a younger age than previously. The main aim of this thesis was to identify novel early indicators of sperm production onset and maturity status of young Norwegian Red bulls during their performance test period, to provide insight into their potential future semen production, acceptance for the AI station, and field fertility. In Paper 1, flow cytometry and computer-aided sperm analysis were used to analyse various sperm quality parameters in ejaculates collected from 65 bulls aged 9-13 months. Semen samples were subjected to stress tests and cryopreservation. The bulls were classified into three clusters with different responses to sperm stress tests. By incorporating sperm stress tests, cryopreservation, and early morphology analysis, valuable insights into the maturity of bulls for sperm production could be gained. This approach would allow for the integration of younger bulls into semen collection, facilitating reduced generation interval and increased genetic gain. The focus in Paper 2 is on investigating the potential of insulin-like factor 3 as a biomarker for predicting the onset of sperm production in young Norwegian Red bulls. Blood samples and scrotal circumference measurements were collected from 142 bulls at four time-points between 2 and 12 months of age. The aim of the study was to determine the relationship between insulin-like factor 3, scrotal circumference, and semen characteristics. While a positive correlation was found between insulin-like factor 3 and scrotal circumference, no significant correlations were observed between scrotal circumference and semen characteristics. Due to the substantial interindividual variability in the Norwegian Red bull population, insulin-like factor 3 is currently not a reliable biomarker for predicting the onset of sperm production in this breed. In Paper 3 an automated method for measuring scrotal circumference of Norwegian Red bulls using 3D images and convolutional neural networks is presented. 3D images were captured, and manual scrotal circumference measurements made of bulls at different ages. The study compared the manual and automated measurements obtained through semantic segmentation. The results showed that the automated scrotal circumference measurements were similar to manual measurements. Mean prediction error varied depending on bull age and image quality. This novel measurement method has the potential to be implemented in bull breeding soundness evaluations at performance test stations and semen collection centers, providing a fast and efficient approach for assessing scrotal circumference.publishedVersio

Does artificial intelligence have a role in the IVF clinic?

Funding: K R D is supported by a Mid-Career Fellowship from the Hospital Research Foundation (C-MCF-58-2019). K D is supported by the UK Engineering and Physical Sciences Research Council (grants EP/P030017/1 and EP/R004854/1).Lay summary The success of IVF has remained stagnant for a decade. The focus of a great deal of research is to improve on the current ~30% success rate of IVF. Artificial intelligence (AI), or machines that mimic human intelligence, has been gaining traction for its potential to improve outcomes in medicine, such as cancer diagnosis from medical images. In this commentary, we discuss whether AI has the potential to improve fertility outcomes in the IVF clinic. Based on existing research, we examine the potential of adopting AI within multiple facets of an IVF cycle, including egg/sperm and embryo selection, as well as formulation of an IVF treatment regimen. We discuss both the potential benefits and concerns of the patient and clinician in adopting AI in the clinic. We outline hurdles that need to be overcome prior to implementation. We conclude that AI has an important future in improving IVF success.Publisher PDFPeer reviewe

Advanced methods in reproductive medicine: Application of optical nanoscopy, artificial intelligence-assisted quantitative phase microscopy and mitochondrial DNA copy numbers to assess human sperm cells

Declined fertility rate and population is a matter of serious concern, especially in the developed nations. Assisted Reproductive Technologies (ART), including in vitro fertilization (IVF), have provided great hope for infertility treatment and maintaining population growth and social structure. With the help of ART, more than 8 million babies have already been born so far. Despite the worldwide expansion of ART, there is a number of open questions on the IVF success rates. Male factors for infertility contribute equally as female factors, however, male infertility is primarily focused on the “semen quality”. Therefore, the search of new semen parameters for male fertility evaluation and the exploration of the optimal method of sperm selection in IVF have been included among the top 10 research priorities for male infertility and medically assisted reproduction. The development of imaging systems coupled with image processing by Artificial Intelligence (AI) could be the revolutionary step for semen quality analysis and sperm cell selection in IVF procedures. For this work, we applied optical nanoscopy technology for the analysis of human spermatozoa, i.e., label-based Structured Illumination Microscopy (SIM) and non-invasive Quantitative Phase Microscopy (QPM). The SIM results demonstrated a prominent contrast and resolution enhancement for subcellular structures of living sperm cells, especially for mitochondria-containing midpiece, where features around 100 nm length-scale were resolved. Further, non-labeled QPM combined with machine learning technique revealed the association between gradual progressive motility loss and the morphology changes of the sperm head after external exposure to various concentrations of hydrogen peroxide. Moreover, to recognize healthy and stress-affected sperm cells, we applied Deep Neural Networks (DNNs) to QPM images achieving an accuracy of 85.6% on a dataset of 10,163 interferometric images of sperm cells. Additionally, we summarized the evidence from published literature regarding the association between mitochondrial DNA copy numbers (mtDNAcn) and semen quality. To conclude, we set up the high-resolution imaging of living human sperm cells with a remarkable level of subcellular structural details provided by SIM. Next, the morphological changes of sperm heads resulting from peroxidation have been revealed by QPM, which may not be explored by microscopy currently used in IVF settings. Besides, the implementation of DNNs for QPM image processing appears to be a promising tool in the automated classification and selection of sperm cells during IVF procedures. Moreover, the results of our meta-analysis showed an association of mtDNAcn in human sperm cells and semen quality, which seems to be a relevant sperm parameter for routine clinical practice in male fertility assessment

Computational approaches to Explainable Artificial Intelligence: Advances in theory, applications and trends

Deep Learning (DL), a groundbreaking branch of Machine Learning (ML), has emerged as a driving force in both theoretical and applied Artificial Intelligence (AI). DL algorithms, rooted in complex and non-linear artificial neural systems, excel at extracting high-level features from data. DL has demonstrated human-level performance in real-world tasks, including clinical diagnostics, and has unlocked solutions to previously intractable problems in virtual agent design, robotics, genomics, neuroimaging, computer vision, and industrial automation. In this paper, the most relevant advances from the last few years in Artificial Intelligence (AI) and several applications to neuroscience, neuroimaging, computer vision, and robotics are presented, reviewed and discussed. In this way, we summarize the state-of-the-art in AI methods, models and applications within a collection of works presented at the 9 International Conference on the Interplay between Natural and Artificial Computation (IWINAC). The works presented in this paper are excellent examples of new scientific discoveries made in laboratories that have successfully transitioned to real-life applications

Computational approaches to Explainable Artificial Intelligence:Advances in theory, applications and trends

Deep Learning (DL), a groundbreaking branch of Machine Learning (ML), has emerged as a driving force in both theoretical and applied Artificial Intelligence (AI). DL algorithms, rooted in complex and non-linear artificial neural systems, excel at extracting high-level features from data. DL has demonstrated human-level performance in real-world tasks, including clinical diagnostics, and has unlocked solutions to previously intractable problems in virtual agent design, robotics, genomics, neuroimaging, computer vision, and industrial automation. In this paper, the most relevant advances from the last few years in Artificial Intelligence (AI) and several applications to neuroscience, neuroimaging, computer vision, and robotics are presented, reviewed and discussed. In this way, we summarize the state-of-the-art in AI methods, models and applications within a collection of works presented at the 9th International Conference on the Interplay between Natural and Artificial Computation (IWINAC). The works presented in this paper are excellent examples of new scientific discoveries made in laboratories that have successfully transitioned to real-life applications.</p