FuseCap: Leveraging Large Language Models to Fuse Visual Data into Enriched Image Captions

Image captioning is a central task in computer vision which has experienced substantial progress following the advent of vision-language pre-training techniques. In this paper, we highlight a frequently overlooked limitation of captioning models that often fail to capture semantically significant elements. This drawback can be traced back to the text-image datasets; while their captions typically offer a general depiction of image content, they frequently omit salient details. To mitigate this limitation, we propose FuseCap - a novel method for enriching captions with additional visual information, obtained from vision experts, such as object detectors, attribute recognizers, and Optical Character Recognizers (OCR). Our approach fuses the outputs of such vision experts with the original caption using a large language model (LLM), yielding enriched captions that present a comprehensive image description. We validate the effectiveness of the proposed caption enrichment method through both quantitative and qualitative analysis. Our method is then used to curate the training set of a captioning model based BLIP which surpasses current state-of-the-art approaches in generating accurate and detailed captions while using significantly fewer parameters and training data. As additional contributions, we provide a dataset comprising of 12M image-enriched caption pairs and show that the proposed method largely improves image-text retrieval

Concomitant medication use and clinical outcome of repetitive Transcranial Magnetic Stimulation (rTMS) treatment of Major Depressive Disorder.

BackgroundRepetitive Transcranial Magnetic Stimulation (rTMS) is commonly administered to Major Depressive Disorder (MDD) patients taking psychotropic medications, yet the effects on treatment outcomes remain unknown. We explored how concomitant medication use relates to clinical response to a standard course of rTMS.MethodsMedications were tabulated for 181 MDD patients who underwent a six-week rTMS treatment course. All patients received 10 Hz rTMS administered to left dorsolateral prefrontal cortex (DLPFC), with 1 Hz administered to right DLPFC in patients with inadequate response to and/or intolerance of left-sided stimulation. Primary outcomes were change in Inventory of Depressive Symptomatology Self Report (IDS-SR30) total score after 2, 4, and 6 weeks.ResultsUse of benzodiazepines was associated with less improvement at week 2, whereas use of psychostimulants was associated with greater improvement at week 2 and across 6 weeks. These effects were significant controlling for baseline variables including age, overall symptom severity, and severity of anxiety symptoms. Response rates at week 6 were lower in benzodiazepine users versus non-users (16.4% vs. 35.5%, p = 0.008), and higher in psychostimulant users versus non-users (39.2% vs. 22.0%, p = 0.02).ConclusionsConcomitant medication use may impact rTMS treatment outcome. While the differences reported here could be considered clinically significant, results were not corrected for multiple comparisons and findings should be replicated before clinicians incorporate the evidence into clinical practice. Prospective, hypothesis-based treatment studies will aid in determining causal relationships between medication treatments and outcome

Compromiso social de la Universidad Latinoamericana del Siglo XXI: entre el debate y la acción

Voluntariado; Educación extraescolar; responsabilidad social; Ética; Extensión universitaria; Enseñanza-aprendizaje; Educación superior; Universidades; Sociedad; Caribe; América Latina.Fil: Pérez, Dora Alicia. Federación Nacional de Docentes Universitarios. Instituto de Estudios y Capacitación; Argentina.Fil: Rotstein, Andrés David. Federación Nacional de Docentes Universitarios. Instituto de Estudios y Capacitación; Argentina.Fil: Lakonich, Juan José. Federación Nacional de Docentes Universitarios. Instituto de Estudios y Capacitación; Argentina.Fil: Cecchi, Néstor Horacio. Federación Nacional de Docentes Universitarios. Instituto de Estudios y Capacitación; Argentina

Fatally entangled right whales can die extremely slowly

Author Posting. © IEEE, 2006. This article is posted here by permission of IEEE for personal use, not for redistribution. The definitive version was published in Proceedings Oceans 2006, Boston, MA, USA, 3 pp, doi:10.1109/OCEANS.2006.306792.Unlike smaller marine mammals that lack the mass and power to break free from serious entanglements in fixed fishing gear, right whales can do so, but they are not always rope free. The remaining rope can gradually constrict one or more body parts and the resulting debilitation and ultimate death can take many months. Thus the practices that lead to these mortalities need to be viewed not only as a conflict between the cultural and socioeconomic value of a fishery versus a potential species extinction process, but also in terms of an extreme animal welfare issue.Supported by NOAA NA04NMF4720392, Woods Hole Oceanographic Institution Ocean Life Institute, and the North Pond Foundation

Discrimination between bycatch and other causes of cetacean and pinniped stranding

© The Author(s), 2018. This article is distributed under the terms of the Creative Commons Attribution License. The definitive version was published in Diseases of Aquatic Organisms 127 (2018): 83-95, doi:10.3354/dao03189.The challenge of identifying cause of death in discarded bycaught marine mammals stems from a combination of the non-specific nature of the lesions of drowning, the complex physiologic adaptations unique to breath-holding marine mammals, lack of case histories, and the diverse nature of fishing gear. While no pathognomonic lesions are recognized, signs of acute external entanglement, bulging or reddened eyes, recently ingested gastric contents, pulmonary changes, and decompression-associated gas bubbles have been identified in the condition of peracute underwater entrapment (PUE) syndrome in previous studies of marine mammals. We reviewed the gross necropsy and histopathology reports of 36 cetaceans and pinnipeds including 20 directly observed bycaught and 16 live stranded animals that were euthanized between 2005 and 2011 for lesions consistent with PUE. We identified 5 criteria which present at significantly higher rates in bycaught marine mammals: external signs of acute entanglement, red or bulging eyes, recently ingested gastric contents, multi-organ congestion, and disseminated gas bubbles detected grossly during the necropsy and histologically. In contrast, froth in the trachea or primary bronchi, and lung changes (i.e. wet, heavy, froth, edema, congestion, and hemorrhage) were poor indicators of PUE. This is the first study that provides insight into the different published parameters for PUE in bycatch. For regions frequently confronted by stranded marine mammals with non-specific lesions, this could potentially aid in the investigation and quantification of marine fisheries interactions.This work was supported by the Nat - ional Oceanic and Atmospheric Administration (NOAA) John H. Prescott Program NA12NMF4390144. The WHOI Marine Mammal Center, Wick and Sloan Simmons, and the University of Las Palmas de Gran Canaria provided postdoctoral funding for Y.B.Q

Rope trauma, sedation, disentanglement, and monitoring-tag associated lesions in a terminally entangled North Atlantic right whale (Eubalaena glacialis)

Author Posting. © Society for Marine Mammalogy, 2012. Re-use of this article is permitted in accordance with the Terms and Conditions set out at http://wileyonlinelibrary.com/onlineopen#OnlineOpen_Terms. The definitive version was published in Marine Mammal Science 29 (2013): E98–E113, doi:10.1111/j.1748-7692.2012.00591.x.A chronically entangled North Atlantic right whale, with consequent emaciation was sedated, disentangled to the extent possible, administered antibiotics, and satellite tag tracked for six subsequent days. It was found dead 11 d after the tag ceased transmission. Chronic constrictive deep rope lacerations and emaciation were found to be the proximate cause of death, which may have ultimately involved shark predation. A broadhead cutter and a spring-loaded knife used for disentanglement were found to induce moderate wounds to the skin and blubber. The telemetry tag, with two barbed shafts partially penetrating the blubber was shed, leaving barbs embedded with localized histological reaction. One of four darts administered shed the barrel, but the needle was found postmortem in the whale with an 80º bend at the blubber-muscle interface. This bend occurred due to epaxial muscle movement relative to the overlying blubber, with resultant necrosis and cavitation of underlying muscle. This suggests that rigid, implanted devices that span the cetacean blubber muscle interface, where the muscle moves relative to the blubber, could have secondary health impacts. Thus we encourage efforts to develop new tag telemetry systems that do not penetrate the subdermal sheath, but still remain attached for many months.Funding from NOAA Cooperative Agreement NA09OAR4320129, PO EA133F09SE4792, M. S. Worthington Foundation, North Pond Foundation, Sloan and Hardwick Simmons, and Woods Hole Oceanographic Institution Marine Mammal Center

Hematological, biochemical, and morphological parameters as prognostic indicators for stranded common dolphins (Delphinus delphis) from Cape Cod, Massachusetts, U.S.A.

© The Author(s), 2013. This article is distributed under the terms of the Creative Commons Attribution License. The definitive version was published in Marine Mammal Science 30 (2014): 864–887, doi:10.1111/mms.12093.The current paucity of published blood values and other clinically relevant data for short-beaked common dolphins, Delphinus delphis, hinders the ability of veterinarians and responders to make well-informed diagnoses and disposition decisions regarding live strandings of this species. This study examined hematologic, clinical chemistry, and physical parameters from 26 stranded common dolphins on Cape Cod, Massachusetts, in light of their postrelease survival data to evaluate each parameter's efficacy as a prognostic indicator. Statistically and clinically significant differences were found between failed and survived dolphins, including lower hematocrit, hemoglobin, TCO2, and bicarbonate and higher blood urea nitrogen, uric acid, and length-to-girth ratios in animals that failed. In general when compared to survivors, failed dolphins exhibited acidosis, dehydration, lower PCVs, and decreased body condition. Additionally, failed dolphins had the highest ALT, AST, CK, LDH, GGT, and lactate values. These blood values combined with necropsy findings indicate that there are likely a variety of factors affecting postrelease survival, including both preexisting illness and stranding-induced conditions such as capture myopathy. Closer evaluation of these parameters for stranded common dolphins on point of care analyzers in the field may allow stranding personnel to make better disposition decisions in the future.The John H. Prescott Marine Mammal Rescue Assistance Program provided support for stranding response efforts during this study period (Grants: NA11NMF4390078, NA11NMF4390079, NA11NMF4390093). We would like to thank the Pegasus Foundation and Barbara Birdsey for their support and funding for the IFAW Satellite Tag Program. This project would not have been possible without a summer research grant from the US Army Medical Research and Material Command through Tufts Cummings School of Veterinary Medicine (TCSVM)