11 research outputs found
Spartan Daily, February 5, 1982
Volume 78, Issue 3https://scholarworks.sjsu.edu/spartandaily/6846/thumbnail.jp
ABQ Free Press, January 28, 2015
https://digitalrepository.unm.edu/abq_free_press/1019/thumbnail.jp
Probabilistic Models and Natural Language Processing in Health
The treatment of mental disorders nowadays entails a wide variety of still non-solved
tasks such as misdiagnosis or delayed diagnosis. During this doctoral thesis we study and
develop different models that can serve as potential tools for the clinician labor. Among
our proposals, we outline two main lines of research, Natural Language Processing and
probabilistic methods.
In Chapter 2, we start our thesis with a regularization mechanism used in language
models and specially effective in Transformer-based architectures, where we call it NoRBERT,
from Noisy Regularized Bidirectional Representations from Transformers [9], [15].
According to the literature, we found out that regularization in NLP is a low explored
field limited to the use of general mechanisms such as dropout [57] or early stopping
[58]. In this landscape, we propose a novel approach to combine any LM with Variational
Auto-Encoders [23]. VAEs belong to deep generative models, with the construction of
a regular latent space that permits the reconstruction of the input samples throughout an
encoder and decoder networks. Our VAE is based in a prior distribution of a mixture
of Gaussians (GMVAE), what gives the model the chance to capture some multimodal
information. Combining both, Transformers and GMVAEs we build an architecture capable
of imputing missing words from a text corpora in a diverse topic space as well as
improve BLEU score in the reconstruction of the data base. Both results depend on the
depth of the regularized layer from the Transformer Encoder. The regularization in essence
is formed by the GMVAE reconstruction of the Transformer embeddings at some point in
the architecture, adding structure noise that helps the model a better generalization. We
show improvements in BERT[15], RoBERTa [16] and XLM-R [17] models, verified in
different datasets and we also provide explicit examples of sentences reconstructed by
Top NoRBERT. In addition, we validate the abilities of our model in data augmentation,
improving classification accuracy and F1 score in various datasets and scenarios thanks
to augmented samples generated by NoRBERT. We study some variations in the model,
Top, Deep and contextual NoRBERT, the latter based in the use of contextual words to
reconstruct the embeddings in the corresponding Transformer layer.
We continue with the Transformers line of research in Chapter 3, proposing PsyBERT.
PsyBERT, as the own name refers, is a BERT-based [15] architecture suitably modified
to work in Electronic Health Records from psychiatry patients. It is inspired by BEHRT [19], also devoted to EHRs in general health. We distinguish our model from the training
methodology and the embedding layer. In a similar way that with NoRBERT, we find
the utility of using a Masked Language Modeling (MLM) policy without no finetuning or
specific-task layer at all. On the one hand, we used MLM in NoRBERT to solve the task
of imputing missing words, finishing the aim of the model in generating new sentences by
inputs with missing information. On the other hand, we firstly propose the use of PsyBERT
such as tool to fill the missing diagnoses in the EHR as well as correct misdiagnosed
cases. After this task, we also apply PsyBERT in delusional disorder detection. On the
contrary, in this scenario we apply a multi-label classification layer, that aims to compute
the probability of the different diagnoses in the last visit of the patient to the hospital.
From these probabilities, we analyse delusional cases and propose a tool to detect potential
candidates of this mental disorder. In both tasks, we make use of several fields obtained
from the patient EHR, such as age, sex, diagnoses, treatments of psychiatric history and
propose a method capable of combining heterogeneous data to help the diagnosis in mental
health. During these works, we point out the problematic in the quality of the data from
the EHRs [104], [105] and the great advantage that medical assistance tools like our
model can provide. We do not only solve a classification problem with more than 700
different illnesses, but we bring a model to help doctors in the diagnosis of very complex
scenarios, with comorbidity, long periods of patient exploration by traditional methodology
or low prevalence cases. We present a powerful method treating a problematic with great
necessity.
Following the health line of research and psychiatry application, we analyse in Chapter
4 a probabilistic method to search for behavioral pattern in patients also with mental
disorders. In this case it is not the method the contribution of the work but the application
and results in collaboration with the clinician interpretation. The model is called SPFM
(Sparse Poisson Factorization Model) [22] and consist on a non-parametric probabilistic
model based on the Indian Buffet Process (IBP) [20], [21]. It is a exploratory method
capable of decomposing the input data in sparse matrixes. For that, it imposes the Poisson
distribution to the product of two matrixes, Z and B, both obtained respectively by the IBP
and a Gamma distribution. Hence Z corresponds to a binary matrix representing active
latent features in a patient data and B weights the contribution of the data characteristics to
the latent features. The data we use in the three works described during the chapter refers
to different questions from e-health questionnaries. Then, the data characteristics refer to
the answer or punctuation on each question and the latent features from different behavioral
patterns in a patient regarding the selection of features active in their questionnaires. For
example, patient X can present feature 1 and 2 and patient Y may presence feature 1
and 3, giving as a result two different profiles of behavioral. With these procedure we
study three scenarios. In the first problematic, we relate the profiles with the diagnoses,
finding common patterns among the patients and connections between diseases. We also
analyse the grade of critical state and contrast the clinician judgment via the Clinical
Global Impression (CGI). In the second scenario, we pursue a similar study and find
out connections between disturbed sleeping patterns and clinical markers of wish to die. We focus this analysis in patients with suicidal thoughts due to the problematic that
those individuals suppose as a major public health issue [175]. In this case we vary
the questionnarie and the data sample, obtaining different profiles also with important
information to interpret by the psychiatrist. The main contribution of this work is the
proportion of a mechanism capable of helping with detection and prevention of suicide.
Finally, the third work comprehend a behavioral pattern study in mental health patient
before and during covid-19 lockdown. We did not want to lose the chance to contribute
during coronavirus disease outbreak and presented a study about the changes in psychiatric
patients during the alarm state. We analyse again the profiles with the previous e-health
questionnaire and discover that the self-reported suicide risk decreased during the lockdown.
These results contrast with others studies [237] and suppose signs for an increase in suicidal
ideation once the crisis ceases.
Finally, Chapter 5 propose a regularization mechanism based in a theoretical idea from
[245] to obtain a variance reduction in the real risk. We interpret the robust regularized
risk that those authors propose in a two-step mechanism formed by the minimization of the
weighted risk and the maximization of a robust objective and suggest an idea to apply this
methodology in a way to select the samples from the mini-batch in a deep learning set up.
We study different variations of repeating the worst performed samples from the previous
mini-bath during the training procedure and show proves of improvements in the accuracy
and faster convergence rates of a image classification problem with different architectures
and datasets.Programa de Doctorado en Multimedia y Comunicaciones por la Universidad Carlos III de Madrid y la Universidad Rey Juan CarlosPresidente: Joaquín Míguez Arenas.- Secretario: Francisco Jesús Rodríguez Ruiz.- Vocal: Santiago Ovejero Garcí
Bractwo Prerafaelickie - malarstwo i poezja
Pre-Raphaelitism in art and literature is in many respects regarded as a foreshadowing of Modernism. Rossetti, in his creation of mood and inclusion of psychological analysis in poetry, heralds the techniques and concerns of Imagism, and his experiments with consciousness and phenomenology are combined with a devotion to an idea of the image as a compact and revelatory expression of a state or feeling (an idea comparable to the Modernist “epiphany”). Pre-Raphaelitism in poetry had a major influence upon the writers of the Decadence, and on Gerard Manley Hopkins and William Butler Yeats, who were also influenced by Ruskin and visual Pre-Raphaelitism. Additionally, Yeats’s private symbolism and the visual aspects of his poetry bear much resemblance to Pre-Raphaelite ideas. The examples gathered in the present study show that the work of the Brotherhood did not pass away as a short-lived phenomenon, but instead paved the way for future generations
of poets and painters. The Pre-Raphaelite legacy is significant, and the achievements of the movement encompass both poetry and painting, which they freed from their constraints simultaneously, bringing the two areas of artistic expression closer together. The analytical approach taken towards the interrelationship of poetry and painting in this study has consisted of a treatment of both forms of expression as “secondary modelling systems,” composed of distinguishable meaningful units (refered to as “images” throughout the argument). The application of this approach to both arts has demonstrated that those units are indeed comparable even though they are created in different artistic domains and employ different tools, methods and material in order to express meanings. As has been shown, these arts can be analysed in a parallel fashion if they are treated as texts that can be read regardless of the kind of code they are composed of. Therefore, it is possible to demonstrate that the intellectual operations involved in both the poetic and the painterly text creation and
reception processes are similar. To show that it is possible to compare these arts has been the broadest aim of
this study. Such a comparison leads to the discovery of specific similarities between the two artistic domains. In this study, a few fields of intellectual operations have een treated as those that particularly facilitate investigation of the resemblances between poetry and painting. First of all, notions of spatiality and temporality have
been the most informative and constructive in terms of cross-artistic references. As has been proved, neither space nor time can be unequivocally associated with only one form of expression; even though the refutation of Lessing’s traditional approach is not an innovative contribution of the present study to the research field, my
argument provides evidence that spatiality and temporality are not realms differentiating poetry from painting but are, in fact, spheres that facilitate the substantiation of the close connection between the arts. The evidence was gathered throughout the demonstration of the interconnectedness, but also ambivalence, of time and space as concepts as well as due to the revelation of the presence of temporal structures in painting and spatial relations in poetry, which was a traditionally repudiated argument. The next broad notion that this study has been concerned with is spectatorship. The concept has appeared with the same frequency in interpretations
of poetry and in analyses of painting; this fact can serve as an argument supporting the proximity of these arts. More specifically, the idea of looking, when it appears in discussions of poetry, immediately steers these discussions towards the topic of human visual perception, which conventionally relates to pictorial arts. At this point, what I believe to be two significant achievements of the current study should be mentioned: first, not only are the themes of human perception, visuality and even physical optics discussed in relation to painterly creation, but, and this is worth emphasising, they are also explored in connection with poetic accounts. Secondly,
the argument successfully, I believe, merges the concepts of the “reader” and the “viewer” into one locution – the “reader/viewer” – in discussions of these two, thereby conceptually fused arts. The most prominent (but not the only) illustration of this achievement is the phenomenon of the double work of art, which was discussed
as being, in varying degrees, a unified form of painterly/poetic expression. Of course, it would be an overstatement to claim that such an approach to the recipient of the artistic experience is an innovative contribution of the present study, but contemporary criticism is still too bashful in using the “reader/viewer” as a
legitimate, conceptual entity in discussions of painting/poetry as fused forms of expression. Inter-systemic correspondence was most evidently exemplified in the parts of this dissertation concerned with the verbal features of painterly expression and the visual qualities of poetry. As was pointed out, paintings do indeed show
“exclusively” poetic attributes, like the ability to generate narratives, equivalents of rhetorical figures, devices that indicate mood, and self-reflexive remarks. Poetry, on the other hand, has painterly characteristics such as indications of space, attention to detail and references to the act of looking itself. These sets of attributes do not only reveal that painting and poetry share each other’s features, but also that each of those forms of art can imitate the other. The intermedial “exchange” of properties leads to a situation in which verbal images can actually “simulate” pictorial occurrences, and, reversibly, visual images “pretend” to belong to the realm of verbalism. The presentation of such examples in this study is, I believe, a further noteworthy accomplishment.
As was stated at the outset of this study, similarities inevitably entail differences. These are most vividly observable in transformations of poetry and painting into the other medium, in which cases the mode of inter-systemic translation is exposed. The most frequent alterations involve the emphases and contexts that are
changed during the process of conversion. For example, the painter or the poet may choose to focus on a different area than the one highlighted in the source work, or the converted work can be situated in altered historical or cultural circumstances. Frequently, the time perspectives are also changed; poetic extensions of momentary actions from painting obviously indicate a discrepancy between the verbal and visual renderings. This fact, however, does not mean that prolonged time perspectives are not achievable in painting: this study examines examples of visual narratives, or socalled “pregnant moments” with extended chronology. Thus, the difference in question is one between particular versions of the same motif or a deliberate modification of the source meanings by the “appropriator,” not a difference dictated by the insufficiency of any of these forms of art.
Another dissimilarity, and, this time, a certain deficiency of the visual medium, surfaces in the painters’ attempts to render ambiguity, moral dilemmas or complex spiritual experiences. Such transformations often involve a narrowing of meaning, and the resulting painterly representations prove limited, simplified or too obvious (as in the case of Hunt’s depictions of Shakespeare’s characters). Nevertheless, instances of successful renderings of even the most intricate spiritual states are also numerous, as is proved by the example of Rossetti’s Dantesque
paintings. Therefore, it is not legitimate to claim that painting is incapable of conveying abstract complexities.
It has not been the aim of this study to desperately search for differences, and, as it turns out, when dissimilarities between poetry and painting occur, they are not essentially conditioned by the nature of these art forms. One could even say that there are no discrepancies between the arts that could not be reconciled on the
condition that both arts are approached with the same attitude towards their creation, structure and mechanisms. The stance assumed in the present study is, in fact, exactly of this kind, with its emphasis on the image-istic, textual and readerly character of both forms of expression
The Advocate - April 12, 1958
Original title (1951-1987)--The Advocate: official publication of the Archdiocese of Newark (N.J.)
The Advocate - April 12, 1958
Original title (1951-1987)--The Advocate: official publication of the Archdiocese of Newark (N.J.)
Nekrolog jako gatunek tekstu : analiza wydania internetowego The New York Times
The thesis presents an analysis of the death notice as a genre, which has been conducted by applying the research models of genre analysis designed by John Swales and Vijay K. Bhatia, and taxonomy of Polish death notices by Jacek Kolbuszewski. This in-depth structural analysis is based on a large corpus of texts (1843 texts consisting of 210,021 words), containing all death notices published in the online edition of The New York Times in a threemonth period (October 1st, 2012 – December 31st, 2012), and downloaded from Legacy.com
(the leading global provider of online obituaries and death notices). The analysis involves identifying subgenres of the death notice and their communicative purposes, applying the Move and Steps analytical model to investigate the macrostructure of each subgenre of the death notice and its variants, and carrying out a register analysis, based on lexical and syntactic study with the aim of discovering patterns and lexemes characteristic of each move and/or step. Contrary to the well-researched staff-edited obituary, the genre of American death notice, written by non-professional authors (e.g. relatives, friends, employers or colleagues of the deceased) has not been thoroughly investigated; therefore, it is believed that the thesis will not only make a valuable contribution to the understanding of the genre in question, but it can be used as a reference manual helping prospective writers create a death notice in accordance with the American traditions and rules of the genre.
The thesis consists of a theoretical part (Chapters One to Four) and a research part (Chapters Five to Eight). Chapter One revolves around the concepts of discourse, text and genre, and presents an overview of their theories. Chapter Two investigates the American discourse of death; it concentrates on the issue of death as a language taboo and various ways of coping with it, and provides a historical overview of numerous genres commemorating the dead. Chapter Three focuses on the both genres in question; it outlines their origin and evolution in the early British press, and summarizes contemporary research into them. Chapter Four
introduces the research part as it discusses the corpus and principles of its division into subcorpora,
the research model and applied methodology, and presents the discourse community and communicative purposes. Each of the four chapters constituting the research part deals with the Move and Step analysis of one of four subgenres of the death notice: informative (Chapter Five), farewell (Chapter Six), condolence (Chapter Seven), and anniversary (Chapter Eight); their lexico-structural analysis is illustrated with numerous excerpts from the
respective sub-corpora. The Conclusion summarizes the research, and provides implications
for future projects.
The research has shown that the death notice is a highly conventionalized genre, deeply
rooted in American culture and funeral tradition. While presenting biographies of the
deceased (always in a positive way, according to the classical rule de mortuis nihil nisi bene),
the American death notice emphasizes those specific periods and aspects of their lives
(education, professional, political or military career, private life), accomplishments and traits
that are valued and respected, and should be imitated by other members of the community. A
notice usually contains a lengthy hierarchical list of relatives, both the predeceased and
survivors. Each subgenre can be characterized by a specific set of communicative purposes,
which are accomplished by a sequence of moves and steps. The commonest subgenre, the
informative notice, continues the oldest traditions of the genre by informing the community
about a person’s death (optionally its circumstances) and the date and place of the funeral and
other services. The style and content of the farewell notice and the condolence notice depend
on authorship: highly conventionalized formal institutional notices contrast with more original
and intimate private ones. Their authors, whether representatives of an institution or relatives,
friends, colleagues, etc., express their loss and grief, praise lives and deeds of the deceased,
emphasize their importance for the authors or institution, and, in the case of the condolence
notice, they offer their sympathy. The anniversary notice, the rarest subgenre, commemorates
the anniversary of decedent’s birth or death, and frequently reminds the community about
never-ending love and remembrance of its authors. A significant number of farewell and
anniversary notices are addressed to the deceased themselves, the ‘virtual readers,’ which
affects their structure and style. The register analysis displays a high level of intertextuality:
non-professional obituarists tend to use conventional and stereotypical lexicon, phrases and
structures, or even templates (they may copy or imitate other texts and study models provided
in obituary manuals). There is no substantial evidence that the Internet has affected the genre:
only few texts include hyperlinks that direct to the memorial sites at Legacy.com, where
particular groups of the dead are commemorated (e.g. war veterans, university graduates,
breast cancer victims)
University of San Diego News Print Media Coverage 1987.02
Printed clippings housed in folders.https://digital.sandiego.edu/print-media/1171/thumbnail.jp
Bowdoin Orient v.90, no.1-22 (1960-1961)
https://digitalcommons.bowdoin.edu/bowdoinorient-1960s/1001/thumbnail.jp