CausaLM: Causal Model Explanation Through Counterfactual Language Models

Understanding predictions made by deep neural networks is notoriously difficult, but also crucial to their dissemination. As all ML-based methods, they are as good as their training data, and can also capture unwanted biases. While there are tools that can help understand whether such biases exist, they do not distinguish between correlation and causation, and might be ill-suited for text-based models and for reasoning about high level language concepts. A key problem of estimating the causal effect of a concept of interest on a given model is that this estimation requires the generation of counterfactual examples, which is challenging with existing generation technology. To bridge that gap, we propose CausaLM, a framework for producing causal model explanations using counterfactual language representation models. Our approach is based on fine-tuning of deep contextualized embedding models with auxiliary adversarial tasks derived from the causal graph of the problem. Concretely, we show that by carefully choosing auxiliary adversarial pre-training tasks, language representation models such as BERT can effectively learn a counterfactual representation for a given concept of interest, and be used to estimate its true causal effect on model performance. A byproduct of our method is a language representation model that is unaffected by the tested concept, which can be useful in mitigating unwanted bias ingrained in the data.Comment: Our code and data are available at: https://amirfeder.github.io/CausaLM/ Under review for the Computational Linguistics journa

Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews

This paper presents a simple unsupervised learning algorithm for classifying reviews as recommended (thumbs up) or not recommended (thumbs down). The classification of a review is predicted by the average semantic orientation of the phrases in the review that contain adjectives or adverbs. A phrase has a positive semantic orientation when it has good associations (e.g., "subtle nuances") and a negative semantic orientation when it has bad associations (e.g., "very cavalier"). In this paper, the semantic orientation of a phrase is calculated as the mutual information between the given phrase and the word "excellent" minus the mutual information between the given phrase and the word "poor". A review is classified as recommended if the average semantic orientation of its phrases is positive. The algorithm achieves an average accuracy of 74% when evaluated on 410 reviews from Epinions, sampled from four different domains (reviews of automobiles, banks, movies, and travel destinations). The accuracy ranges from 84% for automobile reviews to 66% for movie reviews

Use Effectiveness of the Creighton Model Ovulation Method of Natural Family Planning

OBJECTIVE: To determine the use effectiveness of the Creighton model ovulation method in avoiding and achieving pregnancy. DESIGN: Prospective, descriptive. SETTING: A natural family planning clinic at a university nursing center. PARTICIPANTS: Records and charts from 242 couples who were taught the Creighton model. The sample represented 1,793 months of use of the model. MAIN OUTCOME MEASURE: Creighton model demographic forms and logbook. RESULTS: At 12 months of use, the Creighton model was 98.8% method effective and 98.0% use effective in avoiding pregnancy. It was 24.4% use effective in achieving pregnancy. The continuation rate for the sample at 12 months of use was 78.0%. CONCLUSION: The Creighton model is an effective method of family planning when used to avoid or achieve pregnancy. However, its effectiveness depends on its being taught by qualified teachers. The effectiveness rate of the Creighton model is based on the assumption that if couples knowingly use the female partner\u27s days of fertility for genital intercourse, they are using the method to achieve pregnancy

Aquaculture Asia, Vol. 8, No. 1, pp.1-58, January-March 2003

*Table of Contents* Sustainable Aquaculture Fertilization, soil and water quality management in small-scale ponds part II:Soil and water quality management S. Adhikari Fisheries and aquaculture activities in Nepal Tek Gurung Peter Edwards writes on rural aquaculture: A knowledge-base for rural aquaculture Farmers as Scientists: Commercialization of giant freshwater prawn culture in India M.C. Nandeesha Aquaculture in reservoir fed canal based irrigation systems of India – a boon for fish production K.M. Rajesh, Mridula R. Mendon, K. N. Prabhudeva and P. Arun Padiyar Research and Farming Techniques Production and grow-out of the Black-lip pearl oyster Pinctada margaritifera Idris Lane Breeding of carps using a low-cost, small-scale hatchery in Assam, India: A farmer proven technology S.K. Das Genes and Fish: Hybridisation – more trouble than its worth? Graham Mair Breeding and culture of the sea cucumber Holothuria scabra in Vietnam R. Pitt and N. D. Q. Duy The potential use of palm kernel meal in aquaculture feeds Wing-Keong Ng Using a Simple GIS model to assess development patterns of small-scale rural aquaculture in the wider environment Simon R. Bush Aquaculture fundamentals: Getting the most out of your feed Simon Wilkinson Marine finfish section Status of marine finfish aquaculture in Myanmar U Khin Kolay Regional training course on grouper hatchery production Aquatic Animal Health Advice on aquatic animal health care: Problems in Penaeus monodon culture in low salinity areas Pornlerd Chanratchakoo