Bivariate Beta-LSTM

Long Short-Term Memory (LSTM) infers the long term dependency through a cell state maintained by the input and the forget gate structures, which models a gate output as a value in [0,1] through a sigmoid function. However, due to the graduality of the sigmoid function, the sigmoid gate is not flexible in representing multi-modality or skewness. Besides, the previous models lack modeling on the correlation between the gates, which would be a new method to adopt inductive bias for a relationship between previous and current input. This paper proposes a new gate structure with the bivariate Beta distribution. The proposed gate structure enables probabilistic modeling on the gates within the LSTM cell so that the modelers can customize the cell state flow with priors and distributions. Moreover, we theoretically show the higher upper bound of the gradient compared to the sigmoid function, and we empirically observed that the bivariate Beta distribution gate structure provides higher gradient values in training. We demonstrate the effectiveness of bivariate Beta gate structure on the sentence classification, image classification, polyphonic music modeling, and image caption generation.Comment: AAAI 202

Counterfactual Fairness with Disentangled Causal Effect Variational Autoencoder

The problem of fair classification can be mollified if we develop a method to remove the embedded sensitive information from the classification features. This line of separating the sensitive information is developed through the causal inference, and the causal inference enables the counterfactual generations to contrast the what-if case of the opposite sensitive attribute. Along with this separation with the causality, a frequent assumption in the deep latent causal model defines a single latent variable to absorb the entire exogenous uncertainty of the causal graph. However, we claim that such structure cannot distinguish the 1) information caused by the intervention (i.e., sensitive variable) and 2) information correlated with the intervention from the data. Therefore, this paper proposes Disentangled Causal Effect Variational Autoencoder (DCEVAE) to resolve this limitation by disentangling the exogenous uncertainty into two latent variables: either 1) independent to interventions or 2) correlated to interventions without causality. Particularly, our disentangling approach preserves the latent variable correlated to interventions in generating counterfactual examples. We show that our method estimates the total effect and the counterfactual effect without a complete causal graph. By adding a fairness regularization, DCEVAE generates a counterfactual fair dataset while losing less original information. Also, DCEVAE generates natural counterfactual images by only flipping sensitive information. Additionally, we theoretically show the differences in the covariance structures of DCEVAE and prior works from the perspective of the latent disentanglement

Production of CMAH Knockout Preimplantation Embryos Derived From Immortalized Porcine Cells Via TALE Nucleases

Although noncancerous immortalized cell lines have been developed by introducing genes into human and murine somatic cells, such cell lines have not been available in large domesticated animals like pigs. For immortalizing porcine cells, primary porcine fetal fibroblasts were isolated and cultured using the human telomerase reverse transcriptase (hTERT) gene. After selecting cells with neomycin for 2 weeks, outgrowing colonized cells were picked up and subcultured for expansion. Immortalized cells were cultured for more than 9 months without changing their doubling time (similar to 24 hours) or their diameter (< 20 mu m) while control cells became replicatively senescent during the same period. Even a single cell expanded to confluence in 100 mm dishes. Furthermore, to knockout the CMAH gene, designed plasmids encoding a transcription activator-like effector nuclease (TALENs) pairs were transfected into the immortalized cells. Each single colony was analyzed by the mutation-sensitive T7 endonuclease I assay, fluorescent PCR, and dideoxy sequencing to obtain three independent clonal populations of cells that contained biallelic modifications. One CMAH knockout clone was chosen and used for somatic cell nuclear transfer. Cloned embryos developed to the blastocyst stage. In conclusion, we demonstrated that immortalized porcine fibroblasts were successfully established using the human hTERT gene, and the TALENs enabled biallelic gene disruptions in these immortalized cells.

Increased accuracy of estrus prediction using ruminoreticular biocapsule sensors in Hanwoo (Bos taurus coreanae) cows

Visual estrus observation can only be confirmed at a rate of 50%–60%, which is lower than that obtained using a biosensor. Thus, the use of biosensors provides more opportunities for artificial insemination because it is easier to confirm estrus than by visual observation. This study determines the accuracy of estrus prediction using a ruminoreticular biosensor by analyzing ruminoreticular temperature during the estrus cycle and measuring changes in body activity. One hundred and twenty-five Hanwoo cows (64 with a ruminal biosensor in the test group and 61 without biosensors in the control group) were studied. Ruminoreticular temperatures and body activities were measured every 10 min. The first service of artificial insemination used gonadotropin-releasing hormone (GnRH)-based fixed-time artificial insemination protocol in the control and test groups. The test group received artificial insemination based on the estrus prediction made by the biosensor, and the control group received artificial insemination according to visual estrus observation. Before artificial insemination, the ruminoreticular temperature was maintained at an average of 38.95 ± 0.05°C for 13 h (−21 to −9 h), 0.73°C higher than the average temperature observed at −48 h (38.22 ± 0.06°C). The body activity, measured using an indwelling 3-axis accelerometer, averaged 1502.57 ± 27.35 for approximately 21 h from −4 to −24 h before artificial insemination, showing 203 indexes higher body activity than −48 hours (1299 ± 9.72). Therefore, using an information and communication techonology (ICT)-based biosensor is highly effective because it can reduce the reproductive cost of a farm by accurately detecting estrus and increasing the rate of estrus confirmation in cattle

DsRed gene expression by doxycycline in porcine fibroblasts and cloned embryos using transposon

To develop a transgenic pig, introduction of foreign genes into fibroblasts is required. In this study, Piggybac transposition was used to produce tetracycline dependent gene expressing cloned embryos. Red fluorescence proteins (DsRed) combined with tetracycline promoter flanked transposon sequences were transfected into fetal fibroblasts, and the transfected cells were used as the donor for somatic cell nuclear transfer. Induction of DsRed expression was successfully controlled by doxycycline treatment in donor fibroblasts and early stage embryos. In conclusion, this study suggested that Piggybac transposition could deliver genes into cells or embryos for developing transgenic pig.Keywords: Miniature pigs, transfection, Piggybac, somatic cell nuclear transfer (SCNT), RFPAfrican Journal of Biotechnology Vol. 12(21), pp. 3188-319

Identification of TUBB2A by quantitative proteomic analysis as a novel biomarker for the prediction of distant metastatic breast cancer

Background Metastasis of breast cancer to distal organs is fatal. However, few studies have identified biomarkers that are associated with distant metastatic breast cancer. Furthermore, the inability of current biomarkers, such as HER2, ER, and PR, to differentiate between distant and nondistant metastatic breast cancers accurately has necessitated the development of novel biomarker candidates. Methods An integrated proteomics approach that combined filter-aided sample preparation, tandem mass tag labeling (TMT), high pH fractionation, and high-resolution MS was applied to acquire in-depth proteomic data from FFPE distant metastatic breast cancer tissues. A bioinformatics analysis was performed with regard to gene ontology and signaling pathways using differentially expressed proteins (DEPs) to examine the molecular characteristics of distant metastatic breast cancer. In addition, real-time polymerase chain reaction (RT-PCR) and invasion/migration assays were performed to validate the differential regulation and function of our protein targets. Results A total of 9441 and 8746 proteins were identified from the pooled and individual sample sets, respectively. Based on our criteria, TUBB2A was selected as a novel biomarker candidate. The metastatic activities of TUBB2A were subsequently validated. In our bioinformatics analysis using DEPs, we characterized the overall molecular features of distant metastasis and measured differences in the molecular functions of distant metastatic breast cancer between breast cancer subtypes. Conclusions Our report is the first study to examine the distant metastatic breast cancer proteome using FFPE tissues. The depth of our dataset allowed us to discover a novel biomarker candidate and a proteomic characteristics of distant metastatic breast cancer. Distinct molecular features of various breast cancer subtypes were also established. Our proteomic data constitute a valuable resource for research on distant metastatic breast cancer.This work was supported by the Industrial Strategic Technology Development Program (#10079271 and #20000134), funded by the Ministry of Trade, Industry, and Energy (MOTIE, Korea); the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea (Grant Number: HI17C0048); the Basic Science Research Program through the Seoul National University Hospital Research Fund (26-2016-0020); and the National Research Foundation of Korea (NRF), funded by the Ministry of Science, ICT & Future Planning (Grant Number: 2018R1A1A1A05077484)

Oncologic outcomes after immediate breast reconstruction following mastectomy: comparison of implant and flap using propensity score matching

Although immediate breast reconstruction has been reported to be oncologically safe, no affirmative study comparing the two reconstruction methods exists. We investigated breast cancer recurrence rates in two breast reconstruction types; implant reconstruction and autologous flap reconstruction. A retrospective cohort study was performed on propensity score-matched (for age, stage, estrogen receptor status) patients who underwent IBR after mastectomy at Seoul National University Hospital between 2010 and 2014. The main outcomes determined were locoregional recurrence-free interval (LRRFI) and disease-free interval (DFI). We analyzed 496 patients among 731 patients following propensity score matching (Median age 43, 247 implant reconstruction and 249 flap reconstruction). During median follow-up of 58.2 months, DFI was not different between the two groups at each tumor stage. However, flap reconstruction showed inferior DFI compared to implant reconstruction in patients with high histologic grade (p = 0.012), and with high Ki-67 (p = 0.028). Flap reconstruction was related to short DFI in multivariate analysis in aggressive tumor subsets. Short DFI after flap reconstruction in aggressive tumor cell phenotype was most evident in hormone positive/Her-2 negative cancer (p = 0.008). LRRFI, on the other hand, did not show difference according to reconstruction method regardless of tumor cell aggressiveness. Although there is no difference in cancer recurrence according to reconstruction method in general, flap-based reconstruction showed higher systemic recurrence associated with histologically aggressive tumors

Are Franchising Systems Beneficial for Lodging Industry in terms of Profitability and Intangible Value?

Franchising plays a significant role in the rapid growth of its retail sales. Franchising is a system in which the franchisor grants a license, trademark,and service mark, as well as advice, and assistance in organizing, merchandising, and managing the business as a long-term business relationship.This system is a major expansion strategy for the hotel industry because of its advantages. Actually, the annual retail sales of business-format franchising were about $246 billion in 1992 (Huber, 1993).In the lodging industry, franchising has contributed so significantly to the growth of major hotelchains since the 1960s that it has made lodging one of the ten most franchised industries in the United States Naturally, franchising systems have gained the interest of researchersand scholars thanks to this rapid growth speed and large scale business. Although there has been considerable interest in franchising, the present research considers whether this system is beneficial for the lodging industry in terms of profitability and intangible value. Based upon prior research, the resource scarcity theory is the most appropriate theory to explain the motivation of franchising companies. The resource scarcity theory suggests that the franchising system can grow more quickly because others\u27 funds are used to finance the construction of the franchised units and other people manage those facilities. However, there is some debate as to whether franchising is more beneficial for the hospitality firms’ financial performance than owning in terms of business operation. Some research compares the financial performance of franchisedrestaurants with the financial performance of non-franchised restaurants. The results reveal that franchised restaurant performance is better. However, it is rare to find a study which compares the franchised lodging industry’s financial performance with that of non-franchised lodging firms. Therefore, the purpose of this research is to compare the financial performance of franchised-lodging industry firms with the financial performance of those which are non-franchised. Moreover, this study is conducted from the franchisors’ perspective. To identify whetherfranchising can influence lodging firms\u27 financial performance, this study investigates the profitability and intangible values of both franchised and non-franchised restaurant firms. The collected data is the lodging companies’ annual reports from 2001 to 2009.The sample used in this study is composed of publicly held lodging firms. Financial data, which is derived from each company’s annual report, were collected from the National Association of Securities Dealers Automated Quotations (NASDAQ) website (http://www.nasdaq.com) and each lodging firm’s website. Some non-franchised lodging firms’ financial data were collected from Korean non-franchising lodging firms. The financial statement came from the Korean Financial Statement Publication Websites (http://dart.fss.or.kr). Since this study is conducted from the hotel franchisor’s perspective, hotel management companies and referral groups plus some companies which include a bigger proportion of casino and resorts than lodging are excluded. As a result, the number of hotel franchisors and non-franchisors is 16. The study period is 2001-2009. Even though the study period is 9 years, each company has a different policy and status to publicize their own financial information. Consequently, collected data are derived from a total number of 92 hotel firms which consist of 54 franchised firms and 38 non-franchised firms. The variables include ROA (Return on Assets), ROE (Return on Equity), intangible value, firm size, leverage, and franchising dummy. The results of the hierarchical regression model, independent t-test, and descriptive statistics support the positive association between ROA, intangible value and franchising. The results of this study show that franchised lodging firms have higher profitability and intangible value than non-franchised firms, and indiscriminate expansion and low financial leverage can lead to poor financial performance. The literature review of this study mentioned that franchisors adopt the franchising system for rapid expansion. Since the franchisee’s funds are available under this system, franchisors can overcome the resource constraint. Also, the economies of scale theory support the efficiency of the franchising system’s resource distribution. Unfortunately, even though there are multiple advantages in a franchising system, the research which treats the relationship between a franchising firm and the firm’s performance is rare. Therefore, this study examines the influence of franchising in lodging firms’ profitability and intangible value. Generally, the results of this study reveal that lodging firms adopting franchise system showed a higher profitability and intangible value than non-franchised lodging firms. Specifically, this study proves that franchised lodging firms record a higher profitability and intangible value, while controlling other variables, including firm size and financial leverage. In addition, this study indicates that a bigger firm size negatively influences in the financial performance of lodging firms. This means that indiscriminate expansion of franchising systems contains the possibility of poor performance in terms of profitability and intangible value. Moreover, this study shows the positive relationship between ROE and debt to owner’s equity ratio. This is the evidence that the lower owner’s equity proportion or the higher liabilities’ proportion can lead to better financial performance of the lodging firms. Finally, this study has some limitations. First, the hotel industry’s profitability can be influenced by economic circumstances. Since each company’s financial data have different periods, this study did not faithfully cover the economic situation. Secondly, the model that is used in this study can be applied only to lodging firms. Other industries may have different models because other industries have different competitive environment and business conditions that affect the financial performance. Thirdly, the size of the sample is not big because lodging firms’ franchisors are rare. This fact led to the restriction of available financial data. Lastly, since this study’s financial data were collected from a global franchisor’s financial data, different currency rates and accounting standards, such as GAAP and IFRS can be a restriction to the analysis financial data. If there is a future study which is related with this concept, the future study can consider these factors in models to further examine the lodging industry\u27s financial performance and intangible value