Collecting Image Cropping Dataset: A Hybrid System of Machine and Human Intelligence

Image cropping is a common tool that exists in almost any image editor, yet automatic cropping is still a difficult problem in Computer Vision. Since images nowadays can be easily collected through the web, machine learning is a promising approach to solve this problem. However, an image cropping dataset is not yet available and gathering such a large-scale dataset is a non-trivial task. Although a crowdsourcing website such as Mechanical Turk seems to be a solution to this task, image cropping is a sophisticated task that is vulnerable to unreliable annotation; furthermore, collecting a large-scale high-quality dataset through crowdsourcing is expensive. Alternatively, we introduce a system that uses automatic methods and human inputs to generate and evaluate image crops. Our system is a hybrid of machine and human intelligence. Given an image, the hybrid system generates image crops in three steps: identify main objects in the image; automatically generate a set of potential good crops around the identified main objects following principle photographic composition; and assess the generated crops. The second step is automatic while the first and third steps require inputs from the human. We obtain these user inputs by designing an online game. In the user’s perspective, our system is a website where users can access to play games. In our perspective, by letting people play games, we have them annotate the images for us with no cost. The games are carefully designed so that users’ feedbacks are helpful to our main goal. The system is embedded with a quality control model that assesses the user’s accuracy and the quality of the annotation

Suboptimal Surveillance for and Knowledge of Hepatocellular Carcinoma Among Primary Care Providers

A large proportion of patients with cirrhosis are seen only by their primary care provider (PCP). Surveillance for hepatocellular carcinoma (HCC) therefore depends on PCPs in these cases. We aimed to assess PCP knowledge and practice of HCC surveillance

Photo Quality Assessment: Predicting Crowd Opinions

Existing methods for photo quality assessment typically formulate photo quality assessment as a binary classification problem that labels a photo as low- or high-quality. Photo quality assessment, however, is subjective, and people often rate a photo differently. Therefore, the quality of a photo sometimes cannot be fully described by a low- or high-quality label. In this paper, we present a subjective photo quality assessment method that predicts how a group of users rates a photo. Specifically, our method predicts a quality score distribution that is likely produced by a group of people rating the photo. Our method models the score distribution using the mean and standard deviation. Our method uses a regression approach and integrates a wide spectrum of image features, including manually crafted features, generic image features, and deep learning features, to predict the mean score and standard deviation. We experiment our method on the large scale AVA dataset where each photo on average is rated by 200 users with score ranges from 1-10. Our experiment shows that our regression approach can predict the mean score and standard deviation with RMSE errors 0.67 and 0.19, respectively

Detecting Rule of Balance in Photography

Rule of Balance is one of the most important composition rules in photography, which can be used as a standard for photo quality assessment. The rule of balance states that images with evenly distributed visual elements are visually pleasing and thus are highly aesthetic. This work presents a method to automatically classify balanced and unbalanced images. Detecting the rule of balance requires a robust technique to locate and analyze important objects and visual elements, which involves understanding of the image content. Since semantic understanding is currently beyond the state of the art in computer vision, we employ the saliency maps as an alternative. We design a range of features according to the definition and effects of the rule of balance. Our experiments with a variety of machine learning techniques ([8-11]) and saliency analysis methods ([2-6]) demonstrate an encouraging performance in detecting vertical and horizontal balanced images. For future works, the balance detecting system can be developed into a subroutine for an automatic evaluation of professional photography

Human Epitopes Identified from Herpes Simplex Virus Tegument Protein VP11/12 (UL46) Recall Multifunctional Effector Memory CD4+ TEM Cells in Asymptomatic Individuals and Protect from Ocular Herpes Infection and Disease in "Humanized" HLA-DR Transgenic Mice.

While the role of CD8+ T cells in the control of herpes simplex virus 1 (HSV-1) infection and disease is gaining wider acceptance, a direct involvement of effector CD4+ T cells in this protection and the phenotype and function of HSV-specific human CD4+ T cell epitopes remain to be fully elucidated. In the present study, we report that several epitopes from the HSV-1 virion tegument protein (VP11/12) encoded by UL46 are targeted by CD4+ T cells from HSV-seropositive asymptomatic individuals (who, despite being infected, never develop any recurrent herpetic disease). Among these, we identified two immunodominant effector memory CD4+ TEM cell epitopes, amino acids (aa) 129 to 143 of VP11/12 (VP11/12129-143) and VP11/12483-497, using in silico, in vitro, and in vivo approaches based on the following: (i) a combination of the TEPITOPE algorithm and PepScan library scanning of the entire 718 aa of HSV-1 VP11/12 sequence; (ii) an in silico peptide-protein docking analysis and in vitro binding assay that identify epitopes with high affinity to soluble HLA-DRB1 molecules; and (iii) an ELISpot assay and intracellular detection of gamma interferon (IFN-γ), CD107a/b degranulation, and CD4+ T cell carboxyfluorescein succinimidyl ester (CFSE) proliferation assays. We demonstrated that native VP11/12129-143 and VP11/12483-497 epitopes presented by HSV-1-infected HLA-DR-positive target cells were recognized mainly by effector memory CD4+ TEM cells while being less targeted by FOXP3+ CD4+ CD25+ regulatory T cells. Furthermore, immunization of HLA-DR transgenic mice with a mixture of the two immunodominant human VP11/12 CD4+ TEM cell epitopes, but not with cryptic epitopes, induced HSV-specific polyfunctional IFN-γ-producing CD107ab+ CD4+ T cells associated with protective immunity against ocular herpes infection and disease.IMPORTANCE We report that naturally protected HSV-1-seropositive asymptomatic individuals develop a higher frequency of antiviral effector memory CD4+ TEM cells specific to two immunodominant epitopes derived from the HSV-1 tegument protein VP11/12. Immunization of HLA-DR transgenic mice with a mixture of these two immunodominant CD4+ T cell epitopes induced a robust antiviral CD4+ T cell response in the cornea that was associated with protective immunity against ocular herpes. The emerging concept of developing an asymptomatic herpes vaccine that would boost effector memory CD4+ and CD8+ TEM cell responses is discussed

Upregulation of Multiple CD8+ T Cell Exhaustion Pathways Is Associated with Recurrent Ocular Herpes Simplex Virus Type 1 Infection.

A large proportion of the world's population harbors latent HSV type 1 (HSV-1). Cross-talk between antiviral CD8+ T cells and HSV-1 appear to control latency/reactivation cycles. We found that compared with healthy asymptomatic individuals, in symptomatic (SYMP) patients, the CD8+ T cells with the same HLA-A*0201-restricted HSV-1 epitope specificities expressed multiple genes and proteins associated to major T cell exhaustion pathways and were dysfunctional. Blockade of immune checkpoints with anti-LAG-3 and anti-PD-1 antagonist mAbs synergistically restored the frequency and function of antiviral CD8+ T cells, both 1) ex vivo, in SYMP individuals and SYMP HLA-A*0201 transgenic mice; and 2) in vivo in HSV-1-infected SYMP HLA-A*0201 transgenic mice. This was associated with a significant reduction in virus reactivation and recurrent ocular herpetic disease. These findings confirm antiviral CD8+ T cell exhaustion during SYMP herpes infection and pave the way to targeting immune checkpoints to combat recurrent ocular herpes

Suboptimal Surveillance for and Knowledge of Hepatocellular Carcinoma Among Primary Care Providers

A large proportion of patients with cirrhosis are seen only by their primary care provider (PCP). Surveillance for hepatocellular carcinoma (HCC) therefore depends on PCPs in these cases. We aimed to assess PCP knowledge and practice of HCC surveillance

NLRP3, NLRP12, and IFI16 Inflammasomes Induction and Caspase-1 Activation Triggered by Virulent HSV-1 Strains Are Associated With Severe Corneal Inflammatory Herpetic Disease.

The crosstalk between the host's inflammasome system and the invading virulent/less-virulent viruses determines the outcome of the ensuing inflammatory response. An appropriate activation of inflammasomes triggers antiviral inflammatory responses that clear the virus and heal the inflamed tissue. However, an aberrant activation of inflammasomes can result in a harmful and overwhelming inflammation that could damage the infected tissue. The underlying host's immune mechanisms and the viral virulent factors that impact severe clinical inflammatory disease remain to be fully elucidated. In this study, we used herpes simplex virus type 1 (HSV-1), the causative agent of corneal inflammatory herpetic disease, as a model pathogen to determine: (i) Whether and how the virulence of a virus affects the type and the activation level of the inflammasomes; and (ii) How triggering specific inflammasomes translates into protective or damaging inflammatory response. We showed that, in contrast to the less-virulent HSV-1 strains (RE, F, KOS, and KOS63), corneal infection of B6 mice with the virulent HSV-1 strains (McKrae, 17 or KOS79): (i) Induced simultaneous expression of the NLRP3, NLRP12, and IFI16 inflammasomes; (ii) Increased production of the biologically active Caspase-1 and pro-inflammatory cytokines IL-1β and IL-18; (iii) Heightened recruitment into the inflamed cornea of CD45highLy6C+Ly6G-F4/80+CD11b+CD11c- inflammatory monocytes and CD45highCD11b+F4/80-Ly6GhiLy6Cmed neutrophils; and (iv) This intensified inflammatory response was associated with a severe corneal herpetic disease, irrespective of the level of virus replication in the cornea. Similarly, in vitro infection of human corneal epithelial cells and human monocytic THP-1 cells with the virulent HSV-1 strains triggered a synchronized early expression of NLRP3, NLRP12 and IFI16, 2 h post-infection, associated with formation of single and dense specks of the adapter molecule ASC in HSV(+) cells, but not in the neighboring bystander HSV(-) cells. This was associated with increased cleavages of Caspase-1, IL-1β, and IL-18. These findings suggest a previously unappreciated role of viral virulence in a synchronized early induction of the NLRP3, NLRP12, and IFI16 inflammasomes that lead to a damaging inflammatory response. A potential role of common virus virulent factors that stimulate this harmful inflammatory corneal disease is currently under investigation