Knowledge Distillation with Adversarial Samples Supporting Decision Boundary

Many recent works on knowledge distillation have provided ways to transfer the knowledge of a trained network for improving the learning process of a new one, but finding a good technique for knowledge distillation is still an open problem. In this paper, we provide a new perspective based on a decision boundary, which is one of the most important component of a classifier. The generalization performance of a classifier is closely related to the adequacy of its decision boundary, so a good classifier bears a good decision boundary. Therefore, transferring information closely related to the decision boundary can be a good attempt for knowledge distillation. To realize this goal, we utilize an adversarial attack to discover samples supporting a decision boundary. Based on this idea, to transfer more accurate information about the decision boundary, the proposed algorithm trains a student classifier based on the adversarial samples supporting the decision boundary. Experiments show that the proposed method indeed improves knowledge distillation and achieves the state-of-the-arts performance.Comment: Accepted to AAAI 201

Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons

An activation boundary for a neuron refers to a separating hyperplane that determines whether the neuron is activated or deactivated. It has been long considered in neural networks that the activations of neurons, rather than their exact output values, play the most important role in forming classification friendly partitions of the hidden feature space. However, as far as we know, this aspect of neural networks has not been considered in the literature of knowledge transfer. In this paper, we propose a knowledge transfer method via distillation of activation boundaries formed by hidden neurons. For the distillation, we propose an activation transfer loss that has the minimum value when the boundaries generated by the student coincide with those by the teacher. Since the activation transfer loss is not differentiable, we design a piecewise differentiable loss approximating the activation transfer loss. By the proposed method, the student learns a separating boundary between activation region and deactivation region formed by each neuron in the teacher. Through the experiments in various aspects of knowledge transfer, it is verified that the proposed method outperforms the current state-of-the-art.Comment: Accepted to AAAI 201

Skeleton-based Action Recognition of People Handling Objects

In visual surveillance systems, it is necessary to recognize the behavior of people handling objects such as a phone, a cup, or a plastic bag. In this paper, to address this problem, we propose a new framework for recognizing object-related human actions by graph convolutional networks using human and object poses. In this framework, we construct skeletal graphs of reliable human poses by selectively sampling the informative frames in a video, which include human joints with high confidence scores obtained in pose estimation. The skeletal graphs generated from the sampled frames represent human poses related to the object position in both the spatial and temporal domains, and these graphs are used as inputs to the graph convolutional networks. Through experiments over an open benchmark and our own data sets, we verify the validity of our framework in that our method outperforms the state-of-the-art method for skeleton-based action recognition.Comment: Accepted in WACV 201

Ten years of MIREX: reflections, challenges and opportunities

The Music Information Retrieval Evaluation eXchange (MIREX) has been run annually since 2005, with the October 2014 plenary marking its tenth iteration. By 2013, MIREX has evaluated approximately 2000 individual music information retrieval (MIR) algorithms for a wide range of tasks over 37 different test collections. MIREX has involved researchers from over 29 different contrives with a median of 109 individual participants per year. This pater summarizes the history of MIREX form its earliest planning meeting in 2001 to the present. It reflects upon the administrative, financial, and technological challenges MIREX has faced and describes how those challenges have been surmounted. We propose new funding models, a distributed evaluation framework, and more holistic user experience evaluation tasks-some evolutionary, some revolutionary-for the continued success of MIREX. We hope that this paper will inspire MIR community members to contribute their ideas so MIREX can have many more successful years to come

Identification of predictive variables for the recurrence of oral mucocele

Oral mucocele is the most common minor salivary gland lesion with good prognosis after surgical removal. However, its recurrence is not rare, sometimes bothersome. This study aimed to identify the possible predictive variables affecting the recurrence rate of oral mucocele. The histoclinical data of 164 patients diagnosed with oral mucocele were retrospectively obtained by reviewing dental records. The predictive variables for its recurrence were identified by analyzing its recurrence rate according to clinical variables. The recurrence rate showed the significant differences according to location and age. Oral mucocele recurred with significantly higher frequency on the ventral mucosa of tongue (50.0%) than on the labial/buccal mucosa (8.8%). Its recurrence was significantly more common in the younger patients (aged 30 years, 4.4%). However, there was no significant difference in recurrence rates between surgical procedures using scalpels and those using lasers. Patients with oral mucocele should be more carefully informed of its possible recurrence, especially when it is found on the ventral surface of the tongue or in a younger population

Impact of Emotional Harassment on Firm’s Value

The activities and consequences of workplace bullying and harassment have been widely explored in the literature but mainly studied within the scope of individuals or at the team level. Taking a holistic approach, we associate the concept of bullying with firm-level performance as well as stakeholders’ responses in the market. In this paper, we examine whether and how market investors react to the news of corporate harassment by top officials of publicly listed firms in Korea. Using a standard event study methodology and multiple regression analysis with matched sample, we find significantly negative stock price reactions to news of corporate bullying. We also find that the impact is more salient if emotional bullying is involved and discuss both the theoretical and practical implications of these findings

Medial Meniscal Tears in Anterior Cruciate Ligament-Deficient Knees: Effects of Posterior Tibial Slope on Medial Meniscal Tear

PURPOSE: To evaluate the incidence of meniscal tears in patients with chronic anterior cruciate ligament (ACL)-deficient knees, and to determine the influence of posterior tibial slope (PTS) on medial meniscal tears in ACL-deficient knees. MATERIALS AND METHODS: We reviewed 174 patients (174 knees) with a mean age of 30.7 years who underwent ACL reconstruction for chronic ACL tears. We divided the patients into two groups: low group (135 knees with a PTS or =13degrees). RESULTS: The incidence of medial meniscus tears was 44% (77/174), and that of lateral meniscus tears was 35% (61/174). The mean PTS in patients with medial meniscal tears was 11.4degrees+/-3.0degrees, whereas that in patients without medial meniscal tears was 9.8degrees+/-2.4degrees. The incidence of meniscal tears was 57.8% (78/135) in the low group and 89.7% (35/39) in the high group (p or =13degrees is a risk factor for secondary medial meniscal tears in ACL-deficient knees. So, we suggest that PTS is one of the considerations for determining early ACL reconstruction to prevent secondary meniscal tears.ope