Fine-Grained Product Class Recognition for Assisted Shopping

Assistive solutions for a better shopping experience can improve the quality of life of people, in particular also of visually impaired shoppers. We present a system that visually recognizes the fine-grained product classes of items on a shopping list, in shelves images taken with a smartphone in a grocery store. Our system consists of three components: (a) We automatically recognize useful text on product packaging, e.g., product name and brand, and build a mapping of words to product classes based on the large-scale GroceryProducts dataset. When the user populates the shopping list, we automatically infer the product class of each entered word. (b) We perform fine-grained product class recognition when the user is facing a shelf. We discover discriminative patches on product packaging to differentiate between visually similar product classes and to increase the robustness against continuous changes in product design. (c) We continuously improve the recognition accuracy through active learning. Our experiments show the robustness of the proposed method against cross-domain challenges, and the scalability to an increasing number of products with minimal re-training.Comment: Accepted at ICCV Workshop on Assistive Computer Vision and Robotics (ICCV-ACVR) 201

Engineering students’ spatial abilities in Budapest and Debrecen

The goal of this paper is to provide the level of first-year engineering students’ spatial abilities. We made our comparative survey at the Szent István University Budapest and University of Debrecen, Faculty of Engineering among first-year students of architecture. We made the survey among those students, who were successful in Descriptive Geometry I and II. We were looking for the answer for the question whether which part of the firstyear architecture students’ spatial ability and spatial geometrical knowledge is incomplete, and whether the students of two universities have sufficient differences between their spatial ability. The test results have been statistically evaluated and conclusions formulated. Keywords: Spatial ability, Descriptive Geometry education MSC: 51N0

Multiframe visual-inertial blur estimation and removal for unmodified smartphones

Pictures and videos taken with smartphone cameras often suffer from motion blur due to handshake during the exposure time. Recovering a sharp frame from a blurry one is an ill-posed problem but in smartphone applications additional cues can aid the solution. We propose a blur removal algorithm that exploits information from subsequent camera frames and the built-in inertial sensors of an unmodified smartphone. We extend the fast non-blind uniform blur removal algorithm of Krishnan and Fergus to non-uniform blur and to multiple input frames. We estimate piecewise uniform blur kernels from the gyroscope measurements of the smartphone and we adaptively steer our multiframe deconvolution framework towards the sharpest input patches. We show in qualitative experiments that our algorithm can remove synthetic and real blur from individual frames of a degraded image sequence within a few seconds

Motor recovery beginning 23 years after ischemic stroke

It is widely believed that most stroke recovery occurs within 6 mo, with little benefit of physiotherapy or other modalities beyond 1 yr. We report a remarkable case of stroke recovery beginning 23 yr after a severe stroke due to embolization from the innominate artery and subclavian artery, resulting from compression of the right subclavian artery by a cervical rib. The patient had a large right frontoparietal infarction with severe left hemiparesis and a totally nonfunctional spastic left hand. He experienced some recovery of hand function that began 23 yr after the stroke, 1 yr after he took up regular swimming. As a result, intensive physiotherapy was initiated, with repetitive large muscle movement and a spring-loaded mechanical orthosis that provides resistance to finger flexors and supports finger extensors. Within 2 yr, he could pick up coins with the previously useless left hand. Functional MRI studies document widespread distribution of the recovery in both hemispheres. This case provides impetus not only to more intensive and prolonged physiotherapy, but also to treatment with emerging modalities such as stem cell therapy and exosome and microRNA therapies. NEW & NOTEWORTHY Widespread bilateral activation of both sides of the cerebrum and cerebellum are demonstrated on functional MRI after motor recovery of a completely nonfunctional left hand that began 23 yr after a severe stroke. This suggests that the generally accepted window of recovery beyond which further therapy is not indicated should be entirely reconsidered. Physiotherapy and new modalities in development might be indicated long after a stroke