A 3D descriptor to detect task-oriented grasping points in clothing

© 2016. This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/Manipulating textile objects with a robot is a challenging task, especially because the garment perception is difficult due to the endless configurations it can adopt, coupled with a large variety of colors and designs. Most current approaches follow a multiple re-grasp strategy, in which clothes are sequentially grasped from different points until one of them yields a recognizable configuration. In this work we propose a method that combines 3D and appearance information to directly select a suitable grasping point for the task at hand, which in our case consists of hanging a shirt or a polo shirt from a hook. Our method follows a coarse-to-fine approach in which, first, the collar of the garment is detected and, next, a grasping point on the lapel is chosen using a novel 3D descriptor. In contrast to current 3D descriptors, ours can run in real time, even when it needs to be densely computed over the input image. Our central idea is to take advantage of the structured nature of range images that most depth sensors provide and, by exploiting integral imaging, achieve speed-ups of two orders of magnitude with respect to competing approaches, while maintaining performance. This makes it especially adequate for robotic applications as we thoroughly demonstrate in the experimental section.Peer ReviewedPostprint (author's final draft

Browse-to-search

This demonstration presents a novel interactive online shopping application based on visual search technologies. When users want to buy something on a shopping site, they usually have the requirement of looking for related information from other web sites. Therefore users need to switch between the web page being browsed and other websites that provide search results. The proposed application enables users to naturally search products of interest when they browse a web page, and make their even causal purchase intent easily satisfied. The interactive shopping experience is characterized by: 1) in session - it allows users to specify the purchase intent in the browsing session, instead of leaving the current page and navigating to other websites; 2) in context - -the browsed web page provides implicit context information which helps infer user purchase preferences; 3) in focus - users easily specify their search interest using gesture on touch devices and do not need to formulate queries in search box; 4) natural-gesture inputs and visual-based search provides users a natural shopping experience. The system is evaluated against a data set consisting of several millions commercial product images. © 2012 Authors

Apparel recommendation system evolution: an empirical review

Purpose: With the developments of e-commerce markets, novel recommendation technologies are becoming an essential part of many online retailers' economic models to help drive online sales. Initially, the purpose of this paper is to undertake an investigation of apparel recommendations in the commercial market in order to verify the research value and significance. Then, this paper reviews apparel recommendation techniques and systems through academic research, aiming to acquaint apparel recommendation context, summarize the pros and cons of various research methods, identify research gaps and eventually propose new research solutions to benefit apparel retailing market. Design/methodology/approach: This study utilizes empirical research drawing on 130 academic publications indexed from online databases. The authors introduce a three-layer descriptor for searching articles, and analyse retrieval results via distribution graphics of years, publications and keywords. Findings: This study classified high-tech integrated apparel systems into 3D CAD systems, personalised design systems and recommendation systems. The authors' research interest is focussed on recommendation system. Four types of models were found, namely clothes searching/retrieval, wardrobe recommendation, fashion coordination and intelligent recommendation systems. The forth type, smart systems, has raised more awareness in apparel research as it is equipped with advanced functions and application scenarios to satisfy customers. Despite various computational algorithms tested in system modelling, existing research is lacking in terms of apparel and users profiles research. Thus, from the review, the authors have identified and proposed a more complete set of key features for describing both apparel and users profiles in a recommendation system. Originality/value: Based on previous studies, this is the first review paper on this topic in this subject field. The summarised work and the proposed new research will inspire future researchers with various knowledge backgrounds, especially, from a design perspective