Robotic manipulation for the shoe-packaging process

Abstract

[EN] This paper presents the integration of a robotic system in a human-centered environment, as it can be found in the shoe manufacturing industry. Fashion footwear is nowadays mainly handcrafted due to the big amount of small production tasks. Therefore, the introduction of intelligent robotic systems in this industry may contribute to automate and improve the manual production steps, such us polishing, cleaning, packaging, and visual inspection. Due to the high complexity of the manual tasks in shoe production, cooperative robotic systems (which can work in collaboration with humans) are required. Thus, the focus of the robot lays on grasping, collision detection, and avoidance, as well as on considering the human intervention to supervise the work being performed. For this research, the robot has been equipped with a Kinect camera and a wrist force/ torque sensor so that it is able to detect human interaction and the dynamic environment in order to modify the robot¿s behavior. To illustrate the applicability of the proposed approach, this work presents the experimental results obtained for two actual platforms, which are located at different research laboratories, that share similarities in their morphology, sensor equipment and actuation system.This work has been partly supported by the Ministerio de Economia y Competitividad of the Spanish Government (Key No.: 0201603139 of Invest in Spain program and Grant No. RTC-2016-5408-6) and by the Deutscher Akademischer Austauschdienst (DAAD) of the German Government (Projekt-ID 54368155).Gracia Calandin, LI.; Perez-Vidal, C.; Mronga, D.; Paco, JD.; Azorin, J.; Gea, JD. (2017). Robotic manipulation for the shoe-packaging process. The International Journal of Advanced Manufacturing Technology. 92(1-4):1053-1067. https://doi.org/10.1007/s00170-017-0212-6S10531067921-4Pedrocchi N, Villagrossi E, Cenati C, Tosatti LM (2017) Design of fuzzy logic controller of industrial robot for roughing the uppers of fashion shoes. Int J Adv Manuf Technol 77(5):939–953Hinojo-Perez JJ, Davia-Aracil M, Jimeno-Morenilla A, Sanchez-Romero L, Salas F (2016) Automation of the shoe last grading process according to international sizing systems. Int J Adv Manuf Technol 85(1):455–467Dura-Gil JV, Ballester-Fernandez A, Cavallaro M, Chiodi A, Ballarino A, von Arnim V., Brondi C, Stellmach D (2016) New technologies for customizing products for people with special necessities: project fashion-able. Int J Comput Integr Manuf. In Press, doi: 10.1080/0951192X.2016.1145803Jatta F, Zanoni L, Fassi I, Negri S (2004) A roughing/cementing robotic cell for custom made shoe manufacture. Int J Comput Integr Manuf 17(7):645–652Nemec B, Zlajpah L (2008) Robotic cell for custom finishing operations. Int J Comput Integr Manuf 21(1):33–42Molfino R, et al (2004) Modular, reconfigurable prehensor for grasping and handling limp materials in the shoe industry. In: IMS international forum, CernobbioIntelishoe - integration and linking of shoe and auxiliary industries. 5Th FPSpecial shoes movement. 7th FP, NMP-2008-SME-2-R.229261, http://www.sshoes.euVilaca JL, Fonseca J (2007) A new software application for footwear industry. In: IEEE international symposium on intelligent signal processing WISP 2007, pp 1–6Custom, environment and comfort made shoe. 6TH FP [2004-2008]Framework of integrated technologies for user centred products. Grant agreement no.: CP-TP 229336-2. NMP2-SE-2009-229336 FIT4U -7TH FPRobofoot project website. http://www.robofoot.eu/ . Accessed 2016/ 09/16Montiel E (2007) Customization in the footwear industry. In: proceedings of the MIT congress on mass customizationSucan I, Kavraki LE (2012) A sampling-based tree planner for systems with complex dynamics, vol 28Kuffner JJ Jr, LaValle SM (2000) Rrt-connect: an efficient approach to single-query path planning. In: Proceedings of the IEEE international conference on robotics and automation, 2000. ICRA ’00, vol 2, pp 995–1001Ratliff N, Zucker M, Andrew Bagnell J, Srinivasa S (2009) Chomp: gradient optimization techniques for efficient motion planning. In: IEEE international conference on robotics and automation, 2009. ICRA ’09, pp 489–494Brock O, Khatib O (1997) Elastic strips: real-time path modification for mobile manipulationKroger T (2011) Opening the door to new sensor-based robot applications #x2014;the reflexxes motion libraries. In: 2011 IEEE international conference on robotics and automation (ICRA), pp 1–4Berg J, Ferguson D, Kuffner J (2006) Anytime path planning and replanning in dynamic environments. In: Proceedings of the IEEE international conference on robotics and automation (ICRA), pp 2366–2371Berenson D, Abbeel P, Goldberg K (2012) A robot path planning framework that learns from experience. In: IEEE international conference on robotics and automation. IEEE, pp 3671–3678Bischoff R, Kurth J, Schreiber G, Koeppe R, Albu-Schaeffer A, Beyer A, Eiberger O, Haddadin S, Stemmer A, Grunwald G, Hirzinger G (2010) The kuka-dlr lightweight robot arm — a new reference platform for robotics research and manufacturing. In: Robotics (ISR), 2010 41st international symposium on and 2010 6th German conference on robotics (ROBOTIK), pp 1–8Rooks B (2006) The harmonious robot. Industrial Robot-an International Journal 33:125–130Vahrenkamp N, Wieland S, Azad P, Gonzalez D, Asfour T, Dillmann R (2008) Visual servoing for humanoid grasping and manipulation tasks. In: 8th IEEE-RAS international conference on humanoid robots, 2008, Humanoids 2008, pp 406–412Pieters RS, et al. (2012) Direct trajectory generation for vision-based obstacle avoidance. In: Proceedings of the 2012 IEEE/RSJ international conference on intelligent robots and systemsKinect for windows sensor components and specifications, website. http://msdn.microsoft.com/en-us/library/jj131033.aspx . Accessed 2016/09/16Jatta F, Zanoni L, Fassi I, Negri S (2004) A roughing cementing robotic cell for custom made shoe manufacture. Int J Comput Integr Manuf 17(7):645–652Maurtua I, Ibarguren A, Tellaeche A (2012) Robotics for the benefit of footwear industry. In: International conference on intelligent robotics and applications. Springer, Berlin, pp 235–244Arkin RC (1998) Behavior-based robotics. MIT PressNilsson NJ (1980) Principles of artificial intelligence. Morgan KaufmannAsada H, Slotine J-JE (1986) Robot analysis and control. WileyROS official web page. http://www.ros.org , (Accessed on 2017/ 02/03)Langmann B, Hartmann K, Loffeld O (2012) Depth camera technology comparison and performance evaluation. In: 1st international conference on pattern recognition applications and methods, pp 438–444The player project. free software tools for robot and sensor applications. http://playerstage.sourceforge.net/ , (Accessed on 2017/ 02/03)Yet another robot platform (YARP). http://www.yarp.it/ , (Accessed on 2017/02/03)The OROCOS project. smarter control in robotics and automation. http://www.orocos.org/ , (Accessed on 2017/02/03)CARMEN: Robot navigation toolkit. http://carmen.sourceforge.net/ , (Accessed on 2017/02/03)ORCA: Components for robotics. http://orca-robotics.sourceforge.net/ , (Accessed on 2017/02/03)MOOS: Mission oriented operating suite. http://www.robots.ox.ac.uk/mobile/MOOS/wiki/pmwiki.php/Main/HomePage , (Accessed on 2017/02/03)Microsoft robotics studio. https://www.microsoft.com/en-us/download/details.aspx?id=29081 , (Accessed on 2017/02/03)Pr2 ros website. http://www.ros.org/wiki/Robots/PR2 . Accessed 2016/09/16Care-o-bot 3 ros website. http://www.ros.org/wiki/Robots/Care-O-bot . Accessed 2016/09/16Aila, mobile dual-arm manipulation, website. http://robotik.dfki-bremen.de/de/forschung/robotersysteme/aila.html . Accessed 2016/09/16Package libpcan documentation, website. http://www.ros.org/wiki/libpcan . Accessed 2016/09/16Pcan driver for linux, user manual. http://www.peak-system.com . Document version 7.1 (2011-03-21)Pcan driver for linux, user manual. http://wiki.ros.org/schunk_powercube_chain . Accessed 2016/09/16Ros nodes documentation, website. http://www.ros.org/wiki/Nodes . Accessed 2016/09/16Ros messages documentation, website. http://www.ros.org/wiki/Messages . Accessed 2016/09/16Ros topics documentation, website. http://www.ros.org/wiki/Topics . Accessed 2016/09/16Ros services documentation, website. http://www.ros.org/wiki/Services . Accessed 2016/09/16Yaml files officials website. http://www.yaml.org/ . Accessed 2016/ 09/16Ros robot model (urdf) documentation website. http://www.ros.org/wiki/urdf . Accessed 2016/09/16Point cloud library (pcl), website. http://www.pointclouds.org/ . Accessed 2016/09/16Arm navigation ros stack, website. http://wiki.ros.org/arm_navigation . Accessed 2016/09/16Hornung A, Wurm KM, Bennewitz M, Stachniss C, Burgard W (2013) Octomap: an efficient probabilistic 3d mapping framework based on octrees Autonomous RobotsOrocos kdl documentation, website. http://www.orocos.org/kdl . Accessed 2016/09/16Ioan A, Şucan MM, Kavraki LE (2012) The open motion planning library, vol 19. http://ompl.kavrakilab.orgWaibel M, Beetz M, Civera J, D’Andrea R, Elfring J, Galvez-Lopez D, Haussermann K, Janssen R, Montiel JMM, Perzylo A, Schiessle B, Tenorth M, Zweigle O, van de Molengraft R (2011) Roboearth. IEEE Robot Autom Mag 18(2):69–82Simox toolbox. http://simox.sourceforge.net/ . Accessed 2016/09/16Moreels P, Perona P (2007) Evaluation of features detectors and descriptors based on 3d objects. Int J Comput Vis 73:263–284Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, 2001. CVPR 2001, vol 1Teuliere C, Marchand E, Eck L (2010) Using multiple hypothesis in model-based tracking. In: 2010 IEEE international conference on robotics and automation (ICRA), pp 4559–4565Moulianitis VC, Dentsoras AJ, Aspragathos NA (1999) A knowledge-based system for the conceptual design of grippers for handling fabrics. Artif Intell Eng Des Anal Manuf 13(1):13–25Davis S, Tsagarakis NG, Caldwell DG (2008) The initial design and manufacturing process of a low cost hand for the robot icub. In: 8th IEEE-RAS international conference on humanoid robots, pp 40–45Cerruti G, Chablat D, Gouaillier D, Sakka S (2017) Design method for an anthropomorphic hand able to gesture and grasp. In: IEEE international conference on robotics and automation. IEEE, pp 3671–367