Blümel, Ina

Klein, Reinhard

Wessel, Raoul

English

KITopen

Ina BlümelWorkshop on Classification and Subject Indexing in Library and Information Science (LIS'2013)10.07.2013Towards an automatic multi-label classification of 3D architectural modelsTIB-project conducted with University of Bonn• founded in 1959• financed by Federal Government and all Federal States• recently positively evaluated in 2011• Global literature supplier• > 6 mio media units• Scientific and technical information• engineering, architecture, chemistry, information technology, mathematics and physicsGerman National Library of Science and TechnologyTIB – facts2Traditional textual materialsSome current challenges for libraries…• Increasing information volume 10x larger in 2011 than in 2006*• Extension of search space WWW instead catalog• Structural aspects / Document models „Enhanced publications“, increasingly hybrid• New content / media formats increasing amount of non textual information – e.g. 3D models3* IDC Study 2008CONTENT BASEDINDEXINGVISUAL SEARCHINGTIB goals4• Scientific library services for non textual documents• Integrating indexing and file processing into library workflow• Innovative user interfaces for searching and visualisation• several projects, e.g. PROBADO 3D models of architecture• development in cooperation with partners5Architects are…– creating 3D models when drafting– gladly using existing models• …as source for inspiration• …for direct integration into own drafts– searching for models• WWW• databases• …3D models in architecturehere: Computer aided design process* conducted within PROBADO project 2006+Survey among 58 architects*:71% use existing 3D modelsSearch methods most wanted:Textual: 72,5% Query‐by‐example: 27,5%3D models – content? no explicitly available information (for e.g. full text search) poor metadata annotation available Need for indexing and classification algorithms (tailored to architectural data and architect‘s requirements)opened in CAD editor… Machine view: definition of vertices / faces, no semantics6Automatic multi-label classification of 3D modelsproject for the development of a prototypeTIB and University of Bonn???Given: A set of 3D models without any textual annotationObjective: Multi-label classification of the models in order to allow textual search for these modelstables sideboardsseating furniturearmatures mirrorssofascouchescolumn tables7Training data• We want to have as little work with any manual labeling for training purposes• We want to have multiple labelingWe chose:• Archibase portal, about 16.000 object models• manually annotated with keywordsTraining data and preliminary work (TIB)Step 1:a) Selection: terms that correspond to a particular formb) Mapping of Archibase terms on AAT classes > 15 models / conceptseat 1049table 933chair 877easy chair 777couch 760lamp 739sofa 739furniture 696elbow chair 687armchair 682desk 637luminaire 621locker 607rack 560– building element• fixtures– fixtures.circulation fixtures– fixtures.cleaning fixtures– fixtures.culinary fixtures– fixtures.general room and secondary spacesfixtures– fixtures.sanitary fixtures• installations– installations.electrical– installations.lifts and escalators– installations.lighting– installations.lightning protection and conductors– installations.power– installations.telecommunication• primary elements– primary elements.building elements above roof– primary elements.ceilings– primary elements.external walls– primary elements.external walls.curtain walling– primary elements.external walls.loadbearing walls– primary elements.external walls.non‐loadbearingwalls– primary elements.flat roofs and terracesDescriptor calculation, classification and integration(Bonn University)Step 2:Implementation of the shape descriptorsStep 3:Application on test setEvaluation feedback  adaptation of the algorithm, various iterationsStep 4:Integration into PROBADO framework10Challenges #1• Training data: inconsistencies in keyword assignment, no real "ground truth"11Challenges #2• Shape variance within classes12Challenges #3• similar classes (considering their shape) both at Archibase and AAT13Challenges #4• Amount of training data in classes14Challenges #5• Suitability of descriptor15Results• Training with different parameter settings• about 6 out of 10 models was tagged correctly, about every 9 tagged incorrectly• Optimization algorithm, such that low false positive rate occurs(book)shelves 73,000 76,000balusters 92,857 83,333balustrades 85,714 60,000barriers 90,196 78,049bathtubs 90,909 52,577benches 79,070 65,714bidets 75,000 91,667bookcases 83,333 73,684boxes 84,000 64,000brackets 72,000 68,000cabinets 74,000 79,000candles_and_candleholders 86,000 73,000chandeliers_(hanging_lights) 85,000 85,000chests_of_drawers 84,000 68,000coffee_tables 81,395 53,659columns 94,805 74,576console_tables 71,429 41,667couches 69,000 87,000cupboards 86,441 85,714curtains 96,226 96,000dining_tables 83,333 73,333divans 89,000 75,000doors 92,000 87,629double_beds 89,000 88,000dressing_tables 81,250 80,000easy_chairs 74,000 84,000elbow_chairs 81,000 86,000faucets 87,671 79,105fences 89,706 78,333floor_lamps 92,308 87,719hassocks 80,435 71,739lampposts 95,238 67,500lanterns 81,818 58,511lockers 81,000 70,000lusters 86,000 83,000i l i 100 000 80 000Selection• Visualization Tool for selection of classes that are to be accepted• 37 of classes 83 integrated17Integration into the PROBADO 3D portal• Ranking by confidences18Publications (selection)• Metadatenbasierte Kontextualisierung architektonischer 3D-ModelleIna BlümelDissertation, HU Berlin 2013• 3D @Technische Informationsbibliothek (TIB)Ina Blümel, Irina Sensin Unimagazin, Ausgabe 1|2-2012 "WebScience", Präsidium der LUH (Hrsg.), Juni 2012, Seiten 16ff• Efficient Retrieval of 3D Building Models Using Embeddings of Attributed SubgraphsRaoul Wessel, Sebastian Ochmann, Richard Vock, Ina Blümel, Reinhard KleinProceedings of the 20th ACM Conference on Information and Knowledge Management (CIKM 2011) : Glasgow, UK, Okt. 2011• Supporting Planning through Content-Based Indexing and 3D Shape RetrievalIna Blümel, René Berndt, Sebastian Ochmann, Richard Vock and Raoul WesselProceedings of 10th International Conference on Design & Decision Support Systems in Architecture und Urban Planning (DDSS), July, 2010• A 3D Shape Benchmark for Retrieval and Automatic Classification of Architectural DataR. Wessel, I. Blümel and R. KleinEUROGRAPHICS 2009 Workshop on 3D Object Retrieval, March 2009• The Room Connectivity Graph: Shape Retrieval in the Architectural DomainR. Wessel, I. Blümel and R. KleinProceedings of The 16-th International Conference in Central Europe on Computer Graphics, Visualization und Computer Vision'2008, ISBN 978-80-86943-15-2, February 200819Thank you for your attention!Ina Blümel, TIB HannoverRaoul Wessel, Steinbeis Research Center Computer Graphics and Digitalization BonnReinhard Klein, Computer Graphics Group University of Bonn

Towards an automatic multi-label classification of 3D architectural models. TIB-project conducted with University of Bonn

https://publikationen.bibliothek.kit.edu/1000035751/2683992

Towards an automatic multi-label classification of 3D architectural models. TIB-project conducted with University of Bonn

Abstract

Similar works

Full text

Available Versions

KITopen