Semi-automatic geometry-driven reassembly of fractured archeological objects

Nombre pages : 6International audience3D laser scanning of broken cultural heritage content is becoming increasingly popular, resulting in large collections of detailed fractured archeological 3D objects that have to be reassembled virtually. In this paper, we present a new semi-automatic reassembly approach for pairwise matching of the fragments, that makes it possible to take into account both the archeologist's expertise, as well as the power of automatic geometry-driven matching algorithms. Our semi-automatic reassembly approach is based on a real-time interaction loop: an expert user steadily specifies approximate initial relative positions and orientations between two fragments by means of a bimanual tangible user interface. These initial poses are continuously corrected and validated in real-time by an algorithm based on the Iterative Closest Point (ICP): the potential contact surface of the two fragments is identified by efficiently pruning insignificant areas of a pair of two bounding sphere hierarchies, that is combined with a k-d tree for closest vertex queries. The locally optimal relative pose for the best match is robustly estimated by taking into account the distance of the closest vertices as well as their normals. We provide feedback to the user by a visual representation of the locally optimal best match and its associated error. Our first results on a concrete dataset show that our system is capable of assisting an expert user in real-time during the pairwise matching of downsampled 3D fragments

A Survey of Geometric Analysis in Cultural Heritage

We present a review of recent techniques for performing geometric analysis in cultural heritage (CH) applications. The survey is aimed at researchers in the areas of computer graphics, computer vision and CH computing, as well as to scholars and practitioners in the CH field. The problems considered include shape perception enhancement, restoration and preservation support, monitoring over time, object interpretation and collection analysis. All of these problems typically rely on an understanding of the structure of the shapes in question at both a local and global level. In this survey, we discuss the different problem forms and review the main solution methods, aided by classification criteria based on the geometric scale at which the analysis is performed and the cardinality of the relationships among object parts exploited during the analysis. We finalize the report by discussing open problems and future perspectives

Analysis of 3D objects at multiple scales (application to shape matching)

Depuis quelques années, l évolution des techniques d acquisition a entraîné une généralisation de l utilisation d objets 3D très dense, représentés par des nuages de points de plusieurs millions de sommets. Au vu de la complexité de ces données, il est souvent nécessaire de les analyser pour en extraire les structures les plus pertinentes, potentiellement définies à plusieurs échelles. Parmi les nombreuses méthodes traditionnellement utilisées pour analyser des signaux numériques, l analyse dite scale-space est aujourd hui un standard pour l étude des courbes et des images. Cependant, son adaptation aux données 3D pose des problèmes d instabilité et nécessite une information de connectivité, qui n est pas directement définie dans les cas des nuages de points. Dans cette thèse, nous présentons une suite d outils mathématiques pour l analyse des objets 3D, sous le nom de Growing Least Squares (GLS). Nous proposons de représenter la géométrie décrite par un nuage de points via une primitive du second ordre ajustée par une minimisation aux moindres carrés, et cela à pour plusieurs échelles. Cette description est ensuite derivée analytiquement pour extraire de manière continue les structures les plus pertinentes à la fois en espace et en échelle. Nous montrons par plusieurs exemples et comparaisons que cette représentation et les outils associés définissent une solution efficace pour l analyse des nuages de points à plusieurs échelles. Un défi intéressant est l analyse d objets 3D acquis dans le cadre de l étude du patrimoine culturel. Dans cette thèse, nous nous étudions les données générées par l acquisition des fragments des statues entourant par le passé le Phare d Alexandrie, Septième Merveille du Monde. Plus précisément, nous nous intéressons au réassemblage d objets fracturés en peu de fragments (une dizaine), mais avec de nombreuses parties manquantes ou fortement dégradées par l action du temps. Nous proposons un formalisme pour la conception de systèmes d assemblage virtuel semi-automatiques, permettant de combiner à la fois les connaissances des archéologues et la précision des algorithmes d assemblage. Nous présentons deux systèmes basés sur cette conception, et nous montrons leur efficacité dans des cas concrets.Over the last decades, the evolution of acquisition techniques yields the generalization of detailed 3D objects, represented as huge point sets composed of millions of vertices. The complexity of the involved data often requires to analyze them for the extraction and characterization of pertinent structures, which are potentially defined at multiple scales. Amongthe wide variety of methods proposed to analyze digital signals, the scale-space analysis istoday a standard for the study of 2D curves and images. However, its adaptation to 3D dataleads to instabilities and requires connectivity information, which is not directly availablewhen dealing with point sets.In this thesis, we present a new multi-scale analysis framework that we call the GrowingLeast Squares (GLS). It consists of a robust local geometric descriptor that can be evaluatedon point sets at multiple scales using an efficient second-order fitting procedure. We proposeto analytically differentiate this descriptor to extract continuously the pertinent structuresin scale-space. We show that this representation and the associated toolbox define an effi-cient way to analyze 3D objects represented as point sets at multiple scales. To this end, we demonstrate its relevance in various application scenarios.A challenging application is the analysis of acquired 3D objects coming from the CulturalHeritage field. In this thesis, we study a real-world dataset composed of the fragments ofthe statues that were surrounding the legendary Alexandria Lighthouse. In particular, wefocus on the problem of fractured object reassembly, consisting of few fragments (up to aboutten), but with missing parts due to erosion or deterioration. We propose a semi-automaticformalism to combine both the archaeologist s knowledge and the accuracy of geometricmatching algorithms during the reassembly process. We use it to design two systems, andwe show their efficiency in concrete cases.BORDEAUX1-Bib.electronique (335229901) / SudocSudocFranceF

Analysis of 3D objects at multiple scales (application to shape matching)

Depuis quelques années, l évolution des techniques d acquisition a entraîné une généralisation de l utilisation d objets 3D très dense, représentés par des nuages de points de plusieurs millions de sommets. Au vu de la complexité de ces données, il est souvent nécessaire de les analyser pour en extraire les structures les plus pertinentes, potentiellement définies à plusieurs échelles. Parmi les nombreuses méthodes traditionnellement utilisées pour analyser des signaux numériques, l analyse dite scale-space est aujourd hui un standard pour l étude des courbes et des images. Cependant, son adaptation aux données 3D pose des problèmes d instabilité et nécessite une information de connectivité, qui n est pas directement définie dans les cas des nuages de points. Dans cette thèse, nous présentons une suite d outils mathématiques pour l analyse des objets 3D, sous le nom de Growing Least Squares (GLS). Nous proposons de représenter la géométrie décrite par un nuage de points via une primitive du second ordre ajustée par une minimisation aux moindres carrés, et cela à pour plusieurs échelles. Cette description est ensuite derivée analytiquement pour extraire de manière continue les structures les plus pertinentes à la fois en espace et en échelle. Nous montrons par plusieurs exemples et comparaisons que cette représentation et les outils associés définissent une solution efficace pour l analyse des nuages de points à plusieurs échelles. Un défi intéressant est l analyse d objets 3D acquis dans le cadre de l étude du patrimoine culturel. Dans cette thèse, nous nous étudions les données générées par l acquisition des fragments des statues entourant par le passé le Phare d Alexandrie, Septième Merveille du Monde. Plus précisément, nous nous intéressons au réassemblage d objets fracturés en peu de fragments (une dizaine), mais avec de nombreuses parties manquantes ou fortement dégradées par l action du temps. Nous proposons un formalisme pour la conception de systèmes d assemblage virtuel semi-automatiques, permettant de combiner à la fois les connaissances des archéologues et la précision des algorithmes d assemblage. Nous présentons deux systèmes basés sur cette conception, et nous montrons leur efficacité dans des cas concrets.Over the last decades, the evolution of acquisition techniques yields the generalization of detailed 3D objects, represented as huge point sets composed of millions of vertices. The complexity of the involved data often requires to analyze them for the extraction and characterization of pertinent structures, which are potentially defined at multiple scales. Amongthe wide variety of methods proposed to analyze digital signals, the scale-space analysis istoday a standard for the study of 2D curves and images. However, its adaptation to 3D dataleads to instabilities and requires connectivity information, which is not directly availablewhen dealing with point sets.In this thesis, we present a new multi-scale analysis framework that we call the GrowingLeast Squares (GLS). It consists of a robust local geometric descriptor that can be evaluatedon point sets at multiple scales using an efficient second-order fitting procedure. We proposeto analytically differentiate this descriptor to extract continuously the pertinent structuresin scale-space. We show that this representation and the associated toolbox define an effi-cient way to analyze 3D objects represented as point sets at multiple scales. To this end, we demonstrate its relevance in various application scenarios.A challenging application is the analysis of acquired 3D objects coming from the CulturalHeritage field. In this thesis, we study a real-world dataset composed of the fragments ofthe statues that were surrounding the legendary Alexandria Lighthouse. In particular, wefocus on the problem of fractured object reassembly, consisting of few fragments (up to aboutten), but with missing parts due to erosion or deterioration. We propose a semi-automaticformalism to combine both the archaeologist s knowledge and the accuracy of geometricmatching algorithms during the reassembly process. We use it to design two systems, andwe show their efficiency in concrete cases.BORDEAUX1-Bib.electronique (335229901) / SudocSudocFranceF

Report on shape analysis and matching and on semantic matching

In GRAVITATE, two disparate specialities will come together in one working platform for the archaeologist: the fields of shape analysis, and of metadata search. These fields are relatively disjoint at the moment, and the research and development challenge of GRAVITATE is precisely to merge them for our chosen tasks. As shown in chapter 7 the small amount of literature that already attempts join 3D geometry and semantics is not related to the cultural heritage domain. Therefore, after the project is done, there should be a clear ‘before-GRAVITATE’ and ‘after-GRAVITATE’ split in how these two aspects of a cultural heritage artefact are treated.This state of the art report (SOTA) is ‘before-GRAVITATE’. Shape analysis and metadata description are described separately, as currently in the literature and we end the report with common recommendations in chapter 8 on possible or plausible cross-connections that suggest themselves. These considerations will be refined for the Roadmap for Research deliverable.Within the project, a jargon is developing in which ‘geometry’ stands for the physical properties of an artefact (not only its shape, but also its colour and material) and ‘metadata’ is used as a general shorthand for the semantic description of the provenance, location, ownership, classification, use etc. of the artefact. As we proceed in the project, we will find a need to refine those broad divisions, and find intermediate classes (such as a semantic description of certain colour patterns), but for now the terminology is convenient – not least because it highlights the interesting area where both aspects meet.On the ‘geometry’ side, the GRAVITATE partners are UVA, Technion, CNR/IMATI; on the metadata side, IT Innovation, British Museum and Cyprus Institute; the latter two of course also playing the role of internal users, and representatives of the Cultural Heritage (CH) data and target user’s group. CNR/IMATI’s experience in shape analysis and similarity will be an important bridge between the two worlds for geometry and metadata. The authorship and styles of this SOTA reflect these specialisms: the first part (chapters 3 and 4) purely by the geometry partners (mostly IMATI and UVA), the second part (chapters 5 and 6) by the metadata partners, especially IT Innovation while the joint overview on 3D geometry and semantics is mainly by IT Innovation and IMATI. The common section on Perspectives was written with the contribution of all

Computer-Assisted Assembling of Fragmented Objects

Si propone un medoto semi automatico ed interattivo per la ricostruzione virtuale di oggetti frammentati. Tramite un'interfaccia, l'utente specica un insieme di constraints tra coppie di frammenti ( digitalizzati come mesh di triangoli) o tra gruppi di frammenti. Il metodo ~A stato testato con successo su un inseme di casi reali

Revisión de los métodos computerizados para la reconstrucción de fragmentos arqueológicos de cerámica

[ES] Las cerámicas son los hallazgos más numerosos encontrados en las excavaciones arqueológicas; a menudo se usan para obtener información sobre la historia, la economía y el arte de un sitio. Los arqueólogos rara vez encuentran jarrones completos; en general, están dañados y en fragmentos, a menudo mezclados con otros grupos de cerámica.El análisis y la reconstrucción de fragmentos se realiza por un operador experto mediante el uso del método manual tradicional. Los artículos revisados proporcionaron evidencias de que el método tradicional no es reproducible, no es repetible, consume mucho tiempo y sus resultados generan grandes incertidumbres. Con el objetivo de superar los límites anteriores, en los últimos años, los investigadores han realizado esfuerzos para desarrollar métodos informáticos que permitan el análisis de fragmentos arqueológicos de cerámica, todo ello destinado a su reconstrucción. Para contribuir a este campo de estudio, en este artículo, se presenta un análisis exhaustivo de las publicaciones disponibles más importantes hasta finales de 2019. Este estudio, centrado únicamente en fragmentos de cerámica, se realiza mediante la recopilación de artículos en inglés de la base de datos Scopus, utilizando las siguientes palabras clave: "métodos informáticos en arqueología", "arqueología 3D", "reconstrucción 3D", "reconocimiento y reconstrucción automática de características", "restauración de reliquias en forma de cerámica ". La lista se completa con referencias adicionales que se encuentran a través de la lectura de documentos seleccionados. Los 53 trabajos seleccionados se dividen en tres períodos de tiempo. Según una revisión detallada de los estudios realizados, los elementos clave de cada método analizado se enumeran en función de las herramientas de adquisición de datos, las características extraídas, los procesos de clasificación y las técnicas de correspondencia. Finalmente, para superar las brechas reales, se proponen algunas recomendaciones para futuras investigaciones.[EN] Potteries are the most numerous finds found in archaeological excavations; they are often used to get information about the history, economy, and art of a site. Archaeologists rarely find complete vases but, generally, damaged and in fragments, often mixed with other pottery groups. By using the traditional manual method, the analysis and reconstruction of sherds are performed by a skilled operator. Reviewed papers provided evidence that the traditional method is not reproducible, not repeatable, time-consuming and its results have great uncertainties. To overcome the aforementioned limits, in the last years, researchers have made efforts to develop computer-based methods for archaeological ceramic sherds analysis, aimed at their reconstruction. To contribute to this field of study, in this paper, a comprehensive analysis of the most important available publications until the end of 2019 is presented. This study, focused on pottery fragments only, is performed by collecting papers in English by the Scopus database using the following keywords: “computer methods in archaeology", "3D archaeology", "3D reconstruction", "automatic feature recognition and reconstruction", "restoration of pottery shape relics”. The list is completed by additional references found through the reading of selected papers. The 53 selected papers are divided into three periods of time. According to a detailed review of the performed studies, the key elements of each analyzed method are listed based on data acquisition tools, features extracted, classification processes, and matching techniques. Finally, to overcome the actual gaps some recommendations for future researches are proposed.Highlights:The traditional manual method for reassembling sherds is very time-consuming and costly; it also requires a great deal effort from skilled archaeologists in repetitive and routine activities.Computer-based methods for archaeological ceramic sherds reconstruction can help archaeologists in the above-mentioned repetitive and routine activities.In this paper, the state-of-the-art computer-based methods for archaeological ceramic sherds reconstruction are reviewed, and some recommendations for future researches are proposed.Eslami, D.; Di Angelo, L.; Di Stefano, P.; Pane, C. (2020). Review of computer-based methods for archaeological ceramic sherds reconstruction. Virtual Archaeology Review. 11(23):34-49. https://doi.org/10.4995/var.2020.13134OJS34491123Andrews, S., & Laidlaw, D. H. (2002). Toward a framework for assembling broken pottery vessels. In Proceedings of the National Conference on Artificial Intelligence, (August 2003), (pp. 945-946).Banterle, F., Itkin, B., Dellepiane, M., Wolf, L., Callieri, M., Dershowitz, N., & Scopigno, R. (2017). VASESKETCH: Automatic 3D Representation of Pottery from Paper Catalog Drawings. In Proceedings of the International Conference on Document Analysis and Recognition, ICDAR, 1(693548), (pp. 683-690). https://doi.org/10.1109/ICDAR.2017.117Belenguer, C. S., & Vidal, E. V. (2012). Archaeological fragment characterization and 3D reconstruction based on projective GPU depth maps. In Proceedings of the 2012 18th International Conference on Virtual Systems & Multimedia, VSMM 2012: Virtual Systems in the Information Society, (pp. 275-282). https://doi.org/10.1109/VSMM.2012.6365935Blender. (2018). An open-source 3D graphics and animation software. Retrieved from https://www.blender.orgBrown, B. J., Toler-Franklin, C., Nehab, D., Burns, M., Dobkin, D., Vlachopoulos, A., Weyrich, T. (2008). A system for high-volume acquisition and matching of fresco fragments: Reassembling Theran wall paintings. ACM Transactions on Graphics, 27(3). https://doi.org/10.1145/1360612.1360683Cao, Y., & Mumford, D. (2002). Geometric Structure Estimation of Axially Symmetric Pots from Small Fragments. In Proceedings of the signal processing, pattern recognition and applications, IASTED, Crete, Greece, June 25-28, 2002, (pp. 92-97).Cohen, F., Zhang, Z., & Jeppson, P. (2010). Virtual reconstruction of archaeological vessels using convex hulls of surface markings. 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, (pp. 55-61). http://dx.doi.org/10.1109/CVPRW.2010.5543528Cohen, F., Zhang, Z., & Liu, Z. (2016). Mending broken vessels a fusion between color markings and anchor points on surface breaks. Multimedia Tools and Applications, 75(7), 3709-3732. https://doi.org/10.1007/s11042-014-2190-0Cooper, D. B., Willis, A., Andrews, S., Baker, J., Cao, Y., Han, D., … others. (2001). Assembling virtual pots from 3D measurements of their fragments. In Proceedings of the 2001 Conference on Virtual Reality, Archeology, and Cultural Heritage, (pp. 241-254). https://doi.org/10.1145/584993.585032Di Angelo, L., Di Stefano, P., Morabito, A. E., & Pane, C. (2018). Measurement of constant radius geometric features in archaeological pottery. Measurement: Journal of the International Measurement Confederation, 124 (March), 138-146. https://doi.org/10.1016/j.measurement.2018.04.016Di Angelo, L., Di Stefano, P., & Pane, C. (2018). An automatic method for pottery fragments analysis. Measurement: Journal of the International Measurement Confederation, 128, 138-148. https://doi.org/10.1016/j.measurement.2018.06.008Di Angelo, Luca, Di Stefano, P., & Pane, C. (2017). Automatic dimensional characterization of pottery. Journal of Cultural Heritage, 26, 118-128. https://doi.org/10.1016/j.culher.2017.02.003Fragkos, S., Tzimtzimis, E., Tzetzis, D., Dodun, O., & Kyratsis, P. (2018). 3D laser scanning and digital restoration of an archaeological find. MATEC Web of Conferences, 178. https://doi.org/10.1051/matecconf/201817803013Funkhouser, T., Shin, H., Toler-Franklin, C., Castañeda, A. G., Brown, B., Dobkin, D., Weyrich, T. (2011). Learning how to match fresco fragments. Journal on Computing and Cultural Heritage, 4(2). https://doi.org/10.1145/2037820.2037824Halir, R., & Menard, C. (1996). Diameter estimation for archaeological pottery using active vision. In Proceedings of the 20th Workshop of the Austrian Association for Pattern Recognition (OAGM/AAPR) on Pattern Recognition 1996, (pp. 251-261).Halir, R., & Flusser, J. (1997). Estimation of profiles of sherds of archaeological pottery. In Proceedings of the of the Czech Pattern Recognition Workshop (CPRW'97), Czech Republic, February 1997, 1-5, (pp. 126-130).Halir, R. (1999). An Automatic Estimation Of The Axis Of Rotation Of Fragments Of Archaeological Pottery: A Multi-Step Model-Based Approach. In Proceedings of the 7th International Conference in Central Europe on Computer Graphics, Visualization and Interactive Digital Media (WSCG '99) https://semanticscholar.org/0248/ae5a8dca3d2c6bfff282ce481a5625d32362Hall, N. S., & Laflin, S. (1984). A computer aided design technique for pottery profiles. In Computer applications in Archaeology, (pp. 178-188). Computer Center, University of Birmingham Birmingham. Retrieved from https://www.bcin.ca/bcin/detail.app?id=40524Han, D., & Hahn, H. S. (2014). Axis estimation and grouping of rotationally symmetric object segments. Pattern Recognition, 47(1), 296-312. https://doi.org/10.1016/j.patcog.2013.06.022Hlavackova-Schindler, K., Kampel, M., & Sablatnig, R. (2001). Fitting of a Closed Planar Curve Representing a Profile of an Archaeological Fragment. In Proceedings VAST 2001 Virtual Reality, Archeology, and Cultural Heritage, (pp. 263-269). https://doi.org/10.1145/585031.585034Huang, Q. X., Flöry, S., Gelfand, N., Hofer, M., & Pottmann, H. (2006). Reassembling fractured objects by geometric matching. ACM SIGGRAPH 2006 Papers, SIGGRAPH '06, (May), (pp. 569-578). https://doi.org/10.1145/1179352.1141925Igwe, P. C., & Knopf, G. K. (2006). 3D object reconstruction using geometric computing. Geometric Modeling and Imaging New Trends, 9-14. https://doi.org/10.1109/GMAI.2006.1Kalasarinis, I., & Koutsoudis, A. (2019). Assisting pottery restoration procedures with digital technologies. International Journal of Computational Methods in Heritage Science, 3(1), 20-32. https://doi.org/10.4018/ijcmhs.2019010102Kampel, M., & Sablatnig, R. (2003). Profile-based Pottery Reconstruction. In IEEE Proceeding of Conference on Computer Vision and Pattern Recognition Workshops, Wisconsin, June, (pp. 1-6). https://doi.org/10.1109/CVPRW.2003.10007Kampel, M, & Mara, H. (2005). Robust 3D reconstruction of archaeological pottery based on concentric circular rills. In Proceedings of the Sixth International. Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS'05), Montreux, Switzerland, (pp. 14-20). Retrieved from https://semanticscholar.org/43df/9b3c6fef5aa54964bdc4825a86cc4e9f4531Kampel, M., & Sablatnig, R. (2003). An automated pottery archival and reconstruction system. Journal of Visualization and Computer Animation, 14(3), 111-120. https://doi.org/10.1002/vis.310Kampel, M., & Sablatnig, R. (2004). 3D Puzzling of Archeological Fragments. In Proceedings of 9th Computer Vision Winter Workshop, (February), (pp. 31-40). Retrieved from https://cvl.tuwien.ac.at/wp-content/uploads/2014/12/cvww041Karasik, A., & Smilansky, U. (2011). Computerized morphological classification of ceramics. Journal of Archaeological Science, 38(10), 2644-2657. https://doi.org/10.1016/j.jas.2011.05.023Kashihara, K. (2012). Three-dimensional reconstruction of artifacts based on a hybrid genetic algorithm. In IEEE International Conference on Systems, Man and Cybernetics, (pp. 900-905). https://doi.org/10.1109/ICSMC.2012.6377842Kashihara, K. (2017). An intelligent computer assistance system for artifact restoration based on genetic algorithms with plane image features. International Journal of Computational Intelligence and Applications, 16(3), 1-15. https://doi.org/10.1142/S1469026817500213Kleber, F., & Sablatnig, R. (2009). A survey of techniques for document and archaeology artifact reconstruction. In Proceedings of the International Conference on Document Analysis and Recognition, ICDAR, (March 2014), (pp. 1061-1065). https://doi.org/10.1109/ICDAR.2009.154Kotoula, E. (2016). Semiautomatic fragments matching and virtual reconstruction: a case study on ceramics. International Journal of Conservation Science, 7(1), 71-86. Retrieved from http://eprints.lincoln.ac.uk/id/eprint/31035/Lucena, M., Martínez-Carrillo, A. L., Fuertes, J. M., Javier Carrascosa Malagón, F., & Ruiz Rodríguez, A. (2016). Decision support system for classifying archaeological pottery profiles based on mathematical morphology. Multimedia Tools and Applications, 75(7), 3677-3691. https://doi.org/10.1007/s11042-014-2063-6Maiza, C., & Gaildrat, V. (2005). Automatic classification of archaeological potsherds. In Proceedings of the 8th International Conference on Computer Graphics and Artificial Intelligence, Limoges, France, May 11-12, 2005, (pp. 135-147). https://semanticscholar.org/3c95/82c3e562b44e7d61dc0fd3487ea3dc977ff3Mara, H., Kampel, M., & Sablatnig, R. (2002). Preprocessing of 3D-Data for Classification of Archaeological Fragments in an Automated System. In Proceedings of the 26th Workshop of the Austrian Association for Pattern Recognition, Vision with Non-Traditional Sensors, (ÖAGM/AAPR), Graz, Austria, 10-11 September 2002, (pp. 257-264). https://doi.org/10.1.1.15.748Mara, H., & Sablatnig, R. (2006). The orientation of fragments of rotationally symmetrical 3D-shapes for archaeological documentation. In Proceedings - Third International Symposium on 3D Data Processing, Visualization, and Transmission, 3DPVT 2006, (June), (pp. 1064-1071). https://doi.org/10.1109/3DPVT.2006.105Melero, F. J., Torres, J. C., & Leon, A. (2003). On the interactive 3d reconstruction of Iberian vessels. In 4th International Symposium on Virtual Reality, Archaeology, and Intelligent Cultural Heritage, VAST, 3, (pp. 71-78). http://dx.doi.org/10.2312/VAST/VAST03/071-078Papaioannou, G., Karabassi, E. a., & Theoharis, T. (2000). Automatic Reconstruction of Archaeological Finds-A Graphics Approach. In International Conference on Computer Graphics and Artificial Intelligence, (March), (pp. 117-125). Retrieved from https://semanticscholar.org/6a3c/7ec8f544bbfb83174d868cd406eaaf40f438Papaioannou, G., Karabassi, E. A., & Theoharis, T. (2002). Reconstruction of three-dimensional objects through the matching of their parts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(1), 114-124. https://doi.org/10.1109/34.982888Pulli, K. (1999). Multiview registration for large data sets. In Proceedings of Second International Conference on 3D Digital Imaging and Modeling, Ottawa, ON, Canada, 4-8 December 1999, (pp. 160-168). http://doi.org/10.1109/IM.1999.805346Rasheed, N. A., & Nordin, J. (2015a). A Survey of Computer Methods in Reconstruction of 3D Archaeological Pottery Objects. International Journal of Advanced Research, 3(3), 712-714. Retrieved from https://academia.edu.documents/45540231Rasheed, N. A., & Nordin, M. J. (2014). A polynomial function in the automatic reconstruction of fragmented objects. Journal of Computer Science, 10(11), 2339-2348. https://doi.org/10.3844/jcssp.2014.2339.2348Rasheed, N. A., & Nordin, M. J. (2015b). Archaeological fragments classification based on RGB color and texture features. Journal of Theoretical and Applied Information Technology, 76(3), 358-365. Retrieved from http://repository.uobabylon.edu.iq/papers/publication.aspx?pubid=6746Rasheed, N. A., & Nordin, M. J. (2018). Classification and reconstruction algorithms for the archaeological fragments. Journal of King Saud University-Computer and Information Sciences. https://doi.org/10.1016/j.jksuci.2018.09.019Rasheed, N. A., Nordin, M. J., Dakheel, A. H., Nados, W. L., & Maaroof, M. K. A. (2017). Classification archaeological fragments into groups. Research Journal of Applied Sciences, Engineering, and Technology, 14(9), 324-333. https://doi.org/10.19026/rjaset.14.5072Sablatnig, R., & Menard, C. (1997). 3D Reconstruction of Archaeological Pottery using Profile Primitives. In Proceedings of I International Workshop on Synthetic-Natural Hybrid Coding and Three-Dimensional Imaging, (pp. 93-96).Sablatnig, R., Menard, C., & Kropatseh, W. (1998). Classification of archaeological fragments using a description language. In Proceedings of European Signal Processing Conference, (Eusipco '98), (pp. 1097-1100), 1998.Sakpere, W. (2019). 3D Reconstruction of Archaeological Pottery from Its Point Cloud. In Proceedings of Iberian Conference on Pattern Recognition and Image Analysis, (pp. 125-136). https://doi.org/10.1007/978-3-030-31332-6_11Shin, H., Doumas, C., Funkhouser, T., Rusinkiewicz, S., Steiglitz, K.,Vlachopoulos, & Weyrich, T. (2010). Analyzing Fracture Patterns in Theran Wall Paintings. In Proceedings of the 11th International Symposium on Virtual Reality, Archaeology - VAST, (pp. 71-78). https://doi.org/10.2312/VAST/VAST10/071-078Son, K., Almeida, E. B., & Cooper, D. B. (2013). Axially symmetric 3D pots configuration system using the axis of symmetry and break curve. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, (pp. 257-264). https://doi.org/10.1109/CVPR.2013.40Stamatopoulos, M. I., & Anagnostopoulos, C.-N. (2016). 3D digital reassembling of archaeological ceramic pottery fragments based on their thickness profile. The Computing Research Repository (CoRR). Retrieved from https://arxiv.org/abs/1601.05824Toler-Franklin, C., Funkhouser, T., Rusinkiewicz, S., Brown, B., & Weyrich, T. (2010). Multi-Feature Matching of Fresco Fragments. ACM Transactions on Graphics, 29(6), 1-12. https://doi.org/10.1145/1882261.1866207Üçoluk, G., & Hakki Toroslu, I. (1999). Automatic reconstruction of broken 3-D surface objects. Computers and Graphics, 23(4), 573-582. https://doi.org/10.1016/S0097-8493(99)00075-8Vendrell-Vidal, E., & Sánchez-Belenguer, C. (2014). A Discrete Approach for Pairwise Matching of Archaeological Fragments. Journal on Computing and Cultural Heritage, 7(3), 1-19. https://doi.org/10.1145/2597178Willis, A., Orriols, X., & Cooper, D. B. (2003). Accurately Estimating Sherd 3D Surface Geometry with Application to Pot Reconstruction. In Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, (16-22 June 2003), Madison, Wisconsin, USA (pp. 1-7). https://doi.org/10.1109/CVPRW.2003.10014Willis, A. R., & Cooper, D. B. (2004). Bayesian assembly of 3D axially symmetric shapes from fragments. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1, (pp. 82-89). https://doi.org/10.1109/cvpr.2004.1315017Zhou, Mingquam, Geng, G., Wu, Z., Zheng, X., Shui, W., Lu, K., & Gao, Y. (2007). A system for re-assembly of fragment objects and computer-aided restoration of cultural relics. Virtual Retrospect 2007, 3, 21-27. Retrieved from http://hal.univ-savoie.fr/ENIB/hal-01765241v1Zhou, Mingquan, Geng, G., Wu, Z., & Shui, W. (2010). A Virtual Restoration System for Broken Pottery. In Proceedings of the CAA Conference 37th Computer applications and quantitative methods in archaeology, Williamsburg, VA, USA, 22-26 March 2009; (pp. 391-396). Retrieved from https://semanticscholar.org/87b5/aa5c7710806677abbedb4e43f6134e05304

Computer aided puzzle assembly based on shape and texture information /

Puzzle assembly’s importance lies into application in many areas such as restoration and reconstruction of archeological findings, the repairing of broken objects, solving of the jigsaw type puzzles, molecular docking problem, etc. Puzzle pieces usually include not only geometrical shape information but also visual information of texture, color, continuity of lines, and so on. Moreover, textural information is mainly used to assembly pieces in some cases, such as classic jigsaw puzzles. This research presents a new approach in that pictorial assembly, in contrast to previous curve matching methods, uses texture information as well as geometric shape. The assembly in this study is performed using textural features and geometrical constraints. First, the texture of a band outside the border of pieces is predicted by inpainting and texture synthesis methods. The feature values are derived by these original and predicted images of pieces. A combination of the feature and confidence values is used to generate an affinity measure of corresponding pieces. Two new algorithms using Fourier based image registration techniques are developed to optimize the affinity. The algorithms for inpainting, affinity and Fourier based assembly are explained with experimental results on real and artificial data. The main contributions of this research are: The development of a performance measure that indicates the level of success of assembly of pieces based on textural features and geometrical shape. Solution of the assembly problem by using of the Fourier based methods

An optimizational approach for an algorithmic reassembly of fragmented objects

In Cambodia close to the Thai border, lies the Angkor-style temple of Banteay Chhmar. Like all nearly forgotten temples in remote places, it crumbles under the ages. By today most of it is only a heap of stones. Manually reconstructing these temples is both complex and challenging: The conservation team is confronted with a pile of stones, the original position of which is generally unkown. This reassembly task resembles a large-scale 3D puzzle. Usually, it is resolved by a team of specialists who analyze each stone, using their experience and knowledge of Khmer culture. Possible solutions are tried and retried and the stones are placed in different locations until the correct one is found. The major drawbacks of this technique are: First, since the stones are moved continuously they are further damaged, second, there is a threat to the safety of the workers due to handling very heavy weights, and third because of the high complexity and labour-intensity of the work it takes several months up to several years to solve even a small part of the puzzle. These risks and conditions motivated the development of a virtual approach to reassemble the stones, as computer algorithms are theoretically capable of enumerating all potential solutions in less time, thereby drastically reducing the amount of work required for handling the stones. Furthermore the virtual approach has the potential to reduce the on-site costs of in-situ analysis. The basis for this virtual puzzle algorithm are high-resolution 3D models of more than one hundred stones. The stones can be viewed as polytopes with approximately cuboidal form although some of them contain additional indentations. Exploiting these and related geometric features and using a priori knowledge of the orientation of each stone speeds up the process of matching the stones. The aim of the current thesis is to solve this complex large-scale virtual 3D puzzle. In order to achieve this, a general workflow is developed which involves 1) to simplify the high-resolution models to their most characteristic features, 2) apply an advanced similarity analysis and 3) to match best combinations as well as 4) validate the results. The simplification step is necessary to be able to quickly match potential side-surfaces. It introduces the new concept of a minimal volume box (MVB) designed to closely and storage efficiently resemble Khmer stones.Additionally, this reduced edge-based model is used to segment the high-resolution data according to each side-surface. The second step presents a novel technique allowing to conduct a similarity analysis of virtual temple stones. It is based on several geometric distance functions which determine the relatedness of a potential match and is capable of sorting out unlikely ones. The third step employs graph theoretical methods to combine the similarity values into a correct solution of this large-scale 3D puzzle. The validation demonstrates the high quality and robustness of this newly constructed puzzle workflow. The workflow this thesis presents virtually puzzles digitized stones of fallen straight Khmer temple walls. It is able to virtually and correctly reasemble up to 42 digitized stones requiring a minimum of user-interaction