Exploring OCR Capabilities of GPT-4V(ision) : A Quantitative and In-depth Evaluation

This paper presents a comprehensive evaluation of the Optical Character Recognition (OCR) capabilities of the recently released GPT-4V(ision), a Large Multimodal Model (LMM). We assess the model's performance across a range of OCR tasks, including scene text recognition, handwritten text recognition, handwritten mathematical expression recognition, table structure recognition, and information extraction from visually-rich document. The evaluation reveals that GPT-4V performs well in recognizing and understanding Latin contents, but struggles with multilingual scenarios and complex tasks. Specifically, it showed limitations when dealing with non-Latin languages and complex tasks such as handwriting mathematical expression recognition, table structure recognition, and end-to-end semantic entity recognition and pair extraction from document image. Based on these observations, we affirm the necessity and continued research value of specialized OCR models. In general, despite its versatility in handling diverse OCR tasks, GPT-4V does not outperform existing state-of-the-art OCR models. How to fully utilize pre-trained general-purpose LMMs such as GPT-4V for OCR downstream tasks remains an open problem. The study offers a critical reference for future research in OCR with LMMs. Evaluation pipeline and results are available at https://github.com/SCUT-DLVCLab/GPT-4V_OCR

Rethinking Leadership: The Changing Role of Principal Supervisors

In the fall of 2012, the Council of the Great City Schools launched a two-part study of the ways principal supervisors are selected, supported, and evaluated in major school districts across the country. The first part involved a survey administered to district staff serving as principal supervisors in the fall of 2012. The second part of the study involved site visits to the six districts participating in The Wallace Foundation's Principal Pipeline Initiative -- Charlotte-Mecklenburg Schools, Denver Public Schools, Gwinnett County Public Schools, Hillsborough County Public Schools, the New York City Department of Education, and Prince George's County Public Schools. This report provides a summary of findings from both the survey and site visits. Part I presents a description of the organizational structure and general features of the various principal supervisory systems, including the roles, selection, deployment, staffing, professional development, and evaluation of principal supervisors, as well as the preparation, selection, support, and evaluation of principals. Part II provides recommendations for building more effective principal supervisory systems. Based on the survey results and observations from the site visits, these recommendations identify those structures and practices that are most likely to result in stronger school leaders and higher student achievement

Sustainability experiments in the agri-food system : uncovering the factors of new governance and collaboration success

In recent years, research, society and industry recognize the need to transform the agri-food system towards sustainability. Within this process, sustainability experiments play a crucial role in transforming the structure, culture and practices. In literature, much attention is given to new business models, even if the transformation of conventional firms toward sustainability may offer opportunities to accelerate the transformation. Further acceleration could be achieved through collaboration of multiple actors across the agri-food system, but this calls for a systems approach. Therefore, we developed and applied a new sustainability experiment systems approach (SESA) consisting of an analytical framework that allows a reflective evaluation and cross-case analysis of multi-actor governance networks based on business and learning evaluation criteria. We performed a cross-case analysis of four agri-food sustainability experiments in Flanders to test and validate SESA. Hereby, the key factors of the success of collaboration and its performance were identified at the beginning of a sustainability experiment. Some of the key factors identified were risk sharing and the drivers to participate. We are convinced that these results may be used as an analytical tool for researchers, a tool to support and design new initiatives for policymakers, and a reflective tool for participating actors

Comparison of different Multiple-criteria decision analysis methods in the context of conceptual design: application to the development of a solar collector structure

At each stage of the product development process, the designers are facing an important task which consists of decision making. Two cases are observed: the problem of concept selection in conceptual design phases and, the problem of pre-dimensioning once concept choices are made. Making decisions in conceptual design phases on a sound basis is one of the most difficult challenges in engineering design, especially when innovative concepts are introduced. On the one hand, designers deal with imprecise data about design alternatives. On the other hand, design objectives and requirements are usually not clear in these phases. The greatest opportunities to reduce product life cycle costs usually occur during the first conceptual design phases. The need for reliable multi-criteria decision aid (MCDA) methods is thus greatest at early conceptual design phases. Various MCDA methods are proposed in the literature. The main criticism of these methods is that they usually yield different results for the same problem. In this work, an analysis of six MCDA methods (weighed sum, weighted product, Kim & Lin, compromise programming, TOPSIS, and ELECTRE I) was conducted. Our analysis was performed via an industrial case of solar collector structure development. The objective is to define the most appropriate MCDA methods in term of three criteria: (i) the consistency of the results, (ii) the ease of understanding and, (iii) the adaptation of the decision type. The results show that TOPSIS is the most consistent MCDA method in our case

A comparative evaluation of dynamic visualisation tools

Despite their potential applications in software comprehension, it appears that dynamic visualisation tools are seldom used outside the research laboratory. This paper presents an empirical evaluation of five dynamic visualisation tools - AVID, Jinsight, jRMTool, Together ControlCenter diagrams and Together ControlCenter debugger. The tools were evaluated on a number of general software comprehension and specific reverse engineering tasks using the HotDraw objectoriented framework. The tasks considered typical comprehension issues, including identification of software structure and behaviour, design pattern extraction, extensibility potential, maintenance issues, functionality location, and runtime load. The results revealed that the level of abstraction employed by a tool affects its success in different tasks, and that tools were more successful in addressing specific reverse engineering tasks than general software comprehension activities. It was found that no one tool performs well in all tasks, and some tasks were beyond the capabilities of all five tools. This paper concludes with suggestions for improving the efficacy of such tools