Multi-level DEA Approach in Research Evaluation

It is well known that the discrimination power of DEA models will be diminishing if too many inputs or outputs are used. It is a dilemma if the decision makers want to select comprehensive indicators to present a relatively holistic evaluation using DEA. In this work we show that by utilizing hierarchical structures of input-output data DEA can handle quite large numbers of inputs and outputs. We present two approaches in a pilot evaluation of 15 institutes for basic research in Chinese Academy of Sciences using DEA models

PERFORMANCE OF BRAZILIAN BUSINESS, ACCOUNTING AND TOURISM GRADUATE PROGRAMS

The Brazilian institution in charge of graduate programs (CAPES) evaluates all programs every three years, focusing on publications in scientific periodicals, which are classified by the Qualis – CAPES system. This study aims to measure the relative efficiency of post-graduate programs in Business, Accounting and Tourism through Data Envelopment Analysis (DEA) and to measure the change in productivity from the three-year period of 2004-2006 to the 2007-2009 period by the Malmquist Index. Efficiencies of some graduate programs in Brazil using DEA have been evaluated but the Malmquist Index was not used because the 2007-2009 data was only recently available. They also used different input and output variables and did not consider, in our view, the real importance CAPES attributes to publications. We used, as inputs, professors, dissertations and thesis and, as outputs, total points obtained from the Qualis classification of periodicals. Among the results: the efficiency increased from the first to the second period; the efficiency of public institutions was higher as was the efficiency of programs with PhD courses and of programs more than 12 years old; the Malmquist index increased from one triennium to another

An application of statistical interference in DEA models: An analysis of public owned university departments' efficiency

This paper uses Data Envelopment Analysis (DEA) model formulations in order to determine the performance levels of 16 departments of the University of Thessaly. Particularly, the constant returns to scale (CRS) and variable returns to scale (VRS) models have been applied alongside with bootstrap techniques in order to determine accurate performance measurements of the 16 departments. The study illustrates how the recent developments in efficiency analysis and statistical inference can be applied when evaluating institutional performance issues. The paper provides the efficient departments and the target values which need to be adopted from the inefficient departments in order to operate in the most productive scale size (MPSS). Moreover it provides bias corrected estimates alongside with their confidence intervals. The analysis indicates that there are strong inefficiencies among the departments, emphasizing the misallocation of resources or/and inefficient application of departments policy developments.University efficiency; DEA; Bootstrap techniques; Kernel density estimation, Economic research; Europe; University rankings.

Agricultural Economics Education in Ukrainian Agricultural Universities: An Efficiency Analysis Using Data Envelopment Analysis

Ukraine's transition from a centrally-planned to a market economy has had a profound effect upon its agricultural sector and agricultural universities. A substantial reduction in state financing has forced universities to adopt a range of survival strategies, with varying degrees of success. In this paper we use data envelopment analysis to examine the technical efficiency of 44 agricultural economics programs from 19 Ukrainian universities during the 2002/03 academic year. Our empirical results indicate wide disparities in performance, ranging from 36% to 100% technical efficiency. A second-stage analysis suggests that factors such as student demand, commercial activities and staff quality help explain a portion of this variation.higher education, Ukraine, efficiency, data envelopment analysis, Teaching/Communication/Extension/Profession, I21, C14, Q16,

Measuring Efficiency and Productivity of ICT Infrastructure Utilization

Several researches have been carried out with respect to ICT Infrastructure Investments made by nations in a bid to bridge the digital divide and improve quality of life and the Human Development Index (HDI). With a strong argument being made in the literature for continued investments in ICT Infrastructure, this research investigated the relative efficiency and productivity of ICT Infrastructure Utilization in Education. The research employed the Data Envelopment Analysis (DEA) and Malmquist Index (MI) non-parametric research methodology with Arab States, Europe, Sub-Saharan Africa and World regions forming the Decision-Making Units. With Data collected from the United Nations Educational, Scientific and Cultural Organization (UNESCO) and the International Tel-ecommunications Union (ITU), findings show a relatively efficient utilization and steady increase in productivity for the regions but with only Europe and Arab States currently operating in a state of positive growth in produc-tivity

Influence of Constant Returns to Scale and Variable Returns to Scale Data Envelopment Analysis Models in ICT Infrastructure Efficiency Utilization

A lot of research has been done using Data Envelopment Analysis (DEA) to measure efficiency in Education. DEA has also been used in the field of Information and Communication Technology for Development (ICT4D) to investigate and measure the efficiency of Information and Communication Technology (ICT) investments on Human Development. Education is one of the major components of the Human Development Index (HDI) which affects the core of Human Development. This research investigates the relative efficiency of ICT Infrastructure Utilization on the educational component of the HDI. A conceptual model taking the form of a Linear Equation was used and the Constant Returns to Scale (CRS) and Variable Returns to Scale (VRS) models of the Data Envelopment Analysis were employed to measure the relative efficiency of the components of ICT Infrastructure (Inputs) and the components of Education (Outputs). Results show a generally high relative efficiency of ICT Infrastructure utilization on Educational Attainment and Adult Literacy rates, a strong correlation between this Infrastructure and Literacy rates as well, provide an empirical support for the argument of increasing ICT infrastructure to provide an increase in Human Development, especially within the educational context

Evaluación de la eficiencia investigativa de las universidades públicas colombianas 2003-2012 utilizando el análisis envolvente de datos

In 2003, the process of public universities evaluation began. For this purpose, a set of performance indicators constructed by the Public University System (SUE by its acronym in Spanish) in alliance with the Ministry of National Education (MEN) was used. In an effort to know about the research efficiency level that public universities had in the period 2003-2012, an analysis of the results of these indicators was executed using Data Envelopment Analysis. In particular, the product-oriented CCR model was applied.  Although many universities have experienced a sustained development in some of the indicators analyzed and show high relative levels of efficiency, the results show that, as a whole, the Public University System has still much to improve regarding its scientific mission, especially, those aspects related to graduate programs and scientific journals.En el año 2003 se inició el proceso de evaluación de las universidades públicas colombianas utilizando un conjunto de indicadores de gestión construidos por el Sistema de Universidades Estatales (SUE) conjuntamente con el Ministerio de Educación Nacional (MEN). Con el ánimo de conocer la eficiencia en investigación que han tenido las universidades públicas en el periodo 2003-2012 se realizó un análisis de los resultados de los indicadores utilizando el Análisis Envolvente de Datos. Se aplicó el modelo CCR orientado a los productos. A pesar de que muchas universidades han experimentado un desarrollo sostenido en algunos de los indicadores analizados y muestran niveles relativos altos de eficiencia, los resultados muestran que, en su conjunto, el Sistema Universitario Estatal tiene mucho que mejorar en su misión científica, en particular en lo relacionado con los programas de posgrado y producción de revistas

Research efficiency assessment of colombian public universities 2003-2012 data envelopment analysis

In 2003, the process of public universities evaluation began. For this purpose, a set of performance indicators constructed by the Public University System (SUE by its acronym in Spanish) in alliance with the Ministry of National Education (MEN) was used. In an effort to know about the research efficiency level that pu-blic universities had in the period 2003-2012, an analy-sis of the results of these indicators was executed using Data Envelopment Analysis. In particular, the product-oriented CCR model was applied. Although many univer-sities have experienced a sustained development in some of the indicators analyzed and show high relative levels of efficiency, the results show that, as a whole, the Public University System has still much to improve regarding its scientific mission, especially, those aspects related to graduate programs and scientific journalsEn el año 2003 se inició el proceso de eva-luación de las universidades públicas colombianas uti-lizando un conjunto de indicadores de gestión construi-dos por el Sistema de Universidades Estatales (SUE) conjuntamente con el Ministerio de Educación Nacional (MEN). Con el ánimo de conocer la eficiencia en investi-gación que han tenido las universidades públicas en el periodo 2003-2012 se realizó un análisis de los resulta-dos de los indicadores utilizando el Análisis Envolvente de Datos. Se aplicó el modelo CCR orientado a los pro-ductos. A pesar de que muchas universidades han expe-rimentado un desarrollo sostenido en algunos de los indi-cadores analizados y muestran niveles relativos altos de eficiencia, los resultados muestran que, en su conjunto, el Sistema Universitario Estatal tiene mucho que mejorar en su misión científica, en particular en lo relacionado con los programas de posgrado y producción de revista