A Practical Procedure to Integrate the First 1:500 Urban Map of Valencia into a Tile-Based Geospatial Information System

[EN] The use of geographic data from early maps is a common approach to understanding urban geography as well as to study the evolution of cities over time. The specific goal of this paper is to provide a means for the integration of the first 1:500 urban map of the city of Valencia (Spain) on a tile-based geospatial system. We developed a workflow consisting of three stages: the digitization of the original 421 map sheets, the transformation to the European Terrestrial Reference System of 1989 (ETRS89), and the conversion to a tile-based file format, where the second stage is clearly the most mathematically involved. The second stage actually consists of two steps, one transformation from the pixel reference system to the 1929 local reference system followed by a second transformation from the 1929 local to the ETRS89 system. The last stage comprises a map reprojection to adapt to tile-based geospatial standards. The paper describes a pilot study of one map sheet and results showed that the affine and bilinear transformations performed well in both transformations with average residuals under 6 and 3 cm respectively. The online viewer developed in this study shows that the derived tile-based map conforms to common standards and lines up well with other raster and vector datasets.Villar-Cano, M.; Jiménez-Martínez, MJ.; Marqués-Mateu, Á. (2019). A Practical Procedure to Integrate the First 1:500 Urban Map of Valencia into a Tile-Based Geospatial Information System. ISPRS International Journal of Geo-Information. 8(9). https://doi.org/10.3390/ijgi809037837889Bitelli, G., & Gatta, G. (2011). Digital Processing and 3D Modelling of an 18th Century Scenographic Map of Bologna. Advances in Cartography and GIScience. Volume 2, 129-146. doi:10.1007/978-3-642-19214-2_9Brovelli, M. A., Minghini, M., Giori, G., & Beretta, M. (2012). Web Geoservices and Ancient Cadastral Maps: The Web C.A.R.T.E. Project. Transactions in GIS, 16(2), 125-142. doi:10.1111/j.1467-9671.2012.01311.xBitelli, G., Cremonini, S., & Gatta, G. (2014). Cartographic heritage: Toward unconventional methods for quantitative analysis of pre-geodetic maps. Journal of Cultural Heritage, 15(2), 183-195. doi:10.1016/j.culher.2013.04.003Cardesín Díaz, J. M., & Araujo, J. M. (2016). Historic Urbanization Process in Spain (1746–2013). Journal of Urban History, 43(1), 33-52. doi:10.1177/0096144215583481Villar-Cano, M., Marqués-Mateu, Á., & Jiménez-Martínez, M. J. (2019). Triangulation network of 1929–1944 of the first 1:500 urban map of València. Survey Review, 52(373), 317-329. doi:10.1080/00396265.2018.1564599Chen, W., & Hill, C. (2005). Evaluation Procedure for Coordinate Transformation. Journal of Surveying Engineering, 131(2), 43-49. doi:10.1061/(asce)0733-9453(2005)131:2(43)ISO 19157:2013: Geographic Information—Data Qualityhttps://www.iso.org/standard/32575.htmlASPRS Positional Accuracy Standards for Digital Geospatial Datahttps://www.asprs.org/news-resources/asprs-positional-accuracy-standards-for-digital-geospatial-dataEven-Tzur, G. (2018). Coordinate transformation with variable number of parameters. Survey Review, 52(370), 62-68. doi:10.1080/00396265.2018.1517477Yuanxi, Y., & Tianhe, X. (2002). Combined method of datum transformation between different coordinate systems. Geo-spatial Information Science, 5(4), 5-9. doi:10.1007/bf02826467Lehmann, R. (2014). Transformation model selection by multiple hypotheses testing. Journal of Geodesy, 88(12), 1117-1130. doi:10.1007/s00190-014-0747-

On potential cognitive abilities in the machine kingdom

The final publication is available at Springer via http://dx.doi.org/10.1007/s11023-012-9299-6Animals, including humans, are usually judged on what they could become, rather than what they are. Many physical and cognitive abilities in the ‘animal kingdom’ are only acquired (to a given degree) when the subject reaches a certain stage of development, which can be accelerated or spoilt depending on how the environment, training or education is. The term ‘potential ability’ usually refers to how quick and likely the process of attaining the ability is. In principle, things should not be different for the ‘machine kingdom’. While machines can be characterised by a set of cognitive abilities, and measuring them is already a big challenge, known as ‘universal psychometrics’, a more informative, and yet more challenging, goal would be to also determine the potential cognitive abilities of a machine. In this paper we investigate the notion of potential cognitive ability for machines, focussing especially on universality and intelligence. We consider several machine characterisations (non-interactive and interactive) and give definitions for each case, considering permanent and temporal potentials. From these definitions, we analyse the relation between some potential abilities, we bring out the dependency on the environment distribution and we suggest some ideas about how potential abilities can be measured. Finally, we also analyse the potential of environments at different levels and briefly discuss whether machines should be designed to be intelligent or potentially intelligent.We thank the anonymous reviewers for their comments, which have helped to significantly improve this paper. This work was supported by the MEC-MINECO projects CONSOLIDER-INGENIO CSD2007-00022 and TIN 2010-21062-C02-02, GVA project PROMETEO/2008/051, the COST - European Cooperation in the field of Scientific and Technical Research IC0801 AT. Finally, we thank three pioneers ahead of their time(s). We thank Ray Solomonoff (1926-2009) and Chris Wallace (1933-2004) for all that they taught us, directly and indirectly. And, in his centenary year, we thank Alan Turing (1912-1954), with whom it perhaps all began.Hernández-Orallo, J.; Dowe, DL. (2013). On potential cognitive abilities in the machine kingdom. Minds and Machines. 23(2):179-210. https://doi.org/10.1007/s11023-012-9299-6S179210232Amari, S., Fujita, N., Shinomoto, S. (1992). Four types of learning curves. Neural Computation 4(4), 605–618.Aristotle (Translation, Introduction, and Commentary by Ross, W.D.) (1924). Aristotle’s Metaphysics. Oxford: Clarendon Press.Barmpalias, G. & Dowe, D. L. (2012). Universality probability of a prefix-free machine. Philosophical transactions of the Royal Society A [Mathematical, Physical and Engineering Sciences] (Phil Trans A), Theme Issue ‘The foundations of computation, physics and mentality: The Turing legacy’ compiled and edited by Barry Cooper and Samson Abramsky, 370, pp 3488–3511.Chaitin, G. J. (1966). On the length of programs for computing finite sequences. Journal of the Association for Computing Machinery, 13, 547–569.Chaitin, G. J. (1975). A theory of program size formally identical to information theory. Journal of the ACM (JACM), 22(3), 329–340.Dowe, D. L. (2008, September). Foreword re C. S. Wallace. Computer Journal, 51(5):523–560, Christopher Stewart WALLACE (1933–2004) memorial special issue.Dowe, D. L. (2011). MML, hybrid Bayesian network graphical models, statistical consistency, invariance and uniqueness. In: P. S. Bandyopadhyay, M. R. Forster (Eds), Handbook of the philosophy of science—Volume 7: Philosophy of statistics (pp. 901–982). Amsterdam: Elsevier.Dowe, D. L. & Hajek, A. R. (1997a). A computational extension to the turing test. Technical report #97/322, Dept Computer Science, Monash University, Melbourne, Australia, 9 pp, http://www.csse.monash.edu.au/publications/1997/tr-cs97-322-abs.html .Dowe, D. L. & Hajek, A. R. (1997b, September). A computational extension to the Turing Test. in Proceedings of the 4th conference of the Australasian Cognitive Science Society, University of Newcastle, NSW, Australia, 9 pp.Dowe, D. L. & Hajek, A. R. (1998, February). A non-behavioural, computational extension to the Turing Test. In: International conference on computational intelligence and multimedia applications (ICCIMA’98), Gippsland, Australia, pp 101–106.Dowe, D. L., Hernández-Orallo, J. (2012). IQ tests are not for machines, yet. Intelligence, 40(2), 77–81.Gallistel, C. R., Fairhurst, S., & Balsam, P. (2004). The learning curve: Implications of a quantitative analysis. In Proceedings of the National Academy of Sciences of the United States of America, 101(36), 13124–13131.Gardner, M. (1970). Mathematical games: The fantastic combinations of John Conway’s new solitaire game “life”. Scientific American, 223(4), 120–123.Goertzel, B. & Bugaj, S. V. (2009). AGI preschool: A framework for evaluating early-stage human-like AGIs. In Proceedings of the second international conference on artificial general intelligence (AGI-09), pp 31–36.Hernández-Orallo, J. (2000a). Beyond the Turing Test. Journal of Logic, Language & Information, 9(4), 447–466.Hernández-Orallo, J. (2000b). On the computational measurement of intelligence factors. In A. Meystel (Ed), Performance metrics for intelligent systems workshop (pp 1–8). Gaithersburg, MD: National Institute of Standards and Technology.Hernández-Orallo, J. (2010). On evaluating agent performance in a fixed period of time. In M. Hutter et al. (Eds.), Proceedings of 3rd international conference on artificial general intelligence (pp. 25–30). New York: Atlantis Press.Hernández-Orallo, J., & Dowe, D. L. (2010). Measuring universal intelligence: Towards an anytime intelligence test. Artificial Intelligence, 174(18), 1508–1539.Hernández-Orallo, J. & Dowe, D. L. (2011, April). Mammals, machines and mind games. Who’s the smartest?. The conversation, http://theconversation.edu.au/mammals-machines-and-mind-games-whos-the-smartest-566 .Hernández-Orallo J., Dowe D. L., España-Cubillo S., Hernández-Lloreda M. V., & Insa-Cabrera J. (2011). On more realistic environment distributions for defining, evaluating and developing intelligence. In: J. Schmidhuber, K. R. Thórisson, & M. Looks (Eds.), Artificial general intelligence 2011, volume 6830, LNAI series, pp. 82–91. New York: Springer.Hernández-Orallo, J., Dowe, D. L., & Hernández-Lloreda, M. V. (2012a, March). Measuring cognitive abilities of machines, humans and non-human animals in a unified way: towards universal psychometrics. Technical report 2012/267, Faculty of Information Technology, Clayton School of I.T., Monash University, Australia.Hernández-Orallo, J., Insa, J., Dowe, D. L., & Hibbard, B. (2012b). Turing tests with Turing machines. In A. Voronkov (Ed.), The Alan Turing centenary conference, Turing-100, Manchester, volume 10 of EPiC Series, pp 140–156.Hernández-Orallo, J., & Minaya-Collado, N. (1998). A formal definition of intelligence based on an intensional variant of Kolmogorov complexity. In Proceedings of the international symposium of engineering of intelligent systems (EIS’98) (pp 146–163). Switzerland: ICSC Press.Herrmann, E., Call, J., Hernández-Lloreda, M. V., Hare, B., & Tomasello, M. (2007). Humans have evolved specialized skills of social cognition: The cultural intelligence hypothesis. Science, 317(5843), 1360–1366.Herrmann, E., Hernández-Lloreda, M. V., Call, J., Hare, B., & Tomasello, M. (2010). The structure of individual differences in the cognitive abilities of children and chimpanzees. Psychological Science, 21(1), 102–110.Horn, J. L., & Cattell, R. B. (1966). Refinement and test of the theory of fluid and crystallized general intelligences. Journal of educational psychology, 57(5), 253.Hutter, M. (2005). Universal artificial intelligence: Sequential decisions based on algorithmic probability. New York: Springer.Insa-Cabrera, J., Dowe, D. L., España, S., Hernández-Lloreda, M. V., & Hernández-Orallo, J. (2011a). Comparing humans and AI agents. In AGI: 4th conference on artificial general intelligence—Lecture Notes in Artificial Intelligence (LNAI), volume 6830, pp 122–132. Springer, New York.Insa-Cabrera, J., Dowe, D. L., & Hernández-Orallo, J. (2011b). Evaluating a reinforcement learning algorithm with a general intelligence test. In CAEPIA—Lecture Notes in Artificial Intelligence (LNAI), volume 7023, pages 1–11. Springer, New York.Kearns, M. & Singh, S. (2002). Near-optimal reinforcement learning in polynomial time. Machine Learning, 49(2), 209–232.Kolmogorov, A. N. (1965). Three approaches to the quantitative definition of information. Problems of Information Transmission, 1, 4–7.Legg, S. (2008, June). Machine super intelligence. Department of Informatics, University of Lugano.Legg, S. & Hutter, M. (2007). Universal intelligence: A definition of machine intelligence. Minds and Machines, 17(4), 391–444.Legg, S., & Veness, J. (2012). An approximation of the universal intelligence measure. In Proceedings of Solomonoff 85th memorial conference. New York: Springer.Levin, L. A. (1973). Universal sequential search problems. Problems of Information Transmission, 9(3), 265–266.Li, M., Vitányi, P. (2008). An introduction to Kolmogorov complexity and its applications (3rd ed). New York: Springer.Little, V. L., & Bailey, K. G. (1972). Potential intelligence or intelligence test potential? A question of empirical validity. Journal of Consulting and Clinical Psychology, 39(1), 168.Mahoney, M. V. (1999). Text compression as a test for artificial intelligence. In Proceedings of the national conference on artificial intelligence, AAAI (pp. 486–502). New Jersey: Wiley.Mahrer, A. R. (1958). Potential intelligence: A learning theory approach to description and clinical implication. The Journal of General Psychology, 59(1), 59–71.Oppy, G., & Dowe, D. L. (2011). The Turing Test. In E. N. Zalta (Ed.), Stanford encyclopedia of philosophy. Stanford University. http://plato.stanford.edu/entries/turing-test/ .Orseau, L. & Ring, M. (2011). Self-modification and mortality in artificial agents. In AGI: 4th conference on artificial general intelligence—Lecture Notes in Artificial Intelligence (LNAI), volume 6830, pages 1–10. Springer, New York.Ring, M. & Orseau, L. (2011). Delusion, survival, and intelligent agents. In AGI: 4th conference on artificial general intelligence—Lecture Notes in Artificial Intelligence (LNAI), volume 6830, pp. 11–20. Springer, New York.Schaeffer, J., Burch, N., Bjornsson, Y., Kishimoto, A., Muller, M., Lake, R., et al. (2007). Checkers is solved. Science, 317(5844), 1518.Solomonoff, R. J. (1962). Training sequences for mechanized induction. In M. Yovits, G. Jacobi, & G. Goldsteins (Eds.), Self-Organizing Systems, 7, 425–434.Solomonoff, R. J. (1964). A formal theory of inductive inference. Information and Control, 7(1–22), 224–254.Solomonoff, R. J. (1967). Inductive inference research: Status, Spring 1967. RTB 154, Rockford Research, Inc., 140 1/2 Mt. Auburn St., Cambridge, Mass. 02138, July 1967.Solomonoff, R. J. (1978). Complexity-based induction systems: comparisons and convergence theorems. IEEE Transactions on Information Theory, 24(4), 422–432.Solomonoff, R. J. (1984). Perfect training sequences and the costs of corruption—A progress report on induction inference research. Oxbridge research.Solomonoff, R. J. (1985). The time scale of artificial intelligence: Reflections on social effects. Human Systems Management, 5, 149–153.Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge: The MIT press.Thorp, T. R., & Mahrer, A. R. (1959). Predicting potential intelligence. Journal of Clinical Psychology, 15(3), 286–288.Turing, A. M. (1950). Computing machinery and intelligence. Mind, 59, 433–460.Veness, J., Ng, K. S., Hutter, M., & Silver, D. (2011). A Monte Carlo AIXI approximation. Journal of Artificial Intelligence Research, JAIR, 40, 95–142.Wallace, C. S. (2005). Statistical and inductive inference by minimum message length. New York: Springer.Wallace, C. S., & Boulton, D. M. (1968). An information measure for classification. Computer Journal, 11, 185–194.Wallace, C. S., & Dowe, D. L. (1999a). Minimum message length and Kolmogorov complexity. Computer Journal 42(4), 270–283.Wallace, C. S., & Dowe, D. L. (1999b). Refinements of MDL and MML coding. Computer Journal, 42(4), 330–337.Woergoetter, F., & Porr, B. (2008). Reinforcement learning. Scholarpedia, 3(3), 1448.Zvonkin, A. K., & Levin, L. A. (1970). The complexity of finite objects and the development of the concepts of information and randomness by means of the theory of algorithms. Russian Mathematical Surveys, 25, 83–124

Evaluation of Bipolar, Tripolar, and Quadripolar Laplacian Estimates of Electrocardiogram via Concentric Ring Electrodes

[EN] Surface Laplacian estimates via concentric ring electrodes (CREs) have proven to enhance spatial resolution compared to conventional disc electrodes, which is of great importance for P-wave analysis. In this study, Laplacian estimates for traditional bipolar configuration (BC), two tripolar configurations with linearly decreasing and increasing inter-ring distances (TCLDIRD and TCLIIRD, respectively), and quadripolar configuration (QC) were obtained from cardiac recordings with pentapolar CREs placed at CMV1 and CMV2 positions. Normalized P-wave amplitude (NAP) was computed to assess the contrast to study atrial activity. Signals were of good quality (20-30 dB). Atrial activity was more emphasized at CMV1 (NAP similar or equal to 0.19-0.24) compared to CMV2 (NAP similar or equal to 0.08-0.10). Enhanced spatial resolution of TCLIIRD and QC resulted in higher NAP values than BC and TCLDIRD. Comparison with simultaneous standard 12-lead ECG proved that Laplacian estimates at CMV1 outperformed all the limb and chest standard leads in the contrast to study P-waves. Clinical recordings with CRE at this position could allow more detailed observation of atrial activity and facilitate the diagnosis of associated pathologies. Furthermore, such recordings would not require additional electrodes on limbs and could be performed wirelessly, so it should also be suitable for ambulatory monitoring, for example, using cardiac Holter monitors.This research was funded by the National Science Foundation (NSF) Division of Human Resource Development (HRD) Tribal Colleges and Universities Program (TCUP), grants number 1622481 and 1914787 to O.M.Garcia-Casado, J.; Ye Lin, Y.; Prats-Boluda, G.; Makeyev, O. (2019). Evaluation of Bipolar, Tripolar, and Quadripolar Laplacian Estimates of Electrocardiogram via Concentric Ring Electrodes. Sensors. 19(17):1-11. https://doi.org/10.3390/s19173780S1111917Roth, G. A., Johnson, C., Abajobir, A., Abd-Allah, F., Abera, S. F., Abyu, G., … Alam, K. (2017). Global, Regional, and National Burden of Cardiovascular Diseases for 10 Causes, 1990 to 2015. Journal of the American College of Cardiology, 70(1), 1-25. doi:10.1016/j.jacc.2017.04.052Lopez, A. D., Mathers, C. D., Ezzati, M., Jamison, D. T., & Murray, C. J. (2006). Global and regional burden of disease and risk factors, 2001: systematic analysis of population health data. The Lancet, 367(9524), 1747-1757. doi:10.1016/s0140-6736(06)68770-9Bhatnagar, P., Wickramasinghe, K., Wilkins, E., & Townsend, N. (2016). Trends in the epidemiology of cardiovascular disease in the UK. Heart, 102(24), 1945-1952. doi:10.1136/heartjnl-2016-309573https://healthmetrics.heart.org/cardiovascular-disease-a-costly-burden/Leal, J., Luengo-Fernández, R., Gray, A., Petersen, S., & Rayner, M. (2006). Economic burden of cardiovascular diseases in the enlarged European Union. European Heart Journal, 27(13), 1610-1619. doi:10.1093/eurheartj/ehi733Wang, Y., Cuculich, P. S., Zhang, J., Desouza, K. A., Vijayakumar, R., Chen, J., … Rudy, Y. (2011). Noninvasive Electroanatomic Mapping of Human Ventricular Arrhythmias with Electrocardiographic Imaging. Science Translational Medicine, 3(98), 98ra84-98ra84. doi:10.1126/scitranslmed.3002152SippensGroenewegen, A., Peeters, H. A. P., Jessurun, E. R., Linnenbank, A. C., Robles de Medina, E. O., Lesh, M. D., & van Hemel, N. M. (1998). Body Surface Mapping During Pacing at Multiple Sites in the Human Atrium. Circulation, 97(4), 369-380. doi:10.1161/01.cir.97.4.369Kornreich, F., MacLeod, R. S., & Lux, R. L. (2008). Supplemented standard 12-lead electrocardiogram for optimal diagnosis and reconstruction of significant body surface map patterns. Journal of Electrocardiology, 41(3), 251-256. doi:10.1016/j.jelectrocard.2008.02.011Fereniec, M., Stix, G., Kania, M., Mroczka, T., & Maniewski, R. (2013). An Analysis of the U-Wave and Its Relation to the T-Wave in Body Surface Potential Maps for Healthy Subjects and MI Patients. Annals of Noninvasive Electrocardiology, 19(2), 145-156. doi:10.1111/anec.12110Lian, J., Li, G., Cheng, J., Avitall, B., & He, B. (2002). Body surface Laplacian mapping of atrial depolarization in healthy human subjects. Medical & Biological Engineering & Computing, 40(6), 650-659. doi:10.1007/bf02345304Wu, D., Tsai, H. C., & He, B. (1999). On the Estimation of the Laplacian Electrocardiogram during Ventricular Activation. Annals of Biomedical Engineering, 27(6), 731-745. doi:10.1114/1.224He, B., & Cohen, R. J. (1992). Body surface Laplacian mapping of cardiac electrical activity. The American Journal of Cardiology, 70(20), 1617-1620. doi:10.1016/0002-9149(92)90471-aHe, B., & Cohen, R. J. (1992). Body surface Laplacian ECG mapping. IEEE Transactions on Biomedical Engineering, 39(11), 1179-1191. doi:10.1109/10.168684He, B., & Cohen, R. J. (1995). Body Surface Laplacian Electrocardiographic Mapping−A Review. Critical Reviews in Biomedical Engineering, 23(5-6), 475-510. doi:10.1615/critrevbiomedeng.v23.i5-6.30UMETANI, K., OKAMOTO, Y., MASHIMA, S., ONO, K., HOSAKA, H., & HE, B. (1998). Body Surface Laplacian Mapping in Patients with Left or Right Ventricular Bundle Branch Block. Pacing and Clinical Electrophysiology, 21(11), 2043-2054. doi:10.1111/j.1540-8159.1998.tb01122.xBin He, Guanglin Li, & Jie Lian. (2002). A spline Laplacian ECG estimator in a realistic geometry volume conductor. IEEE Transactions on Biomedical Engineering, 49(2), 110-117. doi:10.1109/10.979350Besio, G., Koka, K., Aakula, R., & Weizhong Dai. (2006). Tri-polar concentric ring electrode development for Laplacian electroencephalography. IEEE Transactions on Biomedical Engineering, 53(5), 926-933. doi:10.1109/tbme.2005.863887Besio, W., Aakula, R., Koka, K., & Dai, W. (2006). Development of a Tri-polar Concentric Ring Electrode for Acquiring Accurate Laplacian Body Surface Potentials. Annals of Biomedical Engineering, 34(3), 426-435. doi:10.1007/s10439-005-9054-8Besio, W., & Chen, T. (2007). Tripolar Laplacian electrocardiogram and moment of activation isochronal mapping. Physiological Measurement, 28(5), 515-529. doi:10.1088/0967-3334/28/5/006Prats-Boluda, G., Garcia-Casado, J., Martinez-de-Juan, J. L., & Ye-Lin, Y. (2011). Active concentric ring electrode for non-invasive detection of intestinal myoelectric signals. Medical Engineering & Physics, 33(4), 446-455. doi:10.1016/j.medengphy.2010.11.009Prats-Boluda, G., Ye-Lin, Y., Bueno-Barrachina, J., Rodriguez de Sanabria, R., & Garcia-Casado, J. (2016). Towards the clinical use of concentric electrodes in ECG recordings: influence of ring dimensions and electrode position. Measurement Science and Technology, 27(2), 025705. doi:10.1088/0957-0233/27/2/025705Zena-Giménez, V., Garcia-Casado, J., Ye-Lin, Y., Garcia-Breijo, E., & Prats-Boluda, G. (2018). A Flexible Multiring Concentric Electrode for Non-Invasive Identification of Intestinal Slow Waves. Sensors, 18(2), 396. doi:10.3390/s18020396Ye-Lin, Y., Alberola-Rubio, J., Prats-boluda, G., Perales, A., Desantes, D., & Garcia-Casado, J. (2014). Feasibility and Analysis of Bipolar Concentric Recording of Electrohysterogram with Flexible Active Electrode. Annals of Biomedical Engineering, 43(4), 968-976. doi:10.1007/s10439-014-1130-5Wang, K., Parekh, U., Pailla, T., Garudadri, H., Gilja, V., & Ng, T. N. (2017). Stretchable Dry Electrodes with Concentric Ring Geometry for Enhancing Spatial Resolution in Electrophysiology. Advanced Healthcare Materials, 6(19), 1700552. doi:10.1002/adhm.201700552Lidón-Roger, J., Prats-Boluda, G., Ye-Lin, Y., Garcia-Casado, J., & Garcia-Breijo, E. (2018). Textile Concentric Ring Electrodes for ECG Recording Based on Screen-Printing Technology. Sensors, 18(1), 300. doi:10.3390/s18010300Makeyev, O., Ding, Q., & Besio, W. G. (2016). Improving the accuracy of Laplacian estimation with novel multipolar concentric ring electrodes. Measurement, 80, 44-52. doi:10.1016/j.measurement.2015.11.017Makeyev, O., & Besio, W. (2016). Improving the Accuracy of Laplacian Estimation with Novel Variable Inter-Ring Distances Concentric Ring Electrodes. Sensors, 16(6), 858. doi:10.3390/s16060858Makeyev, O. (2018). Solving the general inter-ring distances optimization problem for concentric ring electrodes to improve Laplacian estimation. BioMedical Engineering OnLine, 17(1). doi:10.1186/s12938-018-0549-6Ye-Lin, Y., Bueno-Barrachina, J. M., Prats-boluda, G., Rodriguez de Sanabria, R., & Garcia-Casado, J. (2017). Wireless sensor node for non-invasive high precision electrocardiographic signal acquisition based on a multi-ring electrode. Measurement, 97, 195-202. doi:10.1016/j.measurement.2016.11.009Prats-Boluda, G., Ye-Lin, Y., Pradas-Novella, F., Garcia-Breijo, E., & Garcia-Casado, J. (2018). Textile Concentric Ring Electrodes: Influence of Position and Electrode Size on Cardiac Activity Monitoring. Journal of Sensors, 2018, 1-9. doi:10.1155/2018/7290867Huiskamp, G. (1991). Difference formulas for the surface Laplacian on a triangulated surface. Journal of Computational Physics, 95(2), 477-496. doi:10.1016/0021-9991(91)90286-tHamilton, P. S., & Tompkins, W. J. (1986). Quantitative Investigation of QRS Detection Rules Using the MIT/BIH Arrhythmia Database. IEEE Transactions on Biomedical Engineering, BME-33(12), 1157-1165. doi:10.1109/tbme.1986.325695Koka, K., & Besio, W. G. (2007). Improvement of spatial selectivity and decrease of mutual information of tri-polar concentric ring electrodes. Journal of Neuroscience Methods, 165(2), 216-222. doi:10.1016/j.jneumeth.2007.06.007Prats-Boluda, G., Ye-Lin, Y., Bueno Barrachina, J. M., Senent, E., Rodriguez de Sanabria, R., & Garcia-Casado, J. (2015). Development of a portable wireless system for bipolar concentric ECG recording. Measurement Science and Technology, 26(7), 075102. doi:10.1088/0957-0233/26/7/07510

Neutrosophic Completion Technique for Incomplete Higher-Order AHP Comparison Matrices

[EN] After the recent establishment of the Sustainable Development Goals and the Agenda 2030, the sustainable design of products in general and infrastructures in particular emerge as a challenging field for the development and application of multicriteria decision-making tools. Sustainability-related decision problems usually involve, by definition, a wide variety in number and nature of conflicting criteria, thus pushing the limits of conventional multicriteria decision-making tools practices. The greater the number of criteria and the more complex the relations existing between them in a decisional problem, the less accurate and certain are the judgments required by usual methods, such as the analytic hierarchy process (AHP). The present paper proposes a neutrosophic AHP completion methodology to reduce the number of judgments required to be emitted by the decision maker. This increases the consistency of their responses, while accounting for uncertainties associated to the fuzziness of human thinking. The method is applied to a sustainable-design problem, resulting in weight estimations that allow for a reduction of up to 22% of the conventionally required comparisons, with an average accuracy below 10% between estimates and the weights resulting from a conventionally completed AHP matrix, and a root mean standard error below 15%.The authors acknowledge the financial support of the Spanish Ministry of Economy and Business, along with FEDER funding (DIMALIFE Project: BIA2017-85098-R).Navarro, IJ.; Martí Albiñana, JV.; Yepes, V. (2021). Neutrosophic Completion Technique for Incomplete Higher-Order AHP Comparison Matrices. Mathematics. 9(5):1-19. https://doi.org/10.3390/math905049611995Worrell, E., Price, L., Martin, N., Hendriks, C., & Meida, L. O. (2001). CARBON DIOXIDE EMISSIONS FROM THE GLOBAL CEMENT INDUSTRY. Annual Review of Energy and the Environment, 26(1), 303-329. doi:10.1146/annurev.energy.26.1.303García, J., Yepes, V., & Martí, J. V. (2020). A Hybrid k-Means Cuckoo Search Algorithm Applied to the Counterfort Retaining Walls Problem. Mathematics, 8(4), 555. doi:10.3390/math8040555Penadés-Plà, V., García-Segura, T., & Yepes, V. (2020). Robust Design Optimization for Low-Cost Concrete Box-Girder Bridge. Mathematics, 8(3), 398. doi:10.3390/math8030398Kim, S., & Frangopol, D. M. (2017). Multi-objective probabilistic optimum monitoring planning considering fatigue damage detection, maintenance, reliability, service life and cost. Structural and Multidisciplinary Optimization, 57(1), 39-54. doi:10.1007/s00158-017-1849-3García-Segura, T., Yepes, V., & Frangopol, D. M. (2017). Multi-objective design of post-tensioned concrete road bridges using artificial neural networks. Structural and Multidisciplinary Optimization, 56(1), 139-150. doi:10.1007/s00158-017-1653-0Van den Heede, P., & De Belie, N. (2014). A service life based global warming potential for high-volume fly ash concrete exposed to carbonation. Construction and Building Materials, 55, 183-193. doi:10.1016/j.conbuildmat.2014.01.033García, J., Martí, J. V., & Yepes, V. (2020). The Buttressed Walls Problem: An Application of a Hybrid Clustering Particle Swarm Optimization Algorithm. Mathematics, 8(6), 862. doi:10.3390/math8060862García-Segura, T., Penadés-Plà, V., & Yepes, V. (2018). Sustainable bridge design by metamodel-assisted multi-objective optimization and decision-making under uncertainty. Journal of Cleaner Production, 202, 904-915. doi:10.1016/j.jclepro.2018.08.177Gursel, A. P., & Ostertag, C. (2016). Comparative life-cycle impact assessment of concrete manufacturing in Singapore. The International Journal of Life Cycle Assessment, 22(2), 237-255. doi:10.1007/s11367-016-1149-yPenadés-Plà, V., Martí, J. V., García-Segura, T., & Yepes, V. (2017). Life-Cycle Assessment: A Comparison between Two Optimal Post-Tensioned Concrete Box-Girder Road Bridges. Sustainability, 9(10), 1864. doi:10.3390/su9101864Navarro, I. J., Yepes, V., & Martí, J. V. (2018). Social life cycle assessment of concrete bridge decks exposed to aggressive environments. Environmental Impact Assessment Review, 72, 50-63. doi:10.1016/j.eiar.2018.05.003Sierra, L. A., Pellicer, E., & Yepes, V. (2017). Method for estimating the social sustainability of infrastructure projects. Environmental Impact Assessment Review, 65, 41-53. doi:10.1016/j.eiar.2017.02.004Navarro, I. J., Yepes, V., & Martí, J. V. (2019). Sustainability assessment of concrete bridge deck designs in coastal environments using neutrosophic criteria weights. Structure and Infrastructure Engineering, 16(7), 949-967. doi:10.1080/15732479.2019.1676791Tavana, M., Shaabani, A., Javier Santos-Arteaga, F., & Raeesi Vanani, I. (2020). A Review of Uncertain Decision-Making Methods in Energy Management Using Text Mining and Data Analytics. Energies, 13(15), 3947. doi:10.3390/en13153947Yannis, G., Kopsacheili, A., Dragomanovits, A., & Petraki, V. (2020). State-of-the-art review on multi-criteria decision-making in the transport sector. Journal of Traffic and Transportation Engineering (English Edition), 7(4), 413-431. doi:10.1016/j.jtte.2020.05.005Navarro, I. J., Penadés-Plà, V., Martínez-Muñoz, D., Rempling, R., & Yepes, V. (2020). LIFE CYCLE SUSTAINABILITY ASSESSMENT FOR MULTI-CRITERIA DECISION MAKING IN BRIDGE DESIGN: A REVIEW. JOURNAL OF CIVIL ENGINEERING AND MANAGEMENT, 26(7), 690-704. doi:10.3846/jcem.2020.13599Hedelin, B. (2018). Complexity is no excuse. Sustainability Science, 14(3), 733-749. doi:10.1007/s11625-018-0635-5Zadeh, L. A. (1973). Outline of a New Approach to the Analysis of Complex Systems and Decision Processes. IEEE Transactions on Systems, Man, and Cybernetics, SMC-3(1), 28-44. doi:10.1109/tsmc.1973.5408575Zadeh, L. A. (1965). Fuzzy sets. Information and Control, 8(3), 338-353. doi:10.1016/s0019-9958(65)90241-xMilošević, D. M., Milošević, M. R., & Simjanović, D. J. (2020). Implementation of Adjusted Fuzzy AHP Method in the Assessment for Reuse of Industrial Buildings. Mathematics, 8(10), 1697. doi:10.3390/math8101697Lin, C.-N. (2020). A Fuzzy Analytic Hierarchy Process-Based Analysis of the Dynamic Sustainable Management Index in Leisure Agriculture. Sustainability, 12(13), 5395. doi:10.3390/su12135395Salehi, S., Jalili Ghazizadeh, M., Tabesh, M., Valadi, S., & Salamati Nia, S. P. (2020). A risk component-based model to determine pipes renewal strategies in water distribution networks. Structure and Infrastructure Engineering, 17(10), 1338-1359. doi:10.1080/15732479.2020.1842466Liu, P., & Liu, X. (2016). The neutrosophic number generalized weighted power averaging operator and its application in multiple attribute group decision making. International Journal of Machine Learning and Cybernetics, 9(2), 347-358. doi:10.1007/s13042-016-0508-0Peng, J., Wang, J., & Yang, W.-E. (2016). A multi-valued neutrosophic qualitative flexible approach based on likelihood for multi-criteria decision-making problems. International Journal of Systems Science, 48(2), 425-435. doi:10.1080/00207721.2016.1218975Saaty, T. L., & Ozdemir, M. S. (2003). Why the magic number seven plus or minus two. Mathematical and Computer Modelling, 38(3-4), 233-244. doi:10.1016/s0895-7177(03)90083-5Harker, P. T. (1987). Incomplete pairwise comparisons in the analytic hierarchy process. Mathematical Modelling, 9(11), 837-848. doi:10.1016/0270-0255(87)90503-3Chen, K., Kou, G., Michael Tarn, J., & Song, Y. (2015). Bridging the gap between missing and inconsistent values in eliciting preference from pairwise comparison matrices. Annals of Operations Research, 235(1), 155-175. doi:10.1007/s10479-015-1997-zBozóki, S., Fülöp, J., & Rónyai, L. (2010). On optimal completion of incomplete pairwise comparison matrices. Mathematical and Computer Modelling, 52(1-2), 318-333. doi:10.1016/j.mcm.2010.02.047Dong, M., Li, S., & Zhang, H. (2015). Approaches to group decision making with incomplete information based on power geometric operators and triangular fuzzy AHP. Expert Systems with Applications, 42(21), 7846-7857. doi:10.1016/j.eswa.2015.06.007Zhou, X., Hu, Y., Deng, Y., Chan, F. T. S., & Ishizaka, A. (2018). A DEMATEL-based completion method for incomplete pairwise comparison matrix in AHP. Annals of Operations Research, 271(2), 1045-1066. doi:10.1007/s10479-018-2769-3Sumathi, I. R., & Antony Crispin Sweety, C. (2019). New approach on differential equation via trapezoidal neutrosophic number. Complex & Intelligent Systems, 5(4), 417-424. doi:10.1007/s40747-019-00117-3Deli, I., & Şubaş, Y. (2016). A ranking method of single valued neutrosophic numbers and its applications to multi-attribute decision making problems. International Journal of Machine Learning and Cybernetics, 8(4), 1309-1322. doi:10.1007/s13042-016-0505-3Ye, J. (2017). Subtraction and Division Operations of Simplified Neutrosophic Sets. Information, 8(2), 51. doi:10.3390/info8020051Liang, R., Wang, J., & Zhang, H. (2017). A multi-criteria decision-making method based on single-valued trapezoidal neutrosophic preference relations with complete weight information. Neural Computing and Applications, 30(11), 3383-3398. doi:10.1007/s00521-017-2925-8Sodenkamp, M. A., Tavana, M., & Di Caprio, D. (2018). An aggregation method for solving group multi-criteria decision-making problems with single-valued neutrosophic sets. Applied Soft Computing, 71, 715-727. doi:10.1016/j.asoc.2018.07.020Sierra, L. A., Pellicer, E., & Yepes, V. (2016). Social Sustainability in the Lifecycle of Chilean Public Infrastructure. Journal of Construction Engineering and Management, 142(5), 05015020. doi:10.1061/(asce)co.1943-7862.0001099Abdel-Basset, M., Manogaran, G., Mohamed, M., & Chilamkurti, N. (2018). RETRACTED: Three-way decisions based on neutrosophic sets and AHP-QFD framework for supplier selection problem. Future Generation Computer Systems, 89, 19-30. doi:10.1016/j.future.2018.06.024Dubois, D. (2011). The role of fuzzy sets in decision sciences: Old techniques and new directions. Fuzzy Sets and Systems, 184(1), 3-28. doi:10.1016/j.fss.2011.06.003Buckley, J. J. (1985). Fuzzy hierarchical analysis. Fuzzy Sets and Systems, 17(3), 233-247. doi:10.1016/0165-0114(85)90090-9Wang, Y.-M., & Elhag, T. M. S. (2006). On the normalization of interval and fuzzy weights. Fuzzy Sets and Systems, 157(18), 2456-2471. doi:10.1016/j.fss.2006.06.008Enea, M., & Piazza, T. (2004). Project Selection by Constrained Fuzzy AHP. Fuzzy Optimization and Decision Making, 3(1), 39-62. doi:10.1023/b:fodm.0000013071.63614.3dChu, T.-C., & Tsao, C.-T. (2002). Ranking fuzzy numbers with an area between the centroid point and original point. Computers & Mathematics with Applications, 43(1-2), 111-117. doi:10.1016/s0898-1221(01)00277-

The potential mapping of the needs of appropriate technology of cattle farm

Journal of Physics: Conference Series PAPER • THE FOLLOWING ARTICLE ISOPEN ACCESS The potential mapping of the needs of appropriate technology of cattle farm R A Purnomo1, J J Sarungu2, B R Samodro2, T Mulyaningsih2, E Gravitiani2 and A Gunardi2 Published under licence by IOP Publishing Ltd Journal of Physics: Conference Series, Volume 1517, 2019 1st Borobudur International Symposium on Applied Science and Engineering (BIS-ASE) 2019 16 October 2019, Magelang, Indonesia Citation R A Purnomo et al 2020 J. Phys.: Conf. Ser. 1517 012076 DownloadArticle PDF References 77 Total downloads Turn on MathJax Share this article Share this content via email Share on Facebook (opens new window) Share on Twitter (opens new window) Share on Mendeley (opens new window) Article information Abstract The purpose of research "The Potential Mapping of the Needs of Appropriate Technology of Cattle Farm" is to describe the profile of dairy farmers, evaluate and measure the level of technological readiness ability of cattle ranchers which doing in Pudak sub-district, Ponorogo. The analytical tool used is a teknometer that serves to measure the level of technological readiness capability used for the production of milk, meat, skin and feces of the cows that are divided into three stages, basic (level 1 to level 3), medium (level 4 to level 6) and ready (Level 7 to Level 9). By using teknometer is expected to provide basic information about the mapping of potential needs and the use of appropriate technology both tools, process and cow production in Pudak, Ponorogo. The results of the evaluation and measurement of TK2T Cattle Farm in Pudak, Ponorogo showed that all samples had not passed the measurement at level 1 to level 3. In addition, no one has passed the middle level 4 to level 6, while the top-level measurement, Namely level 7 to level 9 only get a maximum score of 60 percent. This explains that milk and meat production in Pudak still needs government intervention both in the use of appropriate technology, as well as supporting indicators such as management, hygiene in production, and human resources

On environment difficulty and discriminating power

The final publication is available at Springer via http://dx.doi.org/10.1007/s10458-014-9257-1This paper presents a way to estimate the difficulty and discriminating power of any task instance. We focus on a very general setting for tasks: interactive (possibly multiagent) environments where an agent acts upon observations and rewards. Instead of analysing the complexity of the environment, the state space or the actions that are performed by the agent, we analyse the performance of a population of agent policies against the task, leading to a distribution that is examined in terms of policy complexity. This distribution is then sliced by the algorithmic complexity of the policy and analysed through several diagrams and indicators. The notion of environment response curve is also introduced, by inverting the performance results into an ability scale. We apply all these concepts, diagrams and indicators to two illustrative problems: a class of agent-populated elementary cellular automata, showing how the difficulty and discriminating power may vary for several environments, and a multiagent system, where agents can become predators or preys, and may need to coordinate. Finally, we discuss how these tools can be applied to characterise (interactive) tasks and (multi-agent) environments. These characterisations can then be used to get more insight about agent performance and to facilitate the development of adaptive tests for the evaluation of agent abilities.I thank the reviewers for their comments, especially those aiming at a clearer connection with the field of multi-agent systems and the suggestion of better approximations for the calculation of the response curves. The implementation of the elementary cellular automata used in the environments is based on the library 'CellularAutomaton' by John Hughes for R [58]. I am grateful to Fernando Soler-Toscano for letting me know about their work [65] on the complexity of 2D objects generated by elementary cellular automata. I would also like to thank David L. Dowe for his comments on a previous version of this paper. This work was supported by the MEC/MINECO projects CONSOLIDER-INGENIO CSD2007-00022 and TIN 2010-21062-C02-02, GVA project PROMETEO/2008/051, the COST - European Cooperation in the field of Scientific and Technical Research IC0801 AT, and the REFRAME project, granted by the European Coordinated Research on Long-term Challenges in Information and Communication Sciences & Technologies ERA-Net (CHIST-ERA), and funded by the Ministerio de Economia y Competitividad in Spain (PCIN-2013-037).José Hernández-Orallo (2015). On environment difficulty and discriminating power. Autonomous Agents and Multi-Agent Systems. 29(3):402-454. https://doi.org/10.1007/s10458-014-9257-1S402454293Anderson, J., Baltes, J., & Cheng, C. T. (2011). Robotics competitions as benchmarks for ai research. The Knowledge Engineering Review, 26(01), 11–17.Andre, D., & Russell, S. J. (2002). State abstraction for programmable reinforcement learning agents. In Proceedings of the National Conference on Artificial Intelligence (pp. 119–125). Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press; 1999.Antunes, L., Fortnow, L., van Melkebeek, D., & Vinodchandran, N. V. (2006). Computational depth: Concept and applications. Theoretical Computer Science, 354(3), 391–404. Foundations of Computation Theory (FCT 2003), 14th Symposium on Fundamentals of Computation Theory 2003.Arai, K., Kaminka, G. A., Frank, I., & Tanaka-Ishii, K. (2003). Performance competitions as research infrastructure: Large scale comparative studies of multi-agent teams. Autonomous Agents and Multi-Agent Systems, 7(1–2), 121–144.Ashcraft, M. H., Donley, R. D., Halas, M. A., & Vakali, M. (1992). Chapter 8 working memory, automaticity, and problem difficulty. In Jamie I.D. Campbell (Ed.), The nature and origins of mathematical skills, volume 91 of advances in psychology (pp. 301–329). North-Holland.Ay, N., Müller, M., & Szkola, A. (2010). Effective complexity and its relation to logical depth. IEEE Transactions on Information Theory, 56(9), 4593–4607.Barch, D. M., Braver, T. S., Nystrom, L. E., Forman, S. D., Noll, D. C., & Cohen, J. D. (1997). Dissociating working memory from task difficulty in human prefrontal cortex. Neuropsychologia, 35(10), 1373–1380.Bordini, R. H., Hübner, J. F., & Wooldridge, M. (2007). Programming multi-agent systems in AgentSpeak using Jason. London: Wiley. com.Boutilier, C., Reiter, R., Soutchanski, M., Thrun, S. et al. (2000). Decision-theoretic, high-level agent programming in the situation calculus. In Proceedings of the National Conference on Artificial Intelligence (pp. 355–362). Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press; 1999.Busoniu, L., Babuska, R., & De Schutter, B. (2008). A comprehensive survey of multiagent reinforcement learning. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 38(2), 156–172.Chaitin, G. J. (1977). Algorithmic information theory. IBM Journal of Research and Development, 21, 350–359.Chedid, F. B. (2010). Sophistication and logical depth revisited. In 2010 IEEE/ACS International Conference on Computer Systems and Applications (AICCSA) (pp. 1–4). IEEE.Cheeseman, P., Kanefsky, B. & Taylor, W. M. (1991). Where the really hard problems are. In Proceedings of IJCAI-1991 (pp. 331–337).Dastani, M. (2008). 2APL: A practical agent programming language. Autonomous Agents and Multi-agent Systems, 16(3), 214–248.Delahaye, J. P. & Zenil, H. (2011). Numerical evaluation of algorithmic complexity for short strings: A glance into the innermost structure of randomness. Applied Mathematics and Computation, 219(1), 63–77Dowe, D. L. (2008). Foreword re C. S. Wallace. Computer Journal, 51(5), 523–560. Christopher Stewart WALLACE (1933–2004) memorial special issue.Dowe, D. L., & Hernández-Orallo, J. (2012). IQ tests are not for machines, yet. Intelligence, 40(2), 77–81.Du, D. Z., & Ko, K. I. (2011). Theory of computational complexity (Vol. 58). London: Wiley-Interscience.Elo, A. E. (1978). The rating of chessplayers, past and present (Vol. 3). London: Batsford.Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. London: Lawrence Erlbaum.Fatès, N. & Chevrier, V. (2010). How important are updating schemes in multi-agent systems? an illustration on a multi-turmite model. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1-Volume 1 (pp. 533–540). International Foundation for Autonomous Agents and Multiagent Systems.Ferber, J. & Müller, J. P. (1996). Influences and reaction: A model of situated multiagent systems. In Proceedings of Second International Conference on Multi-Agent Systems (ICMAS-96) (pp. 72–79).Ferrando, P. J. (2009). Difficulty, discrimination, and information indices in the linear factor analysis model for continuous item responses. Applied Psychological Measurement, 33(1), 9–24.Ferrando, P. J. (2012). Assessing the discriminating power of item and test scores in the linear factor-analysis model. Psicológica, 33, 111–139.Gent, I. P., & Walsh, T. (1994). Easy problems are sometimes hard. Artificial Intelligence, 70(1), 335–345.Gershenson, C. & Fernandez, N. (2012). Complexity and information: Measuring emergence, self-organization, and homeostasis at multiple scales. Complexity, 18(2), 29–44.Gruner, S. (2010). Mobile agent systems and cellular automata. Autonomous Agents and Multi-agent Systems, 20(2), 198–233.Hardman, D. K., & Payne, S. J. (1995). Problem difficulty and response format in syllogistic reasoning. The Quarterly Journal of Experimental Psychology, 48(4), 945–975.He, J., Reeves, C., Witt, C., & Yao, X. (2007). A note on problem difficulty measures in black-box optimization: Classification, realizations and predictability. Evolutionary Computation, 15(4), 435–443.Hernández-Orallo, J. (2000). Beyond the turing test. Journal of Logic Language & Information, 9(4), 447–466.Hernández-Orallo, J. (2000). On the computational measurement of intelligence factors. In A. Meystel (Ed.), Performance metrics for intelligent systems workshop (pp. 1–8). Gaithersburg, MD: National Institute of Standards and Technology.Hernández-Orallo, J. (2000). Thesis: Computational measures of information gain and reinforcement in inference processes. AI Communications, 13(1), 49–50.Hernández-Orallo, J. (2010). A (hopefully) non-biased universal environment class for measuring intelligence of biological and artificial systems. In M. Hutter et al. (Ed.), 3rd International Conference on Artificial General Intelligence (pp. 182–183). Atlantis Press Extended report at http://users.dsic.upv.es/proy/anynt/unbiased.pdf .Hernández-Orallo, J., & Dowe, D. L. (2010). Measuring universal intelligence: Towards an anytime intelligence test. Artificial Intelligence, 174(18), 1508–1539.Hernández-Orallo, J., Dowe, D. L., España-Cubillo, S., Hernández-Lloreda, M. V., & Insa-Cabrera, J. (2011). On more realistic environment distributions for defining, evaluating and developing intelligence. In J. Schmidhuber, K. R. Thórisson, & M. Looks (Eds.), LNAI series on artificial general intelligence 2011 (Vol. 6830, pp. 82–91). Berlin: Springer.Hernández-Orallo, J., Dowe, D. L., & Hernández-Lloreda, M. V. (2014). Universal psychometrics: Measuring cognitive abilities in the machine kingdom. Cognitive Systems Research, 27, 50–74.Hernández-Orallo, J., Insa, J., Dowe, D. L. & Hibbard, B. (2012). Turing tests with turing machines. In A. Voronkov (Ed.), The Alan Turing Centenary Conference, Turing-100, Manchester, 2012, volume 10 of EPiC Series (pp. 140–156).Hernández-Orallo, J. & Minaya-Collado, N. (1998). A formal definition of intelligence based on an intensional variant of Kolmogorov complexity. In Proceedings of International Symposium of Engineering of Intelligent Systems (EIS’98) (pp. 146–163). ICSC Press.Hibbard, B. (2009). Bias and no free lunch in formal measures of intelligence. Journal of Artificial General Intelligence, 1(1), 54–61.Hoos, H. H. (1999). Sat-encodings, search space structure, and local search performance. In 1999 International Joint Conference on Artificial Intelligence (Vol. 16, pp. 296–303).Insa-Cabrera, J., Benacloch-Ayuso, J. L., & Hernández-Orallo, J. (2012). On measuring social intelligence: Experiments on competition and cooperation. In J. Bach, B. Goertzel, & M. Iklé (Eds.), AGI, volume 7716 of lecture notes in computer science (pp. 126–135). Berlin: Springer.Insa-Cabrera, J., Dowe, D. L., España-Cubillo, S., Hernández-Lloreda, M. V., & Hernández-Orallo, J. (2011). Comparing humans and AI agents. In J. Schmidhuber, K. R. Thórisson, & M. Looks (Eds.), LNAI series on artificial general intelligence 2011 (Vol. 6830, pp. 122–132). Berlin: Springer.Knuth, D. E. (1973). Sorting and searching, volume 3 of the art of computer programming. Reading, MA: Addison-Wesley.Kotovsky, K., & Simon, H. A. (1990). What makes some problems really hard: Explorations in the problem space of difficulty. Cognitive Psychology, 22(2), 143–183.Legg, S. (2008). Machine super intelligence. PhD thesis, Department of Informatics, University of Lugano, June 2008.Legg, S., & Hutter, M. (2007). Universal intelligence: A definition of machine intelligence. Minds and Machines, 17(4), 391–444.Leonetti, M. & Iocchi, L. (2010). Improving the performance of complex agent plans through reinforcement learning. In Proceedings of the 2010 International Conference on Autonomous Agents and Multiagent Systems (Vol. 1, pp. 723–730). International Foundation for Autonomous Agents and Multiagent Systems.Levin, L. A. (1973). Universal sequential search problems. Problems of Information Transmission, 9(3), 265–266.Levin, L. A. (1986). Average case complete problems. SIAM Journal on Computing, 15, 285.Li, M., & Vitányi, P. (2008). An introduction to Kolmogorov complexity and its applications (3rd ed.). Berlin: Springer.Low, C. K., Chen, T. Y., & Rónnquist, R. (1999). Automated test case generation for bdi agents. Autonomous Agents and Multi-agent Systems, 2(4), 311–332.Madden, M. G., & Howley, T. (2004). Transfer of experience between reinforcement learning environments with progressive difficulty. Artificial Intelligence Review, 21(3), 375–398.Mellenbergh, G. J. (1994). Generalized linear item response theory. Psychological Bulletin, 115(2), 300.Michel, F. (2004). Formalisme, outils et éléments méthodologiques pour la modélisation et la simulation multi-agents. PhD thesis, Université des sciences et techniques du Languedoc, Montpellier.Miller, G. A. (1956). The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review, 63(2), 81.Orponen, P., Ko, K. I., Schöning, U., & Watanabe, O. (1994). Instance complexity. Journal of the ACM (JACM), 41(1), 96–121.Simon, H. A., & Kotovsky, K. (1963). Human acquisition of concepts for sequential patterns. Psychological Review, 70(6), 534.Team, R., et al. (2013). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.Whiteson, S., Tanner, B., & White, A. (2010). The reinforcement learning competitions. The AI Magazine, 31(2), 81–94.Wiering, M., & van Otterlo, M. (Eds.). (2012). Reinforcement learning: State-of-the-art. Berlin: Springer.Wolfram, S. (2002). A new kind of science. Champaign, IL: Wolfram Media.Zatuchna, Z., & Bagnall, A. (2009). Learning mazes with aliasing states: An LCS algorithm with associative perception. Adaptive Behavior, 17(1), 28–57.Zenil, H. (2010). Compression-based investigation of the dynamical properties of cellular automata and other systems. Complex Systems, 19(1), 1–28.Zenil, H. (2011). Une approche expérimentale à la théorie algorithmique de la complexité. PhD thesis, Dissertation in fulfilment of the degree of Doctor in Computer Science, Université de Lille.Zenil, H., Soler-Toscano, F., Delahaye, J. P. & Gauvrit, N. (2012). Two-dimensional kolmogorov complexity and validation of the coding theorem method by compressibility. arXiv, preprint arXiv:1212.6745