The generation of complex systems where the user requires decisions based on several criteria involves building a relationship of global preference for a set of alternatives evaluated. Between these systems there are the Tourist Systems, that was impulse by internet like a facilitator in the access of different sources of information for travel planning. Currently, tourists should not only visit multiple independent Web sites (airlines, hotels, etc.) and await a considerable time receiving confirmation responses.
All these actions required generating a stochastic system that can meet the services and generate plans. Are being studied POMDP algorithms, in order to obtain a method for packages tailored to user requirements. Under the hypothetical-deductive methodology, this includes the study of service pakage´s composition, application, comparison and validation by a computer prototype with real users for a Web Recommender System. This thesis is framed within a PICT project called "E-OASIS Integrated Travel Services to facilitate easy access to Local Cultural Heritage" whose technical objective is to develop a Customized Recommender System for Tourist Services in the Province of San Juan. The automatic planning in real world problems has become a subject of interest to the scientific community because it allows computationally establish courses of action in cases where a human cannot addressed adequately for the complexity.
The motivation for this work focuses on two aspects of the automatic planning, the scientific contributions and its practice application.

(Párrafo extraído del texto a modo de resumen)Sociedad Argentina de Informática e Investigación Operativa (SADIO

Aciar, Silvana

Ferrarini Oliver, Cintia

Forradellas Martinez, Raymundo Quilez

Servicio de Difusión de la Creación Intelectual

 POMDP planning for the creation of Service Packages Cintia Ferrarini Oliver1, Silvana Aciar2, Raimundo Forradella3 {1ferrarini, 2saciar} @iinfo.unsj.edu.ar, 3kike@uncu.edu.ar  1,2National University of San Juan, 3 National University of Cuyo   The generation of complex systems where the user requires decisions based on sever-al criteria involves building a relationship of global preference for a set of alternatives evaluated. Between these systems there are the Tourist Systems, that was impulse by internet like a facilitator in the access of different sources of information for travel planning. Currently, tourists should not only visit multiple independent Web sites (airlines, hotels, etc.) and await a considerable time receiving confirmation responses. All these actions required generating a stochastic system that can meet the services and generate plans. Are being studied POMDP algorithms, in order to obtain a me-thod for packages tailored to user requirements. Under the hypothetical-deductive methodology, this includes the study of service pakage´s composition, application, comparison and validation by a computer prototype with real users for a Web Re-commender System. This thesis is framed within a PICT project called "E-OASIS Integrated Travel Services to facilitate easy access to Local Cultural Heritage" whose technical objective is to develop a Customized Recommender System for Tourist Services in the Province of San Juan. The automatic planning in real world problems has become a subject of interest to the scientific community because it allows computationally establish courses of action in cases where a human cannot addressed adequately for the com-plexity. The motivation for this work focuses on two aspects of the automatic planning, the scientific contributions and its practice application. On the one hand, looking to expand the results of scientists in the automatic planning to improve the efficiency of actual systems, and secondly, to take advantage of the latest scientific advances to broaden its application to plan-ning problems of the real world. In particular, dynamic nature problems, and where uncertainty plays an important role to consider while searching for solutions. One of the practical problems that motivated this work is the design of a computational tool to assist tourists in decision-making and travel planning, the tourist by its  multicultural features, Internet impulse as a faci-litator in access to a variety of resources for travel planning, is regarded today as one of the largest industries in the world, currently, the tourist must, first, visit multiple independent web sites (airlines, Hotels, travel agencies, etc..) and second, await a considerable time receiving confirmation responses. Given these elements, we must recognize the need to create a system that can meet all these services and create service plans, taking into account its stochastic na-ture. This requires a model of mathematical reasoning for planning and decision-making in environments with uncertainty, it is why is being working with POMDP algorithms (Decision Processes Partially Observable Markov), with the purpose of obtaining a new method and / or modifies an existing one for generation packages tailored to the requirements of the users. The work was organized in 6 phases as described below:   Phase 1: Initial - School graduation. Constituted a crucial part in the scientific and exclusive training required in the PhD in engineering from the National University of Cuyo. It consisted in assist, approbation, and accreditation of 400 hours postgraduate  Doctoral Consortium IJCAI School 201443 JAIIO - DC IJCAI School 2014 - ISSN 2362-5120 - Página 29courses at the Academics Committee (taught by Doctors) in different disciplines in-volved in the subject of the Proposed thesis.  Phase # 2: Research - Study the art. All Contributions were investigated, in order to take advantage of other progress in Investigations and to contribute with new propos-als. The state of the art mainly focuses in the following disciplines: Artificial Intelli-gence, Multi Agent Systems, Complex problem solving, planning and resource alloca-tion, Decision theory and planning with uncertainty. Phase # 3: Problematization - Problem formulation. Identification and definition of variables. Hypothesis Formulation.  In this moment, the hypothesis is that it is possible to improve the quality of results obtained by the POMDP algorithms, SARSOP Particularly, storage and incorporating feedback from the history of states and actions that the agents perform into a multia-gent System.  Phase # 4: Construction – Proposal Development.  Currently being implementing the SARSOP of POMDP algorithm in order to prove computationally with test data generated, to rectify and improve the algorithm.  Phase # 5: Validation - Experimentation, analysis and evaluation of the results. Mod-ification of the Proposal. Once completed, Phase No. 4, it will experiment and it will evaluate the Proposal in the studies cases of Tourism and Education with real users, to ensure the reliability of the proposal Phase # 6: Communication and Dissemination: This phase is composed of two activi-ties being carried out simultaneously and both are still in process: writing a doctoral thesis, published in scientific journals and conferences. References 1. An Introduction to MultiAgent Systems - Second Edition. by Michael Wooldridge. Pub-lished May 2009  by John Wiley & Sons. ISBN-10: 0470519460. 2. Durfee, E.H., "Planning for Coordination and Coordination for Planning," Web Intelli-gence and Intelligent Agent Technology, 2008. WI-IAT '08. IEEE/WIC/ACM Internation-al Conference on , vol.1, no., pp.1-3, 9-12 Dec. 2008 3. Dolgov, D. and Durfee, E. Optimal resource allocation and policy formulation in loosely-coupled markov decision processes. In In Proceedings of the Fourteenth International Con-ference on   Automated Planning and Scheduling., 2004.  4. López, B., Innocenti B. and Busquets, D. A Multiagent System to Support Ambulance  Coordination of Urgent Medical Transportation. IEEE Intelligent Systems, Vol. 23(5), pp. 50 - 57,  IEEE Press. 2008 5.  Casali A., Godo L. and Sierra C. Modeling Travel Assistant Agents: a graded BDI Ap-proach. IFIP-AI, WCC. Artificial Intelligence in Theory and Practice., Max Bramer (Ed.) (ISBN 0-387-34654-6), pp. 415-424 Springer Verlag, 2006. 6. Reyes Ballesteros A. Representación y Aprendizaje de Procesos de Decisión de Markov Cualitativos. Tesis Doctoral en Ciencias Computacionales. Instituto Tecnologico y de Es-tudios Superiores de Monterrey. 2006.  Doctoral Consortium IJCAI School 201443 JAIIO - DC IJCAI School 2014 - ISSN 2362-5120 - Página 30

POMDP planning for the creation of service packages

El Servicio de Difusión de la Creación Intelectual

 POMDP planning for the creation of Service Packages 
Cintia Ferrarini Oliver1, Silvana Aciar2, Raimundo Forradella3 
{1ferrarini, 2saciar} @iinfo.unsj.edu.ar, 3kike@uncu.edu.ar  
1,2National University of San Juan, 3 National University of Cuyo 
 
 
The generation of complex systems where the user requires decisions based on sever-
al criteria involves building a relationship of global preference for a set of alternatives 
evaluated. Between these systems there are the Tourist Systems, that was impulse by 
internet like a facilitator in the access of different sources of information for travel 
planning. Currently, tourists should not only visit multiple independent Web sites 
(airlines, hotels, etc.) and await a considerable time receiving confirmation responses. 
All these actions required generating a stochastic system that can meet the services 
and generate plans. Are being studied POMDP algorithms, in order to obtain a me-
thod for packages tailored to user requirements. Under the hypothetical-deductive 
methodology, this includes the study of service pakage´s composition, application, 
comparison and validation by a computer prototype with real users for a Web Re-
commender System. This thesis is framed within a PICT project called "E-OASIS 
Integrated Travel Services to facilitate easy access to Local Cultural Heritage" whose 
technical objective is to develop a Customized Recommender System for Tourist 
Services in the Province of San Juan. The automatic planning in real world problems has 
become a subject of interest to the scientific community because it allows computationally 
establish courses of action in cases where a human cannot addressed adequately for the com-
plexity. The motivation for this work focuses on two aspects of the automatic planning, the 
scientific contributions and its practice application. On the one hand, looking to expand the 
results of scientists in the automatic planning to improve the efficiency of actual systems, and 
secondly, to take advantage of the latest scientific advances to broaden its application to plan-
ning problems of the real world. In particular, dynamic nature problems, and where uncertainty 
plays an important role to consider while searching for solutions. One of the practical problems 
that motivated this work is the design of a computational tool to assist tourists in decision-
making and travel planning, the tourist by its  multicultural features, Internet impulse as a faci-
litator in access to a variety of resources for travel planning, is regarded today as one of the 
largest industries in the world, currently, the tourist must, first, visit multiple independent web 
sites (airlines, Hotels, travel agencies, etc..) and second, await a considerable time receiving 
confirmation responses. Given these elements, we must recognize the need to create a system 
that can meet all these services and create service plans, taking into account its stochastic na-
ture. This requires a model of mathematical reasoning for planning and decision-making in 
environments with uncertainty, it is why is being working with POMDP algorithms (Decision 
Processes Partially Observable Markov), with the purpose of obtaining a new method and / or 
modifies an existing one for generation packages tailored to the requirements of the users. 
The work was organized in 6 phases as described below:  
 
Phase 1: Initial - School graduation. Constituted a crucial part in the scientific and 
exclusive training required in the PhD in engineering from the National University of 
Cuyo. It consisted in assist, approbation, and accreditation of 400 hours postgraduate  
Doctoral Consortium IJCAI School 2014
43 JAIIO - DC IJCAI School 2014 - ISSN 2362-5120 - Página 29
courses at the Academics Committee (taught by Doctors) in different disciplines in-
volved in the subject of the Proposed thesis.  
Phase # 2: Research - Study the art. All Contributions were investigated, in order to 
take advantage of other progress in Investigations and to contribute with new propos-
als. The state of the art mainly focuses in the following disciplines: Artificial Intelli-
gence, Multi Agent Systems, Complex problem solving, planning and resource alloca-
tion, Decision theory and planning with uncertainty. 
Phase # 3: Problematization - Problem formulation. Identification and definition of 
variables. Hypothesis Formulation.  
In this moment, the hypothesis is that it is possible to improve the quality of results 
obtained by the POMDP algorithms, SARSOP Particularly, storage and incorporating 
feedback from the history of states and actions that the agents perform into a multia-
gent System.  
Phase # 4: Construction – Proposal Development.  
Currently being implementing the SARSOP of POMDP algorithm in order to prove 
computationally with test data generated, to rectify and improve the algorithm.  
Phase # 5: Validation - Experimentation, analysis and evaluation of the results. Mod-
ification of the Proposal. Once completed, Phase No. 4, it will experiment and it will 
evaluate the Proposal in the studies cases of Tourism and Education with real users, to 
ensure the reliability of the proposal 
Phase # 6: Communication and Dissemination: This phase is composed of two activi-
ties being carried out simultaneously and both are still in process: writing a doctoral 
thesis, published in scientific journals and conferences. 
References 
1. An Introduction to MultiAgent Systems - Second Edition. by Michael Wooldridge. Pub-
lished May 2009  by John Wiley & Sons. ISBN-10: 0470519460. 
2. Durfee, E.H., "Planning for Coordination and Coordination for Planning," Web Intelli-
gence and Intelligent Agent Technology, 2008. WI-IAT '08. IEEE/WIC/ACM Internation-
al Conference on , vol.1, no., pp.1-3, 9-12 Dec. 2008 
3. Dolgov, D. and Durfee, E. Optimal resource allocation and policy formulation in loosely-
coupled markov decision processes. In In Proceedings of the Fourteenth International Con-
ference on   Automated Planning and Scheduling., 2004.  
4. López, B., Innocenti B. and Busquets, D. A Multiagent System to Support Ambulance  
Coordination of Urgent Medical Transportation. IEEE Intelligent Systems, Vol. 23(5), pp. 
50 - 57,  IEEE Press. 2008 
5.  Casali A., Godo L. and Sierra C. Modeling Travel Assistant Agents: a graded BDI Ap-
proach. IFIP-AI, WCC. Artificial Intelligence in Theory and Practice., Max Bramer (Ed.) 
(ISBN 0-387-34654-6), pp. 415-424 Springer Verlag, 2006. 
6. Reyes Ballesteros A. Representación y Aprendizaje de Procesos de Decisión de Markov 
Cualitativos. Tesis Doctoral en Ciencias Computacionales. Instituto Tecnologico y de Es-
tudios Superiores de Monterrey. 2006. 
 
Doctoral Consortium IJCAI School 2014
43 JAIIO - DC IJCAI School 2014 - ISSN 2362-5120 - Página 30


English

SEDICI - Repositorio de la UNLP

http://sedici.unlp.edu.ar/bitstream/handle/10915/41853/Documento_completo.pdf?sequence=1

POMDP planning for the creation of service packages

Abstract

Similar works

Full text

Available Versions

Servicio de Difusión de la Creación Intelectual

El Servicio de Difusión de la Creación Intelectual

SEDICI - Repositorio de la UNLP