Intelligent opinion mining and sentiment analysis using artificial neural networks

The article formulates a rigorously developed concept of opinion mining and sentiment analysis using hybrid neural networks. This conceptual method for processing natural-language text enables a variety of analyses of the subjective content of texts. It is a methodology based on hybrid neural networks for detecting subjective content and potential opinions, as well as a method which allows us to classify different opinion type and sentiment score classes. Moreover, a general processing scheme, using neural networks, for sentiment and opinion analysis has been presented. Furthermore, a methodology which allows us to determine sentiment regression has been devised. The paper proposes a method for classification of the text being examined based on the amount of positive, neutral or negative opinion it contains. The research presented here offers the possibility of motivating and inspiring further development of the methods that have been elaborated in this paper.Stuart, KDC.; Majewski, M. (2015). Intelligent opinion mining and sentiment analysis using artificial neural networks. Lecture Notes in Computer Science. 9492:103-110. doi:10.1007/978-3-319-26561-2_13S1031109492Feldman, R.: Techniques and applications for sentiment analysis. Commun. ACM 56(4), 82–89 (2013)Taboada, M., Brooke, J., Tofiloski, M., Voll, K., Stede, M.: Lexicon-based methods for sentiment analysis. Comput. Linguist. 37(2), 267–307 (2011)Mohammad, S.M., Turney, P.D.: Crowdsourcing a word-emotion association lexicon. Comput. Intell. 29(3), 436–465 (2013)Chen, H., Zimbra, D.: AI and opinion mining. IEEE Intell. Syst. 25(3), 74–80 (2010)Majewski, M., Zurada, J.M.: Sentence recognition using artificial neural networks. Knowl. Based Syst. 21(7), 629–635 (2008)Kacalak, W., Stuart, K.D., Majewski, M.: Intelligent natural language processing. In: Jiao, L., Wang, L., Gao, X., Liu, J., Wu, F. (eds.) ICNC 2006. LNCS, vol. 4221, pp. 584–587. Springer, Heidelberg (2006)Kacalak, W., Stuart, K., Majewski, M.: Selected problems of intelligent handwriting recognition. In: Melin, P., Castillo, O., Ramírez, E.G., Kacprzyk, J., Pedrycz, W. (eds.) IFSA 2007. Advances in Soft Computing, vol. 41, pp. 298–305. Springer, Cancun (2007)Stuart, K.D., Majewski, M.: Selected problems of knowledge discovery using artificial neural networks. In: Liu, D., Fei, S., Hou, Z., Zhang, H., Sun, C. (eds.) ISNN 2007, Part III. LNCS, vol. 4493, pp. 1049–1057. Springer, Heidelberg (2007)Stuart, K., Majewski, M.: A new method for intelligent knowledge discovery. In: Castillo, O., Melin, P., Ross, O.M., Cruz, R.S., Pedrycz, W., Kacprzyk, J. (eds.) IFSA 2007. Advances in Soft Computing, vol. 42, pp. 721–729. Springer, Heidelberg (2007)Stuart, K.D., Majewski, M.: Artificial creativity in linguistics using evolvable fuzzy neural networks. In: Hornby, G.S., Sekanina, L., Haddow, P.C. (eds.) ICES 2008. LNCS, vol. 5216, pp. 437–442. Springer, Heidelberg (2008)Stuart, K.D., Majewski, M.: Evolvable neuro-fuzzy system for artificial creativity in linguistics. In: Huang, D.-S., Wunsch II, D.C., Levine, D.S., Jo, K.-H. (eds.) ICIC 2008. LNCS (LNAI), vol. 5227, pp. 46–53. Springer, Heidelberg (2008)Stuart, K.D., Majewski, M., Trelis, A.B.: Selected problems of intelligent corpus analysis through probabilistic neural networks. In: Zhang, L., Lu, B.-L., Kwok, J. (eds.) ISNN 2010, Part II. LNCS, vol. 6064, pp. 268–275. Springer, Heidelberg (2010)Stuart, K.D., Majewski, M., Trelis, A.B.: Intelligent semantic-based system for corpus analysis through hybrid probabilistic neural networks. In: Liu, D., Zhang, H., Polycarpou, M., Alippi, C., He, H. (eds.) ISNN 2011, Part I. LNCS, vol. 6675, pp. 83–92. Springer, Heidelberg (2011)Specht, D.F.: Probabilistic neural networks. Neural Netw. 3(1), 109–118 (1990)Specht, D.F.: A general regression neural network. IEEE Trans. Neural Netw. 2(6), 568–576 (1991

Using Neural Networks for Relation Extraction from Biomedical Literature

Using different sources of information to support automated extracting of relations between biomedical concepts contributes to the development of our understanding of biological systems. The primary comprehensive source of these relations is biomedical literature. Several relation extraction approaches have been proposed to identify relations between concepts in biomedical literature, namely, using neural networks algorithms. The use of multichannel architectures composed of multiple data representations, as in deep neural networks, is leading to state-of-the-art results. The right combination of data representations can eventually lead us to even higher evaluation scores in relation extraction tasks. Thus, biomedical ontologies play a fundamental role by providing semantic and ancestry information about an entity. The incorporation of biomedical ontologies has already been proved to enhance previous state-of-the-art results.Comment: Artificial Neural Networks book (Springer) - Chapter 1

Toxic comment classification using convolutional and recurrent neural networks

This thesis aims to provide a reasonable solution for categorizing automatically sentences into types of toxicity using different types of neural networks. There are six types of categories: Toxic, severe toxic, obscene, threat, insult and identity hate. Three different implementations have been studied to accomplish the objective: LSTM (Long Short-Term Memory), GRU (Gated Recurrent Unit) and convolutional neural networks. The thesis is not thought to aim on improving the performance of every individual model but on the comparison between them in terms of natural language processing adequacy. In addition, one differential aspect about this project is the research of LSTM neurons activations and thus the relationship of the words with the final sentence classificatory decision. In conclusion, the three models performed almost equally and the extraction of LSTM activations provided a very accurate and visual understanding of the decisions taken by the network.Esta tesis tiene como objetivo aportar una buena solución para la categorización automática de comentarios abusivos haciendo uso de distintos tipos de redes neuronales. Hay seis categorías: Tóxico, muy tóxico, obsceno, insulto, amenaza y racismo. Se ha hecho una investigación de tres implementaciones para llevar a cabo el objetivo: LSTM (Long Short-Term Memory), GRU (Gated Recurrent Unit) y redes convolucionales. El objetivo de este trabajo no es intentar mejorar al máximo el resultado de la clasificación sino hacer una comparación de los 3 modelos para los mismos parámetros e intentar saber cuál funciona mejor para este caso de procesado de lenguaje. Además, un aspecto diferencial de este proyecto es la investigación sobre las activaciones de las neuronas en el modelo LSTM y su relación con la importancia de las palabras respecto a la clasificación final de la frase. En conclusión, los tres modelos han funcionado de forma casi idéntica y la extracción de las activaciones han proporcionado un conocimiento muy preciso y visual de las decisiones tomadas por la red.Aquesta tesi té com a objectiu aportar una bona solució per categoritzar automàticament comentaris abusius usant diferents tipus de xarxes neuronals. Hi ha sis tipus de categories: Tòxic, molt tòxic, obscè, insult, amenaça i racisme. S'ha fet una recerca de tres implementacions per dur a terme l'objectiu: LSTM (Long Short-Term Memory), GRU (Gated Recurrent Unit) i xarxes convolucionals. L'objectiu d'aquest treball no és intentar millorar al màxim els resultats de classificació sinó fer una comparació dels 3 models pels mateixos paràmetres per tal d'esbrinar quin funciona millor en aquest cas de processat de llenguatge. A més, un aspecte diferencial d'aquest projecte és la recerca sobre les activacions de les neurones al model LSTM i la seva relació amb la importància de les paraules respecte la classificació final de la frase. En conclusió, els tres models han funcionat gairebé idènticament i l'extracció de les activacions van proporcionar un enteniment molt acurat i visual de les decisions preses per la xarxa