ARTÍCULO
TITULO

From Imitation to Prediction, Data Compression vs Recurrent Neural Networks for Natural Language Processing

Juan Andres Laura    
Gabriel Omar Masi    
Luis Argerich    

Resumen

In recent studies Recurrent Neural Networks were used for generative processes and their surprising performance can be explained by their ability to create good predictions. In addition, Data Compression is also based on prediction. What the problem comes down to is whether a data compressor could be used to perform as well as recurrent neural networks in the natural language processing tasks of sentiment analysis and automatic text generation. If this is possible, then the problem comes down to determining if a compression algorithm is even more intelligent than a neural network in such tasks. In our journey, a fundamental difference between a Data Compression Algorithm and Recurrent Neural Networks has been discovered.

 Artículos similares

       
 
Kaan Yilmaz and Neil Yorke-Smith    
In line with the growing trend of using machine learning to help solve combinatorial optimisation problems, one promising idea is to improve node selection within a mixed integer programming (MIP) branch-and-bound tree by using a learned policy. Previous... ver más
Revista: AI

 
Viktor Kostenko,Yaroslav Liashok,Olena Zavialova,Serhii Pozdieiev,Tetiana Kostenko     Pág. 54 - 62
The purpose of this paper is to improve the mechanism that forms an explosive environment within the workings' space from the accumulated coal dust, based on determining the dynamic deformations under the influence of an explosion in the material that co... ver más

 
Thalita Silva Calíope,José Carlos Lázaro da Silva Filho     Pág. 119 - 139
Fashion is recognized by transience, resulting in its short life cycle, since the constant changes make what was previously considered "fashionable" obsolete (Emidio & Sabione, 2010). In this market, innovate and act before competitors, accelerate t... ver más

 
Adela J. Chen,Richard T. Watson,Marie-Claude Boudreau,Elena Karahanna    
This article examines how institutional pressures affect the adoption of green IS & IT across organizations. From the natural-resource-based perspective, it examines green IS & IT practices with strategic foci on pollution prevention, product stewardship... ver más

 
Olena Akhiiezer, Olha Dunaievska, Mykhailo Shyshkin, Olha Butova, Anton Rohovyi     Pág. 5 - 15
The subject matter is a mathematical model describing the process of heart rhythm variability, which is based on the use of triangular models of non-stationary random processes in the Hilbert space. The goal of the research is to develop a mathematical m... ver más