For questions related to data compression in the context of artificial intelligence.
Questions tagged [data-compression]
11 questions
6
votes
2 answers
What is the current research in artificial intelligence in the field of data compression?
What is the current research in artificial intelligence and machine learning in the field of data compression?
I have done my research on the PAQ series of compressors, some of which use neural networks for context mixing.
user15736
- 71
- 2
6
votes
4 answers
Is it possible for a neural network to be used to compress data?
When training a neural network, we often run into the issue of overfitting.
However, is it possible to put overfitting to use? Basically, my idea is, instead of storing a large dataset in a database, you can just train a neural network on the entire…
Bryan Tan
- 183
- 7
4
votes
2 answers
Can a data compression function be used to make predictions?
I've heard that prediction is equivalent to data compression.
Is there a way to take a compression function and use it to create an AI that predicts?
Jesus is Lord
- 169
- 5
3
votes
1 answer
How can I compress the states of a reinforcement learning agent?
I'm working on a problem that involves an RL agent with very large states. These states consist of several pieces of information about the agent. The states are not images, so techniques like convolutional neural networks will not work here.
Is…
Saeid Ghafouri
- 113
- 5
2
votes
2 answers
Do text compression tests qualify winRar or 7zip as intelligent?
I read this paper Text Compression as a Test for Artificial Intelligence, Mahoney, 1999.
So far I understood the following:
Text Compression tests can be used as an alternative to Turing Tests for intelligence.
The Bits per character score obtained…
Aether
- 265
- 2
- 7
2
votes
0 answers
Did the Hutter Prize help research in artificial intelligence in any way?
Wikipedia states:
The Hutter Prize is a cash prize funded by Marcus Hutter which rewards data compression improvements on a specific 1 GB English text file.
The goal of the Hutter Prize is to encourage research in artificial intelligence (AI). The…
Franck Dernoncourt
- 2,626
- 1
- 19
- 31
1
vote
0 answers
Generative systems based on Schmidhuber's compression framework
In Driven by Compression Progress:
A Simple Principle Explains Essential Aspects of
Subjective Beauty, Novelty, Surprise,
Interestingness, Attention, Curiosity, Creativity,
Art, Science, Music, Jokes Jürgen Schmidhuber describes, using the idea of…
2080
- 121
- 3
0
votes
0 answers
Does GPT not need to compress its training data?
In his recent short pamphlet on GPT, Stephan Wolfram says
... the 'size of the network' that seems to work well is ... comparable to the 'size of the training data'. ...
in this representation it seems there’s in the end rather little 'compression'…
orome
- 103
- 5
0
votes
0 answers
How does residual vector quantization in ColBERT v2 work?
I want some clarification on how residual vector quantization works in ColBERT v2.
The model independently encodes document terms offline using a BERT-like model. These embeddings are further reduced to a lower dimension (128-d) using a linear…
abhinavkulkarni
- 129
- 3
0
votes
1 answer
How it is possible to compress audio with the image representation of an audio?
In most of the speech compression using machine/deep learning, I have seen that, in order to process an audio file, we need to convert it into a mel spectrogram format, then this spectrogram is analyzed.
Do we apply the compression process on this…
Nervous Hero
- 145
- 4
0
votes
0 answers
Ready to use (already trained) ANN for small (64x64) RGB image compression
In my research, there is a current task of small (64x64 pixels) image compression. The images are photos, represented as RGB. While it is not a core interest, I wanted to compare some compression methods with ML compression methods. I am NOT a…
Yauhen Yakimenka
- 101
- 1