Questions tagged [style-transfer]

14 questions
3
votes
0 answers

how can a VAE learn to generate a style for Neural Style Transfer?

I have come across this research paper where a Variational Autoencoder is used to map multiple styles from reference images to a linear latent space and then transfer the style to another image like this: What I don't understand from the paper is…
slaifan
  • 31
  • 1
2
votes
2 answers

Open-source vocal cloning (speech-to-speech neural style transfer)

I want to program and train a voice cloner, in part to learn about this area of AI, and in part to use as a prototype of audio for testing and getting feedback from early adopters before recording in a studio with voice actors. For the prototype, I…
2
votes
0 answers

Text rewriting with learning of writing style

I do a lot of scientific writing in my job. Unfortunately, I often also have to rewrite amateurish text that some students write for manuscripts. They use tools like grammarly to fix grammar issues, but even after that, I find myself doing a lot of…
user2751530
  • 121
  • 2
2
votes
1 answer

In style transfer, why does the comparison between channels give a good sense of style?

I have been learning about Style Transfer recently. Style is defined as The correlation of activations between channels. I can't seem to understand why that would be true. Intuitively, style seems to be the patterns that exist in one particular…
1
vote
0 answers

Transfer the colors of a face from a photo inside a drawing

I have a photo of a real person. I have a colorized picture of a resembling person (same angle, different lighting and colors, drawing look alike) I would like to transfer the colors of the photo inside the drawing. (To be exactly the same colors),…
Tompwls
  • 11
  • 1
1
vote
0 answers

What are the definitions for the content and style of an image without using deep neural network?

In deep learning, an image is said to contain two types of features. One is the content of the image and the other is the style of the image. Deep neural networks are generally used to obtain both content representation and style representation of…
hanugm
  • 3,571
  • 3
  • 18
  • 50
1
vote
1 answer

How does a VGG-based Style-Loss incorporate color information?

I've recently been reading a lot about style transfer, its applications and implications. I understand what the Gram matrix is and does. I can program it. But one thing that has been boggling me is: how does the VGG style loss incorporate color…
0
votes
0 answers

Could a small style transfer neural network be built on the darknet under Debian 11 32-bit? (experimental and personal use)

I would like to build a small style transfer neural network, via darknet (Open Source Neural Networks in C), under a Debian 11 32-bit system, for experimental and personal use. What I intend is to test an image and another identical to it, but to…
0
votes
0 answers

Which deep learning models are suitable for network_parameters-to-images mapping?

I face the problem of learning a mapping (or a translation) $f: (x,\theta) \to x^\prime$, where $x, x^\prime$ are images, $\theta$ is the parameters of a neural network. I know the models for parameters-to-parameters mapping (meta-learning),…
0
votes
1 answer

Can any GAN's utilize labels in their datasets while they are training?

It seems to me that the Generative Adversarial Networks have a practical issue when trying to reproduce some of their output images For example, as you can see https://www.youtube.com/watch?v=oIzwe_MOeQI&t=1057s seems to generate shape and…
0
votes
0 answers

Expression Transfer Deep Learning Problem

I have old video and I want to keep the person's face in the video but I want to transfer my facial expressions to that video. Is there any better alternative to first order motion model for that task ? I tried deepfacelab but it has kind of steep…
0
votes
1 answer

Why the partial derivative is $0$ when $F_{ij}^l < 0$?. Math behind style transfer

I am currently in the process of reading and understanding the process of style transfer. I came across this equation in the research paper which went like - For context, here is the paragraph - Generally each layer in the network defines a…
0
votes
0 answers

How to apply the formatting of one json file to another. Coding style transfer for JSON

Time after time I need to merge two large JSON files, or more precisely add a json fragment to another file. The too pieces are often written by different people and have different formatting (spacing), so margining them mechanically result in an…
Serge
  • 101
  • 2
0
votes
0 answers

Upscaling a low-res IR image with a high res webcam image

I have a low resolution thermal/IR image (for example 32x32 or 80x64) and a high resolution webcam image. I would like to combine the two to "fake" a high resolution thermal image (I can already map them together via homography). One could probably…
jdm
  • 101
  • 1