Now I am working on building a deep learning model for a regression problem. I used 50 inputs and try to add one new categorical input. The problem is that this one input is much more important than other inputs. I want to make it more influential than others and all I can think of now are the following three.
- just add at first layer as other inputs
- Add new categorical input to each layer (Now model has 5 layers)
- Fit it to the embedding layer first and increate its dimension and concatenate it with other inputs.
Do these seem fine and are there any other ways to give more power to one input?
