In the transformer model, to incorporate positional information of texts, the researchers have added a positional encoding to the model. How does positional encoding work? How does the positional encoding system learn the positions when varying lengths and types of text are passed at different time intervals?
To be more concrete, let's take these two sentences.
- "She is my queen"
- "Elizabeth is the queen of England"
How would these sentences be passed to the transformer? What would happen to them during the positional encoding part?
Please explain with less math and with more intuition behind it.
