Q4. RoPE (MCQ)

How does Rotary Positional Embedding (RoPE) encode positional information?

• Add a sinusoidal position vector to each token embedding before self-attention.
• Apply a position-dependent rotation to Q and K vectors, encoding relative positions through phase differences. <- correct
• Learn absolute positional embeddings and add them to token embeddings.
• Modify attention scores by directly computing a learned bias based on token distance.