Skip to main content
T0 Big tech Baidu Round 1

Baidu AI Infra first round (1)

Real Baidu AI Infra first-round interview questions covering inference optimization

Inference optimization

Project deep dive

  1. Deep questions around your projects

Theory

  1. Explain how Attention works, and introduce the attention mechanisms used by models you have been following recently
  2. In QKV, what does K do? Can you drop K and use V directly?
  3. Compare BatchNorm, LayerNorm, and RMSNorm
  4. What common position-encoding methods exist, and what are their traits
  5. Introduce PPO, DPO, and GRPO in reinforcement learning
  6. Why are decoder-only architectures more popular than encoder-decoder today?