T2 AI unicorns MiniMax Internship Round 1
MiniMax AI Infra internship first round (1)
Real MiniMax AI Infra internship first-round interview questions covering inference and training optimization
Inference optimization Training optimization
Project deep dive
- Introduce your internship project and research work
Theory
- How do the training objectives of SFT and RLHF differ at a fundamental level? Why do most models still do RLHF after SFT?
- In an MoE model, how does the router decide which experts get a token? What causes severe expert load imbalance?
- When some experts are clearly underused, how can you change the routing strategy to raise utilization?
- Introduce LLM architectures you know well, and compare them on attention compute, training methods, and inference efficiency
- What is the core objective PPO optimizes in RLHF? Write the objective and explain each term
- As parameter count grows, why can MoE still keep relatively high training efficiency?
Live coding
- Given K sorted arrays, find the median of the merged result