T1 Large companies and unicorns Meituan New grad
Meituan Beidou AI Infra campus hire
Real Meituan AI Infra campus-hire interview questions covering inference optimization, operator optimization, and high-performance computing
Inference optimization Operator optimization High-performance computing
Interview topics for Meituan Beidou AI Infra campus hire.
Theory
- Explain the overall Transformer architecture, and what advantages it has over classic RNNs
- Where do Transformer parameters mainly sit? Which part has the most parameters? Which part has the most compute, and why
- Explain the difference between CUDA Core and Tensor Core on GPUs; list common GPU models with memory capacity and bandwidth
- Introduce the basic idea of large-model quantization, and describe how quantization operators are implemented
- Detail the design idea of Prefill-Decode separation (PD disaggregation)
- Detail how Paged Attention works
Live coding
- LeetCode 25: reverse nodes in k-group
- Write a CUDA operator: basic prefix sum, and explain feasible optimizations
- Write a CUDA operator: basic GEMM, and explain feasible optimizations