T2 AI unicorns StepFun Internship
StepFun AI Infra internship
Real StepFun AI Infra internship interview questions covering operator optimization, high-performance computing, and related topics
Operator optimization High-performance computing
High-performance computing
- Explain DMA versus RDMA: principles and differences.
- Why pin memory for cudaMemcpy?
- Core difference between processes and threads?
Training optimization
- How is sequence parallelism implemented? What was communication overhead in experiments? What further optimizations exist?
- Common schemes for training stability and fault tolerance?
- Which frontier techniques or research directions in Infra are worth watching?
Coding
- Given start/end times of several TV shows, how many shows can you fully watch at most (interval scheduling).
- Implement an LRU Cache.