T0 Big tech Tencent Internship Rounds 1-2
Tencent AI Infra internship first and second rounds
Real Tencent AI Infra internship first- and second-round interview questions covering operator optimization, high-performance computing, and related topics
Operator optimization High-performance computing
First round
Project experience
- Introduce project experience, including technical hard parts and highlights
Fundamentals
- Explain basic MPI concepts and how to use it
- What is the basic idea of multithreaded programming
- What common locking mechanisms are there
- Conditions that cause deadlock in an OS, and how to resolve it
- Compare similarities and differences between UDP and TCP
- Which mechanisms does TCP use to guarantee reliable delivery
Coding
- Given an unsorted array and a sorted array, insert elements from the unsorted array into the sorted one while keeping order, and analyze time complexity
- Explain an algorithm orally: a classic big-data processing problem
Second round
Fundamentals
- How deep is your understanding of CPU and GPU architecture
- Do you have experience writing CUDA kernels
- What is the definition and what are the traits of POD types in C++
- Besides priority queues, which other STL containers in C++ can implement a heap
High-performance computing
- Explain these concepts: shuffle, Hyper-Q, SM, slot
- What NVIDIA Nsight is for and how to use it
- What the SOL (Speed of Light) metric means
- Basic idea of the Polyhedral Model
- Core idea of the TVM compilation framework
- Difference between Array of Struct and Struct of Array, and when each fits
- Design idea of the Halide programming language
- How to implement a warp-level reduce
Coding
- Sliding-window median (implement with a max-heap and a min-heap)