T2 AI unicorns SenseTime
SenseTime AI Infra interview
SenseTime AI Infra interview questions covering operator optimization
Operator optimization
The following topics were covered in the SenseTime AI Infra interview, mainly deep dives into projects.
Project experience (GEMM optimization)
- Describe the GEMM optimization implementation in detail
- Why does one thread compute an 8x8 block of C?
- Can registers spill, and how do you handle that?
- Did the project include your own innovations?
- What does
#pragma unrolldo, and when do you use it? - How many compute iterations run inside a single tile?
- How does your implementation compare in performance to cuTLASS?
Fundamentals
- Have you optimized convolution operators?
- Do you know PPL (SenseTime’s HPC library)?
- How do Tensor Cores work, and how do you use them?
- Have you built low-bit GEMM?