T5 Others iFlytek New grad
iFLYTEK AI Infra campus hiring
Real iFLYTEK AI Infra campus hiring interview questions covering high-performance computing and related topics
High-performance computing
Fundamentals
- What are FlashAttention’s core optimizations? How do tiled QKV loads, Online Softmax, and reducing memory complexity from O(N^2) to O(N) each work?
- In Self-Attention, why divide the dot product by sqrt(d)? What goes wrong without scaling?
- How are callback functions implemented?
- Common ways to debug out-of-bounds GPU memory access?
Project experience
- Deep dive into project experience.