T5 Others Hikvision
Hikvision AI Infra
Real Hikvision AI Infra interview questions covering inference, operator optimization, and HPC
Inference optimization Operator optimization High-performance computing
Operator optimization
- What is a bank conflict in CUDA? How do you avoid it?
- How do you implement Softmax in CUDA?
- What are the core ideas of Online Softmax and FlashAttention?
Inference optimization
- What challenges does on-device large-model deployment face? What common optimization techniques exist?
- How do you handle dynamic dimensions when exporting a model?
- What quantization techniques exist, and when does each apply?
High-performance computing
- In multithreaded programming, how do OpenMP and MPI differ, and when does each apply?
Engineering practice
- What does the ncnn cross-compile flow look like?
- How familiar are you with the ncnn source?
Project experience
- Self-introduction and project walkthrough.
- What do you know about perception, planning, and control algorithms?