T5 Others Transsion New grad Round 1
Transsion AI Infra campus recruiting first round
Real Transsion AI Infra campus recruiting first-round interview questions covering inference optimization and operator optimization
Inference optimization Operator optimization
C++ basics
- Difference between pointers and references
- Differences between heap and stack memory
- Causes of wild pointers and how to use smart pointers
Model deployment and inference
- Basic principles of object detection algorithms
- Impact of class count and dataset size in object detection tasks
- What are YOLOv5’s main improvements?
- How to choose a quantization calibration dataset
- Basic principles and implementation of quantization
- How do you evaluate accuracy after quantization?
- Common methods to compute the quantization scale
- How to compute inference throughput
- Comparison and selection among common inference frameworks
Operators and compute graphs
- How compute graphs are built
- Low-level implementation of convolution operators
- Blocking optimization strategies for matrix multiplication
- Basic concepts and uses of the ARM NEON instruction set
Large models
- How a large-model tokenizer works
- Role and implementation of KV Cache