Skip to main content
T0 Big tech Alibaba Internship

Alibaba AI Infra internship (1)

Real Alibaba AI Infra internship interview questions covering AI Infra and related topics

Fundamentals

  1. Core differences among MHA, GQA, and MLA, and when each fits.
  2. For MoE and multimodal training, what optimization directions remain?
  3. In engineering practice for large-model pretraining and RL training, which stages are still worth optimizing?

Project experience

  1. Introduce your projects in detail, with emphasis on technical approach and implementation.

Coding

  1. Level-order traversal of a binary tree.
  2. Hand-write Multi-Head Attention.