Skip to main content
T5 Others Shukun Technology Internship Round 1

Shukun AI Infra internship first round

Real Shukun AI Infra internship first-round interview questions covering AI Infra and related topics

Topics covered in Shukun AI Infra internship first round.

Project experience

  1. Deep questions around the internship experience, with problems based on the internship scenario

Fundamentals

  1. Overall Transformer architecture, and how KV-Cache shows up in inference speedup
  2. Common parallelism strategies (data parallelism, model parallelism, pipeline parallelism, etc.)
  3. What to watch for when tiling matrices in parallel computing, and the math behind matrix tiling
  4. Main factors that affect communication latency, and how to mitigate them
  5. Without related experience, how would you design an agent (reinforcement-learning direction)

Other

  1. Future career plans

Coding

  1. Draw an inscribed circle in an all-zero square matrix (fill with 1s)