Test your understanding of lower-level LLM pre-training and alignment mechanics. This quiz covers Byte-Pair Encoding data structures, cross-entropy gradient derivations, AdamW mixed-precision memory footprints, ZeRO-3 vs Tensor Parallelism communication trade-offs, FlashAttention SRAM tiling dynamics, and DPO implicit reward formulations.
0 / 6
Which data structure combination allows efficient extraction of the most frequent adjacent token pair during Byte-Pair Encoding (BPE) vocabulary construction?
Press 1 to 4 to pick an answer