transformers
2pieces
Apr 13, 20259 min read
Math Foundations of Transformers and MoE Layers
A thorough explanation of the equations powering classic transformer structures and Mixture-of-Experts for advanced deep learning workflows.
ai-systems-engineeringtransformersmixture-of-expertsmachine-learning
Jan 26, 20252 min read
Understanding Tokenizers and Embedders in LLM Pipelines
A deep dive into the role, structure, and training of tokenizers and embedders in modern language models like GPT, BERT, and T5.
machine-learning-fundamentalsmachine-learningtransformerstokenizers