model architecture
2pieces
Apr 13, 20259 min read
Math Foundations of Transformers and MoE Layers
A thorough explanation of the equations powering classic transformer structures and Mixture-of-Experts for advanced deep learning workflows.
ai-systems-engineeringtransformersmixture-of-expertsmachine-learning
Jul 27, 20245 min read
Gemini 2.0 Pro vs. Flash: A Deep Technical Comparison for Enterprise AI
Gemini 2.0 Pro against Flash on architecture, benchmarks, and deployment cost, with a clear rule for choosing between them in enterprise work.
ai-model-engineeringgeminigemini-progemini-flash