Mixtral of Experts: Top-2 Routing Gives 47B Capacity at 13B Active Compute
Yash Patel
Command Palette
Search for a command to run...
Archive
7 posts published so far
LLaMA 2: How Three Borrowed Techniques Fit a 70B Model on Two GPUs
Yash Patel
Attention Is All You Need: What the Paper's Heads Are Actually Doing at Each Layer
Yash Patel
Beyond try/except: Architecting Robust Error Handling in Python Applications
Yash Patel
Demystifying Reinforcement Learning: A Beginner's Guide to the Math
Yash Patel
Exploration vs. Exploitation: A Deep Dive into Multi-armed Bandits
Yash Patel
Reinforcement Learning: First Principles
Yash Patel