Musings by Chris Hayduk

It's Time For Google to Acquire Intel

Breaking the Nvidia-TSMC monopoly

Sep 25 • 

Chris Hayduk

1

August 2025

The Strategic Implications of GPT-5 for OpenAI

OpenAI shifts away from the enterprise and toward the consumer

Aug 8 • 

Chris Hayduk

1

July 2025

Managing Civilizational Tail Risks

401k for Kids and Communist Revolutions

Jul 16 • 

Chris Hayduk

1

On Implicit and Explicit Learning

Some insights from my time learning languages

Jul 9 • 

Chris Hayduk

April 2025

Gemini 2.5 Pro: How Data + Compute Moats Beat Algorithmic Tweaks

Gemini 2.5 Pro and Google's path to AI supremacy

Apr 14 • 

Chris Hayduk

March 2025

The Foundation Model Trap

Why AI Model Companies Are More Like Airlines than Like Cereal Companies

Mar 5 • 

Chris Hayduk

5

2

Understanding DeepSeek Part II: DeepSeek-V2

Compressing the key-value matrix

Mar 5 • 

Chris Hayduk

3

February 2025

A Primer on Multi-Head Causal Self-Attention

The neural network layer that kicked off the LLM craze

Feb 1 • 

Chris Hayduk

1

2

January 2025

Understanding DeepSeek Part I: DeepSeekMoE

Mixture of experts models with a twist

Jan 30 • 

Chris Hayduk

4

Understanding Protein Language Models Part III: Structure Prediction without Multiple Sequence Alignment in ESMFold

How ESMFold and ESM3 replace explicit MSAs with encoder-only transformers

Jan 22 • 

Chris Hayduk

3

Understanding Protein Language Models Part II: Encoder-only Transformers as Continuous Fuzzy String Matching

How transformers learn from their input data

Jan 15 • 

Chris Hayduk

3

December 2024

OpenAI o3 and the Rise of the Intelligence Allocator

The implications of rapidly increasing inference costs

Dec 20, 2024 • 

Chris Hayduk

1