Virtual Laboratory System — Machine Learning, Mathematical and Statistical Experiments

Blog NEW

Deep Learning · Transformers

Attention Mechanism — What are Q, K & V?
Query, Key & Value Explained with Full Mathematics

Attention(Q,K,V) = softmax(QKᵀ/√dₖ)·V

Step-by-step mathematics behind the Attention Mechanism — the heart of ChatGPT, Gemini, and Claude. Covers word embeddings, Q·Kᵀ dot products, softmax from scratch, and final output Z = A·V with full hand calculations.

Transformers Mathematics Bilingual
Read Blog
Machine Learning · Optimization

Gradient Descent — The Math Behind How AI Learns
Loss Functions, Derivatives & Update Rules

w_new = w_old − α × f'(w_old)

Step-by-step numeric walkthrough of gradient descent — the algorithm that trains every neural network. Covers loss functions, derivatives, the update rule, learning rate effects, all 3 types of GD, and Python code.

Optimization Mathematics Python Code
Read Blog

More blogs coming soon…

Stay tuned for the next post in the ML Series

CML

CompMathLab

AI by Hand

AI by Hand - 1
AI by Hand - 2
AI by Hand - 3
AI by Hand - 3 Visual
AI by Hand - 4
AI by Hand - 4 Advanced
AI by Hand - 5
AI by Hand - 6
AI by Hand - 7
AI by Hand - 8
AI by Hand - 9
AI by Hand - 10
AI by Hand - 11
AI by Hand - 12
AI by Hand - 13

Machine Learning

ML - 1
ML - 2
ML - 3 ND
Logistic Regression
Naive Bayes
Uni Regress

Statistics

Descriptive
Discrete Probability
Estimation Test
Mean Estimation
Outliers
Variance Test
Two Mean
Two Proportion
Single Proportion
Convert to ND
ND
Paired Sample Test

Mathematics

Fourier Series
Half Range Fourier Series
Fourier Transform
Analyzing Audio with Fourier Transform
Laplace Transform
Intuition of Integration
Intuition of Differentiation