Welcome to Yayun Liu's Blog!

• Deep Learning: binary- and categorical- cross-entropy

  2026-01-25

  deep-learning

  loss-function  cross-entropy
  This post discuss the loss functions for binary and multi-class cassification.
  Read All

  ---

• Deep Learning: Vectorization over training examples

  2026-01-16

  deep-learning

  fcnn  vectorization
  This post discuss vectorization over training examples in a multi-layer neural networks.
  Read All

  ---

• Deep Learning: Backpropagation for multi-layer fully-connected neural networks

  2026-01-16

  deep-learning

  fcnn  backpropagation
  This post discuss topics such as backpropagation, computational graph, and the algorithm of backpropagation of multi-layer neural networks.
  Read All

  ---

• Deep Learning: Backpropagation for 2-layer fully-connected neural networks

  2026-01-15

  deep-learning

  fcnn  backpropagation
  This post discuss topics such as backpropagation, computational graph, and the algorithm of backpropagation of a 2-layer fully-connected neural network.
  Read All

  ---

• Deep Learning: 2-layer fully-connected neural networks

  2026-01-12

  deep-learning

  fcnn
  This post includes the illustration and mathematical representations of a 2-layer fully-connected neural network.
  Read All

  ---

• Book review: LLM from Strach, chapter 2 - Word Embeddings

  2025-08-07

  LLM  deep-learning

  LLM  word-embeddings
  This post includes the notes while reviewing the book called Build a Large Language Model (From Scratch) by Sebastian Raschka.
  Read All

  ---

• NLP: Naive Bayes Classification

  2024-10-23

  NLP  deep-learning

  NLP
  This post explains Navie Bayes and how to use it for training a model for sentiment analysis on tweets.
  Read All

  ---

• NLP: Logistic Regression, Cost Function, and Gradient Descent

  2024-10-21

  NLP  deep-learning

  NLP
  This post covers the topics about logistic regression (LR) and the cost function and gradient descent used in LR. At the end, it gives a code example using LR for sentiment analysis on tweets.
  Read All

  ---

• NLP Vocabulary and Feature Extraction

  2024-10-18

  NLP  deep-learning

  NLP
  This post discusses about building vocabulary and feature extraction for NLP.
  Read All

  ---

• Transformer

  2024-08-15

  seq2seq  deep-learning

  transformer
  This post discusses the transformer.
  Read All

  ---