Home avatar

Kevin Vu - Welcome to my blog

Understanding LLM Basics: Parameters, Tokens, Context

title : Understanding LLM Basics: Parameters, Tokens, Context

Understanding Parameters (Size Complexity), Context Size, Tokens, Temperature, Shots, Chain of thought (CoT) prompts, and Benchmarks (GSM8k, MMLU) in the context of AI Models

What do terms like temperature, shots, parameters eg. 7B, 13B, 70B, and Benchmarks (GSM8K, MMLU), CoT, Autoregressive LLMs etc. actually mean in the context of AI Models?

Multithreading vs. Asynchronous Programming vs. Parallel Programming in C#

I will show you the differences between Multithreading vs. Asynchronous Programming vs. Parallel Programming in C# with Examples in this article. Points to Remember Before Proceeding Further:

  1. Multithreading: This is all about a single process split into multiple threads.
  2. Parallel Programming: This is all about multiple tasks running on multiple cores simultaneously.
  3. Asynchronous Programming: This is all about a single thread initiating multiple tasks without waiting for each to complete.