In this blog, we will learn about AI Agent Memory - why agents need it, the memory stack, the four core operations (write, read, update, forget), how memory flows at runtime, and the common mistakes.

AI Agent Memory

In this blog, we will learn about the AI Agent - what it is, how it is different from a plain LLM, its five core parts, how it works end to end, the main types, and when to use one.

AI Agent Explained

In this blog, we will learn about RMSNorm, a faster and simpler alternative to Layer Normalization that powers most modern Large Language Models like Llama, Mistral, Gemma, Qwen, PaLM, and DeepSeek.

RMSNorm (Root Mean Square Layer Normalization)

In this blog, we will learn about DeepSeek-V4, the new family of open Mixture-of-Experts language models that natively supports a one-million-token context with dramatically lower inference cost.

Decoding DeepSeek-V4

In this blog, we will learn about LoRA - Low-Rank Adaptation of Large Language Models.

LoRA - Low-Rank Adaptation of LLMs

In this blog, we will learn about the math behind Rotary Position Embedding (RoPE) and why it is used in modern Large Language Models.

Math Behind RoPE (Rotary Position Embedding)

In this blog, we will learn about Grouped-Query Attention (GQA) and how it differs from Multi-Head Attention (MHA).

Grouped Query Attention

In this blog, we will learn about the math behind Cross-Entropy Loss with a step-by-step numeric example.

Math Behind Cross-Entropy Loss

In this blog, we will learn about the math behind gradient descent with a step-by-step numeric example.

Math Behind Gradient Descent

In this blog, we will learn about the Vision Transformer (ViT) by decoding how it splits an image into patches, turns those patches into tokens, and processes them with a transformer to classify the image.

Decoding Vision Transformer (ViT)

In this blog, we will learn about Feed-Forward Networks in LLMs - understanding what they are, how they work inside the Transformer architecture, why every Transformer layer needs one, and what role they play in making Large Language Models so powerful.

Feed-Forward Networks in LLMs

In this blog, we will learn about Flash Attention by decoding it piece by piece - understanding why standard attention is slow, what makes Flash Attention fast, how it uses GPU memory cleverly, and why it is used in almost every modern Large Language Model (LLM).

Decoding Flash Attention in LLMs

In this blog, we will learn about the Mixture of Experts (MoE) architecture - understanding what experts are, how the router picks them, why MoE makes large models faster and cheaper, and why it powers many of today''s most powerful Large Language Models (LLMs).

Mixture of Experts Explained

In this blog, we will learn about the Transformer architecture by decoding it piece by piece - understanding what each component does, how they work together, and why this architecture powers every modern Large Language Model (LLM)

Decoding Transformer Architecture

In this blog, we will learn about the math behind backpropagation in neural networks.

Math Behind Backpropagation

In this blog, we will learn about why we scale the dot product attention by √dₖ in the Transformer architecture with a step-by-step numeric example.

Math behind √dₖ Scaling Factor in Attention

In this blog, we will learn about the math behind Attention - Query(Q), Key(K), and Value(V) with a step-by-step numeric example.

Math behind Attention - Q, K, and V

In this blog, we will learn about Harness Engineering in AI.

Harness Engineering in AI

In this blog, we will learn about BPE (Byte Pair Encoding) - the tokenization algorithm used by most modern Large Language Models (LLMs) to break text into smaller pieces before processing it.

Byte Pair Encoding in LLMs

In this blog, we will learn about Paged Attention, a technique that solves the memory waste problem of KV Cache, allowing LLMs to serve many more users at the same time.

Paged Attention in LLMs

In this blog, we will learn about KV Cache - where K stands for Key and V stands for Value - and why it is used in Large Language Models (LLMs) to speed up text generation.

KV Cache in LLMs

In this blog, we will learn about the Causal Masking in Attention.

Causal Masking in Attention

In this blog, we will learn about Linear Regression vs Logistic Regression in Machine Learning.

Linear Regression vs Logistic Regression

In this blog, we will learn about Supervised vs Unsupervised Learning in Machine Learning.

Supervised vs Unsupervised Learning

In this blog, we will learn about the Android Push Notification Flow using FCM.

Android Push Notification Flow using FCM

Today, we are going to discuss everything about the Android System Design Interviews.

Android System Design Interviews

In this blog, we will learn about Write-Ahead Logging (WAL) and why it is used internally in databases.

Write-Ahead Logging (WAL)

In this blog, we will learn about the Composite Index in Database and why it offers better performance. We will also explore the impact of column order in a composite index.

Composite Index in Database

In this blog, we will learn about the CoroutineContext in Kotlin by going through the source code. We will also cover how to customize it.

CoroutineContext in Kotlin

In this blog, we will learn about the difference between Parcelable and Serializable. We will also learn how they work internally.

Parcelable vs Serializable

In this blog, we will learn about String, StringBuffer, and StringBuilder.

String vs StringBuffer vs StringBuilder

In this blog, we will learn about the data class in Kotlin. We will also learn how it works internally.

data class in Kotlin

In this blog, we will learn about the extension function in Kotlin. We will also learn how it works internally.

Extension function in Kotlin

In this blog, we will learn about database normalization and denormalization.

Database Normalization vs Denormalization

In this blog, we will learn about the difference between remember and rememberSaveable in Jetpack Compose.

remember vs rememberSaveable

In this blog, we will learn about the evolution of HTTP.

Evolution of HTTP

In this blog, we will learn about the difference between React Native and Flutter.

React Native vs Flutter

In this blog, we are going to learn about the internals of the Redis Serialization Protocol(RESP).

Internals of RESP - Redis Serialization Protocol

In this blog, we will learn about the Launch vs Async in Kotlin Coroutines.

Launch vs Async in Kotlin Coroutines

In this blog, we will learn how to convert any Callback to Flow API in Kotlin using callbackFlow.

callbackFlow - Callback to Flow API in Kotlin

In this blog, we will learn about the terms Dalvik, ART, JIT, and AOT in Android.

Dalvik, ART, JIT, and AOT in Android

In this blog, we will learn about the difference between == and === in Kotlin.

Difference between == and === in Kotlin

In this blog, we will learn how to load the configurations from the envfile in Golang using Viper in Go (Golang) projects.

Configuration with Viper in Go

In this blog, we will learn about writing the unit test with Testify and Mockery in Go (Golang) project.

Test with Testify and Mockery in Go

In this blog, we will learn the implementation of JWT Authentication Middleware in Go (Golang).

Go JWT Authentication Middleware

In this blog, we are going to discuss the implementation of clean architecture in the backend project written in the Go language.

Go Backend Clean Architecture

In this blog, we will learn about the StateFlow and SharedFlow in Kotlin.

StateFlow and SharedFlow

In this blog, we will learn about Cold Flow vs Hot Flow in Kotlin.

Cold Flow vs Hot Flow

In this blog, we will learn how to write the unit test for ViewModel with Kotlin Flow and StateFlow.

Unit Testing ViewModel with Kotlin Flow and StateFlow

In this blog, we will learn how the Kotlin Multiplatform works.

How does the Kotlin Multiplatform work?

In this blog, we will learn about the RxJava Subject - Publish, Replay, Behavior, and Async.

RxJava Subject - Publish, Replay, Behavior, and Async

In this blog, we will learn how to work with the OkHttp Interceptors.

OkHttp Interceptor

In this blog, we are going to master the Kotlin Coroutines in Android.

Mastering Kotlin Coroutines

In this blog, we will learn how to convert any Callback to Coroutines in Kotlin.

Callback to Coroutines in Kotlin

In this blog, we will learn about the Retry Operator in Kotlin Flow.

Retry Operator in Kotlin Flow

In this blog, we will learn how to implement pagination in RecyclerView using RxJava operators.

Pagination In RecyclerView Using RxJava Operators

In this blog, we will learn about the Map vs FlatMap Operator in RxJava.

RxJava Operator Map vs FlatMap

In this blog, we will learn about the Merge operator of RxJava.

RxJava Merge Operator

In this blog, we will learn about how to run long tasks in parallel with Kotlin Flow in Android.

Long-running tasks in parallel with Kotlin Flow

In this blog, we will learn how to use Retrofit with Kotlin Coroutines.

Retrofit with Kotlin Coroutines

In this blog, we will learn about the coroutineScope vs supervisorScope of Kotlin Coroutines.

coroutineScope vs supervisorScope

In this blog, we will learn how to use Retrofit with Kotlin Flow.

Retrofit with Kotlin Flow

In this blog, we will learn how to use Room Database with Kotlin Flow.

Room Database with Kotlin Flow

In this blog, we will learn about the Concat operator of RxJava.

RxJava Concat Operator

In this blog, we will learn about the dispose method and the clear method of CompositeDisposable that is present in the RxJava.

dispose vs clear CompositeDisposable RxJava

In this blog, we will learn about the Interval Operator of RxJava.

RxJava Interval Operator

In this blog, we will learn about the crossinline modifier in Kotlin.

crossinline in Kotlin

In this blog, we will learn about the inline function in Kotlin.

inline function in Kotlin

In this blog, we will learn about the noinline modifier in Kotlin.

noinline in Kotlin

In this blog, we will learn about how can we optimize the scrolling performance of the Nested RecyclerView using the setRecycledViewPool.

Use setRecycledViewPool for Optimizing Nested RecyclerView

In this blog, we will learn about the singleTask launchMode in Android.

singleTask launchMode in Android

In this blog, we will learn about the init block in Kotlin.

init block in Kotlin

In this blog, we will learn about the companion object in Kotlin.

Companion object in Kotlin

In this blog, we will learn about the lateinit vs lazy properties in Kotlin.

lateinit vs lazy in Kotlin

In this blog, we will learn about the Infix notation in Kotlin. The Infix notation enables us to write code that looks much more like a natural language.

Infix notation in Kotlin

In this blog, we will learn about the open keyword in Kotlin.

Open keyword in Kotlin

In this blog, we are going to learn about the Dispatchers in Kotlin Coroutines including the types of Dispatchers available for use in Coroutines.

Dispatchers in Kotlin Coroutines

In this blog, we are going to learn what is Flow API in Kotlin. Kotlin provides many features out of the box that we can use to perform various tasks in our project.

Mastering Flow API in Kotlin

In this blog, we are going to learn how the Android Image Loading library optimizes memory usage.

How does the Android Image Loading library optimize memory usage?

In this blog, we are going to learn how the Android Image Loading library uses the bitmap pool to make the UI responsive.

How does the Android Image Loading library use the bitmap pool for responsive UI?

In this blog, we are going to learn about the JvmField annotation in Kotlin.

JvmField Annotation in Kotlin

In this blog, we are going to learn about the JvmOverloads annotation in Kotlin.

JvmOverloads Annotation in Kotlin

In this blog, we are going to learn one of the coding best practices which is how avoiding nesting by handling errors first increases the readability.

Avoid nesting by handling errors first

In this blog, we are going to learn about the JvmStatic annotation in Kotlin.

JvmStatic Annotation in Kotlin

In this blog, we are going to learn about the advantage of using const in Kotlin.

Advantage of using const in Kotlin

In this blog, we are going to learn how the Android Image Loading library solves the slow loading issue of images.

How does the Android Image Loading library solve the slow loading issue?

In this blog, we will learn about the Kotlin filtering function - partition. It filters a collection by a predicate and keeps the elements that don't match it in a separate list.

partition - filtering function in Kotlin

In this blog, we will learn why an Android App lags. I believe that every Android Developer should know the reason for the low performance of the Android app.

Why does an Android App lag?

In this blog, we are going to learn the HTTP Request vs Http Long-Polling vs WebSocket vs Server-Sent Events(SSE).

HTTP Request vs HTTP Long-Polling vs WebSocket vs Server-Sent Events

In this blog, we will learn about the Kotlin Collection Functions - associateBy that converts a list into a map.

AssociateBy - List to Map in Kotlin

In this blog, we are going to learn how to remove duplicates from an array in Kotlin. As there are many ways to remove duplicates from an array in Kotlin, depending on the use case, we can decide which one to use.

Remove duplicates from an array in Kotlin

In this blog, we are going to learn how to cache HTTP responses in Android using OkHttp Interceptor and Retrofit for building offline-first Android apps.

Caching with OkHttp Interceptor and Retrofit

In this blog, we are going to learn why is it recommended to use only the default constructor to create a Fragment.

Why is it recommended to use only the default constructor to create a Fragment?

We can learn so many good things from the blogs of tech companies. The tech engineering blogs of the following companies are a great place to learn.

Top Tech Engineering Blogs of Companies

This post is about career advice for a software developer to earn a higher salary. Here goes my learning from starting from ground zero.

Career advice for a software developer to earn a higher salary

In this blog, we are going to learn about the differences between a junior, mid-level, and senior developer.

Differences between a junior, mid-level, and senior developer

In this blog, we are going to learn how to remove items from an array in JavaScript. As there are many ways to remove the items from an array in JavaScript, depending on the use case, we can decide which one to use.

How to remove items from an array in JavaScript?

This article is for anyone who is curious about the blockchain but has no idea what it is exactly.

What is Blockchain?

My transition from a Civil Engineer to a Software Engineer.

Civil Engineer To Software Engineer

In this blog, we are going to see why we need Jetpack DataStore Preferences, learn how to implement Jetpack DataStore Preferences in our Android application and how can we migrate our SharedPreferences to DataStore Preferences.

All Blogs