DSA Notes
HubAlgorithm vs Data Structure — Key Differences, Definitions, and How They Work TogetherApplications of DSA — How Data Structures and Algorithms Power Real-World SoftwareTime and Space Complexity — A Complete BeginnerWhat is DSA? — A Complete BeginnerWhy Learn DSA? — Career Benefits, Real-World Impact, and Long-Term ValueAsymptotic Analysis — Complete Framework with Recurrence Relations and Master TheoremBest, Average, and Worst Case Analysis — A Practical Guide for Every AlgorithmBig O Notation — Complete Guide with Formal Definition, Rules, and ExamplesBig Omega Notation — Lower Bounds, Best Case, and Formal DefinitionBig Theta (Θ) Notation — Tight Bounds and Exact Growth RatesSpace Complexity — Memory Analysis, Auxiliary Space, and Time-Space TradeoffsTime Complexity Examples — 25 Worked Problems from Basic to AdvancedArray Interview Problems — 15 Classic Problems with Complete SolutionsArray Operations — Every Operation Explained with Code, Complexity, and Edge CasesArray Rotation — Algorithms, Techniques, and Interview ProblemsArray Searching — Linear Search, Binary Search, and Advanced TechniquesArrays — The Complete Introduction to the Most Fundamental Data StructureDynamic Arrays — How Python Lists and ArrayLists Work InternallyMultidimensional Arrays — 2D Arrays, Matrices, and Memory LayoutSliding Window Technique — Complete Guide with 10 Classic ProblemsAnagram Problems — Detection, Grouping, and Sliding Window VariationsPalindrome Problems — Check, Longest, Count, and Expand Around CenterPattern Searching — KMP, Rabin-Karp, and Boyer-Moore AlgorithmsString Interview Problems — 10 Classic Problems with Complete SolutionsString Matching — Longest Common Subsequence, Edit Distance, and Z-AlgorithmString Operations — Complete Reference with Complexity and ImplementationStrings — Complete Introduction to String Data Structure and OperationsCircular Linked List — Structure, Operations, and ApplicationsDoubly Linked List — Complete Implementation with Bidirectional OperationsLinked List Interview Problems — 12 Classic Problems with Complete SolutionsLinked Lists — A Complete Introduction with Memory Model and TypesLinked List Operations — Every Technique with Code and ComplexityReverse Linked List — All Approaches from Basic to AdvancedSingly Linked List — Complete Implementation with All OperationsBalanced Parentheses — Stack-Based Validation with All VariantsInfix, Prefix, and Postfix Expressions — Stack-Based Conversion and EvaluationStack Implementation — Three Complete Implementations with Edge CasesStack Interview Problems — 10 Classic Problems with Complete SolutionsStack — Complete Introduction to LIFO Data StructureStack Using Arrays — Memory Layout, Capacity Management, and PerformanceStack Using Linked List — Implementation, Analysis, and When to Use ItCircular Queue — The Ring Buffer Explained with ImplementationDeque — Double-Ended Queue with Complete Implementation and ApplicationsPriority Queue — Complete Guide from Concept to ImplementationQueue Applications — BFS, Level-Order Traversal, 01-BFS, and MoreQueue Implementation — Array, Linked List, and Two-Stack ApproachesQueue Interview Problems — 10 Classic Problems with Complete SolutionsQueue — Complete Introduction to the FIFO Data StructureAVL Tree - Self-Balancing Binary Search TreeBinary Search Tree (BST)Binary Tree - Structure and OperationsFenwick Tree (Binary Indexed Tree)Red-Black Tree - Another Balanced BSTSegment Tree - Range Query Data StructureTree Interview Problems CollectionTree Data Structure FundamentalsTree Traversals - Inorder, Preorder, Postorder, Level OrderHeap — Complete Introduction to the Priority-Based Tree Data StructureHeap Operations — Complete Reference with Complexity AnalysisHeap Problems — 8 Classic Interview Problems with Complete SolutionsMax Heap — Complete Implementation and ApplicationsMin Heap — Complete Implementation with All OperationsPriority Queue Using Heap — Implementation, Applications, and PatternsBellman-Ford Algorithm — Shortest Path with Negative Weights and Cycle DetectionBFS Algorithm — Breadth-First Search with All Applications and VariantsDFS Algorithm — Depth-First Search with Cycle Detection and All ApplicationsDijkstraFloyd-Warshall Algorithm — All-Pairs Shortest Paths with Complete AnalysisGraph Interview Problems — 12 Classic Problems with Complete SolutionsGraph — Complete Introduction to the Most Powerful Data StructureGraph Representation — Adjacency List, Matrix, Edge List with Complete AnalysisKruskalMinimum Spanning Tree — Definition, Properties, and ApplicationsPrimShortest Path Algorithms — Complete Comparison and Selection GuideTopological Sorting — DFS and BFS (KahnUnion-Find (DSU) in Graphs — Connected Components and Dynamic ConnectivitySeparate Chaining — Complete Implementation and AnalysisCollision Handling — Chaining vs Open Addressing Complete ComparisonHash Functions — Design, Properties, and Common ImplementationsHashing — Complete Introduction to Hash Tables and Hash FunctionsHashing Problems — 10 Classic Interview Problems with Complete SolutionsOpen Addressing — Linear Probing, Quadratic Probing, and Double HashingBubble Sort — Complete Analysis with Optimizations and When to Use ItCounting Sort — O(n+k) Sorting That Breaks the Comparison Lower BoundHeap Sort — Guaranteed O(n log n) with O(1) SpaceInsertion Sort — The O(n) Best Case Sort That Powers PythonMerge Sort — Complete Guide to the Guaranteed O(n log n) Stable SortQuick Sort — The Fastest Practical Sorting Algorithm with Complete AnalysisRadix Sort — O(nk) Digit-by-Digit Sorting for Large Integer RangesSelection Sort — Complete Analysis with Swaps Minimization PropertySorting Algorithm Comparison — The Complete Decision GuideSorting — Complete Introduction to Sorting AlgorithmsBinary Search — Complete Guide with All Variants and Proof of CorrectnessInterpolation Search — O(log log n) Search for Uniformly Distributed DataLinear Search — Complete Guide with All Variants and ApplicationsSearch Algorithm Comparison — Choosing the Right Search for Every SituationSearching Interview Problems — 10 Classic Problems with Complete SolutionsTernary Search — Finding Maximum/Minimum of Unimodal FunctionsBacktracking Introduction — The Recursive Exploration with UndoRecursion Basics — The Complete BeginnerRecursion Problems — 12 Classic Problems from Basic to AdvancedRecursion Tree — Visualizing Recursion for Complexity AnalysisRecursion vs Iteration — When to Use Each and How to ConvertTail Recursion — Definition, Optimization, and Converting to IterationDP Interview Problems — 12 Classic Problems with Pattern Recognition GuideDynamic Programming — Complete Introduction with Properties and Problem IdentificationFibonacci DP — From Exponential to Linear with Memoization and Matrix ExponentiationKnapsack Problem — 0/1, Unbounded, and Fractional with Complete AnalysisLongest Common Subsequence — Complete Guide with DP Table and String VariantsLongest Increasing Subsequence — O(n log n) with Patience SortingMatrix Chain Multiplication — Interval DP with Complete AnalysisMemoization — Top-Down Dynamic Programming with CachingTabulation — Bottom-Up Dynamic Programming with Complete Table BuildingActivity Selection Problem — Greedy Scheduling with Proof of CorrectnessFractional Knapsack — Greedy by Value Density with ProofGreedy Interview Problems — 10 Classic Problems with Complete SolutionsGreedy Algorithms — Complete Introduction with Proof TechniquesHuffman Coding — Optimal Prefix-Free Data CompressionJob Sequencing Problem — Greedy Scheduling with DeadlinesBacktracking — The Complete Guide to Recursive Exploration with UndoBacktracking Problems — 12 Classic Interview Problems with Complete SolutionsN-Queens Problem — Complete Solution with Backtracking and OptimizationRat in a Maze — Backtracking Path Finding with All SolutionsSubset Generation — All Subsets, Combinations, and Partitions with BacktrackingSudoku Solver — Backtracking with Constraint PropagationCodeforces Guide — Complete Strategy to Reach 1800+ RatingCommon CP Techniques — Essential Algorithms Every Competitive Programmer Must KnowContest Strategies — How to Perform Your Best in Competitive Programming ContestsCompetitive Programming — Complete Introduction for BeginnersFast Input/Output — Why I/O Speed Matters and Complete Templates for C++ and PythonLeetCode Guide — Complete Strategy to Crack FAANG InterviewsBit Manipulation — Complete Guide with All Tricks and Interview ProblemsBloom Filter — Space-Efficient Probabilistic Membership TestingComputational Geometry — Points, Lines, Convex Hull, and Geometric AlgorithmsDisjoint Set Union (DSU) — Union-Find with Path Compression and Union by RankRandomized Algorithms — Las Vegas, Monte Carlo, and Probabilistic TechniquesSkip List — The Probabilistic Data Structure that Competes with Balanced BSTsSuffix Array — Construction, LCP Array, and String Search ApplicationsTrie Data Structure — Complete Guide with Implementation and ApplicationsAutocomplete System Using TrieLibrary Management System Using DSARoute Finder Using GraphsMini Search Engine ProjectSocial Network Analysis Using GraphsEssential Coding Patterns for InterviewsDSA Cheatsheet: Quick ReferenceEssential DSA Interview QuestionsFAANG DSA Sheet: Company-Specific Patterns and ProblemsProblem Solving Strategies for Coding InterviewsComplexity CheatsheetImportant Algorithms SummaryBest Practice Platforms for DSARecommended Books for DSA
Master radix sort — LSD and MSD variants, how it uses counting sort as a subroutine to sort digit by digit, why it achieves O(nk) time, sorting strings and multi-field records, comparison with counting sort and comparison sorts, and practical applications.
The Core Insight
When numbers have multiple digits, sorting digit by digit (from least significant to most significant) using a stable sort produces the correct final order.
Why does this work? If you sort by units first, then by tens, then by hundreds — a stable sort preserves the earlier digit ordering when digits at the current position are equal. The final result is sorted by all digits together.
| Input | [170, 45, 75, 90, 802, 24, 2, 66] |
| Step 2 — Sort by tens digit (stable | preserves units order for ties): |
| (802 and 2 both have 0 tens | 802 before 2 from previous step) |
| Final sorted | [2, 24, 45, 66, 75, 90, 170, 802] ✓ |
Complexity Analysis
For n numbers each with at most d digits in base b:
- d passes of counting sort
- Each pass: O(n + b) — n elements plus b digit buckets
- Total: O(d × (n + b))
For base 10, b = 10 (constant), so O(d × n).
Choosing the base (b):
| But | larger count array |
| Base 10 | d = 10 digits, 10 passes |
| Base 256 | d = 4 digits (1 byte each), 4 passes — typical choice |
| Base 65536 | d = 2 digits, 2 passes |
| Optimal tradeoff | b ≈ n gives O(n log_n(max_val)) total |
Radix Sort for Strings
Example
def radix_sort_strings(strings, max_len=None):
"""
Sort strings of equal length using LSD radix sort.
Works on fixed-length strings.
"""
if not strings: return strings
if max_len is None:
max_len = max(len(s) for s in strings)
# Pad shorter strings
padded = [s.ljust(max_len) for s in strings]
# Sort from rightmost to leftmost character
for col in range(max_len - 1, -1, -1):
# Stable sort by character at position col
padded = sorted(padded, key=lambda s: s[col])
return [s.rstrip() for s in padded]
print(radix_sort_strings(["cat", "bat", "hat", "ace"]))
# ['ace', 'bat', 'cat', 'hat']
MSD Radix Sort (Most Significant Digit First)
MSD processes from the most significant digit, recursively sorting each bucket:
Example
def radix_sort_msd(arr, digit_pos=None):
"""
MSD Radix Sort: more complex but handles variable-length strings naturally.
Recursively sorts each bucket.
"""
if len(arr) <= 1: return arr
if digit_pos is None:
max_val = max(arr)
digit_pos = len(str(max_val)) - 1
if digit_pos < 0: return arr
# Partition into buckets by digit at position digit_pos
buckets = [[] for _ in range(10)]
for val in arr:
digit = (val // (10 ** digit_pos)) % 10
buckets[digit].append(val)
result = []
for bucket in buckets:
if len(bucket) > 1:
result.extend(radix_sort_msd(bucket, digit_pos - 1))
else:
result.extend(bucket)
return result
LSD vs MSD:
- LSD: Simpler, works on whole array, better for fixed-length keys
- MSD: More complex, naturally handles variable-length strings, better for early termination on sorted data
Radix Sort vs Other Linear-Time Sorts
| Feature | Counting Sort | Radix Sort | Bucket Sort |
|---|---|---|---|
| Time | O(n + k) | O(d × (n + b)) | O(n) average |
| Range constraint | k must be small | d must be small | Uniform distribution |
| Handles negative | With offset | With modification | With offset |
| Stable | ✅ Yes | ✅ Yes | With stable subroutine |
| Practical k/d | k ≤ 10n | d ≤ log_b(max_val) | Uniform data |
When Radix Sort beats Counting Sort:
| Counting Sort | O(n + k) = O(10^9) — terrible, count array too large |
| Radix Sort (base 10) | d = 10 digits, O(10 × (n + 10)) = O(10n) — fast |
| Radix Sort (base 256) | d = 4 digits, O(4 × (n + 256)) = O(4n) — faster |
When to Use Radix Sort
Use Radix Sort when
✅ Sorting large integers (phone numbers, IDs, timestamps)
✅ Range too large for counting sort
✅ Number of digits d is small relative to n
✅ Stable sort of multi-key records (sort by secondary key, then primary)
Avoid Radix Sort when
❌ Data is floating point (requires careful handling)
❌ Data is arbitrary objects without natural digit decomposition
❌ Memory is very limited (needs O(n + b) extra)
❌ n is small (Quick Sort's constant is smaller)
Multi-Key Sorting Using Radix Sort
LSD Radix Sort naturally handles multi-key record sorting:
Example
def sort_by_multiple_keys(records):
"""
Sort records by (year, month, day) using radix sort approach.
First sort by day (least significant), then month, then year.
Stability ensures final sort is correct.
"""
# Sort by day (stable)
records = sorted(records, key=lambda r: r[2])
# Sort by month (stable — preserves day order for same month)
records = sorted(records, key=lambda r: r[1])
# Sort by year (stable — preserves month/day order for same year)
records = sorted(records, key=lambda r: r[0])
return records
dates = [(2024, 3, 15), (2024, 1, 20), (2023, 12, 31), (2024, 3, 10)]
print(sort_by_multiple_keys(dates))
# [(2023, 12, 31), (2024, 1, 20), (2024, 3, 10), (2024, 3, 15)]
Summary
Radix sort: sort digit by digit from least (or most) significant, using a stable subroutine.
| Property | Value |
|---|---|
| Time | O(d × (n + b)) — effectively O(kn) for k digits |
| Space | O(n + b) |
| Stable | ✅ Yes |
| In-place | ❌ No |
| Comparison sort | ❌ No |
| Constraint | Integer (or digit-decomposable) inputs |
Key advantage over counting sort: Works when the value range is large but the number of digits is small. Sorting 1 million 9-digit numbers takes O(9n) time with radix sort — linear.
*Next Lesson: Sorting Comparison*
Exam Focus
Revise definitions, diagrams, examples, and short-answer points for Radix Sort — O(nk) Digit-by-Digit Sorting for Large Integer Ranges.
Interview Use
Prepare one clear explanation, one practical example, and one common mistake for this Data Structures & Algorithms topic.
Search Terms
data-structures-algorithms, data structures & algorithms, data, structures, algorithms, sorting, radix, sort
Related Data Structures & Algorithms Topics
Continue learning this concept
SortingBubble Sort — Complete Analysis with Optimizations and When to Use ItMaster bubble sort completely — the mechanism, step-by-step trace, optimized version with early termination, formal proof of correctness, time and space complexity analysis with all three cases, comparison with other O(n²) sorts, and when bubble sort is actually useful.SortingCounting Sort — O(n+k) Sorting That Breaks the Comparison Lower BoundMaster counting sort — how it breaks the O(n log n) comparison lower bound, the complete O(n+k) algorithm with stability proof, when k must be small for counting sort to be practical, the cumulative count technique for stable output, and applications in radix sort and frequency counting.SortingHeap Sort — Guaranteed O(n log n) with O(1) SpaceMaster heap sort completely — how heapify works, building a max-heap in O(n), the two-phase sorting process, why heap sort is O(n log n) in all cases with O(1) space, the weak cache performance trade-off, and comparison with merge sort and quick sort.SortingInsertion Sort — The O(n) Best Case Sort That Powers PythonMaster insertion sort completely — the card-dealing analogy, step-by-step trace, O(n) best case proof, binary insertion sort optimization, why it is used in PythonSortingMerge Sort — Complete Guide to the Guaranteed O(n log n) Stable SortMaster merge sort completely — the divide-and-conquer approach, step-by-step trace, formal correctness proof, recurrence relation solution, bottom-up vs top-down implementation, natural merge sort for nearly sorted data, counting inversions, and all comparison-based optimizations.SortingQuick Sort — The Fastest Practical Sorting Algorithm with Complete AnalysisMaster quick sort completely — partition schemes (Lomuto and Hoare), randomized quick sort, 3-way partition for duplicates, average-case proof, worst-case prevention, why quick sort beats merge sort in practice despite equal asymptotic complexity, and tail-call optimization.