DSA Notes
HubAlgorithm vs Data Structure — Key Differences, Definitions, and How They Work TogetherApplications of DSA — How Data Structures and Algorithms Power Real-World SoftwareTime and Space Complexity — A Complete BeginnerWhat is DSA? — A Complete BeginnerWhy Learn DSA? — Career Benefits, Real-World Impact, and Long-Term ValueAsymptotic Analysis — Complete Framework with Recurrence Relations and Master TheoremBest, Average, and Worst Case Analysis — A Practical Guide for Every AlgorithmBig O Notation — Complete Guide with Formal Definition, Rules, and ExamplesBig Omega Notation — Lower Bounds, Best Case, and Formal DefinitionBig Theta (Θ) Notation — Tight Bounds and Exact Growth RatesSpace Complexity — Memory Analysis, Auxiliary Space, and Time-Space TradeoffsTime Complexity Examples — 25 Worked Problems from Basic to AdvancedArray Interview Problems — 15 Classic Problems with Complete SolutionsArray Operations — Every Operation Explained with Code, Complexity, and Edge CasesArray Rotation — Algorithms, Techniques, and Interview ProblemsArray Searching — Linear Search, Binary Search, and Advanced TechniquesArrays — The Complete Introduction to the Most Fundamental Data StructureDynamic Arrays — How Python Lists and ArrayLists Work InternallyMultidimensional Arrays — 2D Arrays, Matrices, and Memory LayoutSliding Window Technique — Complete Guide with 10 Classic ProblemsAnagram Problems — Detection, Grouping, and Sliding Window VariationsPalindrome Problems — Check, Longest, Count, and Expand Around CenterPattern Searching — KMP, Rabin-Karp, and Boyer-Moore AlgorithmsString Interview Problems — 10 Classic Problems with Complete SolutionsString Matching — Longest Common Subsequence, Edit Distance, and Z-AlgorithmString Operations — Complete Reference with Complexity and ImplementationStrings — Complete Introduction to String Data Structure and OperationsCircular Linked List — Structure, Operations, and ApplicationsDoubly Linked List — Complete Implementation with Bidirectional OperationsLinked List Interview Problems — 12 Classic Problems with Complete SolutionsLinked Lists — A Complete Introduction with Memory Model and TypesLinked List Operations — Every Technique with Code and ComplexityReverse Linked List — All Approaches from Basic to AdvancedSingly Linked List — Complete Implementation with All OperationsBalanced Parentheses — Stack-Based Validation with All VariantsInfix, Prefix, and Postfix Expressions — Stack-Based Conversion and EvaluationStack Implementation — Three Complete Implementations with Edge CasesStack Interview Problems — 10 Classic Problems with Complete SolutionsStack — Complete Introduction to LIFO Data StructureStack Using Arrays — Memory Layout, Capacity Management, and PerformanceStack Using Linked List — Implementation, Analysis, and When to Use ItCircular Queue — The Ring Buffer Explained with ImplementationDeque — Double-Ended Queue with Complete Implementation and ApplicationsPriority Queue — Complete Guide from Concept to ImplementationQueue Applications — BFS, Level-Order Traversal, 01-BFS, and MoreQueue Implementation — Array, Linked List, and Two-Stack ApproachesQueue Interview Problems — 10 Classic Problems with Complete SolutionsQueue — Complete Introduction to the FIFO Data StructureAVL Tree - Self-Balancing Binary Search TreeBinary Search Tree (BST)Binary Tree - Structure and OperationsFenwick Tree (Binary Indexed Tree)Red-Black Tree - Another Balanced BSTSegment Tree - Range Query Data StructureTree Interview Problems CollectionTree Data Structure FundamentalsTree Traversals - Inorder, Preorder, Postorder, Level OrderHeap — Complete Introduction to the Priority-Based Tree Data StructureHeap Operations — Complete Reference with Complexity AnalysisHeap Problems — 8 Classic Interview Problems with Complete SolutionsMax Heap — Complete Implementation and ApplicationsMin Heap — Complete Implementation with All OperationsPriority Queue Using Heap — Implementation, Applications, and PatternsBellman-Ford Algorithm — Shortest Path with Negative Weights and Cycle DetectionBFS Algorithm — Breadth-First Search with All Applications and VariantsDFS Algorithm — Depth-First Search with Cycle Detection and All ApplicationsDijkstraFloyd-Warshall Algorithm — All-Pairs Shortest Paths with Complete AnalysisGraph Interview Problems — 12 Classic Problems with Complete SolutionsGraph — Complete Introduction to the Most Powerful Data StructureGraph Representation — Adjacency List, Matrix, Edge List with Complete AnalysisKruskalMinimum Spanning Tree — Definition, Properties, and ApplicationsPrimShortest Path Algorithms — Complete Comparison and Selection GuideTopological Sorting — DFS and BFS (KahnUnion-Find (DSU) in Graphs — Connected Components and Dynamic ConnectivitySeparate Chaining — Complete Implementation and AnalysisCollision Handling — Chaining vs Open Addressing Complete ComparisonHash Functions — Design, Properties, and Common ImplementationsHashing — Complete Introduction to Hash Tables and Hash FunctionsHashing Problems — 10 Classic Interview Problems with Complete SolutionsOpen Addressing — Linear Probing, Quadratic Probing, and Double HashingBubble Sort — Complete Analysis with Optimizations and When to Use ItCounting Sort — O(n+k) Sorting That Breaks the Comparison Lower BoundHeap Sort — Guaranteed O(n log n) with O(1) SpaceInsertion Sort — The O(n) Best Case Sort That Powers PythonMerge Sort — Complete Guide to the Guaranteed O(n log n) Stable SortQuick Sort — The Fastest Practical Sorting Algorithm with Complete AnalysisRadix Sort — O(nk) Digit-by-Digit Sorting for Large Integer RangesSelection Sort — Complete Analysis with Swaps Minimization PropertySorting Algorithm Comparison — The Complete Decision GuideSorting — Complete Introduction to Sorting AlgorithmsBinary Search — Complete Guide with All Variants and Proof of CorrectnessInterpolation Search — O(log log n) Search for Uniformly Distributed DataLinear Search — Complete Guide with All Variants and ApplicationsSearch Algorithm Comparison — Choosing the Right Search for Every SituationSearching Interview Problems — 10 Classic Problems with Complete SolutionsTernary Search — Finding Maximum/Minimum of Unimodal FunctionsBacktracking Introduction — The Recursive Exploration with UndoRecursion Basics — The Complete BeginnerRecursion Problems — 12 Classic Problems from Basic to AdvancedRecursion Tree — Visualizing Recursion for Complexity AnalysisRecursion vs Iteration — When to Use Each and How to ConvertTail Recursion — Definition, Optimization, and Converting to IterationDP Interview Problems — 12 Classic Problems with Pattern Recognition GuideDynamic Programming — Complete Introduction with Properties and Problem IdentificationFibonacci DP — From Exponential to Linear with Memoization and Matrix ExponentiationKnapsack Problem — 0/1, Unbounded, and Fractional with Complete AnalysisLongest Common Subsequence — Complete Guide with DP Table and String VariantsLongest Increasing Subsequence — O(n log n) with Patience SortingMatrix Chain Multiplication — Interval DP with Complete AnalysisMemoization — Top-Down Dynamic Programming with CachingTabulation — Bottom-Up Dynamic Programming with Complete Table BuildingActivity Selection Problem — Greedy Scheduling with Proof of CorrectnessFractional Knapsack — Greedy by Value Density with ProofGreedy Interview Problems — 10 Classic Problems with Complete SolutionsGreedy Algorithms — Complete Introduction with Proof TechniquesHuffman Coding — Optimal Prefix-Free Data CompressionJob Sequencing Problem — Greedy Scheduling with DeadlinesBacktracking — The Complete Guide to Recursive Exploration with UndoBacktracking Problems — 12 Classic Interview Problems with Complete SolutionsN-Queens Problem — Complete Solution with Backtracking and OptimizationRat in a Maze — Backtracking Path Finding with All SolutionsSubset Generation — All Subsets, Combinations, and Partitions with BacktrackingSudoku Solver — Backtracking with Constraint PropagationCodeforces Guide — Complete Strategy to Reach 1800+ RatingCommon CP Techniques — Essential Algorithms Every Competitive Programmer Must KnowContest Strategies — How to Perform Your Best in Competitive Programming ContestsCompetitive Programming — Complete Introduction for BeginnersFast Input/Output — Why I/O Speed Matters and Complete Templates for C++ and PythonLeetCode Guide — Complete Strategy to Crack FAANG InterviewsBit Manipulation — Complete Guide with All Tricks and Interview ProblemsBloom Filter — Space-Efficient Probabilistic Membership TestingComputational Geometry — Points, Lines, Convex Hull, and Geometric AlgorithmsDisjoint Set Union (DSU) — Union-Find with Path Compression and Union by RankRandomized Algorithms — Las Vegas, Monte Carlo, and Probabilistic TechniquesSkip List — The Probabilistic Data Structure that Competes with Balanced BSTsSuffix Array — Construction, LCP Array, and String Search ApplicationsTrie Data Structure — Complete Guide with Implementation and ApplicationsAutocomplete System Using TrieLibrary Management System Using DSARoute Finder Using GraphsMini Search Engine ProjectSocial Network Analysis Using GraphsEssential Coding Patterns for InterviewsDSA Cheatsheet: Quick ReferenceEssential DSA Interview QuestionsFAANG DSA Sheet: Company-Specific Patterns and ProblemsProblem Solving Strategies for Coding InterviewsComplexity CheatsheetImportant Algorithms SummaryBest Practice Platforms for DSARecommended Books for DSA
Master Depth-First Search completely — recursive and iterative implementations, DFS tree and timestamps, cycle detection in directed and undirected graphs, finding articulation points and bridges, DFS on grids, topological sort foundation, and all classic DFS interview problems.
What Is DFS?
Depth-First Search (DFS) is a graph traversal algorithm that explores as far as possible along each branch before backtracking. It uses a stack (implicitly via recursion, or explicitly) to track the path.
Intuition: Navigating a maze — always take the first available path, go as deep as possible, and only backtrack when you hit a dead end.
| Graph | DFS from vertex 0: |
| 0—1—3 Explore 0 | go deep through 1 → go deep through 3 |
| | Backtrack | try 2 from 0 |
| 2 Backtrack | done |
| DFS order: 0 | 1 → 3 → 2 (depth-first, not level-by-level) |
| BFS order: 0 | 1 → 2 → 3 (breadth-first, level-by-level) |
Iterative DFS (Explicit Stack)
Example
def dfs_iterative(graph, start):
"""
Iterative DFS using explicit stack.
Note: order may differ from recursive due to stack reversal.
"""
visited = set()
stack = [start]
order = []
while stack:
vertex = stack.pop() # LIFO: take from top
if vertex in visited:
continue # Skip already-processed vertices
visited.add(vertex)
order.append(vertex)
# Add neighbors in reverse order for consistent left-to-right traversal
for neighbor in reversed(graph[vertex]):
if neighbor not in visited:
stack.append(neighbor)
return order
DFS Timestamps
Timestamps give each vertex two values:
- Discovery time (d[v]): When vertex was first visited
- Finish time (f[v]): When all neighbors were explored (vertex "closed")
Example
def dfs_with_timestamps(graph):
"""
DFS with discovery and finish timestamps.
Used for: cycle detection, topological sort, SCC detection.
"""
n = len(graph)
color = {v: 'WHITE' for v in graph} # WHITE=unvisited, GRAY=in progress, BLACK=done
d = {} # Discovery time
f = {} # Finish time
time = [0]
def dfs_visit(u):
color[u] = 'GRAY' # Discovered
time[0] += 1
d[u] = time[0] # Record discovery time
for v in graph[u]:
if color[v] == 'WHITE':
dfs_visit(v)
elif color[v] == 'GRAY':
print(f"Back edge {u}→{v}: cycle detected!")
color[u] = 'BLACK' # Finished
time[0] += 1
f[u] = time[0] # Record finish time
for u in graph:
if color[u] == 'WHITE':
dfs_visit(u)
return d, f
Cycle Detection
Undirected Graph — Any Back Edge = Cycle
Example
def has_cycle_undirected(graph):
"""
Detect cycle in undirected graph using DFS.
A cycle exists if we encounter an already-visited vertex
that is not the parent of the current vertex.
"""
visited = set()
def dfs(v, parent):
visited.add(v)
for neighbor in graph[v]:
if neighbor not in visited:
if dfs(neighbor, v):
return True
elif neighbor != parent:
# Found visited vertex that is NOT our parent → back edge → cycle
return True
return False
# Check all components
for v in graph:
if v not in visited:
if dfs(v, -1):
return True
return False
g1 = {0:[1,2], 1:[0,2], 2:[0,1]} # Triangle — has cycle
g2 = {0:[1], 1:[0,2], 2:[1]} # Path — no cycle
print(has_cycle_undirected(g1)) # True
print(has_cycle_undirected(g2)) # False
Directed Graph — Gray (In-Progress) Vertices = Cycle
Example
def has_cycle_directed(graph):
"""
Detect cycle in directed graph.
A cycle exists if we find an edge to a GRAY (in-progress) vertex.
"""
WHITE, GRAY, BLACK = 0, 1, 2
color = {v: WHITE for v in graph}
def dfs(v):
color[v] = GRAY # Mark as being processed
for neighbor in graph[v]:
if color[neighbor] == GRAY:
return True # Back edge to in-progress vertex → cycle!
if color[neighbor] == WHITE:
if dfs(neighbor):
return True
color[v] = BLACK # Mark as fully processed
return False
for v in graph:
if color[v] == WHITE:
if dfs(v):
return True
return False
# DAG — no cycle
dag = {'A':['B','C'], 'B':['D'], 'C':['D'], 'D':[]}
print(has_cycle_directed(dag)) # False
# Graph with cycle: A→B→C→A
cycle_g = {'A':['B'], 'B':['C'], 'C':['A']}
print(has_cycle_directed(cycle_g)) # True
DFS for Flood Fill / Island Problems
Example
def count_islands(grid):
"""
Count connected islands (1s) in a 2D grid.
DFS from each unvisited land cell, marks entire island.
Time: O(m×n), Space: O(m×n) stack.
"""
m, n = len(grid), len(grid[0])
visited = [[False]*n for _ in range(m)]
count = 0
def dfs(r, c):
if r < 0 or r >= m or c < 0 or c >= n: return
if visited[r][c] or grid[r][c] == '0': return
visited[r][c] = True
dfs(r+1,c); dfs(r-1,c); dfs(r,c+1); dfs(r,c-1)
for r in range(m):
for c in range(n):
if not visited[r][c] and grid[r][c] == '1':
dfs(r, c)
count += 1
return count
grid = [
["1","1","0","0","0"],
["1","1","0","0","0"],
["0","0","1","0","0"],
["0","0","0","1","1"]
]
print(count_islands(grid)) # 3
Finding All Paths
Example
def find_all_paths(graph, source, target):
"""Find all paths from source to target using DFS."""
all_paths = []
def dfs(node, path):
if node == target:
all_paths.append(list(path))
return
for neighbor in graph[node]:
if neighbor not in path: # Avoid cycles
path.append(neighbor)
dfs(neighbor, path)
path.pop() # Backtrack
dfs(source, [source])
return all_paths
graph = {0:[1,2], 1:[3], 2:[3], 3:[]}
print(find_all_paths(graph, 0, 3)) # [[0,1,3],[0,2,3]]
Finding Articulation Points (Cut Vertices)
An articulation point is a vertex whose removal increases the number of connected components.
Example
def find_articulation_points(graph, n):
"""
Find all articulation points using Tarjan's DFS.
disc[v] = discovery time
low[v] = lowest discovery reachable via DFS subtree
"""
disc = [-1] * n
low = [-1] * n
parent = [-1] * n
ap = set()
timer = [0]
def dfs(u):
disc[u] = low[u] = timer[0]
timer[0] += 1
child_count = 0
for v in graph[u]:
if disc[v] == -1: # v not visited
child_count += 1
parent[v] = u
dfs(v)
low[u] = min(low[u], low[v])
# Root AP: has >= 2 children in DFS tree
if parent[u] == -1 and child_count > 1:
ap.add(u)
# Non-root AP: low[v] >= disc[u] means v can't reach ancestor of u
if parent[u] != -1 and low[v] >= disc[u]:
ap.add(u)
elif v != parent[u]:
low[u] = min(low[u], disc[v])
for i in range(n):
if disc[i] == -1:
dfs(i)
return ap
BFS vs DFS — When to Use Which
| Use BFS When | Use DFS When |
|---|---|
| Shortest path (unweighted) | Cycle detection |
| Level-by-level traversal | Topological sort |
| Find nearest node | Finding all paths |
| Bipartite check | Strongly connected components |
| Multi-source spread | Maze exploration (backtracking) |
| "Minimum hops" problems | "All possible configurations" |
Complexity
| Aspect | Recursive DFS | Iterative DFS |
|---|---|---|
| Time | O(V + E) | O(V + E) |
| Space | O(V) call stack | O(V) explicit stack |
| Stack overflow risk | Yes (deep recursion) | No |
| Order consistency | Natural left-to-right | Depends on push order |
Summary
DFS explores as deep as possible before backtracking. Use a stack (or recursion):
- Recursive: Cleaner code, risk of stack overflow for very deep graphs
- Iterative: No overflow risk, slightly more complex code
Key applications:
- Cycle detection: Gray vertices (in-progress) in directed graphs
- Connected components: Start DFS from each unvisited vertex
- Flood fill: DFS/BFS on 2D grids
- All paths: Backtracking with DFS
- Topological sort: Process vertices in reverse finish order (next lesson)
*Next Lesson: Dijkstra's Algorithm*
Exam Focus
Revise definitions, diagrams, examples, and short-answer points for DFS Algorithm — Depth-First Search with Cycle Detection and All Applications.
Interview Use
Prepare one clear explanation, one practical example, and one common mistake for this Data Structures & Algorithms topic.
Search Terms
data-structures-algorithms, data structures & algorithms, data, structures, algorithms, graphs, dfs, algorithm
Related Data Structures & Algorithms Topics
Continue learning this concept
GraphsBellman-Ford Algorithm — Shortest Path with Negative Weights and Cycle DetectionMaster Bellman-Ford algorithm completely — why it handles negative weights where Dijkstra fails, the V-1 relaxation rounds, negative cycle detection, SPFA optimization, comparison with Dijkstra, and applications in currency arbitrage and network routing protocols.GraphsBFS Algorithm — Breadth-First Search with All Applications and VariantsMaster Breadth-First Search completely — the level-by-level exploration strategy, complete implementation with queue, BFS tree and shortest path guarantee, detecting bipartite graphs, multi-source BFS, 0-1 BFS, BFS on grids, and all classic BFS interview problems.GraphsDijkstraMaster DijkstraGraphsFloyd-Warshall Algorithm — All-Pairs Shortest Paths with Complete AnalysisMaster Floyd-Warshall algorithm completely — the all-pairs shortest path approach, the DP recurrence, step-by-step table filling, path reconstruction, negative cycle detection, transitive closure, and comparison with running Dijkstra V times.GraphsKruskalMaster KruskalGraphsPrimMaster Prim