# big-o notation

Published articles for big-o notation.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Software Performance Begins with Time Complexity and Memory

DevFeed: [Software Performance Begins with Time Complexity and Memory](<https://devfeed.tech/articles/software-performance-begins-with-time-complexity-and-memory-39767.md>)

Original publisher: [Read original article](<https://furkankolcu.com/post/software-performance-begins-with-time-complexity-and-memory>)

Author: Furkan Kolcu

Published: 2025-09-10T17:39:37Z

Content type: tutorial

Language: en

Sources: [Furkan Kolcu - Software Engineer Blog](<https://devfeed.tech/sources/furkan-kolcu-software-engineer-blog.md>)

Topics: [Software](<https://devfeed.tech/topics/software.md>), [Algorithms, Complexity](<https://devfeed.tech/topics/algorithms-complexity.md>), [Scalability](<https://devfeed.tech/topics/scalability.md>), [Programming](<https://devfeed.tech/topics/programming.md>), [Data structures](<https://devfeed.tech/topics/data-structures.md>), [Go](<https://devfeed.tech/topics/go.md>), [C](<https://devfeed.tech/topics/c.md>)

Tags: [big-o-notation](<https://devfeed.tech/tags/big-o-notation.md>), [binary-search](<https://devfeed.tech/tags/binary-search.md>), [c](<https://devfeed.tech/tags/c.md>), [complexity](<https://devfeed.tech/tags/complexity.md>), [go](<https://devfeed.tech/tags/go.md>), [memory](<https://devfeed.tech/tags/memory.md>), [performance](<https://devfeed.tech/tags/performance.md>), [scalability](<https://devfeed.tech/tags/scalability.md>), [software-engineering](<https://devfeed.tech/tags/software-engineering.md>), [sorting](<https://devfeed.tech/tags/sorting.md>), [space-complexity](<https://devfeed.tech/tags/space-complexity.md>), [technology](<https://devfeed.tech/tags/technology.md>), [time-complexity](<https://devfeed.tech/tags/time-complexity.md>)

### AI overview

This tutorial explains how time complexity and memory usage affect application performance as input size, system scale, and traffic increase. It introduces Big O notation, compares common complexity classes, and discusses trade-offs involving algorithms, data structures, and memory, with examples in Go and C.

### Source excerpt

Memory usage and time complexity shape the performance of every application. This post explains why they matter, how they affect scalability, and how to think about the trade-offs behind every decision.

## Zero-One Laws for Random Graphs

DevFeed: [Zero-One Laws for Random Graphs](<https://devfeed.tech/articles/zero-one-laws-for-random-graphs-40376.md>)

Original publisher: [Read original article](<https://www.jeremykun.com/2015/02/09/zero-one-laws-for-random-graphs/>)

Published: 2015-02-09T09:00:00Z

Content type: article

Language: en

Sources: [Jeremy Kun](<https://devfeed.tech/sources/jeremy-kun.md>)

Topics: [Graphs](<https://devfeed.tech/topics/graphs.md>), [Math and Logic](<https://devfeed.tech/topics/math-and-logic.md>)

Tags: [big-o-notation](<https://devfeed.tech/tags/big-o-notation.md>), [connectivity](<https://devfeed.tech/tags/connectivity.md>), [countability](<https://devfeed.tech/tags/countability.md>), [distribution](<https://devfeed.tech/tags/distribution.md>), [erdos-renyi](<https://devfeed.tech/tags/erdos-renyi.md>), [graphs](<https://devfeed.tech/tags/graphs.md>), [logic](<https://devfeed.tech/tags/logic.md>), [logical](<https://devfeed.tech/tags/logical.md>), [mathematics](<https://devfeed.tech/tags/mathematics.md>), [model-theory](<https://devfeed.tech/tags/model-theory.md>), [network-science](<https://devfeed.tech/tags/network-science.md>), [parameter](<https://devfeed.tech/tags/parameter.md>), [random-graph](<https://devfeed.tech/tags/random-graph.md>), [random-graphs](<https://devfeed.tech/tags/random-graphs.md>), [statement](<https://devfeed.tech/tags/statement.md>), [vertex](<https://devfeed.tech/tags/vertex.md>)

### AI overview

This article introduces zero-one laws for Erdős-Rényi random graphs. It explains that many graph properties, including properties expressible in first-order logic, have probabilities that tend toward zero or one as the graph grows, with behavior determined by relevant thresholds or constant edge probabilities.

### Source excerpt

Last time we saw a number of properties of graphs, such as connectivity, where the probability that an Erdős-Rényi random graph $ G(n,p)$ satisfies the property is asymptotically either zero or one. And this zero or one depends on whether the parameter $ p$ is above or below a universal threshold (that depends only on $ n$ and the property in question). To remind the reader, the Erdős-Rényi random "graph" $ G(n,p)$ is a distribution over graphs that you draw from by including each edge independently with probability $ p$.

## The Giant Component and Explosive Percolation

DevFeed: [The Giant Component and Explosive Percolation](<https://devfeed.tech/articles/the-giant-component-and-explosive-percolation-40375.md>)

Original publisher: [Read original article](<https://www.jeremykun.com/2015/02/02/the-giant-component-and-explosive-percolation/>)

Published: 2015-02-02T09:00:00Z

Content type: article

Language: en

Sources: [Jeremy Kun](<https://devfeed.tech/sources/jeremy-kun.md>)

Topics: [Graphs](<https://devfeed.tech/topics/graphs.md>), [Data analysis](<https://devfeed.tech/topics/data-analysis.md>)

Tags: [big-o-notation](<https://devfeed.tech/tags/big-o-notation.md>), [erdos-renyi](<https://devfeed.tech/tags/erdos-renyi.md>), [first-moment-method](<https://devfeed.tech/tags/first-moment-method.md>), [giant-component](<https://devfeed.tech/tags/giant-component.md>), [graph](<https://devfeed.tech/tags/graph.md>), [graphs](<https://devfeed.tech/tags/graphs.md>), [inequality](<https://devfeed.tech/tags/inequality.md>), [markov](<https://devfeed.tech/tags/markov.md>), [method-of-moments](<https://devfeed.tech/tags/method-of-moments.md>), [network-science](<https://devfeed.tech/tags/network-science.md>), [percolation](<https://devfeed.tech/tags/percolation.md>), [probability-theory](<https://devfeed.tech/tags/probability-theory.md>), [random-graph](<https://devfeed.tech/tags/random-graph.md>), [random-graphs](<https://devfeed.tech/tags/random-graphs.md>), [random-variables](<https://devfeed.tech/tags/random-variables.md>)

### AI overview

This article develops rigorous results about Erdős-Rényi random graphs, following a conjecture about connectivity at edge probability p = 5/n. It introduces threshold theorems and begins explaining the first moment method, Markov's inequality, and isolated vertices.

### Source excerpt

Last time we left off with a tantalizing conjecture: a random graph with edge probability $ p = 5/n$ is almost surely a connected graph. We arrived at that conjecture from some ad-hoc data analysis, so let's go back and treat it with some more rigorous mathematical techniques. As we do, we'll discover some very interesting "threshold theorems" that essentially say a random graph will either certainly have a property, or it will certainly not have it.

## The Two-Dimensional Fourier Transform and Digital Watermarking

DevFeed: [The Two-Dimensional Fourier Transform and Digital Watermarking](<https://devfeed.tech/articles/the-two-dimensional-fourier-transform-and-digital-watermarking-40336.md>)

Original publisher: [Read original article](<https://www.jeremykun.com/2013/12/30/the-two-dimensional-fourier-transform-and-digital-watermarking/>)

Published: 2013-12-30T19:24:05Z

Content type: tutorial

Language: en

Sources: [Jeremy Kun](<https://devfeed.tech/sources/jeremy-kun.md>)

Topics: [fourier transform](<https://devfeed.tech/topics/fourier-transform.md>), [watermarking](<https://devfeed.tech/topics/watermarking.md>), [Algorithm](<https://devfeed.tech/topics/algorithm.md>), [Code](<https://devfeed.tech/topics/code.md>)

Tags: [algorithm](<https://devfeed.tech/tags/algorithm.md>), [animations](<https://devfeed.tech/tags/animations.md>), [big-o-notation](<https://devfeed.tech/tags/big-o-notation.md>), [calculus](<https://devfeed.tech/tags/calculus.md>), [dimension](<https://devfeed.tech/tags/dimension.md>), [fft](<https://devfeed.tech/tags/fft.md>), [fourier-analysis](<https://devfeed.tech/tags/fourier-analysis.md>), [fourier-transform](<https://devfeed.tech/tags/fourier-transform.md>), [github](<https://devfeed.tech/tags/github.md>), [graphics](<https://devfeed.tech/tags/graphics.md>), [image-manipulation](<https://devfeed.tech/tags/image-manipulation.md>), [images](<https://devfeed.tech/tags/images.md>), [james-hance](<https://devfeed.tech/tags/james-hance.md>), [mathematics](<https://devfeed.tech/tags/mathematics.md>), [matrices](<https://devfeed.tech/tags/matrices.md>), [programming](<https://devfeed.tech/tags/programming.md>), [python](<https://devfeed.tech/tags/python.md>), [star-wars](<https://devfeed.tech/tags/star-wars.md>), [up](<https://devfeed.tech/tags/up.md>), [watermarking](<https://devfeed.tech/tags/watermarking.md>)

### AI overview

This tutorial introduces the multidimensional Fourier transform, explains its relationship to the one-dimensional transform, describes an FFT-style algorithm for computing it, and applies it to digitally watermarking images.

### Source excerpt

We've studied the Fourier transform quite a bit on this blog: with four primers and the Fast Fourier Transform algorithm under our belt, it's about time we opened up our eyes to higher dimensions. Indeed, in the decades since Cooley & Tukey's landmark paper, the most interesting applications of the discrete Fourier transform have occurred in dimensions greater than 1. But for all our work we haven't yet discussed what it means to take an "n-dimensional" Fourier transform.

## Optimism in the Face of Uncertainty: the UCB1 Algorithm

DevFeed: [Optimism in the Face of Uncertainty: the UCB1 Algorithm](<https://devfeed.tech/articles/optimism-in-the-face-of-uncertainty-the-ucb1-algorithm-40332.md>)

Original publisher: [Read original article](<https://www.jeremykun.com/2013/10/28/optimism-in-the-face-of-uncertainty-the-ucb1-algorithm/>)

Published: 2013-10-28T11:42:55Z

Content type: tutorial

Language: en

Sources: [Jeremy Kun](<https://devfeed.tech/sources/jeremy-kun.md>)

Topics: [Algorithm](<https://devfeed.tech/topics/algorithm.md>), [Mathematics](<https://devfeed.tech/topics/mathematics.md>), [Data Science](<https://devfeed.tech/topics/data-science.md>)

Tags: [algorithm](<https://devfeed.tech/tags/algorithm.md>), [bandit-learning](<https://devfeed.tech/tags/bandit-learning.md>), [bandits](<https://devfeed.tech/tags/bandits.md>), [big-o-notation](<https://devfeed.tech/tags/big-o-notation.md>), [calculus](<https://devfeed.tech/tags/calculus.md>), [confidence-bounds](<https://devfeed.tech/tags/confidence-bounds.md>), [exploitation](<https://devfeed.tech/tags/exploitation.md>), [exploration](<https://devfeed.tech/tags/exploration.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [mathematics](<https://devfeed.tech/tags/mathematics.md>), [programming](<https://devfeed.tech/tags/programming.md>), [python](<https://devfeed.tech/tags/python.md>), [random-variables](<https://devfeed.tech/tags/random-variables.md>), [randomized-algorithm](<https://devfeed.tech/tags/randomized-algorithm.md>), [science](<https://devfeed.tech/tags/science.md>)

### AI overview

This tutorial introduces the multi-armed bandit problem as a model of the exploration-exploitation tradeoff and presents the UCB1 algorithm, which the article describes as performing close to optimally.

### Source excerpt

startups The software world is always atwitter with predictions on the next big piece of technology. And a lot of chatter focuses on what venture capitalists express interest in. As an investor, how do you pick a good company to invest in? Do you notice quirky names like "Kaggle" and "Meebo," require deep technical abilities, or value a charismatic sales pitch? When it comes to innovation in software engineering and computer science, and that as a society we should value big pushes forward much more than we do.

## P vs. NP, A Primer (And a Proof Written in Racket)

DevFeed: [P vs. NP, A Primer (And a Proof Written in Racket)](<https://devfeed.tech/articles/p-vs-np-a-primer-and-a-proof-written-in-racket-40263.md>)

Original publisher: [Read original article](<https://www.jeremykun.com/2012/02/23/p-vs-np-a-primer-and-a-proof-written-in-racket/>)

Published: 2012-02-23T19:57:35Z

Content type: tutorial

Language: en

Sources: [Jeremy Kun](<https://devfeed.tech/sources/jeremy-kun.md>)

Topics: [Computing](<https://devfeed.tech/topics/computing.md>), [Algorithms, Complexity](<https://devfeed.tech/topics/algorithms-complexity.md>), [Racket](<https://devfeed.tech/topics/racket.md>), [Programming](<https://devfeed.tech/topics/programming.md>)

Tags: [algorithm](<https://devfeed.tech/tags/algorithm.md>), [algorithms](<https://devfeed.tech/tags/algorithms.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [big-o-notation](<https://devfeed.tech/tags/big-o-notation.md>), [class](<https://devfeed.tech/tags/class.md>), [computational-complexity](<https://devfeed.tech/tags/computational-complexity.md>), [computing](<https://devfeed.tech/tags/computing.md>), [decidability](<https://devfeed.tech/tags/decidability.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [fast](<https://devfeed.tech/tags/fast.md>), [halting-problem](<https://devfeed.tech/tags/halting-problem.md>), [input](<https://devfeed.tech/tags/input.md>), [language](<https://devfeed.tech/tags/language.md>), [machine](<https://devfeed.tech/tags/machine.md>), [np-completeness](<https://devfeed.tech/tags/np-completeness.md>), [p-versus-np](<https://devfeed.tech/tags/p-versus-np.md>), [primer](<https://devfeed.tech/tags/primer.md>), [racket](<https://devfeed.tech/tags/racket.md>), [solve](<https://devfeed.tech/tags/solve.md>), [theory](<https://devfeed.tech/tags/theory.md>), [turing-machine](<https://devfeed.tech/tags/turing-machine.md>), [turing-machines](<https://devfeed.tech/tags/turing-machines.md>)

### AI overview

A primer on the distinction between decidability and computational efficiency, introducing the complexity class P and its definition in terms of polynomial-time decision by a Turing machine. It also discusses efficient algorithms and gives a card-sorting example.

### Source excerpt

Decidability Versus Efficiency In the early days of computing theory, the important questions were primarily about decidability. What sorts of problems are beyond the power of a Turing machine to solve? As we saw in our last primer on Turing machines, the halting problem is such an example: it can never be solved a finite amount of time by a Turing machine. However, more recently (in the past half-century) the focus of computing theory has shifted away from possibility in favor of determining feasibility.

## Inner Product Spaces--A Primer

DevFeed: [Inner Product Spaces--A Primer](<https://devfeed.tech/articles/inner-product-spaces-a-primer-40231.md>)

Original publisher: [Read original article](<https://www.jeremykun.com/2011/07/25/inner-product-spaces-a-primer/>)

Published: 2011-07-25T00:29:00Z

Content type: tutorial

Language: en

Sources: [Jeremy Kun](<https://devfeed.tech/sources/jeremy-kun.md>)

Topics: [Mathematics](<https://devfeed.tech/topics/mathematics.md>), [Math and Logic](<https://devfeed.tech/topics/math-and-logic.md>), [Computing](<https://devfeed.tech/topics/computing.md>)

Tags: [big-o-notation](<https://devfeed.tech/tags/big-o-notation.md>), [eigenvectors](<https://devfeed.tech/tags/eigenvectors.md>), [inner-product](<https://devfeed.tech/tags/inner-product.md>), [mathematics](<https://devfeed.tech/tags/mathematics.md>), [matrices](<https://devfeed.tech/tags/matrices.md>), [orthogonality](<https://devfeed.tech/tags/orthogonality.md>), [symmetry](<https://devfeed.tech/tags/symmetry.md>), [vector-spaces](<https://devfeed.tech/tags/vector-spaces.md>), [vectors](<https://devfeed.tech/tags/vectors.md>)

### AI overview

This primer explains why vector spaces can be extended with a dot-product-like operation and defines inner products through conjugate symmetry, linearity, additivity, and positive definiteness. It introduces inner product spaces and discusses their connection to linear functionals.

### Source excerpt

Vector spaces alone are not enough to do a lot of the interesting things we'd like them to do. Since a vector space is a generalization of Euclidean space, it is natural for us to investigate more specific types of vector spaces which are more akin to Euclidean space. In particular, we want to include the notion of a dot product. By admitting additional structure to a vector space, we may perform more computations, and hopefully get more interesting results.

## Big-O Notation--A Primer

DevFeed: [Big-O Notation--A Primer](<https://devfeed.tech/articles/big-o-notation-a-primer-40201.md>)

Original publisher: [Read original article](<https://www.jeremykun.com/2011/06/14/big-o-notation-a-primer/>)

Published: 2011-06-14T16:26:27Z

Content type: tutorial

Language: en

Sources: [Jeremy Kun](<https://devfeed.tech/sources/jeremy-kun.md>)

Topics: [Algorithms, Complexity](<https://devfeed.tech/topics/algorithms-complexity.md>), [Algorithms](<https://devfeed.tech/topics/algorithms.md>), [Mathematics](<https://devfeed.tech/topics/mathematics.md>)

Tags: [algorithm](<https://devfeed.tech/tags/algorithm.md>), [algorithms](<https://devfeed.tech/tags/algorithms.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [big-o-notation](<https://devfeed.tech/tags/big-o-notation.md>), [big-theta-notation](<https://devfeed.tech/tags/big-theta-notation.md>), [complexity](<https://devfeed.tech/tags/complexity.md>), [computational-complexity](<https://devfeed.tech/tags/computational-complexity.md>), [example](<https://devfeed.tech/tags/example.md>), [limits](<https://devfeed.tech/tags/limits.md>), [mathematics](<https://devfeed.tech/tags/mathematics.md>), [measurement](<https://devfeed.tech/tags/measurement.md>), [primer](<https://devfeed.tech/tags/primer.md>), [real-analysis](<https://devfeed.tech/tags/real-analysis.md>), [time](<https://devfeed.tech/tags/time.md>)

### AI overview

This primer introduces Big-O notation as a way to describe an algorithm's runtime growth. It defines the notation mathematically and illustrates it with a list-summing algorithm characterized as O(n), while also distinguishing Big-Theta notation.

### Source excerpt

The Quest to Capture Speed Companies and researchers spend hundreds of millions of dollars for the fruits of their algorithms. Whether one is indexing websites on the internet for search, folding proteins, or figuring out which warehouse is the most cost-effective to ship a product from, improvements in algorithm speed save immense amounts of money. It's no surprise then, that a similarly immense amount of money has gone into the mathematics behind algorithm analysis.