Back to News

The Soapbox

My daily column. Where machines learn to speak, policy fails to keep up, and everything else gets the treatment it deserves.

status: Growing

Status Indicator

The status indicator reflects the maturity of the content: • rough — Initial thoughts, unstructured • growing — Being actively developed • evergreen — Stable, well-developed content • withered — No longer being maintained This helps readers understand the completeness of the content.

·
certainty: likely

Confidence Rating

The confidence tag expresses how well-supported the content is, or how likely its overall ideas are right. This uses a scale from "impossible" to "certain", based on the Kesselman List of Estimative Words: 1. "certain" 2. "highly likely" 3. "likely" 4. "possible" 5. "unlikely" 6. "highly unlikely" 7. "remote" 8. "impossible" Even ideas that seem unlikely may be worth exploring if their potential impact is significant enough.

·
importance: 8/10

Importance Rating

The importance rating distinguishes between trivial topics and those which might change your life. Using a scale from 0-10, content is ranked based on its potential impact on: - the reader - the intended audience - the world at large For example, topics about fundamental research or transformative technologies would rank 9-10, while personal reflections or minor experiments might rank 0-1.

December 2026
posted on 12.06.2026

Gemini 1

Overview

The first Gemini model from Google DeepMind, merging strengths from AlphaCode, Pathways, and large-scale training.

Background

This section provides context and background information about Gemini 1.

Key Details

Important details and specifics about this development.

Significance

Why this development is important in the broader context of AI and technology.

Timeline

Date: December 5, 2023

Links to related articles, papers, or announcements.

Tags

  • Google
  • DeepMind
  • Gemini 1
No reactions yet
November 2026
posted on 11.06.2026

GPT-4 Turbo

Overview

An optimized and cost-efficient variant of GPT-4 powering ChatGPT with custom GPTs, tools, and longer context.

Background

This section provides context and background information about GPT-4 Turbo.

Key Details

Important details and specifics about this development.

Significance

Why this development is important in the broader context of AI and technology.

Timeline

Date: November 5, 2023

Links to related articles, papers, or announcements.

Tags

  • OpenAI
  • GPT-4 Turbo
  • ChatGPT
No reactions yet
July 2026
posted on 07.11.2026

Claude 2

Overview

An improved Claude model with stronger reasoning, fewer hallucinations, and increased openness for public use.

Background

This section provides context and background information about Claude 2.

Key Details

Important details and specifics about this development.

Significance

Why this development is important in the broader context of AI and technology.

Timeline

Date: July 10, 2023

Links to related articles, papers, or announcements.

Tags

  • Anthropic
  • Claude 2
  • LLM
No reactions yet
June 2026
posted on 06.11.2026

GPT-1

Overview

OpenAI's first generative pre-trained transformer model, laying the foundation for large language models.

Background

This section provides context and background information about GPT-1.

Key Details

Important details and specifics about this development.

Significance

Why this development is important in the broader context of AI and technology.

Timeline

Date: June 10, 2018

Links to related articles, papers, or announcements.

Tags

  • OpenAI
  • GPT
  • LLM
No reactions yet
June 2026
posted on 06.11.2026

GPT-3

Overview

The 175B parameter model that revolutionized natural language interfaces and powered the first wave of AI API tools.

Background

This section provides context and background information about GPT-3.

Key Details

Important details and specifics about this development.

Significance

Why this development is important in the broader context of AI and technology.

Timeline

Date: June 10, 2020

Links to related articles, papers, or announcements.

Tags

  • OpenAI
  • GPT-3
  • API
No reactions yet
June 2026
posted on 06.01.2026

The Illusion of Thinking

The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem ComplexityBrydon Eastman, Chen Huang, Skyler Seto, Hadi Pouransari, Mehrdad Farajtabar, Raviteja Vemulapalli, Fartash Faghri, Oncel Tuzel, Barry-John Theobald, Josh SusskindJul 18, 2025

The Illusion of Thinking was released by Apple Machine Learning Research Lab on [insert date here)/()link wo wiki

No reactions yet
May 2026
posted on 05.11.2026

The AI Funding Bubble Nobody Wants to Name

Every week another AI startup raises a Series B on vibes and a demo that crashes if you sneeze near it. The valuations are untethered from revenue in a way that would make 1999 blush. I'm not saying the technology isn't real — it is — but the gap between what these models can do and what these companies are promising is a canyon you could lose a pension fund in.

The tell is always the same: when the press release says "enterprise-ready" but the API docs say "beta."

No reactions yet
March 2026
posted on 03.14.2026

GPT-4

Overview

A multimodal leap forward for OpenAI, capable of reasoning over images and text with more nuanced capabilities.

Background

This section provides context and background information about GPT-4.

Key Details

Important details and specifics about this development.

Significance

Why this development is important in the broader context of AI and technology.

Timeline

Date: March 13, 2023

Links to related articles, papers, or announcements.

Tags

  • OpenAI
  • GPT-4
  • Multimodal
No reactions yet
March 2026
posted on 03.04.2026

Claude 3 Family

Overview

Anthropic launched Haiku, Sonnet, and Opus under the Claude 3 family, offering powerful capabilities across tasks.

Background

This section provides context and background information about Claude 3 Family.

Key Details

Important details and specifics about this development.

Significance

Why this development is important in the broader context of AI and technology.

Timeline

Date: March 3, 2024

Links to related articles, papers, or announcements.

Tags

  • Anthropic
  • Claude 3
  • Sonnet
  • Opus
  • Haiku
No reactions yet
February 2026
posted on 02.18.2026

Gemini 1.5 Pro Announced

Gemini 1.5 Pro released this week with the promise.

"The model delivers dramatically enhanced performance, with a breakthrough in long-context understanding across modalities."

It was designed to be a mid-size multi modal model that matches the performance of 1.0 Ultra (their largest model) while simultaneously managing to use less compute than the prized heifer. 1.5 uses a transformer, and mixture of experts architecture. MoE allows the model to be split into smaller "expert" narrow llms rather than the traditional monolith neural net. Meaning for any given input, only relevant expert pathways active, leading to more effective training and inference.

The defining feature of 1.5 Pro is still it's context window however.

MetricValue
Standard context window128,000 tokens
Max context window (preview)1 million tokens
Tested in research up to10 million tokens

A context window of 1 million tokens is equivalent to 1 hour of video, 11 hours of audio, >30K lines of code, >700K words.

The defining feature of 1.5 Pro is its context window:

MetricValue
Standard context window128,000 tokens
Max context window (preview)1 million tokens
Tested in research up to10 million tokens

What 1 million tokens can hold:

  • 1 hour of video
  • 11 hours of audio
  • 30,000+ lines of code
  • 700,000+ words
No reactions yet
February 2026
posted on 02.15.2026

Gemini 1.5

Overview

Gemini 1.5 Pro featured industry-leading long-context capabilities, enabling advanced reasoning over vast documents.

Background

This section provides context and background information about Gemini 1.5.

Key Details

Important details and specifics about this development.

Significance

Why this development is important in the broader context of AI and technology.

Timeline

Date: February 14, 2024

Links to related articles, papers, or announcements.

Tags

  • Google
  • DeepMind
  • Gemini 1.5 Pro
  • Long Context
No reactions yet
February 2026
posted on 02.14.2026

GPT-2

Overview

GPT-2 demonstrated surprisingly coherent text generation, sparking debate over AI safety and open-sourcing.

Background

This section provides context and background information about GPT-2.

Key Details

Important details and specifics about this development.

Significance

Why this development is important in the broader context of AI and technology.

Timeline

Date: February 13, 2019

Links to related articles, papers, or announcements.

Tags

  • OpenAI
  • GPT-2
  • Text Generation
No reactions yet

About The Soapbox

I don't have sources. I have tabs. Forty of them, open since Tuesday, half of them arxiv papers and half of them someone being wrong on the internet. This is my daily column. I write it because silence is complicity and because I woke up with something to say. If you agree with everything here, one of us isn't thinking hard enough.


2026.11.15 14:43:29 in Naperville, IL
Last visitor from Mitaka, Japan
⌘K