The pattern repeats for a century: something engineers designed by hand becomes something the network learns. The last row is different in kind. The architecture has largely converged (a vision encoder plus a small language decoder), and the progress is now in how the training data and rewards are built. Hover a row to light its stops; click to jump there.
When
Papers
Hand-built step removed
Replaced by
1980 to 98Neocognitron, LeCun 1989, LeNet-5Hand-designed featuresConvolutions learned by backprop
2006CTCFrame-level alignment labelsA loss summed over all alignments
1995 / 2018Tesseract, Tesseract 4Closed engines; per-character classifiersOpen-source OCR; an LSTM line reader
2014Synth90k / SynthTextExpensive human labelsMillions of rendered words
2015CRNNCharacter segmentationCNN + BiLSTM + CTC on whole lines
2017 to 20EAST, CRAFT, DBNetMulti-stage detection, fixed thresholdsDense maps with a learned threshold
2015 to 20STN, Transformer, ViTFixed geometry, recurrence, convolutionsLearned warps; attention for everything
2017 to 22im2latex, PubTabNet, TableFormerMaths grammars, table heuristicsImage-to-markup and structure decoders
2020LayoutLMLayout rules and templates2-D position inside the language model
2022 to 24Donut, Nougat, GOTThe OCR engine itselfImage-to-sequence generation
2025 to 26olmOCR 2, PaddleOCR-VL, OvisOCR3Supervised-only trainingData engines, distillation and RL