Why CNNs Fit Images
Encode locality and translation assumptions
An inductive bias is an architectural assumption that helps a model generalize. CNNs assume nearby pixels interact strongly and the same local pattern matters across positions. Weight sharing gives far fewer parameters than connecting every pixel independently to every hidden unit.
CNNs excel at grid-like data and remain important for vision. Their locality can make long-range global relationships harder, and ordinary convolution is only approximately robust to translation; rotation, scale, and viewpoint changes need data augmentation or suitable architecture.
dense layer: separate weights for every pixel-to-unit connection
convolution: one small kernel reused across all positions
Tip: Reach for CNN intuition whenever local patterns repeat across a grid: images, spectrograms, some sensor layouts. Do not force every table or sequence into an image-shaped assumption.
Analogy: A spell-check rule for a three-letter pattern can scan every position in a page. It does not need a separate copy of the rule for the top-left and bottom-right corners.