मुख्य सामग्री पर जाएँ
एआई एटलस

अर्थपूर्ण विभाजन

हर पिक्सेल को रंगना — वस्तु के चारों ओर बॉक्स नहीं, रंग भरने वाली किताब

05 कंप्यूटर विज़नमध्यवर्तीइस क्षेत्र की प्रविष्टि 5

यह पृष्ठ अंग्रेज़ी में प्रस्तुत है; शीर्षक और सारांश का स्थानीयकरण किया गया है।

परिभाषा

Semantic segmentation assigns a class label to every pixel, producing a label map the same size as the input. It answers “what does each pixel belong to,” yielding precise outlines rather than coarse rectangles.

सहज समझ

Detection draws a rectangle saying “there’s a cat”; segmentation traces the cat’s every contour. If detection is drawing boxes on a photo, segmentation is a colouring book: every pixel must decide which colour it belongs to.

चित्र 1

The taxonomy of segmentation: whether same-class instances are separated divides semantic, instance and panoptic segmentation

Image segmentationImage segmentationSemantic segmentationSemantic segmentationOne class per pixelOne class per pixelSame-class instances mergedSame-class instances mergedInstance segmentationInstance segmentationSeparates individuals of the same classSeparates individuals of the…Usually built on detectionUsually built on detectionPanoptic segmentationPanoptic segmentationCountable objects by instanceCountable objects by instanceBackground regions by classBackground regions by class
चित्र 2

mIoU progression on PASCAL VOC 2012: from the fully convolutional FCN to dilated convolution and encoder-decoder designs

कार्यप्रणाली

  1. 01

    Where the three segmentations diverge

    Semantic segmentation labels only the class (all “people” share one colour); instance segmentation additionally separates individuals (person A differs from person B); panoptic segmentation unifies the two — countable objects by instance, background by class.

  2. 02

    Fully convolutional networks and upsampling

    Replacing the classifier’s fully connected tail with convolutions keeps the spatial structure; transposed convolution or interpolation then restores the original resolution. Segmentation thus becomes pixel-wise classification instead of image-level classification.

  3. 03

    U-Net and its skip connections

    The encoder downsamples to gain semantics, the decoder upsamples to restore detail, and skip connections wire the shallow, high-resolution encoder features straight into the matching decoder layers, recovering the boundary information lost to downsampling — decisive in label-scarce medical segmentation.

  4. 04

    Mask R-CNN: detection plus a mask branch

    Mask R-CNN adds a parallel pixel-wise mask branch to Faster R-CNN, emitting a binary mask per proposal and thereby achieving instance segmentation — an elegant extension of the detection framework.

मुख्य सूत्र

IoU = |A ∩ B| / |A ∪ B| , mIoU = mean over classes
IoU measures the overlap between predicted and ground-truth regions; mIoU averages it over all classes and is the primary segmentation metric.
चित्र 3

The symmetric structure of U-Net: the encoder downsamples, the decoder upsamples, and skip connections join features of equal resolution across the two

Skip connections are what let U-Net beat a plain encoder-decoder on boundary detail.

उपयोग के क्षेत्र

  • Medical imaging: outlining organs and lesions
  • Autonomous driving: drivable-area and lane segmentation
  • Remote-sensing mapping: land-cover classification
  • Image editing: matting, background replacement and portrait segmentation

सामान्य भ्रांतियाँ

  • Semantic segmentation does not separate instances of the same class. Two adjacent people form one “person” region; separating them requires instance segmentation.
  • Pixel accuracy is dominated by background. When sky fills most of the frame, predicting sky everywhere scores highly — which is why mIoU is preferred over pixel accuracy.
  • Boundaries are always the hardest part. More downsampling sharpens semantics but blurs edges, so upsampling and skip connections constantly trade semantics against detail.

मुख्य शब्द

Semantic / instance / panoptic
Class → class + instance → the two unified
Transposed convolution
An upsampling operation common in segmentation decoders
Skip connection
Routing shallow high-resolution features into deep layers to preserve boundaries
mIoU
The mean of per-class IoU, the primary segmentation metric

आगे का पठन