Questions tagged [instance-segmentation]

For questions about instance segmentation, which is the task of detecting and delineating each distinct object of interest appearing in an image (even the ones belong to the same class). Instance segmentation is different from semantic segmentation, where objects that belong to the same class are not differentiated. Collectively, instance and semantic segmentation fall into the category of image segmentation.

10 questions
3
votes
3 answers

If I trained a model to perform semantic segmentation on images with only one object, would it also work on images with multiple objects?

I'm working on semantic segmentation tasks in the medical space using the U-Net. Let's say that I train a U-Net model on medical images with the goal of segmenting out, say, ligaments, from a medical image. If I train that model on images that…
2
votes
1 answer

Is it possible to pre-train a CNN in a self-supervised way so that it can later be used to solve an instance segmentation task?

I would like to use self-supervised learning (SSL) to learn features from images (the dataset consists of similar images with small differences), then use the resulting trained model to bootstrap an instance segmentation task. I am thinking about…
1
vote
1 answer

Mask R-CNN: How are the computed masks projected back to the input image?

The computed masks by Mask R-CNN are of fixed size $m \times m$ each. How are they projected back to the image?
1
vote
0 answers

Mask R-CNN: how is the inference done?

According to the Mask R-CNN paper and the picture below (taken from the paper), the mask branch is computed in parallel with the bbox classification and regression branches. However in the paper they write that inference is done differently from…
1
vote
2 answers

Image segmentation when given masking information is incomplete

In my problem, there are about 5,000 training images and there are about 50~100 objects of identical type (or class) on average, per image. And for each training images, there is a partial mask information that denotes the polygon vertices of…
0
votes
1 answer

What is Panoptic Segmentation?

In computer vision what is Panoptic Segmentation about? How it relates to Semantic Segmentation? and how it compares to Instance Segmentation?
0
votes
0 answers

How to use UPSNet or Mask-RCNN? How to format image data for panoptic segmentation?

I want to use UPSNet (github repo) (paper) to train a model to perform panoptic segmentation on my own dataset. I would also consider using a model based on Mask-RCNN to simply perform instance segmentation. These models are typically ran on…
0
votes
0 answers

Should the number of training iterations of an instance segmentation model depend on the number of instances in the training dataset?

I need to train instance segmentation models on several different datasets. The datasets vary widely in how many instances each image contains. For example: Dataset 1: 100 images, each image has about 0 or 1 instances Dataset 2: 100 images, each…
jkelle
  • 1
  • 1
0
votes
1 answer

Why instance segmentation architectures using reconstruction masks but not regression?

I'm wondering why many model architectures use binary mask reconstruction for segmentational CNNs, and not regression of mask polygon coordinates? Many object detectors use regression to find coordinates of bounding boxes.
0
votes
1 answer

How to divide a segmented image into classes instances?

Is there a method/algorithm to generate instances of objects from image that was segmented by the use of any image segmentation models? For example, I have an image with one class and it was segmented in a given way, where 1s are objects of the same…