2

I am trying to do 3d image deconvolution using convolution neural network. But I cannot find many famous CNNs that perform a 3d convolution. Can anyone point out some for me?

Background: I am using PyTorch, but any language is OK. What I want to know most is the network structure. I can't find papers on this topic.

Links to research papers would be especially appreciated.

nbro
  • 39,006
  • 12
  • 98
  • 176
Kicr
  • 23
  • 5
  • See [Learning Descriptor Networks for 3D Shape Synthesis and Analysis](https://arxiv.org/abs/1804.00586). – Kicr Apr 12 '18 at 03:54

1 Answers1

1

There are many approaches for training CNN on 3d data, but the decision to use a particular architecture is heavily dependant upon the format of your dataset.

If you are using 3d point cloud data, I would suggest you go through PointNet and PointCNN.

But training a CNN on 3d point clouds is very tough.

There is also a way to train CNNs by posing the 3d structure from different viewpoints (Multiview CNNs).

But remember that training CNN on 3d data is really a tough task.

If you plan to use a voxelized input data format, I suggest going through VoxelNet.

Since you are mentioning deconvolution, the most relevant paper I can come across is 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation.

But deconvolution in its own right is a very expensive operation, which acting on 3d data makes it very hard, so I would suggest you check for alternate methods.

nbro
  • 39,006
  • 12
  • 98
  • 176
  • Thanks! And for the last sentence, I understand the 3d convolution is a memory consuming operation. Is it because of that that you say it is hard. And also what is the alternate methods except optimization methods like RLTV and etc. ? Thanks again – Kicr May 30 '18 at 12:59
  • yes , deconvolution is more consuming than convolution due to upsampling involved in it . regarding optimization methods i don't know much. PS: can you expand RLTV so that i can check? – thecomplexitytheorist May 30 '18 at 17:02
  • why is it difficult to learn on from 3D data? – Charlie Parker Aug 14 '19 at 19:47