Questions tagged [flops]

I understand that FLOPS means floating-point operations per second, and throughput is the number of inputs (for example, images) per second. If a model has higher FLOPS, it means it performs faster. However, in the article Container: Context…

I have an input tensor of shape $\mathbf{(3, 32, 32)}$ consisting of 3 channels, 16 rows, and 16 columns. I want to convolve the input tensor using $\mathbf{(3 \times 3)}$ kernel/filter. How can I calculate the required FLOPs?

I am trying to find estimates of the typical FLOPs required for training a modern model. The FLOPs used for inference are widely reported and cluster around $10^6$ - $10^7$ for many large models. However, I cannot find equivalent stats for training;…