Questions tagged [precision]
11 questions
2
votes
0 answers
Training tricks to improve stability of mixed precision
I would love to be able to use automatic mixed precision more extensively in my training, but I find that it is too unstable and often ends in NaNs. Are there any general tricks in training that people here have used to improve stability?
I've seen…
Luke
- 21
- 2
2
votes
2 answers
Is it possible that every class has a higher recall than precision for multi-class classification?
I am a student learning machine learning recently, and one thing is keep confusing me, I tried multiple sources and failed to find the related answer.
As following table shows (this is from some paper):
Is it possible that every class has a higher…
Cheleeger Ken
- 73
- 5
1
vote
1 answer
High precision and low recall results. What does it mean?
I am working on a classification algorithm for brain rhythms. However, when I implemented the metrics for precision, accuracy, F1 score and recall. My results show that my algorithm has a high precision but a low recall.
I am not expert on this kind…
GGChe
- 23
- 5
1
vote
1 answer
Why doesn't the high precision of neural network weights improve accuracy?
Consider the following paragraph from the subsubsection 3.5.2: A dtype for every occasion chapter named It starts with a tensor from the textbook titled Deep Learning with PyTorch by Eli Stevens et al.
As we will see in future chapters,…
hanugm
- 3,571
- 3
- 18
- 50
1
vote
2 answers
What is meant by a "relevant document" in NLP?
In natural language processing, I came across the concept of "relevant document" several times. And several analytical formulas, such as precision, recall are based on the relevant documents.
Precision = $\dfrac{\text{Number of documents that are…
hanugm
- 3,571
- 3
- 18
- 50
1
vote
1 answer
Is my understanding of confidence (precision) correct?
I'm attempting to develop a genetic algorithm capable of discovering classification rules for a given data set, a number of papers make use of the confidence (precision) and coverage of a rule to define its fitness. In particular, I've been…
Astronought
- 179
- 3
1
vote
1 answer
Given the precision and recall of this model, what can I say about it?
The following table shows the precision and recall values I obtained for three object detection models.
The goal is to find the best object detection model for that particular data set.
I evaluate the first two models as the following.
Model 1 has…
Nilani Algiriyage
- 155
- 5
1
vote
1 answer
How to calculate the precision and recall given the predictions and targets in this case?
I'm using three pre-trained deep learning models to detect vehicles and count from an image data set. The vehicles belong to one of these classes ['car', 'truck', 'motorcycle', 'bus']. So, for a sample I have manually counted number of vehicles in…
Nilani Algiriyage
- 155
- 5
0
votes
2 answers
What does a value of -1.000 mean in MS COCO Metrics for Object Detection
I am training some Object-Detection-Models from the TensorFlow Object Detection API and got from the evaluation with MS COCO metrics the following results for Average Precision:
IoU = 0.5;0.9
maxDets = 100
area = small
AP = -1.000
The other values…
0
votes
2 answers
What is Precision@K for link prediction in graph embedding meaning?
I am trying to re-implement the SDNE algorithm for graph embedding by PyTorch.
I get stuck at some issues about evaluation metric Precision@K.
precision@k is a metric which gives equal weight to the returned instance. It is defined as…
Truong Hoang
- 27
- 6
-1
votes
1 answer
Equations for computing true positives and false positives when using object detection algorithms?
I am running some evaluation metrics using the YOLOv5 object detection algorithm, and wish to calculate my true positives and false positives. For instance, the evaluation metric outputs are as follows:
Class Images Labels Prec …
ihb
- 129
- 1
- 10