Error Types Breakdown
For use cases with complex data and error types (e.g. Named Entity Recognition, Object Detection or Semantic Segmentation), the Error Types Chart gives you an insight into exactly how the Ground Truth differed from your model's predictions. It allows you to get a sense of what types of mistakes your model is making, with what frequency and, in the case of Object Detection, what impact these errors had on your overall performance metric.
How does this work?
For Named Entity Recognition, Galileo surfaces Ghost Spans, Span Shifts, Missed Spans or Wrong Tag Errors.
For Object Detection, Galileo leverages the TIDE framework to find associations between Ground Truth and Predicted objects and break differences between the two into one of: Localization, Classification, Background, Missed, Duplicates or Localization and Classification mistakes. See a thorough write-up of how that's done and the definition of each error type here.
How should I leverage this chart?
Click on an error type to filter the dataset to samples with that error type. From there, you can inspect your erroneous samples and fix them.
One common flow we see is selecting Ghost Spans (NER) or Background Confusion Errors (Obj. Detection) combined with a high DEP filter can be used to surface Missed Annotations from your labelers. You can send these samples to your labeling tool or fix them with the Galileo console.
Last updated
