detrex is a research platform for DETR-based object detection, segmentation, pose estimation and other visual recognition tasks.
APACHE-2.0 License
Bot releases are hidden (Show)
Support New Algorithms and Benchmarks, including:
dino-eva-01
and dino-eva-02
with LSJ augmentation.All the pretrained DINO-EVA checkpoints can be downloaded in Huggingface Space
Published by rentainhe over 1 year ago
DINO
with optimized hyper-parameters which achieves 50.0 AP
under 1x settings.InternImage
, ConvNeXt-1K pretrained
backbones.Deformable-DETR-R50
pretrained weights.DETA
and better H-DETR
pretrained weights: achieving 50.2 AP
and 49.1 AP
respectively.DETA-R50-5scale-12ep
bs=8: 50.0AP
DETA-R50-5scale-12ep
aligned hyper-param: 49.9AP
DETA-R50-5scale-12ep
with only freeze the stem of backbone: 50.2AP
H-Deformable-DETR-two-stage-R50-12ep
aligned optimizer hyper-params: 49.1AP
DINO-R50-4scale-12ep
aligned optimizer hyper-params: 49.4AP
DINO-Focal-3level-4scale-36ep
: 58.3AP
Benchmark ConvNeXt on DINO
52.4AP
54.2AP
55.1AP
55.5AP
Benchmark InternImage on DINO
52.3AP
53.5AP
54.7AP
57.0AP
Benchmark FocalNet on DINO
Other pre-trained weights
44.9 AP
(better than 44.5AP from original repo)Group-DETR-R50-12ep
: 37.8AP
Published by rentainhe over 1 year ago
New Algorithms
Anchor-DETR
DETA
More training techniques
EMAHook
during training by setting train.model_ema.enabled=True
, which can further enhance the model performance.train.amp.enabled=True
, which can reduce 20% to 30% GPU memory usage.train.fast_dev_run=True
.Release more than 10+ pretrained checkpoints
Method | Pretrained | Epochs | Box AP |
---|---|---|---|
DETR-R50-DC5 | IN1k | 500 | 43.4 |
DETR-R101-DC5 | IN1k | 500 | 44.9 |
Anchor-DETR-R50 | IN1k | 50 | 42.2 |
Anchor-DETR-R50-DC5 | IN1k | 50 | 44.2 |
Anchor-DETR-R101 | IN1k | 50 | 43.5 |
Anchor-DETR-R101-DC5 | IN1k | 50 | 45.1 |
Conditional-DETR-R50-DC5 | IN1k | 50 | 43.8 |
Conditional-DETR-R101 | IN1k | 50 | 43.0 |
Conditional-DETR-R101 -DC5 | IN1k | 50 | 45.1 |
DAB-DETR-R50-3patterns | IN1k | 50 | 42.8 |
DAB-DETR-R50-DC5 | IN1k | 50 | 44.6 |
DAB-DETR-R50-DC5-3patterns | IN1k | 50 | 45.7 |
DAB-DETR-101-DC5 | IN1k | 50 | 45.7 |
DN-DETR-R50-DC5 | IN1k | 50 | 46.3 |
DINO with EMA | IN1k | 12 | 49.4 |
DETA-R50-5scale | IN1k | 12 | 50.1 |
DETA-Swin-Large | object-365 | 24 | 62.9 |
Part of the pre-trained weights are converted from their official repo, and all the pre-trained weights can be downloaded in detrex Model Zoo
Published by rentainhe over 1 year ago
Res/Swin-DINO-5scale
, ViTDet-DINO
, FocalNet-DINO
, etc. #138, #155
All the pretrained weights can be downloaded in detrex Model Zoo
Method | Pretrained | Epochs | Box AP |
---|---|---|---|
DINO-ViTDet-Base-4scale | MAE | 12 | 50.2 |
DINO-ViTDet-Base-4scale | MAE | 50 | 55.0 |
DINO-ViTDet-Large-4scale | MAE | 12 | 50.2 |
DINO-ViTDet-Large-4scale | MAE | 50 | 55.0 |
DINO-FocalNet-Large-3level-4scale | IN22k | 12 | 57.5 |
DINO-FocalNet-Large-4level-4scale | IN22k | 12 | 58.0 |
DINO-FocalNet-Large-4level-5scale | IN22k | 12 | 58.5 |
Published by HaoZhang534 almost 2 years ago
Published by rentainhe almost 2 years ago
H-Deformable-DETR-R50
, H-Deformable-DETR-Swin-Tiny
, H-Deformable-DETR-Swin-Large
.DINO-Swin-Large-36ep
, DAB-Deformable-DETR-R50-50ep
, DAB-Deformable-DETR-Two-Stage-50ep
.All the pretrained weights can be downloaded in detrex Model Zoo
Method | Pretrained | Epochs | Query Num | Box AP |
---|---|---|---|---|
H-Deformable-DETR-R50 + tricks | IN1k | 12 | 300 | 48.9 |
H-Deformable-DETR-R50 + tricks | IN1k | 36 | 300 | 50.3 |
H-Deformable-DETR-Swin-T + tricks | IN1k | 12 | 300 | 50.6 |
H-Deformable-DETR-Swin-T+ tricks | IN1k | 36 | 300 | 53.5 |
H-Deformable-DETR-Swin-L + tricks | IN22k | 12 | 300 | 56.2 |
H-Deformable-DETR-Swin-L + tricks | IN22k | 36 | 300 | 57.5 |
H-Deformable-DETR-Swin-L + tricks | IN22k | 12 | 900 | 56.4 |
H-Deformable-DETR-Swin-L + tricks | IN22k | 36 | 900 | 57.7 |
Method | Pretrained | Epochs | Box AP |
---|---|---|---|
DINO-R50-4Scale-12ep | IN1k | 12 | 49.2 |
Method | Pretrained | Epochs | Box AP |
---|---|---|---|
DAB-Deformable-DETR-R50 | IN1k | 50 | 49.0 |
DAB-Deformable-DETR-R50-Two-Stage | IN1k | 50 | 49.7 |
Published by rentainhe almost 2 years ago
DINO
training results in DINO.Deformable-DETR
baselines in Deformable-DETR.All the pretrained weights can be downloaded in detrex Model Zoo.
Method | Pretrained | Epochs | Box AP |
---|---|---|---|
DINO-R50-4Scale | IN1k | 24 | 50.60 |
DINO-R101-4Scale | IN1k | 12 | 49.95 |
DINO-Swin-Tiny-224-4Scale | IN1k | 12 | 51.30 |
DINO-Swin-Tiny-224-4Scale | IN22k to IN1k | 12 | 51.30 |
DINO-Swin-Small-224-4Scale | IN1k | 12 | 52.96 |
DINO-Swin-Base-384-4Scale | IN22k to IN1k | 12 | 55.83 |
DINO-Swin-Large-224-4Scale | IN22k to IN1k | 12 | 56.92 |
DINO-Swin-Large-384-4Scale | IN22k to IN1k | 12 | 56.93 |
Method | Pretrained | Epochs | Box AP |
---|---|---|---|
Deformable-DETR-R50 + Box-Refinement | IN1k | 50 | 46.99 |
Deformable-DETR-R50 + Box-Refinement + Two-Stage | IN1k | 50 | 48.19 |