Commit graph

25 commits

Author SHA1 Message Date
esat 612c033bc2 Update RF-DETR and ConvNeXt T4 benchmark data 2026-05-04 13:21:53 +03:00
esat cde67bd608 Add T4 obj365 benchmark variants 2026-05-04 12:58:14 +03:00
esat 1660ad4d01 xl6 of deimv2 latency corrected 2026-04-30 14:43:44 +03:00
esat 066954a9ba convnext dinov3 comparison 2026-04-29 08:43:58 +03:00
esat 9d7b24d881 feat: add DEIMv2 obj365 entries, update RF-DETR latencies, add --benchmark arg 2026-04-27 15:02:21 +03:00
esat 296b50bf73 rf and deimv2 values are update on xl and xxl scale 2026-04-20 15:06:21 +03:00
esat 9de202641d benchmark plot update one more time with newer yolo26-detr result 2026-04-20 09:27:10 +03:00
esat 9fc84bec03 benchmark plot is updated after deimv2 and yolo26detr objv2 studies, deployment confirmed ones 2026-04-20 08:33:02 +03:00
esat 81afa4bad0 results of DeimV2-L updated 2026-04-14 22:48:42 +03:00
esat 1e71d17204 rtdetrv1 wo obj365 benchmark 2026-04-10 09:55:29 +03:00
esat b3c8743aef add D-FINE COCO-only data to t4 measured section 2026-03-26 12:58:48 +03:00
esat 2e37288f4a refactor: benchmark plot obj365 labels, RT-DETRv2, title updates
Add (obj365) suffix to RF-DETR and LW-DETR entries, add RT-DETRv2
baseline to measured t4 section, update titles with TRT version info.
2026-03-26 11:05:49 +03:00
esat 953fb07a94 refactor: update benchmark_plot with new models and refined values
Add LW-DETR, RT-DETRv4, ECDet, D-FINE (COCO+obj365), RF-DETR (ECDet
reported) series from ECDet paper (arXiv 2603.18739). Fix RT-DETRv2 S/M
sub-metrics using correct ECDet values. Refine T4 latency measurements
and remove stale Jetson/xeon duplicate sections.
2026-03-25 10:55:56 +03:00
esat b1caed357d deimv1 results are added and reported results are separated 2026-03-24 13:55:20 +03:00
esat 650f967840 benchmark DEIMv2 (Ultralytics, obj365) updated 2026-03-10 08:01:35 +03:00
esat e03ff9e527 fix: update DEIMv2-l obj365 benchmark AP metrics in benchmark_plot
Update COCO val mAP scores for DEIMv2 large (obj365 pretrained) model
to reflect latest evaluation results: AP 56.8->57.2, AP50 74.6->74.9,
AP75 62.0->62.2, AP_small 38.8->39.6, AP_medium 62.2->62.5.
2026-03-04 16:05:16 +03:00
esat 8c8b214812 feat: add DEIMv2 Ultralytics benchmark results and clarify model naming
- Add DEIMv2 (Ultralytics) and DEIMv2 (Ultralytics, obj365) l-size benchmark entries
- Rename DEIMv2 to DEIMv2 (paper) to distinguish paper results from Ultralytics-trained
- Reorder RF-DETR (TopK) entries to appear before DEIMv2 paper results
- Add MODEL_STYLES entries for renamed and new DEIMv2 variants
2026-03-04 07:49:48 +03:00
esat df50e96418 feat: add DINOv3-RTDETR obj365 pretrained benchmark results
- Add benchmark entry for DINOv3-RTDETR (s) pretrained on Object365 with 52.3 mAP
- Register model style for "DINOv3-RTDETR (obj365)" in benchmark plot
2026-02-27 16:14:48 +03:00
esat 93a82296f5 feat: add DINOv3-STA-RTDETR obj365 pretrained benchmark results
- Add obj365-pretrained l6 variant with AP 56.8, AP50 75.2, AP75 61.8
- Register corresponding model style entry for plot rendering
2026-02-26 11:53:31 +03:00
esat c6a2587fd9 feat: update benchmark_plot with DINOv3-STA-RTDETR and DEIMv2 results
- Change default Y-axis metric from ap_large to ap (mAP50-95)
- Add DINOv3-STA-RTDETR benchmark entries (l3 and l6 variants)
- Add DEIMv2 benchmark entries (pico, n, s, m, l, x variants)
- Correct YOLO26-RTDETR l variant latency from 8.8 to 8.6 ms
- Register DINOv3-STA-RTDETR marker style for plot rendering
2026-02-25 10:49:39 +03:00
esat e37e2b167f refactor: consolidate benchmark plot scripts into single configurable tool
Merge benchmark_plot_cpu.py into benchmark_plot.py and delete the now-redundant
separate file. The unified script supports all hardware targets (T4, M5 CPU/CoreML,
Xeon, Jetson AGX Thor/Orin, Jetson Orin Nano Super) and a selectable Y-axis metric
(ap, ap50, ap75, ap_small, ap_medium, ap_large) via a --metric CLI flag.

- Replace hardcoded per-series globals with a BENCHMARKS dict keyed by target name
- Add MODEL_STYLES dict for per-model marker and label-offset configuration
- Support optional latency error bars (4-tuple data points) in plot_series
- Support rich metric dicts alongside legacy scalar mAP values
- Auto-generate output filename based on active BENCHMARK and metric selection
2026-02-23 14:39:43 +03:00
esat 4c19f801c9 benchmark plot and runtime files updated 2026-02-02 12:06:43 +03:00
esat 3a7ee32f05 benchmark plots creators are updated 2026-01-29 18:57:21 +03:00
esat f99238b619 benchmark plot is updated 2026-01-21 12:37:29 +03:00
esat 845752835f benchmark plot code 2026-01-19 12:24:50 +03:00