Skip to content

Spec1: backbone-agnostic extraction dispatcher + InternVideo2/VideoMAEv2 loaders #17

Description

@jinmang2

Part of #16 (Spec 1 — Foundation).

Make feature extraction work for any backbone, inference-only.

Scope

  • scripts/extract_features.py--backbone {i3d,clip,videomae,videomaev2,internvideo2} dispatcher via build_extractor(); cache *_<backbone>.npy; keep segment_features (dim-agnostic). Legacy I3D path byte-identical.
  • New src/features/internvideo2.py, src/features/videomaev2.py — OpenGVLab native weights (not transformers-native) → custom loader (prefer validated HF export). dim from model config.
  • Reuse existing dataset-keyed layout + unified manifest.

Done when

  • Each backbone produces cached features of the documented dim.
  • I3D path unchanged (regression).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions