Skip to content

xiafancheng/AeroInteract3D

 
 

Repository files navigation

AeroInteract3D

中文版本 / Chinese Version

Early-stage project for real-time webcam-based 3D hand interaction.

Current implementation snapshot:

  • Gesture: GestureServiceImpl in src/gesture/service.py
  • Shared gesture temporal reducer: src/gesture/temporal.py
  • Bridge: BridgeServiceImpl in src/bridge/service.py
  • Rendering: RenderingServiceImpl in src/rendering/service.py
  • Rendering backend: Python + Panda3D

The gesture runtime and live preview now share the same temporal logic for:

  • tracking-state transitions
  • pinch hysteresis and confirmation
  • confidence shaping
  • coordinate smoothing

The live preview also shows measured on-screen FPS from the actual preview loop, not just the configured target FPS.

Current runtime defaults:

  • target FPS request: 30
  • requested capture resolution: 1280x960

Main app preview behavior:

  • the Panda3D window now owns the camera preview feed
  • use --flip-camera or --no-flip-camera to control horizontal mirroring
  • use --debug-stats to show the gesture/runtime statistics panel
  • the old main-entry --live-preview path is removed completely
  • use --render-position-sensitivity to make rendered object translation more or less sensitive

Local machine run defaults can be stored in .run.yaml at the repository root. A committed template is available in .run.example.yaml, while the real .run.yaml stays untracked.

Developer environment setup: see DEVELOPMENT.md.

About

Use real-time 3D gesture recognition to interact with a virtual setting.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

  • Python 99.7%
  • Makefile 0.3%