Skip to content

Feature/cachedstream - #9

Merged
gbiavati merged 65 commits into
mainfrom
feature/cachedstream
Jun 16, 2026
Merged

Feature/cachedstream#9
gbiavati merged 65 commits into
mainfrom
feature/cachedstream

Conversation

@gbiavati

Copy link
Copy Markdown
Contributor

[0.4.0] - 2026-06-16

Added

  • New stream-oriented server mode via server_cache_and_stream.py
  • New stream server command support for serving cached and streamed MARS output
  • Additional unit and integration tests for server and client components

Changed

  • Improved stream server configuration for shared volumes and cache folder settings
  • Updated handler wiring to use configuration-driven shared root, shares, and cache folder values
  • Added default PADDING handling in MARS request execution path
  • Enabled automatic splitting of streamed MARS output by date boundaries

Fixed

  • Standardized shared root and cache folder configuration key handling
  • Fixed missing dependency declarations needed by runtime/test workflows
  • Corrected streaming HTTP response chunking and termination behavior
  • Improved datadir resolution logging for better troubleshooting

gbiavati and others added 23 commits February 10, 2026 12:04
- Updated CEPHFS architecture documentation for clarity on monitor, metadata server, and object storage daemon roles.
- Improved log filtering in the WebSocket client to enhance user experience by reducing noise and highlighting important messages.
- Added examples of custom log handlers for MARS requests to demonstrate advanced logging capabilities.
- Adjusted project metadata in pyproject.toml to reflect the current development status and Python version requirements.
- Enhanced the check_cephfs_health script to provide clearer error messages and suggestions for resolving OSD issues.
- Refined test_config.py to improve output formatting and ensure accurate configuration precedence verification.
Co-authored-by: Copilot <copilot@github.com>
…n for streaming

Co-authored-by: Copilot <copilot@github.com>
…he folder options

Co-authored-by: Copilot <copilot@github.com>
Co-authored-by: Copilot <copilot@github.com>
…_root, shares, and cache_folder

Co-authored-by: Copilot <copilot@github.com>
- Implement a fake_mars executable for testing purposes.
- Create unit tests for tools, server functions, client, log filtering, and WebSocket server.
- Add integration tests for pipe and stream modes of the HTTP server.
- Ensure comprehensive coverage of request handling, error scenarios, and data integrity.

Co-authored-by: Copilot <copilot@github.com>
- Merge 0.4.0 branch content and apply all formatting fixes
- ruff-format: reformat multiple files for line length compliance
- ruff: fix unused imports (F401), unused variables (F841), import ordering (I001)
- ruff: add noqa: E402 to module-level imports after function definitions
- ruff: move imports before pytestmark in test_70_ws_integration.py
- mdformat: reformat k8s/DESIGN.md
- trailing-whitespace, end-of-file-fixer, pretty-format-toml: misc fixes
@gbiavati
gbiavati merged commit baced1f into main Jun 16, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants