Skip to content

Identify the disk storing the indices in nightly report HTML - #601

Merged
mikemccand merged 1 commit into
mikemccand:mainfrom
neoremind:identify_index_disk
Jul 21, 2026
Merged

Identify the disk storing the indices in nightly report HTML#601
mikemccand merged 1 commit into
mikemccand:mainfrom
neoremind:identify_index_disk

Conversation

@neoremind

@neoremind neoremind commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Follow-up to #588, the nightly report should show the specific disk storing the indices (e.g., constants.INDEX_DIR_BASE), currently it lists every block device on the machine.

Screenshot 2026-07-21 at 9 53 20 AM

How it works:
get_disk_info() now accepts an optional given path, it attempts to resolve the disk backing that path where the index is stored. It uses df --output=source <path> to find the filesystem source device, then useslsblk -lsno NAME,TYPE,SIZE,MODEL <device> and keeps only disk-typed items. If there is no path specified or the path doesn't exist, just fall back to original listing all devices path. For non-block filesystems (NFS, tmpfs, overlayfs), reports the df source string, for example nas:/export/bench.

Tested on my EC2 with SSD.

  • Before mounting SSD, creating a dir in /home/ec2-user/index, it shows 8G Amazon Elastic Block Store
  • After mounting SSD, it shows 69.8G Amazon EC2 NVMe Instance Storage.

@neoremind
neoremind force-pushed the identify_index_disk branch from dfc8afe to 0dc8268 Compare July 21, 2026 02:16

@mikemccand mikemccand left a comment

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome, thank you @neoremind -- I'll merge and let's watch for tomorrow's report of tonite's run!

@mikemccand
mikemccand merged commit d978305 into mikemccand:main Jul 21, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants