Skip to content

End-to-end BGE runs 1–2 config and mount preflight #492

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
alxsmith wants to merge 8 commits into
base: main
Choose a base branch
from
Open

End-to-end BGE runs 1–2 config and mount preflight #492

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
9b52125
WIP
alxsmith Jul 22, 2026
c4033f0
Add /data.sb mountpoint preflight to run-scenario recipes
alxsmith Jul 23, 2026
9547f66
Fail fast when CAIRO output dir is under an unmounted /data.sb
alxsmith Jul 23, 2026
6155eec
Add tests for assert_output_dir_is_mounted preflight
alxsmith Jul 23, 2026
baa23ac
Point BGE delivery-only runs at MD supply capacity zero MC paths
alxsmith Jul 23, 2026
17a3487
Normalize BGE default fixed charge to 10.0
alxsmith Jul 23, 2026
1be0e27
Add BGE electric tariff maps for default and HP seasonal scenarios
alxsmith Jul 23, 2026
0ceeaf6
Add null gas tariff for MD buildings without a gas connection
alxsmith Jul 23, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 14 additions & 0 deletions rate_design/hp_rates/Justfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -765,6 +765,13 @@ run-scenario-from path_scenario_config run_num *extra_args:
#!/usr/bin/env bash
set -euo pipefail
: "${RDP_BATCH:?Set RDP_BATCH before running (e.g. ny_20260305c_r1-8)}"
# Pre-flight: outputs go under /data.sb, which must be the s3fs mount, not
# a local dir. If unmounted, CAIRO would silently write to local disk.
if ! mountpoint -q /data.sb; then
echo "ERROR: /data.sb is not a mountpoint. Outputs would land on local disk, not S3." >&2
echo "Fix: sudo mount /data.sb (if that fails with 'not empty', clear local contents first)." >&2
exit 1
fi
log_dir="${HOME}/rdp_run_logs"
mkdir -p "${log_dir}"
log_file="${log_dir}/{{ utility }}_run{{ run_num }}_${RDP_BATCH}.log"
Expand All @@ -786,6 +793,13 @@ run-scenario run_num *extra_args:
#!/usr/bin/env bash
set -euo pipefail
: "${RDP_BATCH:?Set RDP_BATCH before running (e.g. ny_20260305c_r1-8)}"
# Pre-flight: outputs go under /data.sb, which must be the s3fs mount, not
# a local dir. If unmounted, CAIRO would silently write to local disk.
if ! mountpoint -q /data.sb; then
echo "ERROR: /data.sb is not a mountpoint. Outputs would land on local disk, not S3." >&2
echo "Fix: sudo mount /data.sb (if that fails with 'not empty', clear local contents first)." >&2
exit 1
fi
# Pre-flight: abort if this utility+run combo already exists under the batch
s3_batch_dir="s3://data.sb/switchbox/cairo/outputs/hp_rates/{{ state }}/{{ utility }}/${RDP_BATCH}/"
existing=$(aws s3 ls "${s3_batch_dir}" 2>/dev/null | grep -i "_run{{ run_num }}_" || true)
Expand Down
24 changes: 12 additions & 12 deletions rate_design/hp_rates/md/config/scenarios/scenarios_bge.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,10 +14,10 @@ runs:
path_tariffs_gas: tariffs/gas
path_outputs: /data.sb/switchbox/cairo/outputs/hp_rates/md/bge/<execution_time>/md_bge_run1_up00_precalc__default__pc
path_supply_energy_mc: s3://data.sb/switchbox/marginal_costs/md/supply/energy/utility=bge/year=2025/zero.parquet
path_supply_capacity_mc: s3://data.sb/switchbox/marginal_costs/ny/supply/capacity/utility=bge/year=2025/zero.parquet
path_supply_capacity_mc: s3://data.sb/switchbox/marginal_costs/md/supply/capacity/utility=bge/year=2025/zero.parquet
path_tariffs_electric:
all: tariffs/electric/bge_default.json
utility_revenue_requirement: rev_requirement/bge.yaml
utility_revenue_requirement: rev_requirement/bge_rate_case_test_year.yaml
run_includes_supply: false
run_includes_subclasses: false
residual_allocation_delivery: percustomer
Expand Down Expand Up @@ -47,7 +47,7 @@ runs:
path_supply_capacity_mc: s3://data.sb/switchbox/marginal_costs/md/supply/capacity/utility=bge/year=2025/data.parquet
path_tariffs_electric:
all: tariffs/electric/bge_default_supply.json
utility_revenue_requirement: rev_requirement/bge.yaml
utility_revenue_requirement: rev_requirement/bge_rate_case_test_year.yaml
run_includes_supply: true
run_includes_subclasses: false
residual_allocation_delivery: percustomer
Expand All @@ -74,10 +74,10 @@ runs:
path_tariffs_gas: tariffs/gas
path_outputs: /data.sb/switchbox/cairo/outputs/hp_rates/md/bge/<execution_time>/md_bge_run3_up02_default__default
path_supply_energy_mc: s3://data.sb/switchbox/marginal_costs/md/supply/energy/utility=bge/year=2025/zero.parquet
path_supply_capacity_mc: s3://data.sb/switchbox/marginal_costs/ny/supply/capacity/utility=bge/year=2025/zero.parquet
path_supply_capacity_mc: s3://data.sb/switchbox/marginal_costs/md/supply/capacity/utility=bge/year=2025/zero.parquet
path_tariffs_electric:
all: tariffs/electric/bge_default_calibrated.json
utility_revenue_requirement: rev_requirement/bge_large_number.yaml
utility_revenue_requirement: rev_requirement/bge_large_number_rate_case_test_year.yaml
run_includes_supply: false
run_includes_subclasses: false
path_electric_utility_stats: s3://data.sb/eia/861/electric_utility_stats/year=2024/state=MD/data.parquet
Expand Down Expand Up @@ -105,7 +105,7 @@ runs:
path_supply_capacity_mc: s3://data.sb/switchbox/marginal_costs/md/supply/capacity/utility=bge/year=2025/data.parquet
path_tariffs_electric:
all: tariffs/electric/bge_default_supply_calibrated.json
utility_revenue_requirement: rev_requirement/bge_large_number.yaml
utility_revenue_requirement: rev_requirement/bge_large_number_rate_case_test_year.yaml
run_includes_supply: true
run_includes_subclasses: false
path_electric_utility_stats: s3://data.sb/eia/861/electric_utility_stats/year=2024/state=MD/data.parquet
Expand All @@ -130,11 +130,11 @@ runs:
path_tariffs_gas: tariffs/gas
path_outputs: /data.sb/switchbox/cairo/outputs/hp_rates/md/bge/<execution_time>/md_bge_run5_up00_precalc__hp_seasonal_vs_nhpdefault__pc
path_supply_energy_mc: s3://data.sb/switchbox/marginal_costs/md/supply/energy/utility=bge/year=2025/zero.parquet
path_supply_capacity_mc: s3://data.sb/switchbox/marginal_costs/ny/supply/capacity/utility=bge/year=2025/zero.parquet
path_supply_capacity_mc: s3://data.sb/switchbox/marginal_costs/md/supply/capacity/utility=bge/year=2025/zero.parquet
path_tariffs_electric:
hp: tariffs/electric/bge_hp_seasonal.json
non-hp: tariffs/electric/bge_nonhp_nhpdefault.json
utility_revenue_requirement: rev_requirement/bge_hp_vs_nonhp.yaml
utility_revenue_requirement: rev_requirement/bge_hp_vs_nonhp_rate_case_test_year.yaml
run_includes_supply: false
run_includes_subclasses: true
residual_allocation_delivery: percustomer
Expand Down Expand Up @@ -165,7 +165,7 @@ runs:
path_tariffs_electric:
hp: tariffs/electric/bge_hp_seasonal.json
non-hp: tariffs/electric/bge_nonhp_nhpdefault.json
utility_revenue_requirement: rev_requirement/bge_hp_vs_nonhp.yaml
utility_revenue_requirement: rev_requirement/bge_hp_vs_nonhp_rate_case_test_year.yaml
run_includes_supply: true
run_includes_subclasses: true
residual_allocation_delivery: percustomer
Expand All @@ -192,10 +192,10 @@ runs:
path_tariffs_gas: tariffs/gas
path_outputs: /data.sb/switchbox/cairo/outputs/hp_rates/md/bge/<execution_time>/md_bge_run7_up02_default__hp_seasonal
path_supply_energy_mc: s3://data.sb/switchbox/marginal_costs/md/supply/energy/utility=bge/year=2025/zero.parquet
path_supply_capacity_mc: s3://data.sb/switchbox/marginal_costs/ny/supply/capacity/utility=bge/year=2025/zero.parquet
path_supply_capacity_mc: s3://data.sb/switchbox/marginal_costs/md/supply/capacity/utility=bge/year=2025/zero.parquet
path_tariffs_electric:
all: tariffs/electric/bge_hp_seasonal_calibrated.json
utility_revenue_requirement: rev_requirement/bge_large_number.yaml
utility_revenue_requirement: rev_requirement/bge_large_number_rate_case_test_year.yaml
run_includes_supply: false
run_includes_subclasses: false
path_electric_utility_stats: s3://data.sb/eia/861/electric_utility_stats/year=2024/state=MD/data.parquet
Expand Down Expand Up @@ -223,7 +223,7 @@ runs:
path_supply_capacity_mc: s3://data.sb/switchbox/marginal_costs/md/supply/capacity/utility=bge/year=2025/data.parquet
path_tariffs_electric:
all: tariffs/electric/bge_hp_seasonal_supply_calibrated.json
utility_revenue_requirement: rev_requirement/bge_large_number.yaml
utility_revenue_requirement: rev_requirement/bge_large_number_rate_case_test_year.yaml
run_includes_supply: true
run_includes_subclasses: false
path_electric_utility_stats: s3://data.sb/eia/861/electric_utility_stats/year=2024/state=MD/data.parquet
Expand Down
Loading