-
Notifications
You must be signed in to change notification settings - Fork 9
Add direct emissions method with data export #3444
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
kndehaan
wants to merge
85
commits into
master
Choose a base branch
from
emissions
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
+4,323
−468
Open
Changes from all commits
Commits
Show all changes
85 commits
Select commit
Hold shift + click to select a range
6c82e32
Add simple emissions group to specified nodes in the buildings sector…
louispt1 3190557
Add crude oil edge group to buildings sector and emissions to buildin…
louispt1 c774f1c
Add emissions.csv (example) to nl2019 and nl2023
louispt1 b3c441a
Add other_ghg carrier
louispt1 0c4c250
Add other_ghg to carriers.csv for nl2019 and nl2023
louispt1 6f5915f
Extend emissions group to rest of buildings sector
kndehaan 460d5e0
Fix which nodes have the emissions group
louispt1 de226a1
Correction in carriers.csv files
kndehaan a202bf7
Adjust molecule node to query EMISSIONS with underscores
louispt1 a7e8a05
Add co2_conversion_per_mj attribute to other_ghg
kndehaan cbe6fc4
Convert emissions.csv values to kton
kndehaan 7d8abfe
Add dataset value molecule nodes with emissions groups
kndehaan c477cb9
Bug fix molecule node positions
kndehaan 95d1fb7
Omit co2 conversion and cost attribute for other_ghg
kndehaan c727bda
Emissions groups added to Building sector nodes
kndehaan 88d2ce7
Add emissions node and edge groups to sector Agriculture
kndehaan 7672310
Add emissions node groups for sector Other
kndehaan c4f6743
Add emissions and edge node groups for sector Households
kndehaan 0bd9af6
Add emissions groups for sector National transport
kndehaan a38a04a
Update molecule node name to transport
kndehaan f6e8f43
Undo added co2_conversion_per_mj attribute to kms carriers
kndehaan 5ded374
Add emissions groups for sector International transport
kndehaan 316c9e8
Rename molecule nodes to bunkers
kndehaan 18b1566
Molecule node positions
kndehaan 8d81730
Add co2_converison_per_mj to carrier files
kndehaan f8e7d17
Omit unused attribute from other_ghg carrier
kndehaan 864d932
Add emissions groups to households final demand network gas
kndehaan f82fc3f
Add edge group for crude oil mix and node groups for emissions includ…
robindesmit-quintel d831e20
Add emissions group to energy electricity and heat production nodes
kndehaan a6b5348
Add emissions groups to Energy fuels production nodes
kndehaan e8d02be
Omit distribution and some other nodes from emissions groups
kndehaan 228632f
Add emission groups to energy node in sector Industry
robindesmit-quintel 061a59b
Add emission groups to extra energy nodes in sector Industry
robindesmit-quintel 9a55c43
Improve indentation
kndehaan a5af83f
Add emission groups to energy nodes in industry, subcategory electric…
robindesmit-quintel 136fdab
Update emission groups of energy nodes industry_useful_demand_for_oth…
robindesmit-quintel 8d9896f
Add missing emission groups to extra energy nodes in sector Industry
robindesmit-quintel 428ad20
Add emission groups to energy nodes in sector energy, hydrogen_produc…
robindesmit-quintel 50bac2d
Add emission groups to 2 extra energy nodes in sector energy, hydroge…
robindesmit-quintel 9f30c9a
Rake import emissions task
louispt1 5e649d0
Split the non_specified lulucf emissions into emissions and removals
robindesmit-quintel e232dbe
Rename lulucf nodes and include lulucf emissions and removals in emis…
robindesmit-quintel 6ff95ee
Add emission groups to external coupling nodes
robindesmit-quintel f981149
Update the positions of the lulucf molecule nodes.
robindesmit-quintel b5d621d
Update import emissions rake task to handle multi-level nl dataset im…
louispt1 b3ee488
Molecule node positions
kndehaan 267cb26
Move DESC inside task for import:emissions rake
louispt1 d04a523
Add emissions.csv files to country datasets
kndehaan 070788b
Add co2_utilisation_per_mj attribute to nodes
kndehaan 9cec8e8
Omit double defined free_co2_factor
kndehaan 21fa157
Update node groups
kndehaan 8b791db
Update emissions csv files according to pipeline changes
kndehaan fb22c0c
Update the layout of groups in files with emission groups.
robindesmit-quintel e61941f
Update ccs_capture_rate for fischer tropsch non-biogenic waste
kndehaan 4914e7a
Add emissions groups to utilisation molecule node
kndehaan a94a3ee
Change the name of emission group ccu_emitted to ccus_emitted
robindesmit-quintel 7f50ada
Reapply emissions_energy_steel groups to cokes nodes
kndehaan 7d1930f
Update ccs_capture_rate value for Fischer Tropsch and Methanol synthe…
robindesmit-quintel 68a1c5e
Add emissions groups and ccus_captured groups to relevant molecule no…
robindesmit-quintel 0e22131
Remove emissions_lulucf_removalsm group and replace with ccus_capture…
louispt1 b745435
Remove ccus_utilised group from utilisation molecule node
kndehaan a3c288e
Restore emissions_lulucf_removals grouop
kndehaan f182e6f
Correction in molecule node groups
kndehaan e3079d9
Fix spelling mistake in emissions group of domestic aviation.
robindesmit-quintel 3d8fd65
Update the co2 utilisation of Fischer Tropsch molecule node.
robindesmit-quintel 5856e95
More decimals in co2_utilization of Fischer Tropsch nodes.
robindesmit-quintel aaa5e76
Add molecule nodes for subcategories of food and paper.
robindesmit-quintel 799f49d
Round to 6 decimals the co2 utilisation of Fischer Tropsch nodes.
robindesmit-quintel 4bae05e
Update methanol synthesis utilisation conversion factor molecule nodes
kndehaan 700d36f
Dummy values for industry food and paper non-energetic
kndehaan 7589918
Exclude fishing from nl datasets
kndehaan 42b4fee
Apply UNFCCC API source for emissions country datasets
kndehaan 270eb16
Correct utilisation factor in fischer tropsch molecule nodes
kndehaan 5aa783f
Split 2.H and reallocate fishing
kndehaan a97905d
Add emissions.csv dummy for eu
kndehaan becd987
Bump Atlas to quintel/atlas@515a69c
kndehaan ffcdcf9
Bump Atlas to quintel/atlas@b6e9aea
kndehaan 2b3f743
Split refineries process emissions from 1.B
kndehaan 620564b
Emissions CSV export (#3443)
aaccensi 18f80a3
Fix in emissions config description
mabijkerk 3f3b639
Move external coupling industry to the correct node
mabijkerk 3a8dcd9
Update documenation on the import emissions task to clarify YEAR_NAME…
louispt1 602df46
Rename emission groups Transport and Bunkers
kndehaan ba37264
Re-import datasets after data pipeline run
kndehaan bdca6e7
Update sector order in data export
kndehaan File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,2 +1,4 @@ | ||
| - infinite = false | ||
| - graphviz_color = purple | ||
|
|
||
| ~ co2_conversion_per_mj = 0.0 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,2 +1,4 @@ | ||
| - infinite = false | ||
| - graphviz_color = purple | ||
|
|
||
| ~ co2_conversion_per_mj = 0.0 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1,3 @@ | ||
| - infinite = false | ||
|
|
||
| ~ co2_conversion_per_mj = 0.0 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,2 +1,4 @@ | ||
| - infinite = false | ||
| - graphviz_color = red | ||
|
|
||
| ~ co2_conversion_per_mj = 0.0 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,2 +1,4 @@ | ||
| - infinite = false | ||
| - graphviz_color = purple | ||
|
|
||
| ~ co2_conversion_per_mj = 0.0 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,4 +1,5 @@ | ||
| - infinite = false | ||
| - graphviz_color = purple | ||
|
|
||
| ~ co2_conversion_per_mj = 0.0 | ||
| ~ cost_per_mj = CARRIER(light, cost_per_mj) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,4 +1,5 @@ | ||
| - infinite = false | ||
| - graphviz_color = gray46 | ||
|
|
||
| ~ co2_conversion_per_mj = 0.0 | ||
| ~ cost_per_mj = CARRIER(loss, cost_per_mj) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,2 @@ | ||
| - infinite = false | ||
| - graphviz_color = black |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,2 +1,4 @@ | ||
| - infinite = false | ||
| - graphviz_color = purple | ||
|
|
||
| ~ co2_conversion_per_mj = 0.0 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,2 +1,4 @@ | ||
| - infinite = false | ||
| - graphviz_color = purple | ||
|
|
||
| ~ co2_conversion_per_mj = 0.0 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,2 +1,4 @@ | ||
| - infinite = false | ||
| - graphviz_color = purple | ||
|
|
||
| ~ co2_conversion_per_mj = 0.0 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,225 @@ | ||
| # Configuration for the direct emissions CSV | ||
| # | ||
| # Schema | ||
| # ------ | ||
| # Defines the columns included in the exported CSV, split into three categories: | ||
| # | ||
| # Row identifiers — must also be specified in each `rows` entry: | ||
| # - Group Node group used to select which nodes appear in the export. | ||
| # The group name itself is not included in the data export. | ||
| # - Sector ETM sector name | ||
| # - Subsector ETM subsector name | ||
| # | ||
| # Auto-generated node attributes: | ||
| # - Key Unique node key | ||
| # - GHG Greenhouse gas type (CO2 or Other GHG), derived via ghg_carrier method | ||
| # | ||
| # Emission method columns. | ||
| # - CO2_production Direct reporting CO2 production | ||
| # - CO2_capture Direct reporting captured CO2 | ||
| # - Other_GHG_emissions Direct reporting other GHG emissions | ||
| # - Total_GHG_emissions Direct reporting total GHG emissions | ||
| # A transform is applied to each: emission values are given in kg, transformed to kton (× 1e-6) | ||
| # and rounded to 6 decimal places. | ||
| # | ||
| # Rows | ||
| # ---- | ||
| # See explanation above for row identifiers, rows include: | ||
| # - Group | ||
| # - Sector | ||
| # - Subsector | ||
|
|
||
|
|
||
| schema: | ||
| - name: Group | ||
| type: node_group | ||
| - name: Sector | ||
| - name: Subsector | ||
| - name: Key | ||
| type: node_attribute | ||
| value: key | ||
| - name: GHG | ||
| type: node_attribute | ||
| value: ghg_carrier | ||
| - name: CO2_production | ||
| label: "CO2 production [kton CO2-eq]" | ||
| type: node_attribute | ||
| value: direct_reporting_emissions_co2_production | ||
| transform: "(value * 1e-6).round(6)" | ||
| - name: CO2_capture | ||
| label: "CO2 capture [kton CO2-eq]" | ||
| type: node_attribute | ||
| value: direct_reporting_emissions_co2_capture | ||
| transform: "(value * 1e-6).round(6)" | ||
| - name: Other_GHG_emissions | ||
| label: "Other GHG emissions [kton CO2-eq]" | ||
| type: node_attribute | ||
| value: direct_reporting_emissions_other_ghg_emissions | ||
| transform: "(value * 1e-6).round(6)" | ||
| - name: Total_GHG_emissions | ||
| label: "Total GHG emissions [kton CO2-eq]" | ||
| type: node_attribute | ||
| value: direct_reporting_emissions_total_ghg_emissions | ||
| transform: "(value * 1e-6).round(6)" | ||
|
|
||
|
|
||
| rows: | ||
|
kndehaan marked this conversation as resolved.
|
||
| - Group: emissions_energy_electricity_and_heat_production | ||
| Sector: Energy | ||
| Subsector: Electricity and heat production | ||
| - Group: emissions_energy_fuels_production | ||
| Sector: Energy | ||
| Subsector: Fuels production | ||
| - Group: emissions_energy_steel | ||
| Sector: Energy | ||
| Subsector: Steel | ||
| - Group: emissions_energy_methanol_production | ||
| Sector: Energy | ||
| Subsector: Methanol production | ||
| - Group: emissions_energy_hydrogen_production | ||
| Sector: Energy | ||
| Subsector: Hydrogen production | ||
| - Group: emissions_energy_fugitive_emissions | ||
| Sector: Energy | ||
| Subsector: Fugitive emissions | ||
| - Group: emissions_energy_ccus | ||
| Sector: Energy | ||
| Subsector: CCUS | ||
| - Group: emissions_industry_non_specified | ||
| Sector: Industry | ||
| Subsector: Non-specified | ||
| - Group: emissions_industry_electricity_and_heat_production | ||
| Sector: Industry | ||
| Subsector: Electricity and heat production | ||
| - Group: emissions_industry_refineries | ||
| Sector: Industry | ||
| Subsector: Refineries | ||
| - Group: emissions_industry_steel | ||
| Sector: Industry | ||
| Subsector: Steel | ||
| - Group: emissions_industry_aluminium | ||
| Sector: Industry | ||
| Subsector: Aluminium | ||
| - Group: emissions_industry_other_metals | ||
| Sector: Industry | ||
| Subsector: Other metals | ||
| - Group: emissions_industry_fertilizers | ||
| Sector: Industry | ||
| Subsector: Fertilizers | ||
| - Group: emissions_industry_chemicals | ||
| Sector: Industry | ||
| Subsector: Chemicals | ||
| - Group: emissions_industry_paper | ||
| Sector: Industry | ||
| Subsector: Paper | ||
| - Group: emissions_industry_food | ||
| Sector: Industry | ||
| Subsector: Food | ||
| - Group: emissions_industry_other | ||
| Sector: Industry | ||
| Subsector: Other | ||
| - Group: emissions_transport_non_specified | ||
| Sector: National transport | ||
| Subsector: Non-specified | ||
| - Group: emissions_transport_cars | ||
| Sector: National transport | ||
| Subsector: Cars | ||
| - Group: emissions_transport_motorcycles | ||
| Sector: National transport | ||
| Subsector: Motorcycles | ||
| - Group: emissions_transport_bicycles | ||
| Sector: National transport | ||
| Subsector: Bicycles | ||
| - Group: emissions_transport_buses | ||
| Sector: National transport | ||
| Subsector: Buses | ||
| - Group: emissions_transport_trucks | ||
| Sector: National transport | ||
| Subsector: Trucks | ||
| - Group: emissions_transport_vans | ||
| Sector: National transport | ||
| Subsector: Vans | ||
| - Group: emissions_transport_trains | ||
| Sector: National transport | ||
| Subsector: Trains | ||
| - Group: emissions_transport_trams_metros | ||
| Sector: National transport | ||
| Subsector: Trams and metros | ||
| - Group: emissions_transport_domestic_navigation | ||
| Sector: National transport | ||
| Subsector: Domestic navigation | ||
| - Group: emissions_transport_domestic_aviation | ||
| Sector: National transport | ||
| Subsector: Domestic aviation | ||
| - Group: emissions_buildings_non_specified | ||
| Sector: Buildings | ||
| Subsector: Non-specified | ||
| - Group: emissions_buildings_space_heating | ||
| Sector: Buildings | ||
| Subsector: Space heating | ||
| - Group: emissions_buildings_cooling | ||
| Sector: Buildings | ||
| Subsector: Cooling | ||
| - Group: emissions_buildings_lighting | ||
| Sector: Buildings | ||
| Subsector: Lighting | ||
| - Group: emissions_buildings_appliances | ||
| Sector: Buildings | ||
| Subsector: Appliances | ||
| - Group: emissions_households_non_specified | ||
| Sector: Households | ||
| Subsector: Non-specified | ||
| - Group: emissions_households_space_heating | ||
| Sector: Households | ||
| Subsector: Space heating | ||
| - Group: emissions_households_hot_water | ||
| Sector: Households | ||
| Subsector: Hot water | ||
| - Group: emissions_households_cooling | ||
| Sector: Households | ||
| Subsector: Cooling | ||
| - Group: emissions_households_cooking | ||
| Sector: Households | ||
| Subsector: Cooking | ||
| - Group: emissions_households_lighting | ||
| Sector: Households | ||
| Subsector: Lighting | ||
| - Group: emissions_households_appliances | ||
| Sector: Households | ||
| Subsector: Appliances | ||
| - Group: emissions_agriculture_non_specified | ||
| Sector: Agriculture | ||
| Subsector: Non-specified | ||
| - Group: emissions_agriculture_electricity_and_heat_production | ||
| Sector: Agriculture | ||
| Subsector: Electricity and heat production | ||
| - Group: emissions_agriculture_heating | ||
| Sector: Agriculture | ||
| Subsector: Heating | ||
| - Group: emissions_other_non_specified | ||
| Sector: Other | ||
| Subsector: Non-specified | ||
| - Group: emissions_other_heating | ||
| Sector: Other | ||
| Subsector: Heating | ||
| - Group: emissions_other_other_transportation | ||
| Sector: Other | ||
| Subsector: Other transportation | ||
| - Group: emissions_other_indirect_emissions | ||
| Sector: Other | ||
| Subsector: Indirect emissions | ||
| - Group: emissions_lulucf_emissions | ||
| Sector: LULUCF | ||
| Subsector: Emissions | ||
| - Group: emissions_lulucf_removals | ||
| Sector: LULUCF | ||
| Subsector: Removals | ||
| - Group: emissions_waste_non_specified | ||
| Sector: Waste | ||
| Subsector: Non-specified | ||
| - Group: emissions_bunkers_international_aviation | ||
| Sector: International transport | ||
| Subsector: International aviation | ||
| - Group: emissions_bunkers_international_navigation | ||
| Sector: International transport | ||
| Subsector: International navigation | ||
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.