2020 Modeling Platform on CMAS Open Data Warehouse
This dataset is available as part of the AWS Open Data Program, therefore egress fees are not charged to either the host or the person downloading the data.
Metadata for this dataset is available on the CMAS Dataverse Entry for the 2020 Platform
2020 Modeling Platform
The emissions in the 2020 Modeling Platform are based on the 2020 National Emissions Inventory released in the spring of 2023.
The platform was created as part of a project for the Centers for Disease Control and Prevention (CDC) to produce derived estimates of air quality for the year 2020 using the Bayesian Space-time Downscaling Fusion Model (Downscaler) and in support of AirToxScreen for 2020.
This platform does not contain projection years. The emissions inputs (model ready and pre-merged) to CMAQ are provided in this data set along with the initial and boundary condition files (icbc) and meteorological inputs (mcip).
Instructions for downloading the aws command line.
Instructions to Download AWS Command Line
Once you have it installed, you can use it without credentials.
Example commands:
To query how much data is in the full bucket:
aws s3 ls --no-sign-request --summarize --region=us-east-1 --human-readable --region=us-east-1 --recursive s3://2020platform
Tail of Output:
Total Objects: 24772
Total Size: 22.0 TiB
Note, this bucket contains initial and boundry condition files, mcip, and model ready emissions for 2020.
To find the size and list the files available in the directory containing the initial and boundary condition files, use the following command:
aws s3 ls --no-sign-request --summarize --region=us-east-1 --human-readable --region=us-east-1 --recursive s3://2020platform/2020platform/12US1/icbc_2020_tox_addhr
Tail of output:
2024-01-23 11:34:19 378.2 MiB 2020platform/icbc_2020_tox_addhr/GCv14_CB6_AE7.20201227_0000z.12US1.BCON_hap_benap.nc
2024-01-23 11:34:22 378.2 MiB 2020platform/icbc_2020_tox_addhr/GCv14_CB6_AE7.20201228_0000z.12US1.BCON_hap_benap.nc
2024-01-23 11:34:22 378.2 MiB 2020platform/icbc_2020_tox_addhr/GCv14_CB6_AE7.20201229_0000z.12US1.BCON_hap_benap.nc
2024-01-23 11:34:22 378.2 MiB 2020platform/icbc_2020_tox_addhr/GCv14_CB6_AE7.20201230_0000z.12US1.BCON_hap_benap.nc
2024-01-23 11:34:28 378.2 MiB 2020platform/icbc_2020_tox_addhr/GCv14_CB6_AE7.20201231_0000z.12US1.BCON_hap_benap.nc
2024-01-23 11:35:00 42.1 MiB 2020platform/icbc_2020_tox_addhr/GCv14_CB6_AE7.20201231_0000z.12US1.BCON_hap_benap.nc.hr21
2024-01-23 11:35:00 42.1 MiB 2020platform/icbc_2020_tox_addhr/GCv14_CB6_AE7.20201231_0000z.12US1.BCON_hap_benap.nc.hr21to24
2024-01-23 11:35:01 35.2 MiB 2020platform/icbc_2020_tox_addhr/a
2024-01-23 11:35:00 54.4 KiB 2020platform/icbc_2020_tox_addhr/h
Total Objects: 381
Total Size: 142.7 GiB
To find the size and list the files available in the MCIP directory for 2020, use the following command:
aws s3 ls --no-sign-request --summarize --region=us-east-1 --human-readable --region=us-east-1 --recursive s3://2020platform/2020platform/12US1/mcip/WRFv4.1.1_12US1_2020_35aL_lucor
Tail of output:
2024-01-25 05:36:45 824 Bytes 2020platform/mcip/WRFv4.1.1_12US1_2020_35aL_lucor/v5.3.3/namelist.12US1.201216
2024-01-25 05:36:45 824 Bytes 2020platform/mcip/WRFv4.1.1_12US1_2020_35aL_lucor/v5.3.3/namelist.12US1.201217
2024-01-25 05:36:45 824 Bytes 2020platform/mcip/WRFv4.1.1_12US1_2020_35aL_lucor/v5.3.3/namelist.12US1.201218
2024-01-25 05:36:45 824 Bytes 2020platform/mcip/WRFv4.1.1_12US1_2020_35aL_lucor/v5.3.3/namelist.12US1.201219
2024-01-25 05:36:45 824 Bytes 2020platform/mcip/WRFv4.1.1_12US1_2020_35aL_lucor/v5.3.3/namelist.12US1.201220
2024-01-25 05:36:46 824 Bytes 2020platform/mcip/WRFv4.1.1_12US1_2020_35aL_lucor/v5.3.3/namelist.12US1.201221
2024-01-25 05:36:45 824 Bytes 2020platform/mcip/WRFv4.1.1_12US1_2020_35aL_lucor/v5.3.3/namelist.12US1.201222
2024-01-25 05:36:45 824 Bytes 2020platform/mcip/WRFv4.1.1_12US1_2020_35aL_lucor/v5.3.3/namelist.12US1.201223
2024-01-25 05:36:45 824 Bytes 2020platform/mcip/WRFv4.1.1_12US1_2020_35aL_lucor/v5.3.3/namelist.12US1.201224
2024-01-25 05:36:45 824 Bytes 2020platform/mcip/WRFv4.1.1_12US1_2020_35aL_lucor/v5.3.3/namelist.12US1.201225
2024-01-25 05:36:45 824 Bytes 2020platform/mcip/WRFv4.1.1_12US1_2020_35aL_lucor/v5.3.3/namelist.12US1.201226
2024-01-25 05:36:45 824 Bytes 2020platform/mcip/WRFv4.1.1_12US1_2020_35aL_lucor/v5.3.3/namelist.12US1.201227
2024-01-25 05:36:45 824 Bytes 2020platform/mcip/WRFv4.1.1_12US1_2020_35aL_lucor/v5.3.3/namelist.12US1.201228
2024-01-25 05:36:45 824 Bytes 2020platform/mcip/WRFv4.1.1_12US1_2020_35aL_lucor/v5.3.3/namelist.12US1.201229
2024-01-25 05:36:45 824 Bytes 2020platform/mcip/WRFv4.1.1_12US1_2020_35aL_lucor/v5.3.3/namelist.12US1.201230
2024-01-25 05:36:45 824 Bytes 2020platform/mcip/WRFv4.1.1_12US1_2020_35aL_lucor/v5.3.3/namelist.12US1.201231
Total Objects: 4180
Total Size: 4.8 TiB
To find the size and list the files available in the merged emis_mole_all model ready emissions directory for 2020, use the following command:
aws s3 ls --no-sign-request --summarize --region=us-east-1 --human-readable --region=us-east-1 --recursive s3://2020platform/2020platform/12US1/emis/smoke_out/2020ha2_cb6_20k/12US1/cmaq_cb6ae7/merged_nobeis_norwc/
Tail of the output:
2023-11-10 09:39:00 1.6 GiB 2020platform/emis/smoke_out/2020ha2_cb6_20k/12US1/cmaq_cb6ae7/merged_nobeis_norwc/emis_mole_all_20201221_12US1_nobeis_norwc_2020ha2_cb6_20k.ncf
2023-11-10 09:54:37 1.6 GiB 2020platform/emis/smoke_out/2020ha2_cb6_20k/12US1/cmaq_cb6ae7/merged_nobeis_norwc/emis_mole_all_20201222_12US1_nobeis_norwc_2020ha2_cb6_20k.ncf
2023-11-10 09:54:37 1.6 GiB 2020platform/emis/smoke_out/2020ha2_cb6_20k/12US1/cmaq_cb6ae7/merged_nobeis_norwc/emis_mole_all_20201223_12US1_nobeis_norwc_2020ha2_cb6_20k.ncf
2023-11-10 09:54:38 1.6 GiB 2020platform/emis/smoke_out/2020ha2_cb6_20k/12US1/cmaq_cb6ae7/merged_nobeis_norwc/emis_mole_all_20201224_12US1_nobeis_norwc_2020ha2_cb6_20k.ncf
2023-11-10 09:54:38 1.6 GiB 2020platform/emis/smoke_out/2020ha2_cb6_20k/12US1/cmaq_cb6ae7/merged_nobeis_norwc/emis_mole_all_20201225_12US1_nobeis_norwc_2020ha2_cb6_20k.ncf
2023-11-10 09:39:00 1.6 GiB 2020platform/emis/smoke_out/2020ha2_cb6_20k/12US1/cmaq_cb6ae7/merged_nobeis_norwc/emis_mole_all_20201226_12US1_nobeis_norwc_2020ha2_cb6_20k.ncf
2023-11-10 09:54:37 1.6 GiB 2020platform/emis/smoke_out/2020ha2_cb6_20k/12US1/cmaq_cb6ae7/merged_nobeis_norwc/emis_mole_all_20201227_12US1_nobeis_norwc_2020ha2_cb6_20k.ncf
2023-11-10 09:54:37 1.6 GiB 2020platform/emis/smoke_out/2020ha2_cb6_20k/12US1/cmaq_cb6ae7/merged_nobeis_norwc/emis_mole_all_20201228_12US1_nobeis_norwc_2020ha2_cb6_20k.ncf
2023-11-10 09:54:37 1.6 GiB 2020platform/emis/smoke_out/2020ha2_cb6_20k/12US1/cmaq_cb6ae7/merged_nobeis_norwc/emis_mole_all_20201229_12US1_nobeis_norwc_2020ha2_cb6_20k.ncf
2023-11-10 09:39:00 1.6 GiB 2020platform/emis/smoke_out/2020ha2_cb6_20k/12US1/cmaq_cb6ae7/merged_nobeis_norwc/emis_mole_all_20201230_12US1_nobeis_norwc_2020ha2_cb6_20k.ncf
2023-11-10 09:54:37 1.6 GiB 2020platform/emis/smoke_out/2020ha2_cb6_20k/12US1/cmaq_cb6ae7/merged_nobeis_norwc/emis_mole_all_20201231_12US1_nobeis_norwc_2020ha2_cb6_20k.ncf
Total Objects: 377
Total Size: 610.4 GiB
and
To find the size and list the files available for the point source emissions:
aws s3 ls --no-sign-request --summarize --region=us-east-1 --human-readable --region=us-east-1 --recursive s3://2020platform/2020platform/12US1/emis/smoke_out/2020ha_cb6_20k/12US1/cmaq_cb6ae7
Tail of the output:
2023-12-20 09:55:51 5.9 GiB 2020platform/emis/smoke_out/2020ha_cb6_20k/12US1/cmaq_cb6ae7/ptnonipm_no-landfills/inln_mole_ptnonipm_no-landfills_20201212_12US1_cmaq_cb6ae7_2020ha_cb6_20k.ncf
2023-12-20 09:55:51 5.9 GiB 2020platform/emis/smoke_out/2020ha_cb6_20k/12US1/cmaq_cb6ae7/ptnonipm_no-landfills/inln_mole_ptnonipm_no-landfills_20201213_12US1_cmaq_cb6ae7_2020ha_cb6_20k.ncf
2023-12-20 09:55:51 5.9 GiB 2020platform/emis/smoke_out/2020ha_cb6_20k/12US1/cmaq_cb6ae7/ptnonipm_no-landfills/inln_mole_ptnonipm_no-landfills_20201224_12US1_cmaq_cb6ae7_2020ha_cb6_20k.ncf
2023-12-20 09:55:51 5.9 GiB 2020platform/emis/smoke_out/2020ha_cb6_20k/12US1/cmaq_cb6ae7/ptnonipm_no-landfills/inln_mole_ptnonipm_no-landfills_20201225_12US1_cmaq_cb6ae7_2020ha_cb6_20k.ncf
2023-12-20 09:55:51 5.9 GiB 2020platform/emis/smoke_out/2020ha_cb6_20k/12US1/cmaq_cb6ae7/ptnonipm_no-landfills/inln_mole_ptnonipm_no-landfills_20201226_12US1_cmaq_cb6ae7_2020ha_cb6_20k.ncf
2023-12-20 09:55:51 29.4 MiB 2020platform/emis/smoke_out/2020ha_cb6_20k/12US1/cmaq_cb6ae7/ptnonipm_no-landfills/stack_groups_ptnonipm_no-landfills_12US1_2020ha_cb6_20k.ncf
Total Objects: 5187
Total Size: 1.6 TiB
To find the size and list the files available in the pre-merged emissions directory for 2020, use the following commands (note two separate directories):
aws s3 ls --no-sign-request --summarize --region=us-east-1 --human-readable --region=us-east-1 --recursive s3://2020platform/2020platform/12US1/emis/2020ha_cb6_20k/premerged
Tail of the output:
2023-11-09 15:10:50 1.1 GiB 2020platform/emis/2020ha_cb6_20k/premerged/rwc/emis_mole_rwc_20201222_12US1_cmaq_cb6ae7_2020ha_cb6_20k.ncf
2023-11-09 15:10:50 1.1 GiB 2020platform/emis/2020ha_cb6_20k/premerged/rwc/emis_mole_rwc_20201223_12US1_cmaq_cb6ae7_2020ha_cb6_20k.ncf
2023-11-09 15:10:50 1.1 GiB 2020platform/emis/2020ha_cb6_20k/premerged/rwc/emis_mole_rwc_20201224_12US1_cmaq_cb6ae7_2020ha_cb6_20k.ncf
2023-11-09 15:10:50 1.1 GiB 2020platform/emis/2020ha_cb6_20k/premerged/rwc/emis_mole_rwc_20201225_12US1_cmaq_cb6ae7_2020ha_cb6_20k.ncf
2023-11-09 15:10:50 1.1 GiB 2020platform/emis/2020ha_cb6_20k/premerged/rwc/emis_mole_rwc_20201226_12US1_cmaq_cb6ae7_2020ha_cb6_20k.ncf
2023-11-09 15:10:50 1.1 GiB 2020platform/emis/2020ha_cb6_20k/premerged/rwc/emis_mole_rwc_20201227_12US1_cmaq_cb6ae7_2020ha_cb6_20k.ncf
2023-11-09 15:10:50 1.1 GiB 2020platform/emis/2020ha_cb6_20k/premerged/rwc/emis_mole_rwc_20201228_12US1_cmaq_cb6ae7_2020ha_cb6_20k.ncf
2023-11-09 15:10:50 1.1 GiB 2020platform/emis/2020ha_cb6_20k/premerged/rwc/emis_mole_rwc_20201229_12US1_cmaq_cb6ae7_2020ha_cb6_20k.ncf
2023-11-09 15:10:50 1.1 GiB 2020platform/emis/2020ha_cb6_20k/premerged/rwc/emis_mole_rwc_20201230_12US1_cmaq_cb6ae7_2020ha_cb6_20k.ncf
2023-11-09 15:10:50 1.1 GiB 2020platform/emis/2020ha_cb6_20k/premerged/rwc/emis_mole_rwc_20201231_12US1_cmaq_cb6ae7_2020ha_cb6_20k.ncf
Total Objects: 2030
Total Size: 657.6 GiB
aws s3 ls --no-sign-request --summarize --region=us-east-1 --human-readable --region=us-east-1 --recursive s3://2020platform/2020platform/12US1/emis/2020ha2_cb6_20k/premerged
Tail of the output:
2023-11-09 15:12:03 1.1 GiB 2020platform/emis/2020ha2_cb6_20k/premerged/onroad_gas/emis_mole_onroad_gas_20201225_12US1_cmaq_cb6ae7_2020ha2_cb6_20k.ncf
2023-11-09 15:12:03 1.1 GiB 2020platform/emis/2020ha2_cb6_20k/premerged/onroad_gas/emis_mole_onroad_gas_20201226_12US1_cmaq_cb6ae7_2020ha2_cb6_20k.ncf
2023-11-09 15:12:03 1.1 GiB 2020platform/emis/2020ha2_cb6_20k/premerged/onroad_gas/emis_mole_onroad_gas_20201227_12US1_cmaq_cb6ae7_2020ha2_cb6_20k.ncf
2023-11-09 15:12:03 1.1 GiB 2020platform/emis/2020ha2_cb6_20k/premerged/onroad_gas/emis_mole_onroad_gas_20201228_12US1_cmaq_cb6ae7_2020ha2_cb6_20k.ncf
2023-11-09 15:12:03 1.1 GiB 2020platform/emis/2020ha2_cb6_20k/premerged/onroad_gas/emis_mole_onroad_gas_20201229_12US1_cmaq_cb6ae7_2020ha2_cb6_20k.ncf
2023-11-09 15:12:03 1.1 GiB 2020platform/emis/2020ha2_cb6_20k/premerged/onroad_gas/emis_mole_onroad_gas_20201230_12US1_cmaq_cb6ae7_2020ha2_cb6_20k.ncf
2023-11-09 15:12:03 1.1 GiB 2020platform/emis/2020ha2_cb6_20k/premerged/onroad_gas/emis_mole_onroad_gas_20201231_12US1_cmaq_cb6ae7_2020ha2_cb6_20k.ncf
Total Objects: 2453
Total Size: 2.2 TiB
To copy or download all of this data, if you have 22 TiB of local disk space, use the following command:
aws s3 --no-sign-request --region=us-east-1 cp --recursive s3://2020platform /your/local/directory/
A script is being developed for downloading 2 days of input data to run a benchmark using this case. That script can be modified to obtain files required to model for a user specified time period.
Please submit any questions or difficulties as a new issue on the CMAS User Forum.
CMAS User Forum