Click on the product name to see the details of the product.
If there are SD arrays (data sets) for multiple observation wavelengths, a representative one is shown.
ARNP (Aerosol properties using numerical prediction) [AROT/ ARAE/ ASSA]
Level-2 products are provided as a single HDF5 file including AROT (Aerosol optical thickness over land and ocean), ARAE (Ångström exponent over land and ocean), and ASSA (Single Scattering Albedo over land and ocean) by tile units.
For more information on tile products, see FAQ https://shikisai.jaxa.jp/faq/faq0080.html.
Level-2 global products are provided in the same geophysical quantity configuration as Level-2 products, but with a global EQA (sinusoidal equal area).
Level-3 products are provided as a global area product for each geophysical quantity.
G-Portal: HDF5
G-Portal Processing Request: GeoTIFF(Individual files)
JASMES: NetCDF4
Physical quantiies
AROT (Aerosol optical thickness over land and ocean)
The optical thickness (τ) of aerosols over land and ocean at 500 nm estimated using visible and near-infrared reflectance and polarization observations.
Resolution
Level-2: 1km
Level-2 Global: 1/24deg (4.6km)
Level-3: 1/12deg (9.3km)
Physical quantiies
ARAE (Ångström exponent over land and ocean)
Ångström index of aerosols over land and ocean at 500 and 380 nm estimated using visible and near-infrared reflectance and polarization observations.
Resolution
Level-2: 1km
Level-2 Global: 1/24deg (4.6km)
Level-3: 1/12deg (9.3km)
Physical quantiies
ASSA (Single Scattering Albedo over land and ocean)
Single scattering albedo over land and ocean at 380 nm estimated using visible and near-infrared reflectance and polarization observations.
Resolution
Level-2: 1km
Level-2 Global: 1/24deg (4.6km)
Level-3: 1/12deg (9.3km)
CLPR (Cloud Properties) [CLTYPE, CFRx/ CLTT/ CLTH/ COTW/ CERW/ COTI/ Ice cloud effective radius]
Level-2 products are provided as a single HDF5 file including CLTYPE/ CFRx (Classified cloud fraction), CLTT (Cloud top temperature), CLTH (Cloud top height), COTW (Water cloud OT), CERW (Water cloud effective radius), COTI (Ice cloud optical thickness), and Ice cloud effective radius by tile units.
(For more information on tile products, see FAQ https://shikisai.jaxa.jp/faq/faq0080.html.)
Level-2 global products are provides in the same geophysical quantity configuration as Level-2 products, but with a global EQA (sinusoidal equal area).
Level-3 products are provided as a global area product for each geophysical quantity.
G-Portal: HDF5
G-Portal Processing Request: GeoTIFF(Individual files)
JASMES: NetCDF4
Physical quantities
Level-2/ Level-2 Global: CLTYPE (Cloud Type (Bit flag))
Level-3: CFRx (Classified cloud Fraction)
Cloud fractions vy nine cloud types based on the ISCCP classification rule.
x: 1–9, A, H, L, M
Resolution
Level-2: 1km
Level-2 Global: 1/24deg (4.6km)
Level-3: 1/12deg (9.3km)
Physical quantities
CLTT (Cloud top temperature)
The temperature of the cloud top layer.
Resolution
Level-2: 1km
Level-2 Global: 1/24deg (4.6km)
Level-3: 1/12deg (9.3km)
Physical quantities
CLTH (Cloud top height)
Height of the cloud top layer.
Resolution
Level-2: 1km
Level-2 Global: 1/24deg (4.6km)
Level-3: 1/12deg (9.3km)
Physical quantities
COTW (Water cloud OT)
Optical thickness(OT) of water cloud droplets
Resolution
Level-2: 1km
Level-2 Global: 1/24deg (4.6km)
Level-3: 1/12deg (9.3km)
Physical quantities
CERW (Water cloud effective radius)
The effective radius of water cloud droplets
Resolution
Level-2: 1km
Level-2 Global: 1/24deg (4.6km)
Level-3: 1/12deg (9.3km)
Physical quantities
COTI (Ice cloud optical thickness)
The optical thickness of the ice cloud
Resolution
Level-2: 1km
Level-2 Global: 1/24deg (4.6km)
Level-3: 1/12deg (9.3km)
CLFG (Cloud flag)
Level-2 products are provided as HDF5 files by tile units.
For more information on tile products, see FAQ https://shikisai.jaxa.jp/faq/faq0080.html.
Level-2 global products are provides in the same geophysical quantity configration as Level-2 products, but with a global EQA (sinusoidal equal area).
G-Portal: HDF5
G-Portal Processing Request: GeoTIFF
JASMES: NetCDF4
LCLR (Top of atmosphere radiance only when clear)
Level-2 global products are provided in EQA (sinusoidal equal area).
G-Portal: HDF5
JASMES: NetCDF4
LTOA (Top-of-atmosphere radiance)
The following methods are available for using GeoTIFF files of "SHIKISAI" Level-2/Level-3 data.
This section provides examples of GeoTIFF conversion of an HDF5 file "SHIKISAI image" obtained from G-Portal into a map-projected GeoTIFF file.
Click on the tool name to go to the download page.
Target Products | Tool Name | |
---|---|---|
Level-2 (L2) |
SGLI Map projection & GeoTIFF conversion tool |
Link to "Tools & Documents" page in G-Portal. Platforms: Windows, Linux |
Level-3 (L3) |
QGIS(Quantum GIS)/gdal |
Link to an external site. Platforms: Windows, Linux |
This section explains converting a GeoTIFF file using the "Tools" above and the HDF5 sample data below. A map projection will also be provided.
Data used
Please obtain the following data from G-Portal.
Level-2 ARNP:
Observed 09/16/2022 Around the Sea of Japan (Tile No.0528) Daytime
GC1SG1_20220916D01D_T0528_L2SG_ARNPK_3003.h5 (4MB)
Level-3 AROT:
Monthly statistics for July 2022 Global Daytime
GC1SG1_20220701D01M_D0000_3MSG_AROTC_3000.h5 (10MB)
Using the Windows command prompt or equivalent, go to the directory where "SGLI_geo_map_win.exe" is located.
(The Windows command prompt can be accessed from Windows Start > Windows System > Command Prompt.)
Below is an example where the SGLI_geo_map_win.exe and the data folder containing the data are in the sgli_data folder on the C drive.
The command is an example of map projection of the SD array AROT in Image_data and output as an LZW compressed GeoTIFF file.
The pixel value of 65535 is set to indicate an invalid value; the slope and offset values in the attribute (text information) are stored in the GDAL_METADATA tag.
These values can be found in the <Slope> and <Offset> tags in the XML file output with the GeoTIFF conversion.
>cd C:\sgli_data
>SGLI_geo_map_win.exe c:\sgli_data\data\GC1SG1_20220916D01D_T0528_L2SG_ARNPK_3003.h5 -d Image_data/AROT -r 0 -a default -n 65535 -z -o c:\sgli_data
See "GeoTIFF Tag Information" for the tag information stored in the converted GeoTIFF file.
Converted image displayed in QGIS
Using the Windows command prompt or the equivalent, go to the directory where "SGLI_geo_map_win.exe" is located.
(The Windows command prompt can be accessed from Windows Start > Windows System > Command Prompt.)
Below is an example where SGLI_geo_map_win.exe and the data folder are in the sgli_data folder directly on the C drive.
The command is an example of map projection of SD arrays AROT, QA_Flag in Image_data, and is output as a single LZW compressed GeoTIFF file.
The pixel value of 65535 is set to indicate an invalid value, and the slope and offset values in the attribute (text information) are stored in the GDAL_METADATA tag.
The values are in the tags in the XML file output with the GeoTIFF conversion.
* To output two files, one geophysical and one QA_flag, in a single GeoTIFF and display them in QGIS, set Layer Properties > Symbology > Rendering Type to single band gray.
>cd C:\sgli_data
>SGLI_geo_map_win.exe C:\sgli_data\GC1SG1_20220916D01D_T0528_L2SG_ARNPK_3003.h5 -c AROT,QA_flag -r 0 -a default -n 65535 -z -o C:\sgli_data
See "GeoTIFF Tag Information" for the tag information stored in the converted GeoTIFF file.
To use the gdal command, start the OSgeo4W Shell.
(The OSgeo4W Shell can be accessed at Windows Start > QGIS 3.22.8 > OSgeo4W Shell for a typical installation. The above GeoTIFF output tool is also available from the OSgeo4W Shell.)
Navigate to the directory where the data to be converted to GeoTIFF is stored.
The example below shows where the data to be converted is in the sgli_data folder on the C drive.
The command is an example of map projection of the SD array AROT_AVE in Image_data and output as an LZW compressed GeoTIFF file.
The pixel value of 65535 is set to indicate an invalid value, and the slope and offset in the attribute (text information) are stored in the GDAL_METADATA tag.
Slopes and offsets can be checked with the gdalinfo and HDFView (tool download required) commands.
For an example, please refer to "How to confirm the SD array name of Level-2/Level-3 Atmosphere products."
>cd C:\sgli_data
>gdal_translate -of GTiff -a_srs EPSG:4326 -a_ullr -180 90 180 -90 -a_nodata 65535 -a_scale 9.9999997e-05 -a_offset 0 -co COMPRESS=LZW HDF5:"GC1SG1_20220701D01M_D0000_3MSG_AROTC_3000.h5"://Image_data/AROT_AVE L3AROT_202207_01M.tif
Converted image displayed in QGIS
Here is an example of applying QA_flag information to AROT data created with the "SGLI Map projection & GeoTIFF conversion tool."
Convert the AROT and QA_flag to GeoTIFF format using option "-c" for the "SGLI Map projection & GeoTIFF conversion tool."
The following command extracts data for which the flag of the 4th-5th bit (unreliable) in one pixel set in the QA of ARNP including AROT is other than 11(3).
In addition, it extracts data for which the flag for the 13th bit (surface reflectance is uncertain) is other than 1 (1). The flag value is "0" or "1."
Information on AROT's QA_flag can be found in the "Products and Algorithms" section of the EORC GCOM-C website (https://suzaku.eorc.jaxa.jp/GCOM_C/data/update/Algorithm_ARNP_en.html).
>cd C:\sgli_data
>gdal_calc -A GC1SG1_20220916D01D_T0528_L2SG_ARNPK_3003_AROT_QA_flag.tif --A_band=2 --outfile=L2ARNP_AROT0528D01D_QA.tif --calc="(((A >> 4) & 3) < 3) * (((A << 13) & 1) == 0) * ((A & 1) == 0) * 1" --NoDataValue=65535
Example of bit calculation
* A >> 4 or right_shift(A, 4) ------ If A has the pixel value (decimal: 18431) "01000111111111111111", it is shifted right by 4. The data will be for "010001111111".
* A & 3 or bitwise_and(A, 3) ------ Performs an 11 (decimal 3)-bit operation on the pixel value of A. Extract 4-5 bits of the original data.
010001111111 | (1151) | ||
& | 000000000011 | (3) | |
--------------------------------- | |||
000000000011 | (3) |
(0 and 0 -->0, 1 and 1 --> 1, 0 and 1 --> 0)
Create AROT data using the created QA_flag data.
>gdal_calc -A GC1SG1_20220916D01D_T0528_L2SG_ARNPK_3003_AROT_QA_flag.tif --A_band=1 -B L2ARNP_AROT0528D01D_QA.tif --outfile=L2ARNP_AROT0528D01D_addQA.tif --calc="((A <= 5000) * (B == 1)) * A + ((A <= 5000) * (B == 0)) * 65535 + ((A > 5000) * (B == 0)) * 65535 + ((A > 5000) * (B == 1)) * 65535" --NoDataValue=65535
Set slope/offset with gdal_edit.
>gdal_edit -scale 9.9999997e-05 -offset 0 L2ARNP_AROT0528D01D_addQA.tif
QGIS display of AROT image with QA_flag applied
The use of the QA_flag for Level-3 products is the same as for Level-2. Apply the QA_flag as necessary.
The following is an example of excluding pixels with no input data and pixels with error flags.
>gdal_translate -of GTiff -a_srs EPSG:4326 -a_ullr -180 90 180 -90 -co COMPRESS=LZW HDF5:"GC1SG1_20220701D01M_D0000_3MSG_AROTC_3000.h5"://Image_data/AROT_QA_flag L3AROT_202207_01M_QAflag.tif
>gdal_calc -A L3AROT_202207_01M_QAflag.tif --outfile=L3AROT_202207_01M_QAflag_cal.tif --calc="(A > 253) * 0 + (A <= 253) * 1"
>gdal_calc -A L3AROT_202207_01M.tif -B L3AROT_202207_01M_QAflag_cal.tif --outfile=L3AROT_202207_01M_addQA.tif --calc="(A <= 50000) * (B == 1) * A + (A <= 50000) * (B == 0) * 65535 + (A > 50000) * (B == 0) * 65535 + (A > 50000) * (B == 1) * 65535" --NoDataValue=65535
Set the slope/offset with gdal_edit.
>gdal_edit -scale 9.9999997e-05 -offset 0 L3AROT_202207_01M_addQA.tif
QGIS display of L3 AROT image with QA_flag applied
For SD array names, please refer to "SD Array Names of Level-2/Level-3 Atmosphere Products," below.
For more information, please visit the EORC GCOM-C "Standard Products and Algorithms" website.
The SD array can be checked in the following ways.
For GeoTIFF conversion of Level 3 products, please use gdalinfo of gdal.
gdalinfo | HDFView |
---|---|
If you have a typical QGIS installation, please use the OSGeo4W Shell. (Start Menu > QGIS 3.22.8 > OSGeo4W Shell for version 3.22) Go to the directory containing the data to be converted and enter gdalinfo followed by the file name. Image_data_xxx_Offset and Slope correspond to offset and scale in gdal. After "Image_data/" in SUBDATASET is the SD array name; for conversion in gdal, specify the underlined part. |
Example of Level-3 AROT display. (1) SD array name in Image_data (2) SD array name in Geometry_data (only folder if not included) (3) Additional information on AROT_AVE, slope, and offset information etc. |
>gdalinfo GC1SG1_20220701D01M_D0000_3MSG_AROTC_3000.h5
Image_data_AROT_AVE_Error_DN=65535 |
Product Name | Physical quantity | ID | SD array name (Dataset name) | |
---|---|---|---|---|
Level-2 | CLFG (Cloud flag) |
CLFG (Cloud flag) |
CLFG |
Cloud_flag |
CLPR (Cloud Properties) |
Water/Ice cloud effective radius |
CLPR |
CLER_I, CLER_W |
|
Water/Ice cloud optical thickness |
CLOT_I, CLOT_W |
|||
Cloud top height |
CLTH |
|||
Cloud top temperature |
CLTT |
|||
Cloud Type |
CLTYPE |
|||
ARNP (Aerosol properties using numerical prediction) |
AROT (Aerosol optical thickness over land and ocean) |
ARNP |
AROT, AROT_uncertainty |
|
ARAE (Ångström exponent over land and ocean) |
ARAE, ARAE_uncertainty |
|||
ASSA (Single Scattering Albedo over land and ocean) |
ASSA, ASSA_uncertainty |
|||
Level-2 Global | CLFG (Cloud flag) |
CLFG (Cloud flag) |
CLFG |
Cloud_flag |
CLPR (Cloud Properties) |
Water/Ice cloud effective radius |
CLPR |
CLER_I, CLER_W |
|
Water/Ice cloud optical thickness |
CLOT_I, CLOT_W |
|||
Cloud top height |
CLTH |
|||
Cloud top temperature |
CLTT |
|||
Cloud Type |
CLTYPE |
|||
ARNP (Aerosol properties using numerical prediction) |
AROT (Aerosol optical thickness over land and ocean) |
ARNP |
AROT, AROT_uncertainty |
|
ARAE (Ångström exponent over land and ocean) |
ARAE, ARAE_uncertainty |
|||
ASSA (Single Scattering Albedo over land and ocean) |
ASSA, ASSA_uncertainty |
|||
LCLR (Top of atmosphere radiance only when clear) |
LCLR (Top of atmosphere radiance only when clear) |
LCLR |
Cloud_flag Land_water_flag Lt_P(1,2)_(0,m60,p60) Lt_P(I,Q,U)(01,02) Lt_SW(01-04) Lt_TI(01,02) Lt_VN(01-11,08P,11P) Statistic_data_(SWI,TIR,VNI) |
|
LTOA (Top-of-atmosphere radiance) |
LTOA (Top-of-atmosphere radiance) |
LTOA |
Land_water_flag Lt_P(1,2)_(0,m60,p60) Lt_P(I,Q,U)(01,02) Lt_SW(01-04) Lt_TI(01,02) Lt_VN(01-11) Statistic_data_(SWI,TIR,VNI) |
|
Level-3 | Water cloud effective radius |
Water cloud effective radius |
CERW |
CLER_W_AVE |
Water cloud optical thickness |
Water cloud optical thickness |
COTW |
CLOT_W_AVE |
|
Ice cloud optical thickness |
Ice cloud optical thickness |
OTI |
CLOT_I_AVE |
|
Cloud top height |
Cloud top height |
CLTH |
CLTH_AVE |
|
Cloud top temperature |
Cloud top temperature |
CLTT |
CLTT_AVE |
|
Classified cloud fraction |
Classified cloud fraction |
CFR(1-9) CFR(A,H,L,M) |
CFR(1-9)_Stat CFR(A,H,L,M)_Stat |
|
Aerosol optical thickness over land and ocean |
Aerosol optical thickness over land and ocean |
AROT |
AROT_AVE |
|
Ångström exponent over land and ocean |
Ångström exponent over land and ocean |
ARAE |
ARAE_AVE |
|
Single Scattering Albedo over land and ocean |
Single Scattering Albedo over land and ocean |
ASSA |
ASSA_AVE |
When converted to GeoTIFF using the SGLI Map projection & GeoTIFF conversion tool, the coefficients (slope/offset) of the geophysical conversion are output to an XML file created at the same time.
Display in a text editor or browser.
Below is an example of AROT xml.
Substitute the values of <Slope> and <Offset> into the formulas in <Data_description> to convert pixel values into physical quantities.
<Data_description>Aerosol Optical Thickness at 500 nm | VAL=DN*Slope+Offset</Data_description>
<Offset>0.000000e+000</Offset>
<Slope>1.000000e-004</Slope>
When calculating with the gdal command, the values converted with the following command are stored.
The Slope and Offset values can be left as "1.00000000e-004, 0.00000000e+000".
>gdal_calc -A input.tif --outfile=output.tif --type=Float32 --calc="A * 0.0001" --NoDataValue=65535
Product quality flags (QA_Flag) are stored as 16- or 8bit ON (1) and OFF (0) information.
Product quality information can be found in the "QA_flag information" section of each product page on the "Standard Products & Algorithms" (https://suzaku.eorc.jaxa.jp/GCOM_C/data/product_std.html) website.
Bit No. | 15 | 14 | 13 | 12 | 11 | 10 | 9 | 8 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | 0 |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Example | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Classification | Tag ID | Name | Definition/Value | |
---|---|---|---|---|
TIFF Field | 258 |
BitPerSample |
Number of bits per component. |
8 or 16 32(when converting physical quantity) |
259 |
Compression |
Compression method |
1: No compression 5: LZW(when compression is specified) |
|
257 |
ImageLength |
Image length |
Height (vertical length) of an image expressed in line units. |
|
256 |
ImageWidth |
Image width |
Width (horizontal length) of an image expressed in pixel units. |
|
274 |
Orientation |
Scanning orientation |
1: TopLeft(The image is stored as it is shown) |
|
262 |
PhotometricInterpretation |
Photometric type |
1: BlackIsZero(Display 0 in grayscale image as black) |
|
284 |
PlanarConfiguration |
Order of storing image data |
1: Pixel priority mode (pixel-by-pixel) e.g.RGBRGBRGB…… 2: Plane priority mode (plane-by-plane) e.g.RRR……GGG……BBB…… |
|
339 |
SampleFormat |
Type of data |
1: Unsigned integer data 3: single precision floating point number (when converting physical quantity) |
|
277 |
SamplesPerPixel |
Number of samples per pixel |
Number of stored channels/band |
|
278 |
RowsPerStrip |
The number of lines per strip |
The number of lines of image data per strip. |
|
42112 |
GDAL_METADATA |
GDAL_METADATA |
The slope and offset values are stored according to the settings. |
|
42113 |
GDAL_NODATA |
GDAL_NODATA |
Used in the GDAL library and treated as transparent. |
|
GeoKey | 34735 |
GeoKeyDirectoryTag |
GeoKey Directory |
Store GeoKey directory |
34736 |
GeoDoubleParamsTag |
GeoDouble parameter |
Stores double-valued GeoKeys |
|
34737 |
GeoAsciiParamsTag |
GeoAscii Parameters |
Stores ASCII-valued GeoKeys |
|
33922 |
ModelTiepointTag |
Tie point |
Tie point information(I,J,K,X,Y,Z). Image position (I,J,K) and geographic coordinates (X,Y,Z) |
|
33550 |
ModelPixelScaleTag |
Pixel scale in map linear units per pixel |
Horizontal and vertical pixel spacing (ScaleX, ScaleY, ScaleZ) |
|
1024 |
GTModelTypeGeoKey |
Type of geographic coordinate information |
1: ModelTypeProjected(Projected coordinate system) 2: ModelTypeGeographic(Latitude-longitude coordinate system) |
|
1025 |
GTRasterTypeGeoKey |
Type of raster |
1: RasterPixelIsArea (One pixel represents an area in the real world) |
|
1026 |
GTCitationGeoKey |
CRS Citation |
Geographic (Lat/Lon) / WGS84 PS / WGS84 (When PS is selected) |
|
2054 |
GeogAngularUnitsGeoKey |
Coordinate unit(angle) identification code. |
9102: Degree |
|
2048 |
GeographicTypeGeoKey |
Type of coordinate system |
4326: WGS84 |
|
2049 |
GeogCitationGeoKey |
Geographic coordinate system citation |
WGS 84 (When converted by gdal) |
|
3072 |
ProjectedCSTypeGeoKey |
Projected coordinate reference system |
32767: User-defined (When PS is selected) |
|
3073 |
PCSCitationGeoKey |
Projection citation |
Geographic (Lat/Lon) / WGS84 PS / WGS84 (When PS is selected) |
|
3074 |
ProjectionGeoKey |
Projection method |
32767: User-defined (When PS is selected) |
|
3075 |
ProjCoordTransGeoKey |
Coordinate transformation method |
15: CT_PolarStereographic (When PS is selected) |
|
3076 |
ProjLinearUnitsGeoKey |
Linear unit |
9001: Linear_Meter (When PS is selected) |
|
3081 |
ProjNatOriginLatGeoKey |
Latitude of map-projection Natural origin |
71(Northern hemisphere), -71(Southern hemisphere) (When PS is selected) |
|
3082 |
ProjFalseEastingGeoKey |
Gives the easting coordinate of the map projection Natural origin |
0 (When PS is selected) |
|
3083 |
ProjFalseNorthingGeoKey |
Gives the northing coordinate of the map projection Natural origin |
0 (When PS is selected) |
|
3095 |
ProjStraightVertPoleLongGeoKey |
Longitude at Straight Vertical Pole. For polar stereographic |
0 (When PS is selected) |