Slide 61
Slide 61 text
ソースコード
61
② 徐々に育てていく
# DynamicFrameの作成
src_timeseries_dyf = glueContext.create_dynamic_f
rame.from_catalog(
database=args["DB_NAME"],
table_name=args["TBL_NAME"],
transformation_ctx="src_timeseries_dyf"
)
# マッピング
mapping_list = [
("device_id", "string", "device_id", "string"
),
("timestamp", "int", "timestamp", "int"),
("location.lat", "string", "latitude", "doubl
e"),
("location.long", "string", "longitude", "dou
ble")
]
map_timeseries_dyf = ApplyMapping.apply(
frame=src_timeseries_dyf,
mappings=mapping_list,
transformation_ctx="timeseries_map_dyf"
)
Amazon Redshift
Spectrum
S3
AWS Cloud
AWS glue data
catalog
Crawler
S3 AWS Glue Job
.py