从原始数据到精炼数据:使用AWS Glue在S3中整理数据以供Athena查询
原文英文,约400词,阅读约需2分钟。发表于: 。Being a data engineer is fun in own ways. Thinking of a different, easiest and optimised way to solve a problem is 90% of the effort. Few years back, when I and AWS Glue was young, created a whole...
数据工程师使用AWS Glue创建了一个完整的ETL流水线,包括Fetch CSV、Convert to Parquet和Curate Data三个作业,可以处理结构化或非结构化数据。流水线易于实施和维护,使用Athena查看S3中的数据。