Data Engineer
株式会社カケハシ
- Data management
- Airflow
- Databricks
- Apache Spark
- AWS Glue
- DMBOK
- data infrastructure development
- ETL/ELT processing development
- development and operation of data platform systems
- experience using various cloud services such as AWS/GCP/Azure
- experience using Databricks
- experience in handling necessary data for anonymous processing
-
¥6,000,000 - 12,000,000
-
Tokyo
-
101 to 1,000
-
Company Homepage
Company Info
Job Summary
As a data engineer, you will be responsible for the following tasks. First, define the requirements for analysis and design of data pipelines, and use Databricks, Airflow, and AWS Glue to design, develop, and operate data pipelines. Also, use Apache Spark to develop ETL processing, and utilize DMBOK and data management for data maintenance and governance.Duties
As a data engineer, you will be mainly responsible for the following tasks. First, define the requirements for analysis and design of data pipelines, and use Databricks, Airflow, and AWS Glue to design, develop, and operate data pipelines. Also, use Apache Spark to develop ETL processing, and utilize DMBOK and data management for data maintenance and governance. In addition, promote the expansion of data business and the utilization of in-house data for the purpose of promoting the development of data infrastructure and ETL processing.Login to see all information about offers.
By registering with LabBase Plus you...
- can view all offer information,
- receive notifications of new offers,
- possibly be scouted by corporations
Registration takes roughly 2 minutes