Data Engineer (AWS Utilization Self-developed Service Development)
クラスメソッド株式会社
- Python
- AWS
- CI/CD
- MySQL
- Scala
- Apache Spark
- Athena
- Data Pipeline
- Data Engineer
- Distributed Processing
- ETL processing
- CSV
- Parquet
- ORC
-
¥7,000,000 - 12,000,000
-
101 to 1,000
-
Company Homepage
Company Info
Cloud service provider as a partner to the AWS Premier Consulting Partner, specializing in AWS infrastructure expansion and business utilization, and providing a solid foundation for business data utilization and promoting the growth of cloud infrastructure. We will contribute to the success and growth of our customers by providing a large number of cases where the compatibility of cloud and the promotion of business utilization of data in the business company are extremely good.Job Summary
As a data engineer, you will be involved in the development of a self-developed service utilizing AWS. You will experience the development of a distributed system that utilizes a scalable environment, data operations and the most suitable optimization, and the demand for programming ability (Java, Scala, Python, etc.). In addition, you will also be welcomed with practical experience in development related to AWS knowledge and CI/CD environment.Duties
In this position, you will be performing the following tasks as a data engineer for the service development of Classmethod (Classmethod Ventures). You will be utilizing various data formats such as CSV, Parquet, ORC, and implementing ETL processing using Apache Spark, and using Athena, MySQL, etc. for data operations, and utilizing the most suitable Scala and Python for development and optimization, and practical time optimization for data processing and machine learning.Login to see all information about offers.
By registering with LabBase Plus you...
- can view all offer information,
- receive notifications of new offers,
- possibly be scouted by corporations
Registration takes roughly 2 minutes