LabBase Plus celebrates pride
You have two remaining job offer view. Register to remove limit.

Data Engineer (AWS Utilization Self-developed Service Development)

クラスメソッド株式会社

Duties

In this position, you will be performing the following tasks as a data engineer for the service development of Classmethod (Classmethod Ventures). You will be utilizing various data formats such as CSV, Parquet, ORC, and implementing ETL processing using Apache Spark, and using Athena, MySQL, etc. for data operations, and utilizing the most suitable Scala and Python for development and optimization, and practical time optimization for data processing and machine learning.

Requirements

・Experience in the development of a distributed system ・Experience in data operations and the most suitable optimization ・Programming ability (Java, Scala, Python, etc.) ・Experience in development in a team

Welcomed Skills

・Knowledge and practical experience in development related to AWS ・Practical experience in development related to CI/CD environment ・Knowledge and practical experience in the design and implementation of data pipeline and various data formats such as CSV, Parquet, ORC

*Data presented in this article may be outdated. If you notice a discrepancy in our data, please notify us on our contact page, here following this link.