Data Engineer
LINEヤフー株式会社
- Python
- Machine Learning
- SQL
- Data management
- Spark
- Hadoop
- Hive
- Data Pipeline
- Data Engineer
- Amazon Redshift
- Apache Airflow
- Amazon Athena
- Teradata
- Trino
- machine learning project
- Apache Nifi
-
¥7,000,000 - 12,000,000
-
Tokyo
-
Over 10,000
Company Info
LINE Yafu is a system that provides a framework for building and operating various data in real-time, and provides a system foundation that can be utilized by various data in real-time. Application developers can easily use data and provide an environment for building systems, maintaining data quality, security, and optimizing performance automatically.Job Summary
As a data engineer, you will be responsible for the development of data analysis, machine learning, data pipeline development, data management, and machine learning project development. Experience with SQL data collection and analysis, as well as experience with Hadoop, Spark, Trino, Hive, Teradata, Amazon Athena, Amazon Redshift, Apache Airflow, and Apache Nifi data pipeline development is required.Duties
As a data engineer, you will be responsible for the development of data analysis for the member service 'LYP Premium' and data management. Specific tasks include the development of large-scale data pipeline for the old LINE and old Yafu data analysis environment, social graph analysis, LINE app utilization, EC utilization, media viewing, search utilization, and other diverse data collection, as well as the development of data analysis, data pipeline development, and machine learning project development.Login to see all information about offers.
By registering with LabBase Plus you...
- can view all offer information,
- receive notifications of new offers,
- possibly be scouted by corporations
Registration takes roughly 2 minutes