Staff Data Engineer
Coupang
This job is no longer accepting applications
See open jobs at Coupang.See open jobs similar to "Staff Data Engineer" Alpha Partners.About the Company :
We are proud to have the best of both worlds — a startup culture with the resources of a large global public company. This fuels us to continue our growth and launch new services at the speed we have been at since our inception. We are all entrepreneurial surrounded by opportunities to drive new initiatives and innovations. At our core, we are bold and ambitious people who like to get our hands dirty and make a hands-on impact. At Coupang, you will see yourself, your colleagues, your team, and the company
grow every day.
As a Staff Data Engineer for the Core Data and Ingestion team, you will be responsible for the Architecting, design, and development of the Data Ingestion, Data Lake, Data Warehouse, and Data Marts to enable data-driven decision-making across different organizations at Coupang.
In this role, you will be responsible to work across business domains to understand their business needs, work with Big Data Infrastructure to Architect/Design the reliable and scalable data products which process tera bytes of data each day and enable our customers to make reliable and fast business decisions. At this scale, you will need to ensure fault tolerance and robustness to deliver accurate results on time.
What You Will Do :
- Serve as a technical expert and exert technical influence over a team, increasing their productivity and effectiveness by sharing your deep knowledge and experience.
- Work closely with Business analyst across business domains, identify their data needs, identify core KPI’s to drive business growth, Influence source data producers to log key attributes.
- Define foundational core data models across different business domains such as search, finance, accounting, advertising, marketing, warehouse management systems etc.
- Design and build Coupang's next generation Data Lake, and Data Warehouse.
- Design and build reliable data pipelines using modern distributed processing technologies such as Spark, Streaming, Iceberg, and Hive with the ability to scale very large data volumes.
- Experience driving Master data management practices from producer/source to consumer/data warehouse.
- Foster, mentor, and enforce industry best practices in data architecture, design patterns, big data platform, storage, distributed compute and coding standard.
Basic Qualifications :
- Bachelor's degree and/or Master's degree in Computer Science or equivalent.
- 8+ years of experience working on Bigdata with deep understanding of data modeling, data architecture, and data warehousing.
- Strong hands-on experience in distributed processing using Scala/Spark, PySpark, and Hive.
- Extensive experience Bigdata Platform, Data Warehousing concepts and languages (SQL, NoSQL) and MPP database such as Redshift.
- Problem solver, Pragmatic and Open-minded.
- Experience with handling large data volumes in a distributed environment.
- Hands on experience with AWS Cloud Computing platforms and understanding of scalability and reliability issues.
- Hands-on experience in one or more programming languages such as Java, Scala, Python or similar languages.
- Experience in collaborating with cross-functional teams to define mission, vision, and roadmaps
Preferred Qualifications :
- Experience in e-commerce Data products.
- Experience of using large-scale distributed infrastructures for data processing (e.g., Kafka, EMR, Spark on Kubernetes, Redis, Hive/Spark on Hadoop).
- Experience in event based Near Real Time (NRT) data ingestion/processing.
- Familiarity with workflow or orchestration frameworks, open-source tools like Airflow and Luigi or commercial enterprise tools. Knowledge of container services (Docker/Kubernetes) is a plus.
Equal Opportunities for All
Coupang is an equal opportunity employer. Our unprecedented success could not be possible without the valuable inputs of our globally diverse team.
This job is no longer accepting applications
See open jobs at Coupang.See open jobs similar to "Staff Data Engineer" Alpha Partners.