Data Engineer
The Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with the most suitable technologies. Our engineers do not merely solve problems at hand; We build foundations for a long-lasting future. We don't limit ourselves on what we can or can't do; we take matters into our own hands even if it means drilling down to the bottom layer of the computing platform. Shopee's hyper-growing business scale has transformed most "innocent" problems into huge technical challenges, and there is no better place to experience it first-hand if you love technologies as much as we do.
Job Description:
- Design and grow Shopee’s data warehouse, build reliable and smart ways to ingest data to the warehouse, and help engineer efficient data pipelines. Some examples include self-service data ingestion systems, Airflow-enabled workflows with code-as-configuration, and data validation tools
- Build critical data marts and applications to support products and solve specific business needs, design data models for optimal storage and retrieval, and optimize data architectures to meet critical product and business requirements. Some examples include a real-time Campaign Mart (used to serve the business with live intelligence) and Order Mart (to supply low latency seller performance system)
Requirements:
- B. Sci. / Ms / PhD in Computer Science or a related technical field
- Less than 1 year of experience welcomed
- Working experience in software development in at least one of these languages: Java, Scala, Python, C/C++, under Linux / Unix. Scala is a plus
- Familiar with SQL; strong scripting ability in Bash is a plus
- Familiar with Hadoop, Spark, Kafka, Presto, and other big data experience is a plus
- Familiar designing and operating of a robust distributed system is a plus
- Love to use and develop open-source technologies
- Excited to work intimately with data
- Passionate, self-motivated, and takes ownership
Virtual interviews will be conducted in place of physical interviews for applicants outside of Singapore.
Work Visa Sponsorship will be considered for non-citizen successful applicants.