【 What You'll be Doing 】
- Develop, operate, and monitor ETL and real-time data pipelines for data collection, cleansing, processing, storage, and analytics
- Design and maintain data schemas, and perform database performance tuning
- Develop backend APIs and maintain data visualization platforms for SHOPLINE merchants
【 Who We are Looking for 】
- Fluent in Python and SQL; experience with API frameworks (Flask, FastAPI, Django) is a plus
- Expertise in designing and developing ETL and real-time streaming jobs (Apache Airflow preferred)
- Solid experience with real-time data processing and stream-processing systems, such as Apache Flink, RisingWave, and Apache Kafka
- Proficient in SQL and NoSQL databases; experience with TiDB, BigQuery, PostgreSQL, MySQL, and MongoDB is a plus
- Experience with cloud services such as AWS / GCP, especially data-related services
- Familiar with Linux/Unix environments and containerization tools such as Docker / Kubernetes
- It's a plus if you have experience in the e-commerce industry and strong skills in data analysis