ETL工程师

Key Responsibilities:
• Design and develop ETL processes to ensure data accuracy and consistency.
• Optimize ETL processes to enhance efficiency and performance
• Participate in requirements analysis and system design to understand business needs and technical solutions.
• Assist in writing documentation, including design documents, user manuals, and technical specifications.
• Learn and implement best practices such as Agile development, version control, and code reviews.
• Attend project meetings and contribute your insights and suggestions.
Requirements:
• Bachelor’s degree or higher in computer science, data science or related field preferred
• Proficient in using Python/Databricks with certain code optimization capabilities.
• Practical experience in Databricks performance tuning, including Spark SQL optimization, cluster configuration, Delta Lake optimization (e.g. partitioning, Z-Ordering), and monitoring job performance and costs.
• Good spoken and written English to handle daily work environment
• Strong teamwork and communication skills
• Be familiar with one or more cloud products, such as Microsoft Azure, Alibaba Cloud.