大数据架构/Data Technical Engineer

关于客户

职位描述

• Brief Introduction of the position
  A data technical engineer who is part of the Data Science Industrialization team charged with building and automating high quality data pipelines that power advanced analytics/Al/ML and key business applications. You will be a member of a global team helping to develop and innovate on commercial go-to-market strategies.
  
  
  Key Tasks
  Data architecture: Responsible for designing and implementing data architecture, including data models, dataflows, data storage, and data integration. Ensure that the data architecture meets business requirements and has good scalability and performance.
  Masters’sdegree or higher in Computer Science, Information Technology, or related majors.
  5+ years of experience in in data processing, data integration, or related fields.
  Experienced in large-scale data processing and analysis, including data cleaning, data preprocessing, data modeling, and data analysis.
  Expertise in using big data processing frameworks and tools like Hadoop, Spark, Flink, MapReduce, Hive, and related components such as Oozie, ZooKeeper, etc.
  Familiarity with big data services on cloud platforms like Huawei Cloud/Alibaba Cloud/AWS, as well as associated deployment and maintenance.
  Understanding of data warehouse architecture design and data lake concepts, capable of designing and optimizing data storage solutions
  Proficient in Linux/Unix operating systems with practical experience working in a Linux environment.
  Mastery of at least one or higher programming languages such as Pythonor R.
  Skilled in data structures and algorithm principles and able to apply them to solve real-world problems.
  Conversational in English in writing and speaking.
  Data model design: Create and maintain data models, including logical and physical models. Understand business requirements and translate them into actionable datamodels, ensuring data consistency and accuracy.
  Data integration and processes: Responsible for designand implementation of data extraction, transformation,and loading ( processes. Integrate different data sources and systems, ensuring data accuracy andintegrity.
  Data security and compliance: Develop data security and compliance strategies, ensuring data confidentiality, integrity, and availability. Understand relevant data privacy regulations and compliance requirements and incorporate them into the data architecture.
  Data quality management: Establish data quality standards and processes, monitor and improve data quality, identify and resolve data quality issues. Assist in data governance work.

任职要求

• Qualification and skills
  Masters’s degree or higher in Computer Science, Information Technology, or related majors.
  5+ years of experience in in data processing, data integration, or related fields.
  Experienced in large-scale data processing and analysis, including data cleaning, data preprocessing, data modeling, and data analysis.
  Expertise in using big data processing frameworks and tools like Hadoop, Spark, Flink, MapReduce, Hive, and related components such as Oozie, ZooKeeper, etc.
  Familiarity with big data services on cloud platforms like Huawei Cloud/Alibaba Cloud/AWS, as well as associated deployment and maintenance.
  Understanding of data warehouse architecture design and data lake concepts, capable of designing and optimizing data storage solutions
  Proficient in Linux/Unix operating systems with practical experience working in a Linux environment.
  Mastery of at least one or higher programming languages such as Pythonor R.
  Skilled in data structures and algorithm principles and able to apply them to solve real-world problems.
  Conversational in English in writing and speaking.