Skip to content

Engineer - Distributed Data Processing System

    • Markham, Ontario
  • pme6g

Job description

Huawei Canada has an immediate 12-month contract opening for an Engineer.


About the team:

Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation center in Canada. The lab focuses on researching and developing advanced cloud technologies, supporting the productization and iterative optimization of its technical achievements. Current research areas include cloud native databases, infrastructure resource scheduling and prediction, cloud-native middleware, media engines, and user experience studies. The lab fosters a robust technical environment, allowing collaboration with industry experts to create a highly competitive cloud platform.Our team has an immediate permanent opening for a Principal Software Engineer.


About the job:

  • Work with a team of architects and engineers to develop proof-of-concept distributed systems and product components.
  • Investigate and design data processing system focusing on extra-large volume data for real-time streaming, based distributed system with the latest and state of the art hardware technology.
  • Continuous enhancements on the AI-native data analysis system to fulfill customer requirements utilizing AI techniques for public cloud capacity management and scheduling.

Job requirements

About the ideal candidate:
  • Master's or Ph.D. in Computer Science, Computer Engineering, Applied Mathematics
  • High proficiency with Java and Golang, must be able to write strong /clean, brand-new code
  • Deep understanding of fundamental concepts such as distributed data processing, distributed database/storage system/file system/memory allocation/cache system, like Kafka and Flink
  • Ability to clearly articulate technical concepts and challenges
  • Highly analytical with strong problem-solving skills
  • Self-motivated with a proven ability to learn and take initiative
  • Experience with Linux system level development, distributed system, or scheduling algorithm is an asset

or