Data Engineer

We are hiring the data engineer ,the key skills Python, SQL, Hadoop, Spark, Databricks. This is contract role ,1 year contract period.

Key Responsibilities

Operate, monitor, and support the data lake platform on a big data environment, ensuring system stability and high availability.

Design, develop, and optimize ETL pipelines to support efficient ingestion, storage, and processing of petabyte-scale data.

Manage data lake metadata, access control, and data lifecycle, ensuring security, governance, and regulatory compliance.

Optimize overall data platform performance, including resource scheduling, storage utilization, cost control, and query efficiency.

Troubleshoot and resolve data pipeline, platform, and production issues in a timely manner.

Collaborate with platform, analytics, and application teams to provide reliable data access and computing services.

Contribute to technical documentation, operational procedures, and continuous platform improvement initiatives.

Requirements

Bachelor's degree or above in Computer Science, Information Technology, or a related field.

Solid understanding of big data ecosystems, including Hadoop, Spark, and related components.

Familiarity with data lake architectures and technology stacks.

Proficient in SQL and Python, with hands-on experience in ETL development and performance tuning.

Good knowledge of Linux systems, distributed storage technologies (HDFS, S3), and container platforms (Docker, Kubernetes).

Strong problem-solving skills, sense of ownership, and ability to work effectively in a team-oriented environment.Fluent in both Chinese and English as working languages.to the application.

Preferred Qualifications

Experience supporting large-scale data platforms in production environments.

Exposure to data governance, metadata management, and access control frameworks.

Experience with resource scheduling and performance optimization in distributed systems.

About CLPS RiDiK

RiDiK is a global technology solutions provider and a subsidiary of CLPS Incorporation

(NASDAQ: CLPS), delivering cutting-edge end-to-end services across banking, wealth

management, and e-commerce. With deep expertise in AI, cloud, big data, and

blockchain, we support clients across Asia, North America, and the Middle East in

driving digital transformation and achieving sustainable growth. Operating from

regional hubs in 10 countries and backed by a global delivery network, we combine

local insight with technical excellence to deliver real, measurable impact. Join RiDiK

and be part of an innovative, fast-growing team shaping the future of technology

across industries