Search by job, company or skills

Senior Data Engineer

Senior Data Engineer

pixelate everything sdn bhd
5-7 Years
Not Disclosed
Early Applicant
  • Posted 8 months ago
  • Be among the first 10 applicants

Job Description

Job Description

We are looking for a highly skilled Data Engineer to support the Marketing & Analytics Department. This role focuses on building robust data pipelines, ensuring data quality, enabling accurate analytics, and supporting high-volume data operations across marketing, product, and BI use cases.

Responsibilities

1. Data Pipeline Development

  • Build and maintain ETL/ELT pipelines for marketing, product, and user analytics data.
  • Implement real-time streaming pipelines using Kafka, Redpanda, Pulsar, or equivalent.
  • Integrate data from multiple platforms (GA4, GTM, ad platforms, CRM, tracking systems).
  • Ensure scalable ingestion into ClickHouse or other columnar databases.

2. Data Infrastructure & Storage

  • Design and manage ClickHouse schemas, tables, materialized views, and optimizations.
  • Maintain data warehouse performance, partitioning, compression, and cost efficiency.
  • Implement data retention policies and optimize for high-volume event data.

3. Data Quality & Governance

  • Work closely with Marketing Data Analysts to support accurate event tracking.
  • Validate incoming data, perform QA on new fields/events, maintain consistency.
  • Establish naming conventions, data dictionary, and governance rules.
  • Monitor pipelines and ensure high system uptime & data accuracy.

4. Data Integration & Automation

  • Build connectors between tracking tools (GA4, PostHog, Mixpanel, Amplitude) and warehouse.
  • Automate marketing and product reporting workflows.
  • Support ingestion of pixel tracking data, ad conversions, campaign performance metrics.
  • Develop APIs or microservices for data sharing across internal systems.

Required Skillset

Must-Have (At Least 5):

  • Strong experience with ClickHouse (or Redshift/BigQuery/Snowflake with willingness to switch).
  • Hands-on experience with data streaming (Kafka, Redpanda, Kinesis, Pulsar).
  • Proficiency in SQL (advanced queries, window functions, optimization).
  • Experience building pipelines using tools like Airflow, dbt, Prefect, or custom scripts.
  • Experience integrating with marketing + product analytics tools (GA4, GTM, tracking SDKs).
  • Proficiency in Python for ETL, API ingestion, and automation.
  • Understanding of event-driven data models (events, properties, sessions, users).
  • Experience with version control (Git) and CI/CD workflows for data.
  • Able to write and talk in Chinese.

Good-to-Have (Bonus Skills):

  • Experience with ClickHouse cluster administration (replication, sharding).
  • Knowledge of marketing metrics (ROAS, CAC, LTV, attribution).
  • Familiarity with BI tools (Tableau, Looker, Power BI, Metabase).
  • Experience in fintech, ad-tech, or other high-volume tracking environments.
  • Familiarity with tracking QA tools, SDK instrumentation, or tag management.

Benefits:

  • Flexi Working Hours
  • Optical and Dental
  • Body Screening and Insurance Claims

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Similar Jobs

4-6 yrs
Malaysia, Selangor, Petaling Jaya
Skills:
Sql, Etl, Big Data Technologies, Python, Pyspark, Presto, Airflow
4-6 yrs
Malaysia, Selangor, Petaling Jaya
Skills:
data segmentation , Python, Sql, Databricks, Data Modeling, Apache Spark, DataFlow, Data structures, Data Transformation, Metadata Management, Data mining, MLflow, dependency management, Prefect, Feature stores, Database design and development, A/B testing platforms, workload management, Experiment tracking, ETL processes
7-15 yrs
Kuala Lumpur, Cyberjaya, Selangor
Skills:
Big Data Hadoop, Apache Airflow, Kubernetes, MinIO
4-6 yrs
Malaysia, Selangor, Shah Alam
Skills:
Sql, Python, Azure Data Factory, Azure Synapse, Pyspark, dimensional data modelling, Lakehouse design, Delta formats, Microsoft Fabric, Medallion Architecture, OneLake, Parquet
SENIOR DATA ENGINEER
**********Company Name Confidential
7-15 yrs
Remote
Skills:
Security amp; Reliability, Snowflake Openflow ? Apache NiFi ? ETL/ELT Pipeline Development ? Data Ingestion, Transformation amp; Integration ? Snowflake Data Warehousing ? Data Flow Optimization amp; Performance Tuning ? Data Quality