Search Jobs

Search by job, company or skills

Data Engineer (SQL, Python, Linux, AWS and PySpark)

Data Engineer (SQL, Python, Linux, AWS and PySpark)

Saxon AI
Early Applicant
  • Posted 2 months ago
  • Be among the first 50 applicants

Job Description

Data Engineer

Immediate starters required

Location: Hyderabad, TG & Pune, MH

Responsibilities

·Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.

·Collaborate with product and technology teams to design and validate the capabilities of the data platform

·Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability

·Provide technical support and usage guidance to the users of our platform's services.

·Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.

Qualifications

·Experience building and optimizing data pipelines in a distributed environment

·Experience supporting and working with cross-functional teams

·Proficiency working in Linux environment

·5+ years of advanced working knowledge of SQL, Python, and PySpark

·Knowledge on Palantir

·Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline

·Experience with platform monitoring and alerts tools

More Info

Job Type:
Industry:
Employment Type:

Key Skills

About Company

Similar Jobs

4-7 yrs
Hyderabad, India
Skills:
RDS, Pyspark, AWS Glue, Dynamodb, Emr, Sql, Lambda, Cloudwatch, Sqs, Iam, Sns, Python, AWS, Lake Formation, CloudTrail
6-9 yrs
Hyderabad, India
Skills:
Infrastructure as Code (IaC), Azure Data Factory (ADF), Data Modeling, Terraform, Pyspark, Spark, Databricks, Aws Cloud, Python, Sql, ETL/ELT
8-10 yrs
Hyderabad, India
Skills:
Logging, PostgreSQL, AWS Glue, Data Modeling, Redshift, Sql, Git, Lambda, Kinesis, MySQL, Python, Aws S3, data lake architectures, AWS Cost Management, star schemas, data warehousing solutions, data versioning, data normalization, error handling, ETL pipelines
8-12 yrs
Hyderabad, India
Skills:
Docker, FastAPI, Datadog, Python, LangChain, Vector Databases, Uvicorn
6-8 yrs
Hyderabad, India
Skills:
snowflake , Data Modeling, Automated Testing, Version Control, Sql, Release Management, ELT, Performance Tuning, Python, Etl, Auditing, Data Quality Checks, Orchestration and Scheduling, dbt, CI/CD, Role-based Access, Monitoring