Search Jobs

Search by job, company or skills

Python Pyspark, Gen AI

Python Pyspark, Gen AI

Tata Consultancy Services
Early Applicant
  • Posted 6 days ago
  • Be among the first 10 applicants

Job Description

Skill: Python Pyspark, Gen AI

Exp: 5 to 8 Years

Location: Chennai

Required Skills & Responsibilities

  • Strong hands-on experience in Python programming, Object-Oriented Programming (OOP), data structures, APIs, and software development best practices.
  • Expertise in PySpark, Apache Spark, Databricks, and building scalable ETL/data processing pipelines for large datasets.
  • Experience with Generative AI technologies, including LLMs, Transformers, Prompt Engineering, RAG, embeddings, and vector databases.
  • Develop, optimize, and maintain data pipelines using Python, PySpark, SQL, and cloud platforms such as Azure, AWS, or GCP.
  • Build and integrate AI/GenAI solutions using frameworks such as LangChain, OpenAI, Hugging Face, TensorFlow, or PyTorch.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

LangChain

embeddings

Generative AI

LLMs

Hugging Face

vector databases

RAG

OpenAI

Prompt Engineering

Similar Jobs

8-15 yrs
Chennai, India
Skills:
Spring Boot, Tensorflow, Pytorch, MLops, Docker, Azure, Kubernetes, Python, AWS, multi-agent systems, vector search, scikit-learn, prompt engineering, R, microservices architecture, LLM observability frameworks, AWS SageMaker, Google Vertex AI, Azure AI
4-6 yrs
Chennai, India
Skills:
.NET, Java, Version Control, Logging, Tensorflow, Pytorch, MLops, Keras, Python, embeddings, Generative AI concepts, LLMs, LLMOps, Monitoring, NLP fundamentals, prompt engineering, foundation models
5-12 yrs
Chennai, India
Skills:
.Net Core, React, Artificial Intelligence, Angular, Microservices, Generative AI, Azure services
5-7 yrs
Chennai, India
Skills:
Python, Gen AI
6-10 yrs
Chennai, India
Skills:
react.js , Docker, Kafka, Rabbitmq, Typescript, Gcp, Javascript, Etl Tools, Azure, Kubernetes, AWS, NoSQL databases, message brokers, LLM Integration, GraphQL APIs, SQL databases