Senior Data Engineer
Pune · On-site · Senior · Full-time
- sql
- python
- scala
- spark
- pyspark
- hadoop
- aws
- s3
- databricks
Senior Data Engineer to design scalable batch and real-time pipelines using Spark, AWS, and Databricks for analytics and ML at Mastercard.
Apply on Mastercard's site Ask for a referral Interview prep
Interview prep: questions this posting points to
- Walk me through how you'd design a data pipeline in Apache Spark that needs to run identically on-prem on Hadoop and on a public cloud object store, with no code changes between environments. What would you abstract away?
- A production ETL job built with DMExpress fails overnight and the data warehouse doesn't get refreshed before business hours. Walk me through how you triage this independently, since the posting says you need to handle incidents on your own.
- Tell me about a time when you had to troubleshoot a complex production incident in a data pipeline. How did you approach root cause analysis and prevent it from happening again?
Read the full job description
Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary Senior Data Engineer
Overview
The Data Engineering team builds trusted, scalable datasets and pipelines that power analytics, BI, and machine learning use cases across Mastercard. This role will help design and deliver resilient data pipelines, curated data models, and ML-ready feature datasets while partnering closely with platform engineering, data science, and BI stakeholders. Role As a Data Engineer / MLE, you will: • Design, build, and maintain scalable batch and near-real-time data pipelines. • Develop curated datasets and data models that enable reliable analytics and ML workloads. • Implement pipeline reliability patterns (monitoring, alerting, retries, performance tuning). • Partner with data scientists to enable feature engineering and model operationalization. • Ensure secure data handling aligned to enterprise governance and compliance expectations. • Drive engineering best practices (code quality, testing, documentation, CI/CD where applicable). All
About You
Essential Skills (Must Have): • Strong proficiency in SQL and Python (or Scala) for data engineering. • Experience building data pipelines using distributed processing (e.g., Spark,PySpark,HADOOP). • Experience in using data technology technology like AWS, S3, Databricks. • Solid understanding of data modeling (dimensional and/or lakehouse patterns) and data quality concepts. • Experience working with cloud data ecosystems (AWS preferred) and object storage / lake patterns. • Ability to troubleshoot performance and reliability issues in production pipelines. • Strong communication skills and ability to collaborate across engineering and analytics stakeholders.
Nice to have
• Experience with Databricks or similar lakehouse platforms. • Exposure to ML feature pipelines, model deployment patterns, or MLOps concepts. • Experience in payments / banking / regulated environments. • Familiarity with data governance tooling (catalog, lineage) and PII handling patterns. Corporate Security Responsibility All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must: Abide by Mastercard’s security policies and practices; Ensure the confidentiality and integrity of the information being accessed; Report any suspected information security violation or breach, and Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
Members get roles like this as soon as we find them on the company's careers page, and paid plans email the ones that match their resume.
Get new roles first — free