lvl100Sign in

PwC Global

IN_Senior Manager_Databricks SME/Architect_Data and Analytics_Advisory_Bangalore

  • Bengaluru Millenia
  • Full-time
  • Posted

Skills

  • AWS
  • Apache Spark
  • CI/CD
  • Communication
  • Data Analysis
  • Google Cloud
  • Large Language Models
  • Leadership
  • Machine Learning
  • Microsoft Azure
  • Python
  • SAP
  • SQL
  • Java
  • Teamwork

Job description

Line of Service

Advisory

Industry/Sector

Not Applicable

Specialism

Data, Analytics & AI

Management Level

Senior Manager

Job Description & Summary

At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals.

In data analysis at PwC, you will focus on utilising advanced analytical techniques to extract insights from large datasets and drive data-driven decision-making. You will leverage skills in data manipulation, visualisation, and statistical modelling to support clients in solving complex business problems.

*Why PWC

At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more

about us

At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations.

Job Description & Summary:

We are looking for an experienced Databricks Subject Matter Expert (SME)/Architect to join an enterprise client engagement. The candidate should have strong expertise in Databricks administration and architecture across Azure, AWS, and GCP, including experience migrating SAP source systems to GCP and Databricks.

The role will oversee platform administration, security, integration of new NPI tools, migrations, platform maintenance, and other administration activities on Azure and AWS. The candidate will design scalable data solutions, optimize Databricks workloads, implement governance and security controls, and work closely with business stakeholders and IT delivery teams.

Role: We are looking for an experienced Databricks Subject Matter Expert (SME)/Architect to join one of our enterprise client engagements. The candidate should have strong expertise in Data Bricks Admin, Azure, AWS, GCP, and Databricks along with experience working with SAP source systems migrating to GCP and Databricks

Core Focus: An experienced Cloud Platform Databricks SME, responsible for overseeing the Platform administration, Security, new NPI tools integration, migrations, platform maintenance and other platform administration activities on Azure/AWS

Advanced proficiency in Python, PySpark, SQL and Apache Spark.

Build and optimize high-performance ETL/ELT pipelines using Apache Spark, PySpark, SQL, and Delta Lake (following Medallion Architecture: Bronze, Silver, Gold layers)

Prepare datasets for generative AI and machine learning using MLflow and Vector Search.

Hands-on experience with cloud services (primarily Azure or AWS) and CI/CD deployment tools

Tune Spark workloads, optimize serverless compute, and utilize Photon engine for cost and processing efficiency.

Implement data security, access controls, and lineage tracking using Databricks Unity Catalog and GCP IAM

Previous experience of migrating from SAP source systems to GCP/Databricks

Interacting with the Business stakeholders and other IT delivery teams to understand the functional requirements and design the whole architecture.

Providing technical input to projects delivering changes to support initial project planning and estimation process

Checking feasibility and designing and developing an optimal solution.

Good communication skills and to be customer facing

Priority Skill

Databricks | Databricks Administration | Azure | AWS | GCP | Apache Spark | PySpark | Python | SQL | Delta Lake | Unity Catalog

Responsibilities:

Oversee Databricks platform administration, security, maintenance, migrations, and integration of new NPI tools across Azure and AWS.

Design, build, and optimize high-performance ETL/ELT pipelines using Apache Spark, PySpark, SQL, and Delta Lake.

Implement Medallion Architecture using Bronze, Silver, and Gold data layers.

Prepare and manage datasets for generative AI and machine learning use cases using MLflow and Vector Search.

Tune Spark workloads, optimize serverless compute, and use the Photon engine to improve cost and processing efficiency.

Implement data security, access controls, governance, and lineage tracking using Databricks Unity Catalog and GCP IAM.

Lead or support migration of SAP source-system data to GCP and Databricks.

Engage with business stakeholders and IT delivery teams to understand functional requirements and design the end-to-end architecture.

Provide technical input for project planning, estimation, feasibility assessment, and solution design.

Develop optimal, scalable solutions and provide customer-facing technical leadership throughout delivery.

Mandatory skill sets:

9–11 years of experience in data engineering, cloud platforms, Databricks administration, or architecture roles.

Strong hands-on expertise in Databricks administration and architecture.

Advanced proficiency in Python, PySpark, SQL, Apache Spark, and Delta Lake.

Hands-on experience with Azure or AWS cloud services and CI/CD deployment tools.

Experience building and optimizing ETL/ELT pipelines using Medallion Architecture.

Experience with Spark workload tuning, serverless compute, and Photon engine optimization.

Strong knowledge of Databricks Unity Catalog, platform security, access controls, and data lineage.

Previous experience migrating data from SAP source systems to GCP and Databricks.

Experience with GCP services and IAM controls.

Excellent communication, stakeholder-management, architecture-design, and customer-facing skills.

Preferred skill sets:

Experience preparing datasets for generative AI and machine learning using MLflow and Vector Search.

Exposure to multi-cloud Databricks environments across Azure, AWS, and GCP.

Experience integrating new tools and services into enterprise data platforms.

Knowledge of platform automation, monitoring, performance management, and cost optimization.

Ability to independently lead architecture discussions, feasibility assessments, and technical estimations.

Experience in enterprise client-facing or consulting engagements.

Years of experience required:

9–11 years

Education qualification:

BE / B.Tech / ME / M.Tech / MCA or an equivalent degree in Computer Science, Information Technology, Engineering, or a related discipline.

Education (if blank, degree and/or field of study not specified)

Degrees/Field of Study required: MBA (Master of Business Administration), Bachelor of Engineering

Degrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills

Core Java, Java Spring

Optional Skills

Accepting Feedback, Accepting Feedback, Active Listening, AI Fluency, AI-Human Collaboration, Algorithm Development, Alteryx (Automation Platform), Analytical Thinking, Analytic Research, Big Data, Business Data Analytics, Coaching and Feedback, Communication, Complex Data Analysis, Conducting Research, Creativity, Customer Analysis, Customer Needs Analysis, Dashboard Creation, Data Analysis, Data Analysis Software, Data Collection, Data-Driven Insights, Data Integration, Data Integrity {+ 49 more}

Desired Languages (If blank, desired languages not specified)

Travel Requirements

Not Specified

Available for Work Visa Sponsorship?

No

Government Clearance Required?

No

Job Posting End Date

July 21, 2026

Browse all jobs by role, city or company