The preference for this role is to be based out of Bangalore – Caterpillar PSN
What you will do
Data Pipelines & Integration
Design, build, and maintain scalable batch/streaming pipelines (e.g., telematics/IoT, SAP, PLM, MES, service/warranty, dealer systems).
Implement CDC, schema evolution, and data quality checks (Great Expectations/Deequ/custom).
Develop feature pipelines for ML and analytics (feature stores, time-series transformations).
Data Modelling & Storage
Model data for lakes/lakehouses/warehouses (Delta/Parquet/Iceberg) following medallion or similar architectures.
Optimize partitioning, compaction, and performance for large datasets.
AI/ML Enablement
Partner with Data Scientists to productionize models (batch/real-time), build inference pipelines/APIs, and manage feature stores.
Contribute to MLOps (CI/CD for models and data, model versioning, monitoring, drift detection).
Support GenAI use cases (RAG pipelines, vector indexing, prompt orchestration, governance).
Platform & DevOps
Implement infrastructure‑as‑code, CI/CD and observability (lineage, cataloging, logging/metrics).
Enforce security, privacy, and compliance (PII handling, role-based access, data contracts).
What you will have
Bachelor’s or master’s degree in computer science, Data Engineering, Industrial Engineering, or related field.
Overall, at least 7+ years of experience in Data engineering
Strong proficiency in Snowflake, SQL, Python, and ETL tools (e.g. Snaplogic).
Familiarity with cloud platforms (AWS, Azure, GCP) and data warehousing solutions (e.g., Snowflake, Redshift).
AI/MLOps Exposure
Building feature pipelines, packaging and deploying models (batch/real‑time).
Model serving (Databricks Model Serving, MLflow, Azure ML etc), model registry, experiment tracking.
Familiarity with vector databases and RAG patterns.
Behavioural Competencies
Ownership & bias for action; thrives in a product operating model.
Clear communicator who can bridge business and engineering.
Pragmatic, security‑first, automation‑oriented mindset.
Collaborative partner across global, cross‑functional teams.
This position requires candidate to work a 5-day -a -week schedule in the office
Shift Timing-01:00PM-10:00PM IST
Skills desired
Core Application Systems: Knowledge of major production application systems used for delivery of services to internal and external clients; ability to leverage major production application systems in diverse situations.
Level Working Knowledge
Helps create contingency plans to mitigate impact of disruption on core applications.
Identifies key players, criticalities, roles, and responsibilities.
Investigates application-related issues with both business and IT professionals.
Recommends enhancements for a major application system or related subsystems.
Works with core application systems for a major business unit or function.
Problem Solving: Knowledge of approaches, tools, techniques for recognizing, anticipating, and resolving organizational, operational or process problems; ability to apply knowledge of problem solving appropriately to diverse situations.
Level Working Knowledge
Identifies and documents specific problems and resolution alternatives.
Examines a specific problem and understands the perspective of each involved stakeholder.
Develops alternative techniques for assessing accuracy and relevance of information.
Helps to analyze risks and benefits of alternative approaches and obtain decision on resolution.
Uses fact-finding techniques and diagnostic tools to identify problems.
Application Design, Architecture: Knowledge of basic activities and deliverables of application design; ability to utilize application design methodologies, tools and techniques to convert business requirements and logical models into a technical application design.
Level Extensive Experience
Facilitates in application design reviews and walkthroughs.
Creates and evaluates technical alternatives for complex applications.
Interprets application services such as API; integrates them with technical design.
Develops various, distinct and multiple technical application designs.
Prepares technical design documents and blueprints for applications.
Explores and evaluates application design considerations for multiple technologies.
Implementation: Knowledge of how to run applications for organizations; ability to implement application software within an organization and help end-users perform specific tasks (ex: accounting or graphic design).
Level Working Knowledge
Tracks problems associated with the quality and effectiveness of application software.
Researches the benefits and drawbacks of an organization's application software.
Drafts application software usage for the department's needs.
Provides instant support for end users of application software.
Implements a specific application software under the supervision of management.
Requirements Analysis: Knowledge of tools, methods, and techniques of requirement analysis; ability to elicit, analyze and record required business functionality and non-functionality requirements to ensure the success of a system or software development project.
Level Working Knowledge
Follows policies, practices and standards for determining functional and informational requirements.
Confirms deliverables associated with requirements analysis.
Communicates with customers and users to elicit and gather client requirements.
Participates in the preparation of detailed documentation and requirements.
Utilizes specific organizational methods, tools and techniques for requirements analysis.
System and Technology Integration: Knowledge of the features and facilities of systems; ability to integrate and communicate among applications, databases and technology platforms.
Level Working Knowledge
Assists with current and planned integration initiatives.
Explores major issues and considerations for successful system integration.
Works with applications, data, technology bridges and a variety of platforms.
Works with existing interfaces as well as integration and migration plans within own area.
Plays an active role in local integration efforts.
System Testing: Knowledge of system and software testing; ability to design, plan and execute system testing strategies and tactics to ensure the quality of software at all stages of the system life cycle.
Level Working Knowledge
Supports the project leader in developing and executing system test plans.
Evaluates system documentation and user manuals for usability, accuracy and completeness.
Executes test cases, analyzes test results and reports on findings regularly.
Tests system components for compliance with functional requirements.
Participates in the testing of a system's ability to recover from hardware or software failures.
What you will get
Work Life Harmony
Earned and medical leave.
Relocation assistance
Holistic Development
Personal and professional development through Caterpillar ‘s employee resource groups across the globe
Career developments opportunities with global prospects
Health and Wellness
Medical coverage -Medical, life and personal accident coverage
Employee mental wellness assistance program
Financial Wellness
Employee investment plan
Pay for performance -Annual incentive Bonus plan.
Additional Information
Caterpillar is not currently hiring individuals for this position who now or in the future require sponsorship for employment visa status; however, as a global company, Caterpillar offers many job opportunities outside of the U.S. which can be found through our employment website at www.caterpillar.com/careers
Caterpillar is an Equal Opportunity Employer (EEO)
EEO/AA Employer. All qualified individuals, including minorities, females, veterans and individuals with disabilities - are encouraged to apply.
This position requires working onsite five days a week.
Visa Sponsorship is not available for this position.
Posting Dates
Caterpillar is an Equal Opportunity Employer. Qualified applicants of any age are encouraged to apply
Not ready to apply? Join our Talent Community.
