Key Responsibilities
Here are the main duties you will perform
Scraping Solution Development:Design, develop, and implement robust web scraping scripts and data extraction tools.Extract data from various online and offline sources (e.g., websites, PDFs, spreadsheets).Automate repetitive data collection tasks efficiently.
Data Quality & Maintenance:Clean, transform, and validate extracted data to ensure high quality and consistency.Monitor and maintain existing scraping solutions, troubleshooting issues (e.g., website changes, anti-scraping measures).Optimize scraping performance and reliability.
Collaboration & Documentation:Work closely with data analysts, developers, and business stakeholders to understand data requirements.Document scraping logic, data models, and processes for clarity and maintainability.
Requirements
What you need to succeed in this role
Experience: X+ years of experience in web scraping, data extraction, or a related field.
Programming Skills:Strong proficiency in a programming language commonly used for scraping (e.g., Python is highly preferred, or JavaScript).Familiarity with relevant libraries/frameworks (e.g., Python: BeautifulSoup, Scrapy, Selenium; JavaScript: Puppeteer, Playwright).
Technical Understanding:Solid understanding of web technologies (HTML, CSS, JavaScript, HTTP/HTTPS protocols).Experience with parsing various data formats (e.g., JSON, XML).
Problem-Solving:Excellent analytical and problem-solving skills to overcome data extraction challenges (e.g., CAPTCHAs, dynamic content).
Data Handling:Basic knowledge of data cleaning and transformation techniques.
Nice-to-Have
These would be a bonus
Experience with cloud platforms (e.g., AWS, Azure, GCP) for deploying and scaling scraping solutions.
Familiarity with database technologies (SQL, NoSQL) for storing and managing extracted data.
Knowledge of regular expressions (regex) for advanced text pattern matching.
Understanding of ethical scraping practices and data privacy regulations.
Qualifications
Bachelors - Computer Engineering, Bachelors - Computer Science, Bachelors - Information Technology, Masters - Software Engineering
- Certifications
- Oracle Certified Java Associate - OracleOracle
- Required Skills
- Agile Methodology, Apache Kafka, Client Relations, Collaboration Tools, Design Thinking, Executive Presence, Inclusion, Personal Effectiveness, Storytelling
- Language Proficiency -
- Proficient - C2
Additional Job Location -
- Master Skill List -
- Application Development JAVA N
- Work Shift -
- Day Job (India)
Why join Genpact?
Lead AI-powered transformation – Drive innovation and solve real-world business challenges that matter
Make an impact – Help global enterprises solve business challenges that matter
Accelerate your career – Gain hands-on experience, mentorship, and world-class learning opportunities to stay ahead
Work with the best – Join 140,000+ bold thinkers and problem-solvers who push boundaries every day
Thrive in a values-driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress
Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up.
Let’s build tomorrow together.
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.