Python Developer

Job Description for Python Developer profile with SecNinjaz Technologies LLP

Profile : Python Developer

Number of Requirements : 02

Location of Deputation : New Delhi

Experience Range : 05 years 07 years

Salary Range : No Bar for Potential Candidates

Education Qualifications : B.Tech. / B.E. / M .C.A.

What We Are Looking For:

- Strong expertise in web scraping with hands-on experience in large-scale data collection systems.

- Proficient in Python, including Scrapy, Requests, Selenium and Appium.

- Skilled in JavaScript for web scraping and automation tasks.

- Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.

- Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.

- Passionate about leveraging advanced technologies to solve complex data challenges

Key Responsibilities

- Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.

- Optimize scraping pipelines for scalability, reliability, and performance.

- Work with Python-based frameworks and libraries for web crawling and data extraction.

- Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.

- Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.

- Implement AI/ML-based solutions in scraping workflows, such as:

- Using LLMs for content parsing/cleaning.

- Improving data matching, deduplication, and entity recognition.

- Collaborate with data engineers and product teams to ensure scraped data quality and usability.

- Maintain proper documentation, testing, and CI/CD practices for scraper code.

Qualifications

- Bachelor's degree in computer science, IT, or related field.

- 57 years of professional experience in Python development and web scraping.

- Strong programming skills in Python (Scrapy, Requests, Selenium and Appium).

- Proficiency in JavaScript for handling browser automation and dynamic sites.

- Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).

- Solid understanding of web technologies (HTTP, HTML, CSS, JS, JSON, AJAX).

- Experience working with databases (SQL/NoSQL) for storing and processing scraped data.

- Design, build, and optimize machine learning and deep learning models for various use cases (NLP, computer vision, recommendation systems, predictive analytics, etc.).

- Work with large datasets: data collection, preprocessing, cleaning, and feature engineering.

- Train, evaluate, and fine-tune models to achieve business goals and high accuracy.

- Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.

- Strong problem-solving skills for dealing with anti-bot measures and rate limits.

- Excellent communication and collaboration skills.