Senior Python Data Scraping Engineer (Freelance) الرباط للعمل في برمجة وكمبيوتر وشبكات

Job Overview

Mindrift is seeking a highly skilled Senior Python Data Scraping Engineer to join the Tendem project. This freelance role focuses on driving specialized data scraping workflows within a hybrid AI and human system. You will be responsible for designing, implementing, and maintaining robust data extraction pipelines to support advanced machine learning models and data analysis initiatives.

Key Responsibilities

• Develop and optimize Python-based web scraping scripts to collect large-scale, structured data from diverse online sources.
• Design and maintain scalable data pipelines that ensure data quality, integrity, and timely delivery.
• Collaborate with cross-functional teams to understand data requirements and translate them into efficient scraping solutions.
• Implement anti-blocking techniques, handle dynamic content, and manage proxies to ensure uninterrupted data collection.
• Monitor and troubleshoot scraping processes, resolving issues related to website changes, rate limits, or data inconsistencies.
• Document workflows, code, and best practices to facilitate knowledge sharing and project continuity.

Required Skills & Qualifications

• Experience: Minimum 5 years of professional experience in Python development, with at least 3 years focused on web scraping and data extraction.
• Technical Expertise: Proficiency in Python libraries such as BeautifulSoup, Scrapy, Selenium, or Playwright. Strong understanding of HTTP protocols, HTML, CSS, and JavaScript.
• Data Handling: Experience with data storage solutions (e.g., SQL, NoSQL, cloud storage) and data transformation tools (e.g., Pandas, NumPy).
• Problem-Solving: Ability to bypass anti-scraping measures, handle CAPTCHAs, and manage IP rotation and proxy management.
• Soft Skills: Excellent communication, teamwork, and self-management skills. Ability to work independently in a remote freelance environment.

Preferred Qualifications

• Familiarity with AI/ML workflows and data annotation processes.
• Experience with cloud platforms (AWS, GCP, or Azure) and containerization (Docker, Kubernetes).
• Knowledge of API integration and RESTful services.

Why Join Mindrift?

This is a freelance opportunity to contribute to cutting-edge AI projects. You will work with a global team of experts, enjoy flexible working hours, and have the chance to solve complex data challenges that directly impact the development of intelligent systems.