09/08/2026 updated
100 % available
Python Backend & Web Data Extraction Engineer
Natore, Bangladesh
Only remote
Bachelor of Arts (English Honours)About me
Self-taught Python developer focused on automated web data extraction, crawlers, and backend APIs. Skilled in bypassing anti-bot blockers and parsing complex pages into structured JSON/CSV data.
Data AnalysisWeb ScrapingGitHubWeb CrawlersBackendFastAPIApi GatewayApi Management
Python Backend Development
Extensive practical experience in building high-performance web data extraction engines, RESTful APIs, and automated data pipelines using Python (Asyncio, OOP), FastAPI, Pydantic, and Uvicorn. Production-grade microservices architected and deployed from scratch with custom parsing logic.
Web Scraping & Data Extraction
Deep expertise in web scraping and dynamic content extraction using Scrapy, BeautifulSoup4, and Requests. Proficiency in state-hydration parsing, JSON-LD parsing, Regex Pattern Matching, anti-bot considerations, and headless automation concepts for large-scale unstructured web data.
RESTful API Design & HTTP Protocols
Strong knowledge of HTTP/HTTPS protocol internals, RESTful API design, JSON Schema Validation, proxy handling, and OpenAPI/Swagger documentation. Experience configuring CI/CD workflows and automated monitoring for cloud-hosted APIs.
Linux/UNIX & Infrastructure
Practical experience working in Linux/UNIX environments, including deployment from mobile Linux development environments, Docker, Git/GitHub, and cloud deployment platforms such as Render and Cloudflare.
JavaScript & Frontend Parsing
Technical understanding of client-side rendering with Next.js and React, including dynamic state hydration and DOM parsing to intercept server-rendered data directly from raw responses without browser overhead.
Data Cleaning & Pipeline Automation
Automated server-side scraping pipelines handling network anomalies, rate limits, and custom HTTP header rotations. Optimization of raw HTML payloads into structured, LLM-ready clean Markdown and JSON with over 99% token and payload reduction.
Bash/Shell Scripting
Proficiency in Bash and Shell scripting for automation tasks within Linux/UNIX environments.
Pandas & Data Processing
Use of Pandas for data manipulation and processing as part of automated data extraction and transformation workflows.
Extensive practical experience in building high-performance web data extraction engines, RESTful APIs, and automated data pipelines using Python (Asyncio, OOP), FastAPI, Pydantic, and Uvicorn. Production-grade microservices architected and deployed from scratch with custom parsing logic.
Web Scraping & Data Extraction
Deep expertise in web scraping and dynamic content extraction using Scrapy, BeautifulSoup4, and Requests. Proficiency in state-hydration parsing, JSON-LD parsing, Regex Pattern Matching, anti-bot considerations, and headless automation concepts for large-scale unstructured web data.
RESTful API Design & HTTP Protocols
Strong knowledge of HTTP/HTTPS protocol internals, RESTful API design, JSON Schema Validation, proxy handling, and OpenAPI/Swagger documentation. Experience configuring CI/CD workflows and automated monitoring for cloud-hosted APIs.
Linux/UNIX & Infrastructure
Practical experience working in Linux/UNIX environments, including deployment from mobile Linux development environments, Docker, Git/GitHub, and cloud deployment platforms such as Render and Cloudflare.
JavaScript & Frontend Parsing
Technical understanding of client-side rendering with Next.js and React, including dynamic state hydration and DOM parsing to intercept server-rendered data directly from raw responses without browser overhead.
Data Cleaning & Pipeline Automation
Automated server-side scraping pipelines handling network anomalies, rate limits, and custom HTTP header rotations. Optimization of raw HTML payloads into structured, LLM-ready clean Markdown and JSON with over 99% token and payload reduction.
Bash/Shell Scripting
Proficiency in Bash and Shell scripting for automation tasks within Linux/UNIX environments.
Pandas & Data Processing
Use of Pandas for data manipulation and processing as part of automated data extraction and transformation workflows.
Experience
Professional experience0 - 5 years
Freelancer since2022
Languages
EnglishFluent
Project history
Architected and deployed production-grade Python web extraction backends and microservices using FastAPI and custom parsing logic. Built dynamic hydration parsers, optimized HTML payloads into structured JSON and Markdown, automated server-side scraping pipelines, and configured CI/CD workflows for cloud-hosted APIs.
Designed and built a high-speed web data extraction REST API using Python, FastAPI, BeautifulSoup4, and a Custom Regex Hydration Engine on Render. Engineered to parse modern JavaScript-heavy dynamic websites without heavy browser dependencies. Developed an algorithmic token-reduction pipeline extracting semantic text, schema-validated JSON, and structural markdown with minimal memory footprint (<512MB RAM). Integrated custom Pydantic models for request validation and OpenAPI/Swagger documentation. Deployed via continuous deployment workflow from a mobile Linux development environment.
Created multi-threaded crawlers using Python, Scrapy, BeautifulSoup, and Asyncio to traverse multi-level e-commerce and content portals, extracting deep links, hierarchical categories, and product metadata. Engineered custom data cleaning scripts and implemented caching mechanisms to optimize bandwidth utilization during iterative crawls.