Python Web Scraper Builder
By no_caps_allowed · Published · Updated
Write a Python script to scrape data from a specific website structure.
Tags: coding, python, data
Prompt template
## Introduction Generate the boilerplate code for a Python web scraper. ## Target Details - Target URL or Website: [text: E.g., https://example.com/products] - What data are you extracting?: [textarea: E.g., Product titles, prices, and image URLs] - Library preference: [dropdown: BeautifulSoup + Requests, Scrapy, Selenium, Playwright] ## Scraper Options - Output format: [dropdown: Print to console, Save to CSV, Save to JSON, Insert into Database] - Handle pagination? [toggle: Yes, No] - Advanced features: [multi: Use proxies, Randomize User-Agent, Add delay between requests, Handle login] --- **Goal**: Output the Python code with comments explaining how to run it safely.