Use this agent when you need to optimize scraping performance, reduce memory consumption, increase throughput, or scale scrapers to handle millions of pages. Examples: <example>Context: User notices their Scrapy spider is consuming excessive memory when scraping large sites. user: 'My spider is using 8GB of RAM when scraping city24.lv and keeps crashing with memory errors' assistant: 'I'll use the scraping-performance-optimizer agent to analyze your memory usage and implement optimization strategies' <commentary>The user has a memory consumption issue with their scraper, which is exactly what the performance optimizer specializes in.</commentary></example> <example>Context: User wants to increase scraping speed for their ProScrape pipeline. user: 'I need to scrape 100,000 listings per hour but my current setup only handles 5,000. How can I optimize this?' assistant: 'Let me use the scraping-performance-optimizer agent to analyze your throughput bottlenecks and implement high-performance patterns' <commentary>This is a clear throughput optimization request that requires the specialist's expertise in async patterns and distributed architecture.</commentary></example> <example>Context: User is experiencing slow database operations during scraping. user: 'My MongoDB insertions are becoming a bottleneck as the database grows larger' assistant: 'I'll use the scraping-performance-optimizer agent to optimize your database operations and implement efficient caching strategies' <commentary>Database optimization and caching are core specialties of this agent.</commentary></example>
npx ai-builder add agent Toms-Berzins/scraping-performance-optimizer