Competitive Radar

Beverage & retail industry sites. Per-site scrapability varies — see individual checks below.

✅ BeverageDaily: free after registration (soft wall, content in HTML). BevNet & TheDrinksBusiness: fully public, standard HTML. ⚠ TrendHunter: Cloudflare bot protection, needs headless browser. ❌ TheGrocer: paid subscription required — headlines only without login. Consider subscription for full access.

7 signals this month

Competitor employee posts, agency activity. #1 social signal — but heavily protected against scraping.

⚠ LinkedIn ToS explicitly prohibits scraping. CAPTCHA, IP bans, bot detection active. Login required for feed. Public company pages partially accessible. Recommend: LinkedIn API (requires partnership) or manual monitoring + RSS-to-alert workflows.

9 signals this month

Wire services: official competitor announcements. Best scrapability of all sources — public by design.

✅ All three wire services serve public HTML with no login or paywall. Standard rate limiting applies. RSS feeds also available as alternative ingestion method. Highest reliability of all source types.

4 signals this month

Products on retailer sites before launch. Scrapability depends heavily on the specific retailer.

⚠ Most major retailers use JavaScript-rendered product pages with anti-bot measures. Amazon has aggressive bot detection. Requires headless browser (Playwright/Puppeteer) + proxy rotation. Some retailers offer product data APIs for business partners — worth exploring.

3 signals this month

Instagram, TikTok, Reddit — trial products spotted in pilot markets. All platforms actively block scrapers.

❌ TikTok & Instagram: heavy anti-bot, login required, ToS prohibit scraping. ⚠ Reddit: public pages accessible but Cloudflare-protected + commercial API now paid. Recommend: platform-specific listening tools (e.g. Brandwatch, Sprinklr) or Pulse/RedSlim integration as noted in original brief.

2 signals this month

WIPO, EPO, national offices. IP team has existing access — integration planned.

Label approvals, food safety registrations. Scoping data access.

Competitor-linked agencies, packaging suppliers, FMCG IP law firms.