Senior Software Engineer (Web Scraping, Data acquisition, Data collection)
NielsenIQ
This job comes from NielsenIQ's own careers page
(see the original posting).
Apply here to keep track of it, then finish on NielsenIQ's site.
Prefer a full account with a password? Sign Up to Apply
Job Description
• Design and build distributed scraping architectures that can scale across thousands of domains.
• Reverse engineer APIs and mobile apps using tools like Frida, mitmproxy, Charles Proxy, burp and many more.
• Detect common anti-bot measures (like JavaScript checks or browser behavior detection) to build crawlers that adjust to appear more human-like.
• Lead technical innovation in scraping: identify edge cases, prototype new approaches, and share knowledge with the team.
• Set up anomaly detection and monitoring to detect blockers or failures early
Requirements
Function: General Business
Experience Level: Mid-Senior Level