A complete technical guide to building ban-resistant web scrapers with Multilogin — covering Selenium, Puppeteer, AI Quick Actions, rotating profiles, residential proxies, and human-like evasion techniques.
Modern websites deploy sophisticated anti-bot systems — Cloudflare, PerimeterX, DataDome, Akamai Bot Manager — that analyze dozens of browser-level signals to determine if a visitor is a real human or a headless scraping bot.
| Detection Signal | What It Checks |
|---|---|
| Browser fingerprint | Canvas, WebGL, fonts, screen resolution — headless browsers return blank/default values |
| HTTP headers | User-Agent strings, Accept-Language, request ordering and timing patterns |
| JavaScript behavior | How the browser executes JS — timing, event loop patterns, missing browser APIs |
| Mouse & keyboard events | Interaction patterns that distinguish human movements from bot sequences |
| Cookie & session state | Browsing history, session continuity — bots often have empty cookie jars |
| IP reputation | Datacenter IP ranges vs. residential IP addresses — datacenter IPs are flagged immediately |
Standard tools like Scrapy, BeautifulSoup, or even headless Chrome fail these checks regularly. Multilogin solves this by providing browser profiles indistinguishable from real human users.
Multilogin adds three critical layers to standard automation frameworks — making scraping traffic indistinguishable from real human browsing:
Ready to build ban-resistant scrapers?Get Multilogin with 50% OFF using code AFF5025 — includes API access on all plans.
Get Multilogin 50% OFF ↗Selenium is the most widely used browser automation framework, and Multilogin integrates seamlessly with it via the WebDriver protocol.
pip install seleniumStep 1: Create a Multilogin Profile via API
import requests
MULTILOGIN_URL = "http://localhost:35000"
def create_profile():
payload = {
"name": "Scraper Profile 1",
"browser": "mimic",
"os": "win",
"proxy": {
"type": "Multilogin" # use built-in residential proxy
}
}
response = requests.post(
f"{MULTILOGIN_URL}/api/v1/profile",
json=payload
)
return response.json()["uuid"]
Step 2: Start the Profile and Connect Selenium
from selenium import webdriver
from selenium.webdriver.chrome.options import Options
def start_profile(profile_id):
response = requests.get(
f"{MULTILOGIN_URL}/api/v1/profile/start?automation=true&profileId={profile_id}"
)
return response.json()["value"]
profile_id = create_profile()
driver_url = start_profile(profile_id)
options = Options()
options.add_experimental_option("debuggerAddress", driver_url)
driver = webdriver.Chrome(options=options)
# Now scrape as a real human user
driver.get("https://target-website.com/products")
titles = driver.find_elements("css selector", ".product-title")
for t in titles:
print(t.text)
# Stop profile when done
requests.get(f"{MULTILOGIN_URL}/api/v1/profile/stop?profileId={profile_id}")
Puppeteer is a Node.js library providing a high-level API for controlling Chromium via the DevTools Protocol. Multilogin's Mimic browser supports full Puppeteer integration.
const puppeteer = require('puppeteer');
const axios = require('axios');
async function scrapeWithMultilogin(profileId) {
// Start profile and get WebSocket URL
const res = await axios.get(
`http://localhost:35000/api/v1/profile/start?automation=true&profileId=${profileId}`
);
const wsUrl = res.data.value;
// Connect Puppeteer to Multilogin profile
const browser = await puppeteer.connect({
browserWSEndpoint: wsUrl,
defaultViewport: null
});
const page = await browser.newPage();
await page.goto('https://target-website.com', {
waitUntil: 'networkidle2'
});
// Extract data
const data = await page.evaluate(() =>
Array.from(document.querySelectorAll('.data-item'))
.map(el => el.textContent.trim())
);
console.log(data);
await browser.disconnect();
}
scrapeWithMultilogin('your-profile-id');
chromium.connectOverCDP(wsUrl) for identical functionality.For simpler scraping tasks, Multilogin X's AI Quick Actions feature lets you automate browser workflows without writing a single line of code:
Rotate Profiles, Not Just ProxiesRotate between multiple complete Multilogin profiles — each with its own unique fingerprint AND unique proxy. Far more effective than rotating a single proxy.
Add Human-Like DelaysUse random.uniform(2.5, 7.0) between actions. Constant machine-speed timing is an immediate bot signal.
Match Geo to Target MarketSet your profile's proxy location to match the geographic region of your target website for invisible traffic.
Warm Up Sessions FirstBefore scraping, have your profile visit neutral pages (news sites, Google) to build session cookies and browsing history.
Use the Proxy Traffic SaverEnable Multilogin's Proxy Traffic Saver to block images and videos during scraping sessions. Dramatically reduces bandwidth consumption.
Respect Rate LimitsEven with perfect fingerprinting, hundreds of requests per minute will trigger rate limiting. Throttle requests to mimic human browsing patterns.
Handle CAPTCHAs GracefullyIntegrate CAPTCHA solving services (2captcha, Anti-Captcha) into your pipeline for edge cases where CAPTCHAs are triggered despite fingerprint masking.
Scale with Profile PoolsCreate a pool of pre-warmed profiles and rotate through them systematically. Assign each profile to specific target domains.
Start building your scraping setup — API support included on all plans. Use code AFF5025 for 50% OFF.
Get Multilogin — 50% OFF ↗E-Commerce Price MonitoringTrack competitor pricing across Amazon, eBay, Walmart in real time.
SERP Rank TrackingMonitor keyword positions in Google, Bing, and other search engines across geographies.
Social Media DataAggregate public posts, engagement metrics, and trend data at scale.
Lead GenerationCollect business information from directories, LinkedIn, and databases.
Real Estate DataProperty listings, pricing history, and availability from major portals.
Job Board MonitoringTrack job postings, salary data, and industry hiring trends in real time.
News AggregationCompile articles from multiple sources for content monitoring and media analysis.
Ad VerificationCheck how your ads appear across different geos, devices, and user profiles.
Step-by-step profile creation guide — proxies, fingerprints, organization, and best practices.
Platform-specific tips for Facebook, Instagram, TikTok, LinkedIn, and Twitter/X.
GoLogin, AdsPower, Dolphin Anty and more — side-by-side comparison with honest verdicts.