Web Scraping Tools

Puppeteer

  • Puppeteer is a Node.js library which provides a high-level API to control Chrome/Chromium.
  • Puppeteer works faster than Selenium.
  • Puppeteer comes with built-in ChromeDriver. It is easy to use.
  • Puppeteer can screenshot a web page and save as PDF.
  • Home page: https://pptr.dev

Cloudflare Tips

Bot Fight Mode

  • Security > Bots
  • Enabling this feature is dangerous! Because other security products cannot be used to skip Bot Fight Mode! Bot Fight Mode should be disabled in Free Plan.

IP Access Rules

  • Security > WAF > Tools

Security Level

  • Security > Settings

Mail Servers

If you have any mail server, beware!

  • Mail server’s IP address must be different than web server.
  • Mail server’s Cloudflare DNS setting must be “Proxied”. The IP address will be (and must be) exposed! IP reputation is important to avoid SPAM.

Other Information

Domain Name Transfer Steps

Unlock

When a domain is unlocked it can be transferred to a different registrar or pushed into a different account. We highly recommend keeping all domains locked and only unlocking them immediately before transfer to avoid unauthorized transfers.

Request Authorization Code

Request “Authorization Code” and it will be emailed to the then current administrative contact.

Go to New Registrar

You can now go to your new registrar and start the transfer process by entering your authorization code.