How to tell whether the crawler IP will be blocked

This article mainly shows you "how to judge whether the reptile IP will be blocked", the content is easy to understand, clear, hope to help you solve your doubts, the following let the editor lead you to study and learn "how to judge whether the reptile IP will be blocked" this article.

1. Set putty

Open putty, find the SSH on the left, select Tunnels, and then in Source.

Fill in the slogan you want on port, and then select Dynamic under Add. Now your machine 127.0.0.1: Port number (for example, 127.0.0.1 localhost 999, of course, instead of 127.0.0.1) proxy server. After setting up, you need to log in to the server with putty to keep the login status. Then install the browser proxy server.

2. Set FireFox

Tools, options, Advanced, Network fill in the native IP and the proxy port number just set on the SOCKS host.

After this setting, the browser opens the site to display the IP of the server, and directly uses the browser to access the site. You can open the other side's site without proxies, indicating that your IP is blocked by the site. If your server can also visit foreign websites abroad, it will not be cut off. If you want to visit a large website like facebook, you need to set up dns. When the browser analyzes the site, use the server dns and enter the address bar of the Firefox.

About:config .

Find network.proxy.socks_remote_dns and double-click to change it to true. This option is to use a remote proxy server to analyze DNS to avoid DNS spoofing.

The above is all the contents of the article "how to determine whether the crawler IP will be blocked". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!