Scrapy não funciona pelo Linode TimeoutError: [Errno 110] Connection timed out
Hello guys
I have a program that scans the page: https://www.investing.com/currencies/eur-brl and checks the value of the euro against the real (Brazilian currency). This program works perfectly locally, however in Linode cannot extract the item, you can see the error here: https://pastebin.pl/view/e69e2872 Is there any additional configuration for Linode? The project code here: https://github.com/Phernando82/monitora_euro
1 Reply
I tried this with curl -- locally on my Mac (Xfinity/Comcast in Oregon) and from my Linode. It failed both times.
Here are some salient details from both tries:
<h1 data-translate="block_headline">Sorry, you have been blocked</h1>
<p data-translate="blocked_why_detail">This website is using a security service to protect itself from online attacks. The action you just performed triggered the security solution. There are several actions that could trigger this block including submitting a certain word or phrase, a SQL command or malformed data.</p>
<p data-translate="blocked_resolve_detail">You can email the site owner to let them know you were blocked. Please include what you were doing when this page came up and the Cloudflare Ray ID found at the bottom of this page.</p>
<span class="cf-footer-item sm:block sm:mb-1">Cloudflare Ray ID: <strong class="font-semibold">741d94844b548e5d</strong></span>
Apparently, the site has some protection against crawlers and 'bots…it also logs your IP address (which probably feeds the former). You can email them but they'll probably just ignore you. I suggest you try to get the info from some site that allows downloads of exchange rate data.
-- sw
P.S. I tried again with curl but this time I set the User-Agent string:
curl -A "Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Firefox/81.0" https://www.investing.com/currencies/eur-brl
Same result.
P.P.S. I tried again with curl but this time I set the -k flag (insecure operation):
curl -k -A "Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Firefox/81.0" https://www.investing.com/currencies/eur-brl
Same result.