Salastil/selenium-twitter-scraper
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

added 10 mins delay for the retry button occurence

Browse Source
This commit is contained in:
ReptilianPride
2025-03-01 14:06:15 +00:00
parent 3800c02a59
commit 3802237842
2 changed files with 1 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
.env.example
View File

@@ -1,3 +0,0 @@
TWITTER_USERNAME=# Your Twitter Handle
TWITTER_PASSWORD=# Your Twitter Password
HEADLESS=# Headless Mode "yes" or "no"

2
scraper/twitter_scraper.py
View File

@@ -498,7 +498,7 @@ It may be due to the following:
retry_button = self.driver.find_element( retry_button = self.driver.find_element(
"xpath", "//span[text()='Retry']/../../..") "xpath", "//span[text()='Retry']/../../..")
self.progress.print_progress(len(self.data), True, retry_cnt, no_tweets_limit) self.progress.print_progress(len(self.data), True, retry_cnt, no_tweets_limit)
sleep(300) sleep(600)
retry_button.click() retry_button.click()
retry_cnt += 1 retry_cnt += 1
sleep(2) sleep(2)