Commit Graph

40 Commits

Author SHA1 Message Date
Salastil
e06d34b34c Error handling regarding headless toggle 2025-07-06 22:52:11 -04:00
Salastil
6a055e64ea Merge branch 'godkingjay:master' into master 2025-04-21 18:56:02 -04:00
occasionallydavid
6db32bbd20 Add support for scraping from --list ID 2025-04-11 02:40:36 +01:00
Salastil
ac67026bb8 Forgot to define raw_user as username card 2025-03-20 02:46:56 -04:00
Salastil
feb7c3d9a4 Exception handling over Unicode decoding 2025-03-20 02:24:52 -04:00
Salastil
adcb97a90f Error handling around emoji processing 2025-03-19 21:22:30 -04:00
Salastil
59967225b5 Changed login order to accommodate 2fa, added prompt, change language on ratelimit waiting 2025-03-13 16:09:39 -04:00
Jarrian Gojar
c7715ae291 feat: Download Twitter Bookmarks. (Merge pull request #23 from zbrasseaux/master)
Add ability to download twitter bookmarks
2025-03-02 15:45:58 +08:00
ReptilianPride
e989d9e8a7 Increased zoom and unchanged scroll delay 2025-03-01 17:39:04 +00:00
ReptilianPride
3802237842 added 10 mins delay for the retry button occurence 2025-03-01 14:06:15 +00:00
ReptilianPride
3800c02a59 Retry button wait made longer 2025-03-01 10:44:14 +00:00
ReptilianPride
04c8949e5b Added choices for headless yes or no, along with user-agent related changes 2025-02-28 00:24:45 +00:00
Zach Brasseaux
338f4814b0 clean up debug statements 2024-11-15 15:14:55 -05:00
Zach Brasseaux
05937c05df add frontend for twitter bookmarks archive 2024-11-15 15:09:21 -05:00
Zach Brasseaux
f4d043bbfa add backend for twitter bookmarks archive 2024-11-15 15:09:01 -05:00
Jarrian Gojar
ea112ad595 Merge pull request #11 from abderahim-saadi/master
fix: Correct username input field in login
2024-05-22 15:41:09 +08:00
hovanhoa
40e6fd9ab5 feat: correct xpath for count 2024-05-21 15:46:37 +07:00
Jarrian Gojar
475393809a Merge pull request #13 from pierreminiggio/add-proxy-option 2024-05-14 20:06:59 +08:00
nautsimon
85a50b4e66 Update progress.py 2024-05-13 12:41:18 -05:00
Pierre MINIGGIO
794f3c8732 Add option to specify proxy 2024-05-10 20:12:06 +02:00
Abderahim SAADI
9fdba6cf24 Correct username input field in login 2024-05-09 18:01:22 +01:00
MagiPrince
91539fcdd7 removing print for debug 2024-03-22 15:29:57 +01:00
MagiPrince
cf048244f3 removing function doing screenshot 2024-03-22 15:26:10 +01:00
MagiPrince
0a1c607e55 adding the twitter username utilisation if asked, and the possibility of scrap tweets with no limits (even tho the limitation will be the numbers of tweets that the browser is able to handle) 2024-03-22 15:05:04 +01:00
Jarrian
975b5197b8 feat: scrape tweet link, tweet id, and user id 2023-09-28 11:30:29 +08:00
Jarrian
069b0cc24a feat: optionally scrape followers and following 2023-09-25 08:27:08 +08:00
Jarrian
2f078f05a8 feat(auth): Authentication Directly in Terminal 2023-09-23 17:51:02 +08:00
Jarrian
33dc3403d3 feat: 0 count for no reply, like, retweet, or analytics 2023-09-23 10:06:39 +08:00
Jarrian
407a717438 feat: scrape mentions and emojis 2023-09-23 10:00:17 +08:00
Jarrian
c896baa165 update scraper configurator 2023-09-20 09:27:22 +08:00
Jarrian
88774e343c terminate script on login failed 2023-09-11 16:13:25 +08:00
Jarrian
7575e20953 . 2023-09-11 11:50:06 +08:00
Jarrian
10a99a3367 fix: responding included in tweet content 2023-09-09 21:27:08 +08:00
Jarrian
ed0df7a0a2 feat: scrape user profile, hashtag, search or query or advanced search, latest tweets, or top tweets 2023-09-09 21:10:44 +08:00
Jarrian
07ece4e29a add: handle errors for no user element 2023-09-09 17:43:07 +08:00
Jarrian
efb0c65c39 scrape tweet tags 2023-09-09 15:34:33 +08:00
Jarrian
b43fb72dbd add error handling and script runs until unexpected error or max reached 2023-09-09 14:19:13 +08:00
Jarrian
8843b4d81e scrape tweet analytics and user avatar data 2023-09-09 13:34:46 +08:00
Jarrian
ec1309885a conditional ChromeDriver Installation 2023-09-09 12:46:38 +08:00
Jarrian
783294a1ed twitter scraper script 2023-09-09 12:23:18 +08:00