Commit Graph

67 Commits

Author SHA1 Message Date
Salastil
6a055e64ea Merge branch 'godkingjay:master' into master 2025-04-21 18:56:02 -04:00
Jarrian Gojar
62d8ceb2f3 feat: Add support for scraping from --list ID (#30 from occasionallydavid/master) 2025-04-12 21:06:16 +08:00
occasionallydavid
6db32bbd20 Add support for scraping from --list ID 2025-04-11 02:40:36 +01:00
Salastil
ac67026bb8 Forgot to define raw_user as username card 2025-03-20 02:46:56 -04:00
Salastil
feb7c3d9a4 Exception handling over Unicode decoding 2025-03-20 02:24:52 -04:00
Salastil
adcb97a90f Error handling around emoji processing 2025-03-19 21:22:30 -04:00
Salastil
59967225b5 Changed login order to accommodate 2fa, added prompt, change language on ratelimit waiting 2025-03-13 16:09:39 -04:00
Jarrian Gojar
c7715ae291 feat: Download Twitter Bookmarks. (Merge pull request #23 from zbrasseaux/master)
Add ability to download twitter bookmarks
2025-03-02 15:45:58 +08:00
Jarrian Gojar
a29b491506 feat: Added choices for headless yes or no, along with user-agent related changes. (#27 from ReptilianPride/browser-options-update)
Added choices for headless yes or no, along with user-agent related changes.
2025-03-02 15:43:39 +08:00
ReptilianPride
dd223a2134 added sample command 2025-03-01 17:40:49 +00:00
ReptilianPride
e989d9e8a7 Increased zoom and unchanged scroll delay 2025-03-01 17:39:04 +00:00
ReptilianPride
de0ef57663 Re-added .env.example file 2025-03-01 14:22:55 +00:00
ReptilianPride
3802237842 added 10 mins delay for the retry button occurence 2025-03-01 14:06:15 +00:00
ReptilianPride
3800c02a59 Retry button wait made longer 2025-03-01 10:44:14 +00:00
ReptilianPride
04c8949e5b Added choices for headless yes or no, along with user-agent related changes 2025-02-28 00:24:45 +00:00
Zach Brasseaux
338f4814b0 clean up debug statements 2024-11-15 15:14:55 -05:00
Zach Brasseaux
05937c05df add frontend for twitter bookmarks archive 2024-11-15 15:09:21 -05:00
Zach Brasseaux
f4d043bbfa add backend for twitter bookmarks archive 2024-11-15 15:09:01 -05:00
Jarrian Gojar
ea112ad595 Merge pull request #11 from abderahim-saadi/master
fix: Correct username input field in login
2024-05-22 15:41:09 +08:00
Jarrian Gojar
d71979face Merge pull request #17 from hovanhoa/master
feat: correct xpath for count
2024-05-22 15:36:48 +08:00
hovanhoa
40e6fd9ab5 feat: correct xpath for count 2024-05-21 15:46:37 +07:00
Jarrian Gojar
475393809a Merge pull request #13 from pierreminiggio/add-proxy-option 2024-05-14 20:06:59 +08:00
Jarrian Gojar
185a7422a4 Merge pull request #15 from nautsimon/fix/typo 2024-05-14 20:04:52 +08:00
nautsimon
85a50b4e66 Update progress.py 2024-05-13 12:41:18 -05:00
Pierre MINIGGIO
794f3c8732 Add option to specify proxy 2024-05-10 20:12:06 +02:00
Abderahim SAADI
9fdba6cf24 Correct username input field in login 2024-05-09 18:01:22 +01:00
Jarrian Gojar
cb07c91b62 Merge pull request #9 from MagiPrince/master 2024-04-09 07:19:29 +08:00
MagiPrince
91539fcdd7 removing print for debug 2024-03-22 15:29:57 +01:00
MagiPrince
cf048244f3 removing function doing screenshot 2024-03-22 15:26:10 +01:00
MagiPrince
0a1c607e55 adding the twitter username utilisation if asked, and the possibility of scrap tweets with no limits (even tho the limitation will be the numbers of tweets that the browser is able to handle) 2024-03-22 15:05:04 +01:00
Jarrian Gojar
ac2f8cc600 Update LICENSE 2023-10-01 17:03:35 +08:00
Jarrian Gojar
8affd9960e Update and rename CONTRIBUTION.md to CONTRIBUTING.md 2023-10-01 17:03:18 +08:00
Jarrian
d1fc79ee38 add Contribution MD 2023-10-01 16:48:16 +08:00
Jarrian
fc67652107 add Contribution MD 2023-10-01 16:47:45 +08:00
Jarrian
2815f92ec7 doc: update additional data 'pd' description 2023-09-28 11:31:31 +08:00
Jarrian
975b5197b8 feat: scrape tweet link, tweet id, and user id 2023-09-28 11:30:29 +08:00
Jarrian
e3960dedcc feat(ipynb): Add tweet link, tweet id, and user id 2023-09-28 11:05:33 +08:00
Jarrian
5c98c3ebc4 docs: Sample code for additional data to scrape. 2023-09-25 08:45:34 +08:00
Jarrian
069b0cc24a feat: optionally scrape followers and following 2023-09-25 08:27:08 +08:00
Jarrian
ed0be321bb remove commented codes 2023-09-25 00:04:36 +08:00
Jarrian
da77993c12 feat: Jupyter scrape followers and following count 2023-09-24 23:54:12 +08:00
Jarrian
6f36bc33ca docs: Add authentication options and add sample commands for Advanced Search 2023-09-23 17:58:46 +08:00
Jarrian
2f078f05a8 feat(auth): Authentication Directly in Terminal 2023-09-23 17:51:02 +08:00
Jarrian
33dc3403d3 feat: 0 count for no reply, like, retweet, or analytics 2023-09-23 10:06:39 +08:00
Jarrian
407a717438 feat: scrape mentions and emojis 2023-09-23 10:00:17 +08:00
Jarrian
c896baa165 update scraper configurator 2023-09-20 09:27:22 +08:00
Jarrian
2553d26590 Update Twitter Scraper IPYNB 2023-09-13 17:29:45 +08:00
Jarrian
88774e343c terminate script on login failed 2023-09-11 16:13:25 +08:00
Jarrian
7575e20953 . 2023-09-11 11:50:06 +08:00
Jarrian Gojar
0fc1465e4b Create LICENSE 2023-09-09 21:45:03 +08:00