Commit Graph

68 Commits

Author SHA1 Message Date
Salastil e06d34b34c Error handling regarding headless toggle 2025-07-06 22:52:11 -04:00
Salastil 6a055e64ea Merge branch 'godkingjay:master' into master 2025-04-21 18:56:02 -04:00
Jarrian Gojar 62d8ceb2f3 feat: Add support for scraping from --list ID (#30 from occasionallydavid/master) 2025-04-12 21:06:16 +08:00
occasionallydavid 6db32bbd20 Add support for scraping from --list ID 2025-04-11 02:40:36 +01:00
Salastil ac67026bb8 Forgot to define raw_user as username card 2025-03-20 02:46:56 -04:00
Salastil feb7c3d9a4 Exception handling over Unicode decoding 2025-03-20 02:24:52 -04:00
Salastil adcb97a90f Error handling around emoji processing 2025-03-19 21:22:30 -04:00
Salastil 59967225b5 Changed login order to accommodate 2fa, added prompt, change language on ratelimit waiting 2025-03-13 16:09:39 -04:00
Jarrian Gojar c7715ae291 feat: Download Twitter Bookmarks. (Merge pull request #23 from zbrasseaux/master)
Add ability to download twitter bookmarks
2025-03-02 15:45:58 +08:00
Jarrian Gojar a29b491506 feat: Added choices for headless yes or no, along with user-agent related changes. (#27 from ReptilianPride/browser-options-update)
Added choices for headless yes or no, along with user-agent related changes.
2025-03-02 15:43:39 +08:00
ReptilianPride dd223a2134 added sample command 2025-03-01 17:40:49 +00:00
ReptilianPride e989d9e8a7 Increased zoom and unchanged scroll delay 2025-03-01 17:39:04 +00:00
ReptilianPride de0ef57663 Re-added .env.example file 2025-03-01 14:22:55 +00:00
ReptilianPride 3802237842 added 10 mins delay for the retry button occurence 2025-03-01 14:06:15 +00:00
ReptilianPride 3800c02a59 Retry button wait made longer 2025-03-01 10:44:14 +00:00
ReptilianPride 04c8949e5b Added choices for headless yes or no, along with user-agent related changes 2025-02-28 00:24:45 +00:00
Zach Brasseaux 338f4814b0 clean up debug statements 2024-11-15 15:14:55 -05:00
Zach Brasseaux 05937c05df add frontend for twitter bookmarks archive 2024-11-15 15:09:21 -05:00
Zach Brasseaux f4d043bbfa add backend for twitter bookmarks archive 2024-11-15 15:09:01 -05:00
Jarrian Gojar ea112ad595 Merge pull request #11 from abderahim-saadi/master
fix: Correct username input field in login
2024-05-22 15:41:09 +08:00
Jarrian Gojar d71979face Merge pull request #17 from hovanhoa/master
feat: correct xpath for count
2024-05-22 15:36:48 +08:00
hovanhoa 40e6fd9ab5 feat: correct xpath for count 2024-05-21 15:46:37 +07:00
Jarrian Gojar 475393809a Merge pull request #13 from pierreminiggio/add-proxy-option 2024-05-14 20:06:59 +08:00
Jarrian Gojar 185a7422a4 Merge pull request #15 from nautsimon/fix/typo 2024-05-14 20:04:52 +08:00
nautsimon 85a50b4e66 Update progress.py 2024-05-13 12:41:18 -05:00
Pierre MINIGGIO 794f3c8732 Add option to specify proxy 2024-05-10 20:12:06 +02:00
Abderahim SAADI 9fdba6cf24 Correct username input field in login 2024-05-09 18:01:22 +01:00
Jarrian Gojar cb07c91b62 Merge pull request #9 from MagiPrince/master 2024-04-09 07:19:29 +08:00
MagiPrince 91539fcdd7 removing print for debug 2024-03-22 15:29:57 +01:00
MagiPrince cf048244f3 removing function doing screenshot 2024-03-22 15:26:10 +01:00
MagiPrince 0a1c607e55 adding the twitter username utilisation if asked, and the possibility of scrap tweets with no limits (even tho the limitation will be the numbers of tweets that the browser is able to handle) 2024-03-22 15:05:04 +01:00
Jarrian Gojar ac2f8cc600 Update LICENSE 2023-10-01 17:03:35 +08:00
Jarrian Gojar 8affd9960e Update and rename CONTRIBUTION.md to CONTRIBUTING.md 2023-10-01 17:03:18 +08:00
Jarrian d1fc79ee38 add Contribution MD 2023-10-01 16:48:16 +08:00
Jarrian fc67652107 add Contribution MD 2023-10-01 16:47:45 +08:00
Jarrian 2815f92ec7 doc: update additional data 'pd' description 2023-09-28 11:31:31 +08:00
Jarrian 975b5197b8 feat: scrape tweet link, tweet id, and user id 2023-09-28 11:30:29 +08:00
Jarrian e3960dedcc feat(ipynb): Add tweet link, tweet id, and user id 2023-09-28 11:05:33 +08:00
Jarrian 5c98c3ebc4 docs: Sample code for additional data to scrape. 2023-09-25 08:45:34 +08:00
Jarrian 069b0cc24a feat: optionally scrape followers and following 2023-09-25 08:27:08 +08:00
Jarrian ed0be321bb remove commented codes 2023-09-25 00:04:36 +08:00
Jarrian da77993c12 feat: Jupyter scrape followers and following count 2023-09-24 23:54:12 +08:00
Jarrian 6f36bc33ca docs: Add authentication options and add sample commands for Advanced Search 2023-09-23 17:58:46 +08:00
Jarrian 2f078f05a8 feat(auth): Authentication Directly in Terminal 2023-09-23 17:51:02 +08:00
Jarrian 33dc3403d3 feat: 0 count for no reply, like, retweet, or analytics 2023-09-23 10:06:39 +08:00
Jarrian 407a717438 feat: scrape mentions and emojis 2023-09-23 10:00:17 +08:00
Jarrian c896baa165 update scraper configurator 2023-09-20 09:27:22 +08:00
Jarrian 2553d26590 Update Twitter Scraper IPYNB 2023-09-13 17:29:45 +08:00
Jarrian 88774e343c terminate script on login failed 2023-09-11 16:13:25 +08:00
Jarrian 7575e20953 . 2023-09-11 11:50:06 +08:00