Commit Graph

51 Commits

Author SHA1 Message Date
Zach Brasseaux 05937c05df add frontend for twitter bookmarks archive 2024-11-15 15:09:21 -05:00
Zach Brasseaux f4d043bbfa add backend for twitter bookmarks archive 2024-11-15 15:09:01 -05:00
Jarrian Gojar ea112ad595 Merge pull request #11 from abderahim-saadi/master
fix: Correct username input field in login
2024-05-22 15:41:09 +08:00
Jarrian Gojar d71979face Merge pull request #17 from hovanhoa/master
feat: correct xpath for count
2024-05-22 15:36:48 +08:00
hovanhoa 40e6fd9ab5 feat: correct xpath for count 2024-05-21 15:46:37 +07:00
Jarrian Gojar 475393809a Merge pull request #13 from pierreminiggio/add-proxy-option 2024-05-14 20:06:59 +08:00
Jarrian Gojar 185a7422a4 Merge pull request #15 from nautsimon/fix/typo 2024-05-14 20:04:52 +08:00
nautsimon 85a50b4e66 Update progress.py 2024-05-13 12:41:18 -05:00
Pierre MINIGGIO 794f3c8732 Add option to specify proxy 2024-05-10 20:12:06 +02:00
Abderahim SAADI 9fdba6cf24 Correct username input field in login 2024-05-09 18:01:22 +01:00
Jarrian Gojar cb07c91b62 Merge pull request #9 from MagiPrince/master 2024-04-09 07:19:29 +08:00
MagiPrince 91539fcdd7 removing print for debug 2024-03-22 15:29:57 +01:00
MagiPrince cf048244f3 removing function doing screenshot 2024-03-22 15:26:10 +01:00
MagiPrince 0a1c607e55 adding the twitter username utilisation if asked, and the possibility of scrap tweets with no limits (even tho the limitation will be the numbers of tweets that the browser is able to handle) 2024-03-22 15:05:04 +01:00
Jarrian Gojar ac2f8cc600 Update LICENSE 2023-10-01 17:03:35 +08:00
Jarrian Gojar 8affd9960e Update and rename CONTRIBUTION.md to CONTRIBUTING.md 2023-10-01 17:03:18 +08:00
Jarrian d1fc79ee38 add Contribution MD 2023-10-01 16:48:16 +08:00
Jarrian fc67652107 add Contribution MD 2023-10-01 16:47:45 +08:00
Jarrian 2815f92ec7 doc: update additional data 'pd' description 2023-09-28 11:31:31 +08:00
Jarrian 975b5197b8 feat: scrape tweet link, tweet id, and user id 2023-09-28 11:30:29 +08:00
Jarrian e3960dedcc feat(ipynb): Add tweet link, tweet id, and user id 2023-09-28 11:05:33 +08:00
Jarrian 5c98c3ebc4 docs: Sample code for additional data to scrape. 2023-09-25 08:45:34 +08:00
Jarrian 069b0cc24a feat: optionally scrape followers and following 2023-09-25 08:27:08 +08:00
Jarrian ed0be321bb remove commented codes 2023-09-25 00:04:36 +08:00
Jarrian da77993c12 feat: Jupyter scrape followers and following count 2023-09-24 23:54:12 +08:00
Jarrian 6f36bc33ca docs: Add authentication options and add sample commands for Advanced Search 2023-09-23 17:58:46 +08:00
Jarrian 2f078f05a8 feat(auth): Authentication Directly in Terminal 2023-09-23 17:51:02 +08:00
Jarrian 33dc3403d3 feat: 0 count for no reply, like, retweet, or analytics 2023-09-23 10:06:39 +08:00
Jarrian 407a717438 feat: scrape mentions and emojis 2023-09-23 10:00:17 +08:00
Jarrian c896baa165 update scraper configurator 2023-09-20 09:27:22 +08:00
Jarrian 2553d26590 Update Twitter Scraper IPYNB 2023-09-13 17:29:45 +08:00
Jarrian 88774e343c terminate script on login failed 2023-09-11 16:13:25 +08:00
Jarrian 7575e20953 . 2023-09-11 11:50:06 +08:00
Jarrian Gojar 0fc1465e4b Create LICENSE 2023-09-09 21:45:03 +08:00
Jarrian 10a99a3367 fix: responding included in tweet content 2023-09-09 21:27:08 +08:00
Jarrian ed0df7a0a2 feat: scrape user profile, hashtag, search or query or advanced search, latest tweets, or top tweets 2023-09-09 21:10:44 +08:00
Jarrian 07ece4e29a add: handle errors for no user element 2023-09-09 17:43:07 +08:00
Jarrian efb0c65c39 scrape tweet tags 2023-09-09 15:34:33 +08:00
Jarrian b43fb72dbd add error handling and script runs until unexpected error or max reached 2023-09-09 14:19:13 +08:00
Jarrian 8843b4d81e scrape tweet analytics and user avatar data 2023-09-09 13:34:46 +08:00
Jarrian ec1309885a conditional ChromeDriver Installation 2023-09-09 12:46:38 +08:00
Jarrian e50fcb956d Update README 2023-09-09 12:35:03 +08:00
Jarrian 783294a1ed twitter scraper script 2023-09-09 12:23:18 +08:00
Jarrian e4e46c9802 update Scraper Initialization 2023-09-09 09:50:43 +08:00
Jarrian 7dce277488 file naming for csv 2023-09-09 00:34:22 +08:00
Jarrian 4fcfb6d3d7 handle StaleElementReferenceException error 2023-09-09 00:17:24 +08:00
Jarrian 98547ff8e2 change README 2023-09-09 00:05:29 +08:00
Jarrian bea29a4bf4 headless twitter scraper 2023-09-09 00:02:46 +08:00
Jarrian 1349a8ef50 Twitter Scraper 2023-09-08 23:19:17 +08:00
Jarrian abe6073f2e driver initial setup 2023-09-08 18:53:05 +08:00