This website requires JavaScript.
ac65d537ee
Webdriver error handling and use native files
2025-07-06 23:23:12 -04:00
e06d34b34c
Error handling regarding headless toggle
2025-07-06 22:52:11 -04:00
6a055e64ea
Merge branch 'godkingjay:master' into master
2025-04-21 18:56:02 -04:00
62d8ceb2f3
feat: Add support for scraping from --list ID (#30 from occasionallydavid/master)
2025-04-12 21:06:16 +08:00
6db32bbd20
Add support for scraping from --list ID
2025-04-11 02:40:36 +01:00
ac67026bb8
Forgot to define raw_user as username card
2025-03-20 02:46:56 -04:00
feb7c3d9a4
Exception handling over Unicode decoding
2025-03-20 02:24:52 -04:00
adcb97a90f
Error handling around emoji processing
2025-03-19 21:22:30 -04:00
59967225b5
Changed login order to accommodate 2fa, added prompt, change language on ratelimit waiting
2025-03-13 16:09:39 -04:00
c7715ae291
feat: Download Twitter Bookmarks. (Merge pull request #23 from zbrasseaux/master)
2025-03-02 15:45:58 +08:00
a29b491506
feat: Added choices for headless yes or no, along with user-agent related changes. (#27 from ReptilianPride/browser-options-update)
2025-03-02 15:43:39 +08:00
dd223a2134
added sample command
2025-03-01 17:40:49 +00:00
e989d9e8a7
Increased zoom and unchanged scroll delay
2025-03-01 17:39:04 +00:00
de0ef57663
Re-added .env.example file
2025-03-01 14:22:55 +00:00
3802237842
added 10 mins delay for the retry button occurence
2025-03-01 14:06:15 +00:00
3800c02a59
Retry button wait made longer
2025-03-01 10:44:14 +00:00
04c8949e5b
Added choices for headless yes or no, along with user-agent related changes
2025-02-28 00:24:45 +00:00
338f4814b0
clean up debug statements
2024-11-15 15:14:55 -05:00
05937c05df
add frontend for twitter bookmarks archive
2024-11-15 15:09:21 -05:00
f4d043bbfa
add backend for twitter bookmarks archive
2024-11-15 15:09:01 -05:00
ea112ad595
Merge pull request #11 from abderahim-saadi/master
2024-05-22 15:41:09 +08:00
d71979face
Merge pull request #17 from hovanhoa/master
2024-05-22 15:36:48 +08:00
40e6fd9ab5
feat: correct xpath for count
2024-05-21 15:46:37 +07:00
475393809a
Merge pull request #13 from pierreminiggio/add-proxy-option
2024-05-14 20:06:59 +08:00
185a7422a4
Merge pull request #15 from nautsimon/fix/typo
2024-05-14 20:04:52 +08:00
85a50b4e66
Update progress.py
2024-05-13 12:41:18 -05:00
794f3c8732
Add option to specify proxy
2024-05-10 20:12:06 +02:00
9fdba6cf24
Correct username input field in login
2024-05-09 18:01:22 +01:00
cb07c91b62
Merge pull request #9 from MagiPrince/master
2024-04-09 07:19:29 +08:00
91539fcdd7
removing print for debug
2024-03-22 15:29:57 +01:00
cf048244f3
removing function doing screenshot
2024-03-22 15:26:10 +01:00
0a1c607e55
adding the twitter username utilisation if asked, and the possibility of scrap tweets with no limits (even tho the limitation will be the numbers of tweets that the browser is able to handle)
2024-03-22 15:05:04 +01:00
ac2f8cc600
Update LICENSE
2023-10-01 17:03:35 +08:00
8affd9960e
Update and rename CONTRIBUTION.md to CONTRIBUTING.md
2023-10-01 17:03:18 +08:00
d1fc79ee38
add Contribution MD
2023-10-01 16:48:16 +08:00
fc67652107
add Contribution MD
2023-10-01 16:47:45 +08:00
2815f92ec7
doc: update additional data 'pd' description
2023-09-28 11:31:31 +08:00
975b5197b8
feat: scrape tweet link, tweet id, and user id
2023-09-28 11:30:29 +08:00
e3960dedcc
feat(ipynb): Add tweet link, tweet id, and user id
2023-09-28 11:05:33 +08:00
5c98c3ebc4
docs: Sample code for additional data to scrape.
2023-09-25 08:45:34 +08:00
069b0cc24a
feat: optionally scrape followers and following
2023-09-25 08:27:08 +08:00
ed0be321bb
remove commented codes
2023-09-25 00:04:36 +08:00
da77993c12
feat: Jupyter scrape followers and following count
2023-09-24 23:54:12 +08:00
6f36bc33ca
docs: Add authentication options and add sample commands for Advanced Search
2023-09-23 17:58:46 +08:00
2f078f05a8
feat(auth): Authentication Directly in Terminal
2023-09-23 17:51:02 +08:00
33dc3403d3
feat: 0 count for no reply, like, retweet, or analytics
2023-09-23 10:06:39 +08:00
407a717438
feat: scrape mentions and emojis
2023-09-23 10:00:17 +08:00
c896baa165
update scraper configurator
2023-09-20 09:27:22 +08:00
2553d26590
Update Twitter Scraper IPYNB
2023-09-13 17:29:45 +08:00
88774e343c
terminate script on login failed
2023-09-11 16:13:25 +08:00
7575e20953
.
2023-09-11 11:50:06 +08:00
0fc1465e4b
Create LICENSE
2023-09-09 21:45:03 +08:00
10a99a3367
fix: responding included in tweet content
2023-09-09 21:27:08 +08:00
ed0df7a0a2
feat: scrape user profile, hashtag, search or query or advanced search, latest tweets, or top tweets
2023-09-09 21:10:44 +08:00
07ece4e29a
add: handle errors for no user element
2023-09-09 17:43:07 +08:00
efb0c65c39
scrape tweet tags
2023-09-09 15:34:33 +08:00
b43fb72dbd
add error handling and script runs until unexpected error or max reached
2023-09-09 14:19:13 +08:00
8843b4d81e
scrape tweet analytics and user avatar data
2023-09-09 13:34:46 +08:00
ec1309885a
conditional ChromeDriver Installation
2023-09-09 12:46:38 +08:00
e50fcb956d
Update README
2023-09-09 12:35:03 +08:00
783294a1ed
twitter scraper script
2023-09-09 12:23:18 +08:00
e4e46c9802
update Scraper Initialization
2023-09-09 09:50:43 +08:00
7dce277488
file naming for csv
2023-09-09 00:34:22 +08:00
4fcfb6d3d7
handle StaleElementReferenceException error
2023-09-09 00:16:01 +08:00
98547ff8e2
change README
2023-09-09 00:05:29 +08:00
bea29a4bf4
headless twitter scraper
2023-09-09 00:02:46 +08:00
1349a8ef50
Twitter Scraper
2023-09-08 23:19:17 +08:00
abe6073f2e
driver initial setup
2023-09-08 18:53:05 +08:00
b23f8c2f5f
Initial commit
2023-09-08 17:19:06 +08:00
Salastil