chat-downloader (v0.1.9)

Sites:

YouTube

• Fixed issue where output file was not created when using a channel link (#116)

Core:

• Removed unused callback attribute from Chat object

chat-downloader (v0.1.8)

Sites:

General

• Improved video data extraction

YouTube

• Added support for YouTube clips
• Fixed get_user_videos method (#114)

Reddit

• Fixed authentication issue

Facebook

• Retry on rate-limit exceeded error

Other:

Output

• Added lazy_initialisation option (only initialise when first message is retrieved)
• Added output file formatting

Core

• Added more keys to Chat items

Testing

• Improved site-specific tests

Utils

• Fixed try_parse_json method
• Added fallback support for python 3.6 when parsing iso8601 date

Misc

• Changed .format to f-strings

chat-downloader (v0.1.7)

Sites:

Facebook

• Use graphql as the primary method of data extraction

Reddit

• Ensure data is a string when retrying

CLI

• Fixed issue involving command-line boolean flags (#111)

Testing

• Improved how site tests are generated

chat-downloader (v0.1.6)

Sites:

Reddit

• Added support for top livestream/post of subreddit
• Retry when an invalid socket url is returned
• Improved VideoNotFound error message

YouTube

• Improved retrying of requests

Twitch

• Added pagination for get_user_videos

Core

• Added interruptible_retry option

Testing

• Added more site-specific tests
• Added tests for outputting to files
• Added test cases for the command line
• Updated default parameters for testing generators
• Created test cases for utilities
• Added test cases for formatting
• Output error if incorrect exception is raised
• Allow multiple errors to be thrown during testing
• Added commands for updating coverage

Utils

• Removed unused methods

chat-downloader (v0.1.5)

Sites:

Reddit

• Added support for past broadcasts
• Added test cases for past broadcasts
• Improved robustness and added authentication token
• Removed sleeping between requests
• Randomly choose RPAN subreddit when testing
• Added support for update_comment_score message type

Facebook

• Added generate_urls functionality
• Fixed title extraction
• Discovered Event attachment type

YouTube

• Fix authentication when using multiple accounts

Twitch

• Discovered charity message types

Misc:

Logging

• Changed logging to use global variables and methods
• Removed params as an argument for helper methods

Utils

• Fixed precedence issue for removing leading zeroes
• Fixed issue when specifying negative indices for multi_get
• Added chunks method for splitting lists into chunks
• Added regex_search method

Output

• Added .jsonl writer and removed --json_lines argument

chat-downloader (v0.1.4)

Sites:

YouTube

• Added functionality to retry a request if YouTube returns a server-side error (Fixes #102)
• Added missing keys and improved extraction for liveChatMembershipItemRenderer items

Twitch

• Discovered crowd-chant-parent-msg-id key
• Error checking for videos

Core:

• Added option to output as JSON lines (#79)
• Fixed issue when using SiteDefault objects

Misc:

Formatting

• Added padded_time formatting option (#47)
• Added 12_hour formatting option
• Added formatting options for time_text and improved file reading

Utils

Fixed seconds_to_time method and added arguments for formatting

Tests

• Added option to choose sites to generate tests for

Documentation:

• Moved documentation scripts to separate folder

chat-downloader (v0.1.3)

Sites:

YouTube

• Fixed issue regarding saving chats for channels (Fixes #100)
• Added additional headers to requests (Fixes #76)

Reddit (new)

• Added basic implementation for live stream chat extraction
• Added websocket-client as dependency

Misc:

• Updated where site-errors are specified
• Fixed retry method and removed unused method
• Updated callback function and error checking

Utils:

• Separated utilities into different modules based on functionality

chat-downloader (v0.1.2)

Sites:

YouTube

• Fix authentication issue for YouTube member-only livestreams (Closes #76). Special thanks to @Lytexx and @tam-carre for bringing up this issue and helping with testing!
• Updated extraction regex to allow for }; in data (along with corresponding tests)

Twitch

• Added is_first_message key (supported by some streams)
• Parse twitch ids as strings instead of integers

Misc:

• Added cookies.txt to .gitignore

chat-downloader (v0.1.1)

Command-line program:

• Catch parsing errors and notify user to make a bug report

Core:

• Added functionality to set cookie values

Sites:

YouTube

• Added support for generating consent cookies upon initialization (Fixes #85 and #94). Thank you to @turbcool for bringing this issue up and providing a temporary fix for users.
• Make emotes optional (Fixes #97)

Twitch

• Improved testing for unknown message types

chat-downloader (v0.1.0)

Documentation:

• Updated supported versions of python to 3.6+
• Changed readme and history from markdown to restructured text
• Add explanations for chat item fields
• Add various docstrings

Sites:

YouTube

• Changed some emoji keys to be optional (Fixes #95)
• Added background_type remapping
• Updated urls for test cases
• Update Video URL regex (do not need it to end in video id)
• Use generated parameters instead of making own

Twitch

• Retry on connection refused

Core:

• Improved function selection + error propagation
• Improve multi-pattern support and allow chat to be downloaded using channel id (#62)