-
Notifications
You must be signed in to change notification settings - Fork 3
Log skipped line count due to TTL #13
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: scylla-5.x
Are you sure you want to change the base?
Conversation
emr-dynamodb-hadoop/src/main/java/org/apache/hadoop/dynamodb/DynamoDBClient.java
Outdated
Show resolved
Hide resolved
6516b7e
to
e8f4c83
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
otherwise looks good
emr-dynamodb-hadoop/src/main/java/org/apache/hadoop/dynamodb/DynamoDBClient.java
Outdated
Show resolved
Hide resolved
For information, those logs won't appear during tests. you need to navigate, using the Spark UI, to the worker to find this log. |
…ynamoDBClient.java Co-authored-by: Dmitry Kropachev <[email protected]>
3ef8add
to
8c982ef
Compare
...dynamodb-hadoop/src/main/java/org/apache/hadoop/dynamodb/preader/QueryRecordReadRequest.java
Outdated
Show resolved
Hide resolved
emr-dynamodb-hadoop/src/main/java/org/apache/hadoop/dynamodb/DynamoDBClient.java
Outdated
Show resolved
Hide resolved
…reader/QueryRecordReadRequest.java Co-authored-by: Dmitry Kropachev <[email protected]>
emr-dynamodb-hadoop/src/main/java/org/apache/hadoop/dynamodb/preader/PageResultMultiplexer.java
Outdated
Show resolved
Hide resolved
concerns scylladb/scylla-migrator#232 |
emr-dynamodb-hadoop/src/main/java/org/apache/hadoop/dynamodb/preader/PageResultMultiplexer.java
Outdated
Show resolved
Hide resolved
emr-dynamodb-hadoop/src/main/java/org/apache/hadoop/dynamodb/preader/PageResultMultiplexer.java
Outdated
Show resolved
Hide resolved
9170076
to
b7ed223
Compare
b7ed223
to
26fae73
Compare
thnx, looks good @chpache |
This PR logs on the spark worker when there is a difference between the number of rows of a scan and the number of rows returned due to the use of a TTL field.