Skip to content

Implement feed file data ingest #4

@crossjam

Description

@crossjam
  • Implement a ingest subcommand that takes a list of file names on the command line and can also read from standard input
  • Each files content should be read and ingested into feed-to-sqlite compatible sqlite db
  • Default to using prompthound.db in the OS specific user directory
  • Accept an option --db that should be a path to an sqlite db to install the data, initialize the feed schemas if necessary,
  • If the '--db` argument points to an existing file, prompt the user whether they want to overwrite the db
  • Write appropriate tests for the ingest process and the cli invocation.
  • There is test data in the tests/data subdirectory. The pluralistic gzip is one rss file. The sample_rss.tar.gz is a collection of multiple rss files
  • If there is a unique identifier for a feed item, make sure it only exists in the db once
  • Add tests for error handling

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions