Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add scraper for dataengineeringpodcast #84

Closed
Sangarshanan opened this issue Nov 9, 2019 · 6 comments
Closed

Add scraper for dataengineeringpodcast #84

Sangarshanan opened this issue Nov 9, 2019 · 6 comments
Labels
enhancement New feature or request

Comments

@Sangarshanan
Copy link
Contributor

Scrape conferences from https://www.dataengineeringpodcast.com/conferences/

@vinayak-mehta vinayak-mehta added the enhancement New feature or request label Nov 9, 2019
@kunaljubce
Copy link

Hi, I am working on this enhancement. However I don't find the cfp links on the mentioned URL. As per the existing application design, do we have to go into each sub-url and get those cfp links? Please clarify,

@Sangarshanan
Copy link
Contributor Author

Yes, they only have conference dates and not the cfp dates, but it seems like most of the conferences on dataengineeringpodcast are anyway coming in from other sources. so this is not a priority, maybe you could take a crack at #5 if possible and if you do please check out https://conference-radar.readthedocs.io/en/latest/dev/adding-crawlers.html#writing-a-crawler for guidelines on writing and scheduling crawlers

@kunaljubce
Copy link

Ok sure. I have actually done most of the work for #113 and hence raised a PR for your review. Meanwhile, I am starting to work on #5

@vinayak-mehta
Copy link
Owner

Thanks for the PR! I'll review and merge it today 👍

@vinayak-mehta
Copy link
Owner

Reviewed, looking forward to merging it! 🍰

@vinayak-mehta
Copy link
Owner

Deprioritizing this for now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants