Can't add podcasts (EOF - forbidden)

[kyrawertho]

Hi, I am just setting up Podgrab for the first time and I can't seem to add several podcasts. When I add them, an error message shows only "EOF" and Docker shows this:

/api/db/dbfunctions.go:17 record not found
[0.433ms] [rows:0] SELECT * FROM `podcasts` WHERE `podcasts`.`url` = "https://feeds.buzzsprout.com/1403161.rss" ORDER BY `podcasts`.`id` LIMIT 1
Response status: 403 Forbidden
{"level":"dpanic","ts":1658264273.0248008,"caller":"[email protected]/sugar.go:191","msg":"Ignored key without a value.","ignored":"EOF","stacktrace":"go.uber.org/zap.(*SugaredLogger).Errorw\n\t/go/pkg/mod/go.uber.org/[email protected]/sugar.go:191\ngithub.com/akhilrex/podgrab/service.AddPodcast\n\t/api/service/podcastService.go:217\ngithub.com/akhilrex/podgrab/controllers.AddPodcast\n\t/api/controllers/podcast.go:406\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:165\ngithub.com/gin-gonic/gin.CustomRecoveryWithWriter.func1\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/recovery.go:99\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:165\nmain.setupSettings.func1\n\t/api/main.go:216\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:165\ngithub.com/gin-gonic/gin.CustomRecoveryWithWriter.func1\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/recovery.go:99\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:165\ngithub.com/gin-gonic/gin.LoggerWithConfig.func1\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/logger.go:241\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/context.go:165\ngithub.com/gin-gonic/gin.(*Engine).handleHTTPRequest\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/gin.go:489\ngithub.com/gin-gonic/gin.(*Engine).ServeHTTP\n\t/go/pkg/mod/github.com/gin-gonic/[email protected]/gin.go:445\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2843\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1925"

Also, I tried adding a random podcast from the search results and it worked, but I found no way to delete it again. Is there a way to delete a podcast apart from deleting podgrab.db?

Thanks

[akhilrex]

Let me see what I can do.

…

On Wed, 20 Jul 2022, 2:27 am kyrawertho, ***@***.***> wrote: Hi, I am just setting up Podgrab for the first time and I can't seem to add several podcasts. When I add them, an error message shows only "EOF" and Docker shows this: /api/db/dbfunctions.go:17 record not found [0.433ms] [rows:0] SELECT * FROM podcasts WHERE podcasts.url = " https://feeds.buzzsprout.com/1403161.rss" ORDER BY podcasts.id LIMIT 1 — Reply to this email directly, view it on GitHub <#225>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAEMVPSX7PFDOS7SQUJEVQLVU4JDFANCNFSM54BJ5TKA> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

[jazzsnobeatcake]

I'm chiming in because I also face this issue and noticed that it's only happening when the feed URL points to feeds.buzzsprout.com, just like in @kyrawertho log. Podcasts hosted elsewhere are working fine for me.

[shellyeah]

Getting the same error with buzzsprout feeds.

Trying to curl with the user agent podgrab provides (Go-http-client/2.0) returns "error code: 1020" which is a cloudflare thing. Same with using the UA in a browser. server responds with a much more detailed cloudflare error page with the same error code.

Workaround could be to set a custom useragent.

I never worked with cloudflare before but since other cloudflare protected sites work just fine with this user agent it is most likely on buzzsprouts side to fix this.

[t3rminalx]

I've tried adding a podcast which also seems to come from buzzsprout and had the same EOF issue.

https://podcastaddict.com/podcast/4040551

[tomrossi7]

Hey guys! This is Tom from Buzzsprout. Are you able to set the user agent to something that reflects podgrab?

[wiseindy]

+1 I have the same issue with Buzzsprout podcasts: e.g.: https://podcastaddict.com/podcast/3386743

[tomrossi7]

Has the user agent been updated?

[wiseindy]

There's an open PR that fixes this issue: #214

[t3rminalx]

There's an open PR that fixes this issue: #214

Thats awesome, thank you. I've noticed you've approved the changes too. How long until we see the changes in the code?

[wiseindy]

Not sure, since I don't have the access to merge. Pinging @akhilrex

[wiseindy]

@t3rminalx In the meantime, I created a fork here with the user agent fix: https://github.com/wiseindy/podgrab

If you use docker and want to use it, you can swap out the image akhilrex/podgrab with wiseindy/podgrab until we wait for the PR to be merged in this repo.

[t3rminalx]

@tomrossi7 In the meantime, I created a fork here with the user agent fix: https://github.com/wiseindy/podgrab

If you use docker and want to use it, you can swap out the image akhilrex/podgrab with wiseindy/podgrab until we wait for the PR to be merged in this repo.

It's working like a charm :-)

[neontechtra]

Just commenting to follow along, having some issues here as well.

[t3rminalx]

So the docker image from @wiseindy and the updated image from @akhilrex both now enable me to add the podcast I was having trouble with however it’s not grabbing the episode artwork or anything newer than when the podcast was initially added.

[ghenry22]

Having the same issue with buzzsprout, what should be setting the user agent to here? Something to mimic a browser or something specific to identify podgrab?

[ghenry22]

So the docker image from @wiseindy and the updated image from @akhilrex both now enable me to add the podcast I was having trouble with however it’s not grabbing the episode artwork or anything newer than when the podcast was initially added.

what did you use for the user-agent setting? I've tried leaving it blank or setting it the same as chrome on my mac and in either case still get the EOF error with a 403 denied in the container logs. using latest akhilrex docker container from docker hub

[tomrossi7]

You should set the user-agent to something to identify yourself or your app -- do not spoof Chrome or any other app since you would then get blocked.

[ghenry22]

@tomrossi7 yep no problem, the issue I was seeing was that the user agent was still not being applied at one point in the code so it wasn't working regardless of what I put in there, have submitted a PR to resolve.

Once that gets merged I'll put together something to ensure that a default user-agent that identifies podgrab and the version is used instead of the library default or people putting in random spoofing unnecessarily.

[tomrossi7]

Perfect! Thanks!

[chiefy]

I'm still seeing this issue even when using @wiseindy 's version 2022.07.07

[zanish]

Is there any update to this? I see PR #243 hasn't been touched in a few months. I'm still seeing the issue.

[thrillhouse2342]

I'm unfortunately also experiencing this issue. Just tried setting it up for the first time and the 4 that failed were all buzzsprout.

[2600box]

I had trouble with this and a buzzsprouts podcast. setting the docker image to wiseindy/podgrab and setting the user-agent to something Podgrab - docker worked

[Patriot2407]

I'm also having this issue +1

[Patriot2407]

@2600box comment above solved my issue