Feeds are not working in Newsblur
-
Noticing that the application is making feed requests from some of its servers without waiting for the
max-ageheader to expire, resulting in some Newsblur servers being temporarily blocked due to the unnecessarily, excessive requests. -
We've been watching the issue over a few days, and happens periodically but looks consistent. Will need to be addressed by Newsblur to prevent the application from being blocked.
-
Notified Newsblur about the issue and provided details.
-
Newsblur has responded letting us know they are working on a resolution to the issue.
-
Followed up with the developer for an update on its progress to a resolution.
-
Developer responded that the
Cache-Controlheaders are now being respected but it has not yet began the work to space out its requests. -
Confirmed that Newsblur has updated the application to address the caching issue and is now caching its requests appropriately.
-
The Open RSS service has been temporarily down due to a burst of requests from the app across its network of IP addresses. We've resolved the outage and have notified Newsblur developer with recommendations on how to resolve the issue.
-
Newsblur has hit the service with over 500 feed requests across its network of IP addresses due to not spacing out its requests. The behavior has caused a temporary partial outage of the service, but we're working to get the service back online. Notified Newsblur developer about the issue.
-
Developer has informed us that Newsblur has been updated and is now spacing out its requests. We'll evaluate the behavior of the app over the next few days to confirm and resolve the issue once confirmed.
-
Confirmed issue is resolved.
-
User reported still seeing issues with feeds used in Newsblur.
-
Confirmed that Newsblur continues to make excessive requests to many feeds using web scrapers across multiple IP addresses in a short time frame. The service is sending the application
429s with no feed content in efforts to prevent further degradation of the service.To resolve the issue, the application needs to space out its requests (even when using different IPs) and hold off requests across of all of its IP addresses when getting a
429response. -
Reached out to Newsblur to resolve the issue.