Reddit feeds are unreliable due to content access issues
-
First noticed a higher than usual amount of issues in a few Reddit feeds. Further investigation uncovered that Reddit appears to be blocking Open RSS IPs specifically from accessing the content.
-
It appears the block is due to our requests being caught by its undocumented rate limits for public access. When requesting content, Reddit is returning a rate limit notification. But fails to provide any information on what the rate limit thresholds are or how long to wait before subsequent requests can be made. Without this information, we're unable to update our systems to adhere. Still looking into alternative options...
-
Changed title of this issue to more accurately reflect the circumstances. The original title, "Reddit is blocking Open RSS from providing RSS feeds for the platform," is no longer accurate. The feeds have been partially working, but are still running into content access issues that prevent them from being reliable.
-
Reddit has started including rate limit information in all of their responses to requests to its content, indicating they are now actively enforcing access quotas. When the quota runs out, Reddit will temporarily stop allowing access to updates, causing feeds to pause until the limit resets. The service has been updated to respect these limits, which should reduce unnecessary delays between updates. However, this also means that Reddit feeds can still be slow to update.