Twitter (X) is blocking access from obtaining RSS feed content
On October 2, 2022, we released the ability to create Twitter RSS feeds from its publicly accessible data. Since then, we've taken significant measures to accommodate Twitter's expectations and avoid being blocked. We've adjusted our systems to their rate limits, adhered to their response headers, and optimized our infrastructure to avoid requesting content too frequently or unnecessarily. But despite these adjustments, Twitter has still blocked access to its content. Without Twitter content, RSS feeds for the platform can not be generated.
-
Switched to obtaining content from its publicly available API after receiving inconsistent results when accessing Twitter content using alternative methods.
-
Twitter began rate-limiting and slowing down the fulfillment of requests, without any warning or indication that it was occurring. No information was in their responses to assist in resolving the limitations. But we've still decreased the amount and frequency content was being requested to see if it would resolve the issue.
-
Forbiddenerrors are occurring. A closer look showed that Twitter has been blocking our access to its content due to what seems like a login requirement. -
Updated our approach by waiting longer times before requesting more content, which seemed to have resolved many of the Forbidden errors.
-
All Twitter feeds are now inoperable due to Twitter no longer allowing access to its content. As a result, we've removed support for Twitter RSS feeds entirely, but looking into other options.
-
Twitter's content can no longer be accessed publicly. API access now requires creation of a Twitter account and paying exhorbitant fees, making the API no longer an option to obtain Twitter content.
-
Twitter feeds are working again, but only partially. Some feeds are still inoperable or have missing and/or outdated content. We'll be testing these out and addressing any issues over the next few days to ensure their stability.
-
We're noticing that some of the feeds (usually from profiles with larger amounts of followers) are showing a significant delay to obtain latest posts. Also noting that feeds can only show publicly available data, so feeds will not have posts that require a login or content that has been restricted by the platform.
-
Resolved a few issues that were causing some feeds not to populate.