RSS Fulltext Proxy logo

RSS Fulltext Proxy

  •  0 ratings
In category: Feed Readers

About RSS Fulltext Proxy

Mirrors RSS feeds to return the full content of the items, extracted from the website.

  •   318  
  •   0  
  •   0  
  •   0  
Github stats:
  •  Commits: N/A  
  •   N/A  
  •   N/A  
  •  Latest commit: N/A  

Deploy this app to Linode with a free $100 credit!

Languages/Platforms/Technologies:
Lincenses:

More about RSS Fulltext Proxy

CircleCI License Docker Pulls Greenkeeper badge

RSS Fulltext Proxy 📃

Can "proxy"/mirror any RSS Feed to fetch full-text Content. Allows integration into any feed reader, without plugins or further configuration required.

Deployment

Using Docker (recommended)

  1. Download and modify the docker-compose.yml file to your liking.
  2. Run docker-compose up -d

Manually

  1. Clone the repository: git clone https://github.com/Kombustor/rss-fulltext-proxy.git
  2. Change working path: cd rss-fulltext-proxy
  3. Install dependencies: npm install
  4. Compile: npm run build
  5. Run: node dist/server.js

Note: You have to set the environment variables described in Configuration yourself, and you have to start a local redis server.

Configuration

The application is easily configurable with environment variables.

Name Type Default Description
PORT number 3000 The port the webserver listens on.
REDIS_URL string redis://127.0.0.1 The redis connection URL for caching.
CACHE_EXPIRY_SECONDS number 900 The number of seconds for cache entries to expire.

Usage

We have to define two query parameters:

Identifier Description
feed The original feed URL to proxy.
selectors URL-encoded string[] of CSS-selectors.

Example:

  • Feed URL: http://rss.sueddeutsche.de/rss/Topthemen
  • Query Selectors of relevant HTML elements: ["figure.asset-image", "section.body > p, section.body > h3"]
  • URL-encoded selectors using this website: %5B%22figure.asset-image%22%2C%20%22section.body%20%3E%20p%2C%20section.body%20%3E%20h3%22%5D
  • The URL we are adding to our feed reader is: http://host:post/?feed=http://rss.sueddeutsche.de/rss/Topthemen&selectors=%5B%22figure.asset-image%22%2C%20%22section.body%20%3E%20p%2C%20section.body%20%3E%20h3%22%5D
  • We are getting full-text RSS content for this feed. 🔥

A collection of selectors can be found on the wiki page. If you create or improve a selector, feel free to open a pull request to add it to the wiki page.

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

TODO

  • Make redis optional.
  • Add common templates for easier usage.
  • Unit tests.
  • Linting.
  • Add option to clear cache.
  • Tutorial on how to choose selectors.
  • Webinterface to visually select elements that should be included/removed.
  • Support websites which don't provide a RSS feed.

License

MIT

Comments (0)

Please login to join the discussion on this project.

RSS Fulltext Proxy Reviews (0)

Overall Rating

None

based on 0 ratings

Please login to review this project.

No reviews for this project yet.

↑ back to top

Linux VPS from $11/yr.
RackNerd VPS for $11.38/mo

Popular Projects

FluxBB

in Social Networks and Forums
 31k    0    0    0  

Nextcloud

in File Transfer & Synchronization
 18k    1    1    0  

Libreddit

in Social Networks and Forums
 6k    0    1    0  

CasaOS

in Self-hosting Solutions
 5k    0    0    0  

Audiobookshelf

in Audio Streaming
 4k    0    1    0  

Mediagoblin

in Photo and Video Galleries
 4k    0    0    0  

Dashboard

in Personal Dashboards
 3k    0    0    0  

Most Discussed

Nextcloud

in File Transfer & Synchronization
 18k    1    1    0  

Tube Archivist

in Automation
 3k    0    1    0  

OneDev

in Project Management
 2k    0    0    0  

iodine

in Proxy
 2k    0    0    0  

Alf.io

in Booking and Scheduling
 2k    0    0    0  

sysPass

in Password Managers
 888    0    0    0  

Misskey

in Social Networks and Forums
 2k    0    0    0  
pCloud Lifetime

Top Rated Projects

Gitea

 1 rating
in Project Management

Bagisto

 1 rating
in E-commerce

LinkAce

 1 rating
in Bookmarks and Link Sharing

Pydio

 1 rating
in File Transfer & Synchronization

Audiobookshelf

 1 rating
in Audio Streaming

Nextcloud

 1 rating
in File Transfer & Synchronization

Seafile

 1 rating
in File Transfer & Synchronization

Categories

You May Also Be Interested In

RSS Monster logo
RSS Monster cover

RSS Monster

RSS Monster is an easy to use web-based RSS aggregator and …

Feedpushr logo
Feedpushr cover

Feedpushr

Powerful RSS aggregator, able to transform and send article…

Goeland logo
Goeland cover

Goeland

Reads RSS/Atom feeds and filter/digest them to create beaut…