NewsBlur logo

NewsBlur

  •  0 ratings
In category: Feed Readers

About NewsBlur

NewsBlur is a personal news reader that brings people together to talk about the world. A new sound of an old instrument.

  •   404  
  •   0  
  •   0  
  •   0  
Github stats:
  •  Commits: 16,727  
  •   62,000  
  •   968  
  •  Latest commit: Feb 4, 2023  

Deploy this app to Linode with a free $100 credit!

Languages/Platforms/Technologies:
Lincenses:

More about NewsBlur

NewsBlur

Get it on F-Droid Get it on Google Play

Features

  1. Shows the original site (you have to see it to believe it).
  2. Hides stories you don't want to read based on tags, keywords, authors, etc.
  3. Highlights stories you want to read, based on the same criteria.

Technologies

Server-side

  • Python 3.7+: The language of choice.
  • Django: Web framework written in Python, used to serve all pages.
  • Celery & RabbitMQ: Asynchronous queueing server, used to fetch and parse RSS feeds.
  • MongoDB, Pymongo, & Mongoengine: Non-relational database, used to store stories, read stories, feed/page fetch histories, and proxied sites.
  • PostgreSQL: Relational database, used to store feeds, subscriptions, and user accounts.
  • Redis: Programmer's database, used to assemble stories for the river, store story ids, manage feed fetching schedules, and the minuscule bit of caching that NewsBlur uses.
  • Elasticsearch: Search database, use for searching stories. Optional.

Client-side and design

  • jQuery: Cross-browser compliant JavaScript code. IE works without effort.
  • Underscore.js: Functional programming for JavaScript. Indispensable.
  • Backbone.js: Framework for the web app. Also indispensable.
  • Miscellaneous jQuery Plugins: Everything from resizable layouts, to progress bars, sortables, date handling, colors, corners, JSON, animations. See the complete list.

Prerequisites

* Docker
* Docker-compose

Installation Instructions

  1. Clone this repo
  2. Run make nb to build all of the NewsBlur containers. This will set up all necessary databases, front-end django apps, celery tasks, node apps, flask database monitor and metrics, nginx, and a haproxy load balancer.
  3. Navigate to:

     https://localhost
    

    Note: You will be warned that you are using a self signed certificate. In order to get around this warning you must type "thisisunsafe" as per this blog post.

Using a custom domain

  1. Run the custom domain script

    bash ./utils/custom_domain.sh <domain name>

    This script will do the following:

    • Change NEWSBLUR_URL and SESSION_COOKIE_DOMAIN in newsblur_web/docker_local_settings.py
    • Change the domain in config/fixtures/bootstrap.json

You can also change domains: bash ./utils/custom_domain.sh <old domain> <new domain>

  1. If you're using a custom subdomain, you'll also want to add it to ALLOWED_SUBDOMAINS in apps/reader/views.py

  2. A way to make sure you updated all the correct places:

    • Go to the website address in your browser
    • Open developer tools and look at the network tab
    • Try to login
    • Look again at the developer tools, there should be a POST call to /login
    • Observe the Response headers for that call
    • The value of the "set-cookie" header should contain a "Domain=" string

    If the string after Domain= is not the domain you are using to access the website, then your configuration still needs your custom domain.

    You can also confirm that there is a domain name mismatch in the database by running make shell & typing Site.objects.all()[0] to show the domain that NewsBlur is expecting.

Making docker-compose work with your existing database

To make docker-compose work with your database, upgrade your local database to the docker-compose version and then volumize the database data path by changing the ./docker/volumes/ part of the volume directive in the service to point to your local database's data directory.

To make docker-compose work with an older database version, change the image version for the database service in the docker-compose file.

Contribution Instructions

  • Making Changes:

    • To apply changes to the Python or JavaScript code, use the make command.
    • To apply changes to the docker-compose.yml file, use the make rebuild command.
    • To apply changes to the docker/haproxy/haproxy.conf file, node packages, or any new database migrations you will need to use the make nb command.
  • Adding Python packages: Currently, the docker-compose.yml file uses the newsblur/newsblur_python3 image. It is built using the Dockerfile found in docker/newsblur_base_image.Dockerfile. Because of how the docker image is set up, you will need to create your own image and direct your docker-compose.yml file to use it. Please follow the following steps to do so.

    1. Add your new site-packages to config/requirements.txt.
    2. Add the following lines of code to your docker-compose.yml file to replace anywhere where it says image: newsblur/newsblur_python3

    build: context: . dockerfile: docker/newsblur_base_image.Dockerfile

    1. Run the make nb command to rebuild your docker-compose containers
  • Debugging Python

    • To debug your code, drop import pdb; pdb.set_trace() into the Python code where you would like to start debugging and run make and then make debug.
  • Using Django shell within Docker

    • Make sure your docker containers are up and run make shell to open the Django shell within the newsblur_web container.

Running unit and integration tests

NewsBlur comes complete with a test suite that tests the functionality of the rss_feeds, reader, and feed importer. To run the test suite:

`make test`

Running a performance test

Performance tests use the locust performance testing tool. To run performance tests via CLI, use make perf-cli users=1 rate=1 host=https://localhost. Feel free to change the users, rate, and host variables in the command to meet you needs.

You can also run locust performance tests using a UI by running make perf-ui and then navigating to http://127.0.0.1:8089. This allows you to chart and export your performance data.

To run locust using docker, just run make perf-docker and navigate to http://127.0.0.1:8089

Author

License

NewsBlur is licensed under the MIT License. (See LICENSE)

Comments (0)

Please login to join the discussion on this project.

NewsBlur Reviews (0)

Overall Rating

None

based on 0 ratings

Please login to review this project.

No reviews for this project yet.

↑ back to top

Linux VPS from $11/yr.
RackNerd VPS for $11.38/mo

Popular Projects

FluxBB

in Social Networks and Forums
 31k    0    0    0  

Nextcloud

in File Transfer & Synchronization
 19k    1    1    0  

Libreddit

in Social Networks and Forums
 6k    0    1    0  

CasaOS

in Self-hosting Solutions
 5k    0    0    0  

Audiobookshelf

in Audio Streaming
 5k    0    1    0  

Mediagoblin

in Photo and Video Galleries
 4k    0    0    0  

Dashboard

in Personal Dashboards
 4k    0    0    0  

Most Discussed

Nextcloud

in File Transfer & Synchronization
 19k    1    1    0  

Tube Archivist

in Automation
 3k    0    1    0  

OneDev

in Project Management
 2k    0    0    0  

iodine

in Proxy
 2k    0    0    0  

Alf.io

in Booking and Scheduling
 2k    0    0    0  

sysPass

in Password Managers
 929    0    0    0  

Misskey

in Social Networks and Forums
 2k    0    0    0  
pCloud Lifetime

Top Rated Projects

Gitea

 1 rating
in Project Management

Bagisto

 1 rating
in E-commerce

LinkAce

 1 rating
in Bookmarks and Link Sharing

Pydio

 1 rating
in File Transfer & Synchronization

Audiobookshelf

 1 rating
in Audio Streaming

Nextcloud

 1 rating
in File Transfer & Synchronization

Seafile

 1 rating
in File Transfer & Synchronization

Categories

You May Also Be Interested In

FreshRSS logo
FreshRSS cover

FreshRSS

Self-hostable RSS feed aggregator.

Yarr logo
Yarr cover

Yarr

Yarr (yet another rss reader) is a web-based feed aggregato…

Leselys logo
Leselys cover

Leselys

Your very elegant RSS reader.