4

Home

Logan Williams edited this page 2022-04-04 13:46:44 +02:00

Table of Contents

• Deployment notes
• Setup
• Status monitoring

Welcome to the cisticola wiki!

Deployment notes

The application is deployed on the DO instance cisticola-prod. Likewise, the managed DB cluster cisticola-prod-db is used to store data. Logan, Miguel, and Tristan all have access to this instance.

The .env file can be inspected as necessary. This contains information for connecting to the database cluster.

It is run regularly using the following cron jobs:

0 0,4,8,12,16,20 * * * . $HOME/.profile; cd /root/cisticola; /usr/bin/flock -w 0 scraper.lock pipenv run python app.py scrape-channels
59 * * * * . $HOME/.profile; cd /root/cisticola; /usr/bin/flock -w 0 scraper.lock pipenv run python app.py archive-media

flock is used to ensure that there is only one archiver or scraper running at any given point in time.

Setup

Currently this is set up and deployed manually. Necessary packages are installed with apt-get and pipenv.

There are also two initialization commands that are not automated. Currently those are run manually.

pipenv run python app.py init-db
pipenv run python app.py sync-channels --gsheet "https://docs.google.com/spreadsheets/d/1UnBxtRVkabKHkDUkLxtFOSIX9akytd-rZyV-H_K1PWg/"

Status monitoring

The status can be monitored after accessing the OSSO network via VPN at http://10.95.41.23:8080/. This is an insecure server/API that is not exposed to the public internet.