46 Commits

Author	SHA1	Message	Date
msramalho	57288a6f8d	revert celery non-root due to larger volume permission issues	2025-07-06 01:42:45 +01:00
msramalho	7ca56193d7	address root privileges warning in celery	2025-07-06 01:30:03 +01:00
msramalho	a5ea84ad2a	testing docker-compose init:true for prod (reducing zombie processes)	2025-06-30 02:53:23 +01:00
msramalho	7bef0b3921	Merge branch 'main' into dev	2025-03-17 18:03:51 +00:00
Michael Plunkett	85cec9fbb9	Consolidate and organize config files (#61)	2025-03-03 08:10:23 -06:00
Michael Plunkett	7e48f706df	Add pre-commit with GiHub Action (#56) ... * Update pyproject.toml * add pre-commit * Create .pre-commit-config.yaml * Comment out ruff * Update .pre-commit-config.yaml * General formatting * Create format-and-fail.yml * Update ci.yml * Add pre-commit to dev dependencies * Update pyproject.toml	2025-02-26 10:42:28 -06:00
msramalho	eec4c09441	adds celery -O fair configuration	2025-02-24 18:44:35 +00:00
msramalho	0869f55c0c	attempt to curb zombie celery processes	2025-02-20 10:25:38 +00:00
msramalho	b3de99aaa0	adds celery logging rotation	2025-02-20 10:17:07 +00:00
msramalho	00cdec92f9	fixes env setting	2025-02-15 23:13:32 +00:00
msramalho	a3b1adb28d	documents and simplifies how .env and .user-groups are passed to the images	2025-02-13 00:06:24 +00:00
msramalho	f587a17a93	introduces low/high priority queue and custom concurrency	2025-02-12 13:24:11 +00:00
msramalho	119faf330d	fixing healthchecks	2025-02-12 10:18:03 +00:00
msramalho	fbfebd4671	improves example files	2025-02-12 00:02:08 +00:00
msramalho	4f9d447ec7	optimizing compose and logging	2025-02-11 23:30:45 +00:00
msramalho	17b3705b64	introduces dynamic service_account emails read from the group's orchestration files	2025-02-11 22:50:00 +00:00
msramalho	37ebba73bf	separate images, no more .env	2025-02-10 23:49:08 +00:00
msramalho	f8c45e2d92	major refactor of structure for worker V web: docker/app/secrets/envs/...	2025-02-10 00:41:50 +00:00
msramalho	5494825286	minor docker comments	2025-02-08 15:18:15 +00:00
msramalho	c8e1d441a4	fixes uvicorn factory warning	2024-10-31 10:33:34 +00:00
msramalho	273adb4ba0	fix docker health command for worker	2024-10-28 15:01:11 +00:00
msramalho	ec93df98fa	refactoring worker file location	2024-10-22 13:01:24 +01:00
msramalho	ea8e06dfee	refactoring with app_factory	2024-10-18 16:35:12 +01:00
msramalho	3ba20d2473	removes flower and updates celery>5	2024-10-17 13:13:06 +01:00
msramalho	f2a14abb17	adds health check and new env logic	2024-10-17 13:09:50 +01:00
msramalho	3432d35af6	isolating api methods, introducing first tests	2024-10-17 11:27:35 +01:00
msramalho	0438d30a60	finally closes #36	2024-02-22 18:26:10 +00:00
Lilia Kai	b83e51de68	correct comment in compose file	2024-01-31 12:31:15 -10:00
Lilia Kai	f4f378082c	Bind the web app to the loopback interface ... Making it only accesible over ssl via the nginx proxy.	2023-12-14 16:54:41 +01:00
Lilia Kai	9aea7d561b	Fix value for BROWSERTRIX_HOME_HOST	2023-09-15 10:33:28 +02:00
msramalho	9443d73d20	simplifies docker compose	2023-09-15 01:05:01 +01:00
Lilia Kai	67e97d9d5f	Rename the shared volume to crawls	2023-09-14 12:46:20 +02:00
Lilia Kai	65bb479218	New environment variables	2023-09-14 12:46:03 +02:00
Lilia Kai	8e4801f3d3	Run browsertrix in docker on the host ... Install docker in the container Add a named volume called `browsertrix` Mount the named volume in the worker at /crawls Expose the host docker socket Override the environment variable from auto-archiver's Dockerfile so that it will call docker. This will require setting new configs in orchestration.yaml: wacz_archiver_enricher: browsertrix_home: auto-archiver-api_browsertrix wacz_collections: /crawls	2023-09-12 20:37:25 +02:00
Lilia Kai	43144330a7	Move dev configs to their own file	2023-09-06 15:01:46 +02:00
Lilia Kai	91762f58b7	Add option to serve local archive files ... Set an environment variable in the docker compose file, then reference that variable in main.py to mount the local archive so that the links generated by auto-archiver will work correctly. Fixes #8	2023-09-05 16:10:37 +02:00
msramalho	36387de435	fixing volume location	2023-08-07 15:09:32 +01:00
msramalho	36ede720cb	sheet processing implemented	2023-05-19 13:50:26 +01:00
msramalho	d6aaaf1e12	WIP: code working, dependency conflict	2023-05-18 18:36:33 +01:00
msramalho	56c18dd96b	added database migrations + soft delete	2023-02-27 13:12:22 +01:00
msramalho	39da4e4eb7	0.1.5	2023-02-27 12:00:38 +01:00
msramalho	a00f3ff8d7	redis password and CORS	2023-02-25 14:54:41 +01:00
msramalho	6b4dd9c0a9	redis fixes	2023-02-25 13:19:42 +01:00
msramalho	f3d8c999fc	docker updates	2023-02-24 17:09:32 +01:00
msramalho	75e98f5f31	fastapi-users	2023-02-23 18:54:19 +01:00
msramalho	c6b39db295	MVP celery worker for auto-archiver	2023-02-21 14:11:32 +00:00