This is the collection service of newsbot to pull articles from the web.
Go to file
James Tombleson 06e50f956a
removed custom tags on source creation. Generates errors that we dont need currently (#19)
2022-07-27 10:56:44 -07:00
.github/workflows Feature/sql (#8) 2022-06-08 21:17:08 -07:00
.vscode Getting the basics setup for the collector. It can pull reddit json and almost post the db api 2022-04-02 12:05:32 -07:00
database Features/output discord (#12) 2022-07-12 15:28:31 -07:00
docs removed custom tags on source creation. Generates errors that we dont need currently (#19) 2022-07-27 10:56:44 -07:00
domain Features/ffxiv (#6) 2022-04-29 13:02:25 -07:00
routes removed custom tags on source creation. Generates errors that we dont need currently (#19) 2022-07-27 10:56:44 -07:00
services Find installed browser for Docker (#17) 2022-07-14 14:27:40 -07:00
.gitignore Basic routes have been added (#10) 2022-06-19 22:02:44 -07:00
Dockerfile Find installed browser for Docker (#17) 2022-07-14 14:27:40 -07:00
README.md Feature/dynamic swagger uri (#15) 2022-07-14 09:59:55 -07:00
docker-compose.yaml Feature/dynamic swagger uri (#15) 2022-07-14 09:59:55 -07:00
go.mod Basic routes have been added (#10) 2022-06-19 22:02:44 -07:00
go.sum Basic routes have been added (#10) 2022-06-19 22:02:44 -07:00
main.go Feature/dynamic swagger uri (#15) 2022-07-14 09:59:55 -07:00
makefile Basic routes have been added (#10) 2022-06-19 22:02:44 -07:00
sqlc.yaml Feature/sql (#8) 2022-06-08 21:17:08 -07:00

README.md

newsbot.collector.api

This is the collection service of newsbot to pull articles from the web.

Deployment

  1. Create a copy of the docker compose file and make it local
  2. Update the docker-compose.yaml with your secrets
  3. Run migrations 2. docker compose run api /app/goose -dir "/app/migrations" up
  4. Run app
    1. docker compose up -d
  5. Once the app is running go to the swagger page and validate that you see the seeded sources.
    1. http://localhost:8081/swagger/index.html#/Source/get_config_sources
    2. curl -X 'GET' 'http://localhost:8081/api/config/sources' -H 'accept: application/json'
  6. Add any new sources
  7. Add a Discord Web Hook
    1. curl -X 'POST' 'http://localhost:8081/api/discord/webhooks/new?url=WEBHOOKURL&server=SERVERNAME&channel=CHANNELNAME' -H 'accept: application/json' -d ''
  8. Create your subscription links
    1. This is a link between a source and a discord web hook. Without this, the app will not send a notification about new posts.

Errors

  • pq: permission denied to create extension "uuid-ossp"
    • Might need to grant your account ALTER USER root WITH SUPERUSER; to create the 'uuid-ossp' for uuid creations