* updated db, added dto for ListSources, and added delete source
* updated from model > models
* updated to models
* sources now sends back a standard message
* updated subscription routes to have beter logid and swagger details
* moved the dto objects back to modles given they are not bound to the database
* cleaned up how we return the error
* cleaned up swag and updated models to take from the base apistatusmodel. less human errors this way
* cleaned up swag and updated models
* swag updated
* updated queue to return a router and also renamed it as it will hold all queue info later on
* removed config tag
* added subscription details route
* article routes have been moved to support dto
* updated discordwebhooks to use dto
* updated discordwebhookqueue to return details on the items via dto
* removed the example routes
* updated sources to use dto
* subscriptions moved to dto
* generated swag
* added a route to delete subscriptions based on the ID given
* added a new route to find a record based on the name and source
* added a route to query Discord Web Hooks by Server and Channel names
* tested the endpoints and they seem good to test more
* updated some routes for subscriptions and formatted files
* removed debug file
* fixing some panic calls
* swag
* added a route to delete subscriptions based on the ID given
* added a new route to find a record based on the name and source
* added a route to query Discord Web Hooks by Server and Channel names
* tested the endpoints and they seem good to test more
* updated to go 1.18.4 and added alpine dep. Image tested locally
* added the first example of how to run the app
* added deployment notes
* updated bootup logic around the env and how to handle things
* swagger update
* basic output looks to be working
* cron was updated to add to the queue and post messages
* new route to make discord webhook subscriptions
* updated swag tags
* swag
* Updated delete subscription call
* removed the time value as it throws off the msg template
* updated logging
* updated swagger
* updated new subscription route
* Updated logging and remove items from the queue if they dont have a subscription
* updated getArticles to return the 50 newest for the portal
* added endpoint to see if an item exists already
* formatting
* updated listArticles
* added colors and updated the image
* Updated to use the pointer in twitch
* added the twitch login command to cron... it works now
* found a better way to disable http2 for reddit. Test worked right away too
* updated the cron tasks to run collected once and hour or longer depending on the service
* added feature flags around background workers
* background workers are moved to a new package as outputs are starting to get added
* package name was updated
* updated refs to the new input package
* query and sql updates on routes
* moved the services and starting to add discord web hook
* query update
* basic routes are working with db context
* swagger is working along with swag gen
* cron was updated with a class and better db context, untested though
* sourcelist command added
* lost the pg package but added it back
* Updated the api startup for cron and api
* updated source routes and started to add article routes
* Updated cron add func calls
* updated swagger
* keeping articles basic for now as I dont need to pull them in yet
* swagger update
* added getarticlesbysourceid call
* adding the subscriptions table to track who to send notifications and where
* removed legacy columns from discordwebhooks that are no longer needed.
* added discord webhook routes
* updated routes
* Minor change to schema
* Updated routes to support subscriptions
* ignore .vscode
* Using sqlc to generate queries and goose for migrations. The intial tests look good.
* moving the old calls away for now. Might use this in a package later on.
* Added postgres driver
* Updated the dockerfile to support sql migrations
* added sqlc config file
* updated schema and starting a seed script
* updated models to use the database ones
* updated reddit cron to talk to the db
* added env for sql connection string
* got the reddit source working with the db and posting articles
* added sql packages
* added rule to ignore dev sql file
* added migration down statement for rolling back
* updated cron for reddit and youtube
* Updated reddit to follow a new standard pattern
* updated youtube to follow new patterns
* updated tests and brought them to the standard
* updated the seed migration
* all cron tasks should feed the db now
* updated app init
* bumped docker to 1.18.3
* disabled remote tests given secrets and lack of interfaces currently to run tests
* ran go mod tity
* updated formatting and moved to using some common errors
* some common source errors
* bumped go version
* a bulk of the work has been completed to parse twitch videos/users
* Added twitch config values
* added common errors
* moved the scheduler to its own package to get it out of main and also start adding tests
* added a new err for invalid author images
* Updated an error used
* tests updated to avoid name duplication
* new func to replace the cached source recor and updated getcontent to return collected posts
* updated scheduler ref
* moved to services/cron
* starting the ffxiv reader
* working on getting the standard interface for sources based on the work for ffxiv
* got more of ffxiv working and updated tests
* Author and Description can be extracted and validated with tests
* added uuid package
* ffxiv core logic is working and testes updated to reflect it.
* Updated the scheduler with the current sources and moved them from main
* updated reddit to allow modern go to talk to the endpoint with a debug flag
* gave the func a better name
* cleaned up main
* Moved cache to its own package and updated tests"
* moved config to its own package and added basic tests
* updated imports
* minor update"
* interface update and cache model update
* updated the scheduler for basic services. No DB calls yet
* updated db calls
* bypassed the reddit test as its flaky in github
* added extra packages to help with parsing
* getting the core built for Youtube collection. The feed can be pulled and starting to build the article object
* added some tests, reddit will need more love but youtube is starting off with more tests. Starting to add Rod to pull missing values from the site
* Added rod to work with browser automation
* Moved the config inside the client as they can change within runtime and need to be refreshed on each client creation
* added more features to collect data per video and tests to support them.
* adding the cache and tests
* moved errors to var values at the top
* youtube is now getting collected and tests have been setup
* resolved an issue with the config
* setting up the first interface, its not used yet
* more updates to the cache service. Not finished yet and could see rework
* added logic to monitor Youtube. Still basic logic that needs to be wired up to the database
* updated db calls to new endpoints. Not all are finished yet
* updated models to use the new dto objects to hide orm values
* updated reddit to build articles based on what type of post it is
* getting reddit ready to post the articles to the db
* Now able to post to the db under the new DTO object
* moved the reddit model to articles model to the struct and out of main
