Commit Graph

27 Commits

Author SHA1 Message Date
97fc34481c ISourcesRepository.cs updated to return total rows 2023-08-06 13:35:26 -07:00
751bbd3a7b IAuthorTable.cs was added 2023-08-04 23:05:49 -07:00
dcb81315bf Adding the calls to track authors for metrics but also to attempt to find AI writers.
All checks were successful
continuous-integration/drone/pr Build is passing
2023-07-29 10:02:43 -07:00
82dea60126 Updated DiscordWebHooks to handle userId
All checks were successful
continuous-integration/drone/pr Build is passing
2023-07-29 09:44:15 -07:00
c92d13797f minor adjustments 2023-07-23 22:58:25 -07:00
a416746269 DiscordNotificationController.cs got a new route, moved over to ActionResults, records are now tracking the userId and returning common result classes 2023-07-23 22:57:35 -07:00
19d8e3e925 ArticlesController.cs was cleaned up and supports results with details now 2023-07-23 22:56:06 -07:00
4cacc03fb8 Getting things setup to support token refresh
Some checks failed
continuous-integration/drone/pr Build is failing
2023-07-10 22:41:39 -07:00
d28ad7424f User defined source subscriptions have been added and starting to let users take ownership of discord Notifications 2023-07-09 22:10:51 -07:00
597470fd69 Renamed the Discord Notification client to help with naming issues 2023-07-09 21:30:23 -07:00
58229b1348 Moving the Subscriptions over to DiscordNotifications as this will be the automated posting compared to user feeds 2023-07-09 21:29:33 -07:00
49342a8c39 subscriptions updated for ef 2023-06-25 21:02:26 -07:00
0797fb8502 Souces has been moved to ef and with entites 2023-06-23 23:01:40 -07:00
2c886d22ad Icons updated with ef 2023-06-23 21:56:15 -07:00
0b68261181 discord web hooks updated with ef 2023-06-23 21:55:56 -07:00
a6ea89be62 Discord Queue Entity updated 2023-06-23 20:19:09 -07:00
4f46247d0c articles table was updated for the entity 2023-06-23 20:09:15 -07:00
a343fa2d7f started to update articlesTable with entities 2023-06-22 08:04:18 -07:00
117653c001
Features/add code projects watcher (#26)
* Migration added to update Articles to define if Release or Commit

* CodeProjectWatcher Job was created from GithubWatcher as this will target services like gitlab and also gitea.

* article model was updated to reflect migration changes

* Added CodeProjects to startup

* Seed was updated with CodeProjects and some new defaults

* Added Delete call for Sources

* Added a route to cleanup all records based on SourceId

* Added CodeProject const values to load from config

* minor changes to the rss controller

* Added codeprojects to the routes to trigger the job
2023-04-10 22:59:13 -07:00
adb4799206
Features/missing files (#14)
* Added jobs Controller to trigger collection.

* Added backgroundjobs to move them out of program.cs

* new column to track youtube ID values and adding a sourceid column on the icon for linking

* Added icon table repo

* added interface for IconsRepo

* hey the missing config models

* adding section const keys to pull blocks of configs

* Added youtubewatcher to the code but not ready to enable it in the background.  More testing needed.

* Test... improvements?
2023-03-31 23:00:15 -07:00
9be985da0a
Features/adding youtube (#13)
* Found the meta tags on youtube... in the body and updated the client to pull them out.

* Updated namespace on test

* I think formatting cleaned this up

* Seed migrations have been cleaned up to get my configs out and moving them to a script.

* Updates to the ISourcesRepository.cs to allow for new calls to the db.

* formatter

* Db models updated. Icon now can track sourceID and source can have a youtube id.

* Updated api logger to ignore otel if no connection string given.

* updated docker init so I can run migrations from the image

* seed was updated to reflect the new api changes

* Updated the SourcesController.cs to grab icon data.

* Added reddit const values

* Minor changes to HtmlPageReader.cs

* Jobs are now pulling in the config section to bundle values.

* Removed youtube api, not needed anymore.

* test updates
2023-03-31 22:49:39 -07:00
799668a059
Features/pulling GitHub (#9)
* Still working though it but looking good on releases

* added the example discord message test

* updated source repo to return an existing record before a new is added

* updated the sources repo interface

* updated new routes to check for existing records

* starting to migrate the seed out of the sql migrations

* A new seed script was made to reload the db from the api

* Docker image works locally

* Adding CI to build docker image

* ... disabled swagger so I can test docker

* Added more to the github job but its not finished.  Isnt pulling sources yet.

* cleaned up formatting

* Controller updates to look for existing records when requesting a new one

* null check cleanup

* namespace fix
2023-03-11 10:43:06 -08:00
bb832ed441
New custom discord webhook client (#7) 2023-03-05 20:12:59 -08:00
521940ca4f
Features/more rss improvements (#6)
* exposing connectionStrings to controllers

* First controller added to start testing

* corrected param to be page not age

* new model to map connection strings to for the controllers

* HelloWorldJob uses options now to make hangfire happy

* improved the html reader to find some rss feeds and start to extract the body of the content

* moved html parser to its own namespace and make a sub client to process theh header

* helpful vsc changes

* updated rss watcher to include the sourceId so it can be added to the db call

* updated tests to reflect changes

* updated gitignore to avoid trash and moved over my makefile

* More routes and added serilog

* adding more database calls for the controllers

* Updated interfaces for the tables

* Added Serilog to jobs

* removed default files

* Added more routes and added DTO

* Added DTO objects and SourceType Consts for easy usage

* updated discord model name to follow the pattern

* updated formatting

* new dto objects and Subscriptions repo interface

* added subscription db and api calls

* focusing on the twitter tags as most sites focus on them

* updated test to pull a html based feed
2023-02-26 09:40:04 -08:00
17e97b4e09
Features/table clients (#5)
* inital table clients are almost ready

* adding new repo interfaces

* adding MS DI to the tables

* adding tables and MS DI to jobs

* updated how the config builder works and pass Iconfig to jobs

* Updated how articles interface returns a value

* updated constructors to support DI and removed static call

* added source consts and model notes

* updated sources.type to contain the value to link what job collects it

* added RssWatcherJob to hangfire

* DI and hangfire jobs wont work.  Defering to options classes

* Services updated to have options exposed over DI

* Tests have been updated.. more to come
2023-02-19 21:39:03 -08:00
9f3a6323a6
Features/html meta extractor (#4)
* gave api access to the db project

* added db models

* working on rss extraction and meta extraction

* test project to debug rsswatcherjob

* added new configs for the project

* new interface to define collectors

* basic rss extraction and article details are now exposed

* tests updated for rss pull

* starting to get dapper working.  Query works but insert seems to have a value issue

* removed dapper from services

* added some basic tests for db calls
2023-02-16 22:19:05 -08:00
9f5772551c
updated domain project with db models (#3) 2023-02-15 21:00:22 -08:00