Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Blogs aggregator #17

Closed
lkrzyzanek opened this issue Nov 5, 2020 · 0 comments · Fixed by #19
Closed

Blogs aggregator #17

lkrzyzanek opened this issue Nov 5, 2020 · 0 comments · Fixed by #19
Assignees
Labels
enhancement New feature or request

Comments

@lkrzyzanek
Copy link
Member

Implement blogs aggregator as replacement of planet.jboss.org and update current site publish process.

Aggregator design

The aggregator needs to be independent process that would be scheduled every e.g. 1 hour as github action and the output of it is a git commit with last n blog posts from various community blogs.

The process would consist of these steps:

  1. Read config yaml file stored in src/data/aggregator-feeds.yaml containing list of ATOM/RSS feeds
  2. Fetch all feeds and store all blog posts in memory
  3. Sort all blog posts on publish date descendently
  4. Convert last 20 blog posts to JSON containing title, link, author, date, content. The content needs to be plain text trimmed to 250 characters
  5. Store last 20 blog posts to src/content/posts-aggregator
  6. Commit and push to src branch if posts have been updated

The commit/push triggers the Production CI github action as any other push.

Website build update

The website build process needs to be updated to:

  1. Stop querying dcp2.jboss.org to fetch latest community posts
  2. During build site read all community blog posts stored in src/content/posts-aggregator and render them on main page and on /blogs.html page in same way as today
  3. Combine weekly editorial blogs and community blogs in atom.xml output. It's needed to sort those blogs based on publish date
@lkrzyzanek lkrzyzanek added the enhancement New feature or request label Nov 5, 2020
@lkrzyzanek lkrzyzanek self-assigned this Nov 5, 2020
lkrzyzanek pushed a commit to lkrzyzanek/jbossorg.github.io that referenced this issue Nov 6, 2020
lkrzyzanek pushed a commit to lkrzyzanek/jbossorg.github.io that referenced this issue Nov 6, 2020
lkrzyzanek pushed a commit to lkrzyzanek/jbossorg.github.io that referenced this issue Nov 6, 2020
lkrzyzanek pushed a commit to lkrzyzanek/jbossorg.github.io that referenced this issue Nov 6, 2020
lkrzyzanek pushed a commit to lkrzyzanek/jbossorg.github.io that referenced this issue Nov 6, 2020
lkrzyzanek pushed a commit to lkrzyzanek/jbossorg.github.io that referenced this issue Nov 6, 2020
lkrzyzanek pushed a commit to lkrzyzanek/jbossorg.github.io that referenced this issue Nov 6, 2020
lkrzyzanek pushed a commit to lkrzyzanek/jbossorg.github.io that referenced this issue Nov 9, 2020
lkrzyzanek pushed a commit to lkrzyzanek/jbossorg.github.io that referenced this issue Nov 9, 2020
lkrzyzanek pushed a commit to lkrzyzanek/jbossorg.github.io that referenced this issue Nov 9, 2020
lkrzyzanek pushed a commit to lkrzyzanek/jbossorg.github.io that referenced this issue Nov 9, 2020
lkrzyzanek pushed a commit to lkrzyzanek/jbossorg.github.io that referenced this issue Nov 9, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant