Org Storage Management V1

[Shrinks99]

Requirements

Custom Storage Buckets

Orgs of a sufficient privlage should be able to set their own S3 storage locations. This will be configured by org admins on the org settings page. Superadmins should be able to control which orgs can do this through the superadmin org settings popup.

Org Storage Limits

Superadmins should be able to set a hard cap on the maximum amount of storage space an org is allowed to use. This should also be set on the superadmin org settings popup.

Once an org has reached its allotted storage maximum any scheduled workflows should not start new crawls. New workflow creation buttons should be disabled with a tooltip explaining why. Existing crawls that have not finished should continue running until they finish (no change here!).

Changes

• Add Superadmin org settings checkbox for "Can Set Custom S3 Bucket"
• Add Superadmin org settings number input for "Alloted Storage", 0 = unlimited
• Add Org admin settings page for storage
  • Radio buttons to select between "Browsertrix Cloud Storage" and "Custom S3 Storage"
    • If custom is set, show / enable the required fields
  • Show the total amount of storage used vs available
• Disable new workflows and manual session creation buttons if an org has reached its storage limit

Tasks

• Mockup of org storage settings page with disk space availablity / storage breakdown
• Stop crawls if org storage space is capped & full #579
• Custom S3 Buckets for Orgs #578
• Allow deleting crawls #284

[tw4l]

@Shrinks99 split out storage usage reporting, storage quotas, and configuring/using a custom S3 bucket

[Shrinks99]

Split out storage limits issue to #930. Leaving custom storage paths to #578 for now, should be another single non-major feature for the front end (that's just gonna be a couple of form options eventually).