Migrated from garage to Seaweed FS for faster speeds and async. Took me ages of untracked time

• Shows upload speed
• Previews of ALL files now

Changelog

• Changed url from garage to seaweed
• Added Mbps speed count

Added another node thanks to seraded stripes allowing for cross region backup. If u wanna help DM me :)

I know, I know, a 3 hour devlog

• I will be honest I just forgot

We got some MASSIVE changes

• Migrated 100% to garage
• Custom SDK no heavy (AWS S3) SDKs
• Fast
• Unlimited file size depending on ur internet speed
• Shortened URLs from previous project reported over with APIs
• No CSS @Tom needs to do another PR
• GH Workflow for publishing arm64 via selfhosted runner, GH hosted runner for x86/

Issues

• Had many enospc errors, (server kept running out of memory and space)
• Phoenix Liveview, had issues coordinating events in the correct sequence leading to crashing randomly
• URL API was weird, sometimes nothing being returned, my fault with json bodies.

PS a lot of this was backend work dont complain it doesnt look “pretty”. It took a long time for all of this

Changelog

• branch issue
• amd86 workflow
• Allow publish workflow on ‘garage’ branch
• docker release
• working frontend & backend minimal CSS
• gitignore
• env vars

UI Addition & bug fixes with in it. Thanks to @Tom.

Custom SDK is underway

• get_bucket_info(client, bucket) returns all bucket info in xml
• get_object(client, bucket, file_name) returns the file contents
• put_object(client, bucket, file_name, file_contents) uploads file to S3.

Added DB.ex

• Test scripts

Env vars are secure

• runtime.ex

config :fts3, :S3,
  base_url: System.get_env("S3_BASE_URL"),
  region: System.get_env("S3_REGION"),
  access_key_id: System.get_env("S3_ACCESS_KEY_ID"),
  secret_access_key: System.get_env("S3_SECRET_ACCESS_KEY")

Todo

• Complete SDK
• Simple UI of garage S3 branch
• Docker workflows for garage etc

Changelog

• gitignore (ebee0e7)
• S3 lib (2c3ed80)
• DB.ex for testing (af961e4)
• test scripts etc (904ce70)

Finally got garage setup. Took me a while to do in docker, but I eventually moved to bare metal locally. Just tried a test upload to the API from another device to the domain. It Worked!.

Time to do more testing in python and then make an SDK in elixir

Migrating to Garage S3 after this devlog

Changelog

• Proper elixir function for splitting filenames
• add timestamp adds the timestamp at the first dot, instead of before the exention
• encoding file names to stop errors
• Syntax fix
• Added timeout to 10m
• Fixed default address, appened .uk
• Fixed address iusssues
• unlimited file size, not 5GB

Working PoC with any file size

Added working PoC.
Lots of work within supabase site including configuring buckets,testing etc.

Workflow

• Upload file
• File is sharded and uploading in chunks to bypass cloudflare limits
• File is reassembled then uploaded to a local supabase S3 bucket
• I make the address where the file will live, then take that address and pass it through my url shortener and return that instead.
• When the link is followed, you are taken directly the file in supabase.

Features

• Data & Time are appended to all uploaded files, this is to ensure files are not overwritten by other users.

• Chunking to bypass CF limits

• Custom bucket support, if I wanted to run two of these services on two different buckets I can change which bucket through env vars.

and more

To do

Get a better UI with more CSS

Changelog

• Added docker release & actions
• removed base page
• remove default phoneix styles
• routing APIs and requests
• Used AI for a basic frontend
• Added upload controller, handles everything. Used AI for commenting
• env managment
• Added env secrets
• Init, depends