Sign up for Cloudflare R2 and move attic storage to it #25

Closed
opened 2025-08-28 02:24:17 +05:30 by Harsh Shandilya · 3 comments

Should be free and faster

Should be free and faster
Author
Owner
Got the bucket: https://dash.cloudflare.com/07d4cd9cc7e8077fcafc5dd2fc30391b/r2/default/buckets/attic-cache/
Harsh Shandilya added spent time 2025-08-28 11:11:08 +05:30
30 minutes
Author
Owner

This is causing a lot of problems, might have to roll back

This is causing a lot of problems, might have to roll back
Harsh Shandilya added spent time 2025-08-28 20:38:14 +05:30
30 minutes
Author
Owner

Cautiously optimistic that this is solved now, we'll see: https://github.com/msfjarvis/dotfiles/actions/runs/17300585991/job/49110356214

Fixing this was a pain in the ass, first I had to swap the database out to clear out all the old NAR information.

Then I had to tweak the chunking algorithm to prefer creating bigger chunks so that recreating a store path doesn't require 300 billion GET requests.

Cautiously optimistic that this is solved now, we'll see: https://github.com/msfjarvis/dotfiles/actions/runs/17300585991/job/49110356214 Fixing this was a pain in the ass, first I had to [swap the database out](https://github.com/msfjarvis/dotfiles/commit/3a2678d6ba67c8e7ab8b07554b8ce42bc894c058) to clear out all the old NAR information. Then I had to [tweak the chunking algorithm](https://github.com/msfjarvis/dotfiles/commit/400dc928b42746a9f91f913636193d7d6c7650fb) to prefer creating bigger chunks so that recreating a store path doesn't require 300 billion GET requests.
Harsh Shandilya stopped working 2025-08-28 21:55:44 +05:30
1 hour 17 minutes
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Total time spent: 2 hours 17 minutes
Harsh Shandilya
2 hours 17 minutes
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
msfjarvis/tasks#25
No description provided.