Ephes Blog

Miscellaneous things. Not sure what to put here, yet.

RSS feed icon Plain RSS

Weeknotes 2023-08-14

, Jochen
Just as most people are not going to stop eating fast food because home cooking is better, they’re not going to abandon social media because blogging is awesome. But that doesn’t mean you have to line up for a Big Mac. And it doesn’t mean your internet experience has to suck --Mike Grindle

Normal working week. Improved media file backup for django-cast (#99) and wrote a TIL blog post about how to test Django management commands with pytest. Attended a rust meetup for the first time and am now looking for a use case for rust as it seems to be really cool (I learned static typing via Java and got burned, but static typing in rust is much better - might be time to revisit that).

Articles

Weeknotes

Mastodon / Twitter

Software

Books

Podcasts

Testing Django Management Commands with PyTest

, Jochen

The other day I wanted to test some Django management commands for django-cast and found this excellent post by Adam Johnson:

How to Unit Test a Django Management Command

But I use pytest to write my Django tests, so how would this be different?

A Management Command to Back up Media Files

Ok, so I wrote this little command that creates a backup of all media files. Django 4.2 introduced a new STORAGES setting, so it's now possible to write a backup command that works without having to know exactly how the media files are stored. It only assumes there are entries for production and backup storage backends and they are configured correctly. So it doesn't matter if your files are stored on S3 and the backup should be written to the local filesystem, or vice versa. The media_backup command does not need to know any of this.

from django.core.management.base import BaseCommand

from ...utils import storage_walk_paths
from .storage_backend import get_production_and_backup_storage


class Command(BaseCommand):
    help = (
        "backup media files from production to backup storage "
        "(requires Django >= 4.2 and production and backup storage configured)"
    )

    @staticmethod
    def backup_media_files(production_storage, backup_storage):
        for num, path in enumerate(storage_walk_paths(production_storage)):
            if not backup_storage.exists(path):
                with production_storage.open(path, "rb") as in_f:
                    backup_storage.save(path, in_f)
            if num % 100 == 0:  # pragma: no cover
                print(".", end="", flush=True)

    def handle(self, *args, **options):
        self.backup_media_files(*get_production_and_backup_storage())

Read on: TIL: Testing Django Management Commands with PyTest

Using staticfiles with STORAGES in Django 4.2

, Jochen

The other day I was trying to improve a management command of django-cast to make it easier to backup media files like images and videos. There's already an existing command, but it had to assume that you stored your media files on s3 and wanted the backup to be stored on the local filesystem. It would be great if you could configure your production and backup storage and have the backup command work either way. And the new STORAGES setting added in Django 4.2 looks like a perfect fit for this. So I tried using such a configuration:

STORAGES = {
    "default": {"BACKEND": "config.settings.local.CustomS3Boto3Storage"},
    "staticfiles": {
        "BACKEND": "django.core.files.storage.FileSystemStorage",
        "OPTIONS": {
            "location": "staticfiles",
            "base_url": "/static/",
        },
    },
    "production": {"BACKEND": "config.settings.local.CustomS3Boto3Storage"},
    "backup": {
        "BACKEND": "django.core.files.storage.FileSystemStorage",
        "OPTIONS": {
            "location": ROOT_DIR.path("backups").path("media"),
        },
    },
}

But it didn't work. It took me longer than I would like to admit to figure out that I should have used this config:

STORAGES = {
    "default": {"BACKEND": "config.settings.local.CustomS3Boto3Storage"},
    "staticfiles": {"BACKEND": "django.contrib.staticfiles.storage.StaticFilesStorage"},
    "production": {"BACKEND": "config.settings.local.CustomS3Boto3Storage"},
    "backup": {
        "BACKEND": "django.core.files.storage.FileSystemStorage",
        "OPTIONS": {
            "location": ROOT_DIR.path("backups").path("media"),
        },
    },
}

If you want to replace django.contrib.staticfiles.storage.StaticFilesStorage with whitenoise for production, it's sufficient overwrite the backend in the production settings like this:

STORAGES["staticfiles"]["BACKEND"] = "whitenoise.storage.CompressedManifestStaticFilesStorage"

Weeknotes 2023-08-07

, Jochen
Mit so radikalen Aktionen wird das Klima absolut nichts erreichen. --Christoph Dolna-Gruber

The new Wagtail 5.1 release broke the video and audio choosers in django-cast so there's a new release 0.2.17 that fixes that. While I was at it, I also added some more documentation for the video and audio features. Lots of distractions this week with school and kindergarten stuff, but hopefully things will pick up soon 😅.

Last week I picked up a musical instrument for the first time in over two years. I hadn't been able to play before because I just didn't have the time. Now I'm thinking about getting back into the habit.

Articles

Software

Weeknotes

Videos

Podcasts

Weeknotes 2023-07-31

, Jochen
Don’t worry about people stealing your ideas. If your ideas are any good, you’ll have to ram them down people’s throats. --Howard Aiken

Last week of vacation. Back to work...

Articles

Weeknotes

Software

Podcasts

Out of Context Images

Blumen an einer Mauer in Aurey Mauer aus Schiefertafeln in Aurey Unbekannte Blüte in Aurey Rettungsboot im Bunker in St Nazaire Wallaby im Tierpark von Branféré Marabu in Branféré Nashorn in Branféré Storch in Branféré Schwan in Branféré Giraffe in Branféré Huhn in Branféré Kletterdingsi in Branféré Gans auf Wiese in Branféré Schloß Suscinio