Linode Object Storage Python sdk

We would like to help get you pointed in the right direction. Before we can offer any advice we'll need some additional information from you on what you're trying to accomplish. Can you provide the code or script you're using that is working with s3, but isn't with our s3 compatible Object Storage?

What parameters are you using when making calls to Linode Object Storage? Also, how are you initializing your connection to Linode Object Storage? These are a few things we may need so we can help you further. Any additional information that you can provide would help us immensely.

I've also included links to some of our Linode Object Storage guides below that may help.

How to Use Linode Object Storage
Accessing Objects with Linode Object Storage
Host a Static Site using Linode Object Storage
Linode API | Object Storage | Linode Developer Tools

@mcivitarese I'm about to use Object Storage with Django too, and can't find any information or tutorials.

I would expect something like this to work: https://blog.theodo.com/2019/07/aws-s3-upload-django/

But it would be good to see a Django-specific tutorial coming from Linode.

Hi there, I'm using Django Storages, boto3 with a configuration like below which seems to work (though lately I've been having intermittent issues when uploading files):

One thing I've noticed is that object storage adds the bucket name to the end of the URL when fetching files so your AWS_S3_CUSTOM_DOMAIN will end up looking like "mybucket.ap-south-1.linodeobjects.com/mybucket" and the AWS_S3_ENDPOINT_URL will just be "https://mybucket.ap-south-1.linodeobjects.com/"

I hope this helps.

AWS_STORAGE_BUCKET_NAME = 'thrive'
AWS_ACCESS_KEY_ID = '--access key--'
AWS_SECRET_ACCESS_KEY = '--secret-key--'
AWS_S3_CUSTOM_DOMAIN = '%s.ap-south-1.linodeobjects.com/%s' % (AWS_STORAGE_BUCKET_NAME, AWS_STORAGE_BUCKET_NAME)
MEDIA_URL = "https://%s/" % (AWS_S3_CUSTOM_DOMAIN,)
DEFAULT_FILE_STORAGE = 'storages.backends.s3boto3.S3Boto3Storage'
AWS_S3_ENDPOINT_URL = "https://%s.ap-south-1.linodeobjects.com/" % AWS_STORAGE_BUCKET_NAME

This video was very usefull. I can conect with the bucket using Django and Boto3

[https://www.youtube.com/watch?v=oAn7isP5Osg&t=716s]

However, all my images are added to the bucket with private access, so I have to go and change permission manualy for each one. Changing the settings on linode web admin panel is not having any effect.

Originally I had back-ported the boto storages backend and finding it easier to debug was able to get it to work.

After checking out the above video mentioned by @gabospa however I found very helpful. I managed to get it working with the boto3 backend.

I had none of the mentioned issues with permissions - I suspect those have been addressed in recent changes and now it seems to work as expected.

David

@gabospa you probably discovered the solution to access problem already, but in case anyone else has the same issue (and you will if you're using your bucket to serve data for a public facing web site), check out this community post:

https://www.linode.com/community/questions/19796/public-read-access-for-object-storage-bucket

It's a little mysterious as to why this setting isn't available in the Linode web UI since it seems like it is a very common use case. Defaulting to private is fine and secure, but an option to change this easily in a more obvious way would be good.

I was able to get boto3 to link directly as follows:

AWS_S3_ENDPOINT_URL = f'https://{LINODE_BUCKET_REGION}.linodeobjects.com'

import boto3
s3 = boto3.client('s3',
region_name = LINODE_BUCKET_REGION,
endpoint_url = AWS_S3_ENDPOINT_URL,
aws_access_key_id = LINODE_BUCKET_ACCESS_KEY,
aws_secret_access_key = LINODE_BUCKET_SECRET_KEY)