This post will introduce the new RGW driver together with the proper configuration parameters to run some examples uploading/downloading objects in Ceph Jewel.
The Ceph RGW storage driver
The driver extends the Libcloud S3 storage driver to provide a compatible S3 API with Ceph RGW.
The driver also contains support for AWS signature versions 2 (AWS2) and 4 (AWS4). It leverages the Libcloud common auth support on the client side. On the Ceph RGW side it required a little patch to handle unsigned paylods in the AWS4 auth header.
Developers and apps can use the Ceph RGW driver via the S3_RGW provider easily. A simple snippet follows...
from libcloud.storage.types import Provider from libcloud.storage.providers import get_driver import libcloud api_key = 'api_key' secret_key = 'secret_key' cls = get_driver(Provider.S3_RGW) driver = cls(api_key, secret_key, signature_version='4', region='my-region', host='my-host', port=8000) container = driver.get_container(...)
If the region has not an explicit value, the driver will use the default region 'default'.
The valid signature versions are '2' (AWS2) and '4' (AWS4). AWS2 is the default signature version.
One host name is always required. No default value here.
The following two examples contain the minimal code to upload/download objects with the new provider:
Running the upload example...
$ ./test-upload-ceph-rgw-driver.py <Object: name=my-name-abcdabcd-123, size=110080, hash=0a5cfeb3bb10e0971895f8899a64e816, provider=Ceph RGW S3 (my-region) ...>
Running the download example...
$ ./test-download-ceph-rgw-driver.py <Object: name=my-name-abcdabcd-123, size=110080, hash=0a5cfeb3bb10e0971895f8899a64e816, provider=Ceph RGW S3 (my-region) ...>
- The Outscale OSU driver goes upstream in Libcloud
- AWS Signature Version 4 goes upstream in Ceph
- Ceph, a free unified distributed storage system
- On S3, endpoints, regions, signatures and Boto 3