Browse All Tools
Platform/OS
Cross-platform
Category
Data Science & Analytics

Alluxio

Alluxio is like a super-fast middle layer that sits between your apps and slow cloud storage. It lets your data-hungry programs grab files and data almost instantly instead of waiting for the cloud to respond every time. It remembers the files your team uses most often and keeps copies close by so everything feels lightning quick. Alluxio uses S3-compatible object storage as its reliable long-term home for all the data, treating cheap S3 buckets like a giant safe warehouse while it handles the speedy delivery. This setup saves companies a lot of money because they get high performance without having to buy expensive fast disks.

Connection / Setup

  1. Create an account and log in to DiskSpace
  2. Click I'm ready to set up my storage
  3. Enter Bucket Name following the instructions
  4. Click Create Bucket and wait for it to be generated
  5. Find your Endpoint URL, Access Key, and Secret Key in the S3 Client Configuration section for use below

Connecting DiskSpace.sh to Alluxio

Alluxio is fully S3 API compatible and works seamlessly with DiskSpace.sh using path-style addressing. Follow the steps below to configure the connection.

Connection Steps
  1. Log in to your Alluxio management console or configuration interface.
  2. Navigate to the S3-compatible storage or Under Storage configuration section.
  3. Add a new S3 endpoint with the following credentials:
Region: Leave empty or set to us-east-1
Important: Path-Style Requests Required

Alluxio must be configured to use path-style URLs when connecting to DiskSpace.sh. Virtual-hosted style requests are not supported.

Correct format:
https://s3.diskspace.sh/bucket-name/key
Example Configuration
alluxio.underfs.s3.endpoint=https://s3.diskspace.sh
alluxio.underfs.s3.disable.dns.buckets=true
alluxio.underfs.s3.region=us-east-1
alluxio.underfs.s3.access.key=YOUR_ACCESS_KEY
alluxio.underfs.s3.secret.key=YOUR_SECRET_KEY
Troubleshooting
  • Ensure "Path Style Access" or "Force Path Style" is enabled in Alluxio settings.
  • Verify your Access Key and Secret Key have the necessary S3 permissions.
  • If connection fails, try setting the region explicitly to us-east-1.
  • Check that no trailing slashes are present in the endpoint URL.
DiskSpace.sh S3-compatible Object Storage • Fully compatible with Alluxio