Related Links

    Integrate Dremio with IDrive® e2

    Dremio is an open data lakehouse and analytics platform that enables organizations to query and analyze data across object storage, databases, and SaaS systems. It supports SQL analytics, data virtualization, governance, query acceleration, and open data formats such as Apache Iceberg for BI, data science, and AI workloads. Integrating Dremio with IDrive® e2 provides a capable, scalable cloud object storage solution that effortlessly integrates with Dremio for secure, efficient, and cost-effective data analytics and lakehouse workflows.

    Prerequisites

    Before you begin, ensure the following:

    1. An active IDrive® e2 account. Sign up here if you do not have one.
    2. A bucket in IDrive® e2. Learn how to create a bucket.
    3. Valid Access Key ID and Secret Access Key. Learn how to create an access key.
    4. A valid Dremio account and access to the latest version of the Dremio Server GUI.

    Configure Dremio with IDrive® e2

    The following steps can help you successfully configure and integrate Dremio with IDrive®e2.

    1. Log in to the Dremio Server GUI.
    2. In the Datasets window, click Add Space to add a new space.
      IDrive e2 dremio guides integration steps
    3. Enter a Name and click Save.
      IDrive e2 dremio guides integration steps
    4. Click Add Source to add IDrive e2 as a data source.
      Under Settings, select Global Storage Settings
    5. Select Amazon S3 as the source type.
      IDrive e2 dremio guides integration steps
      1. Before entering the e2 credentials (access key and secret key), click Advanced Options and make any required changes to enable S3-compatible support.
      2. Select the Enable compatibility mode checkbox. Click Add property.
        Under Settings, select Global Storage Settings
    6. Under Connection Properties, add the following sets as connection properties (Name and Value), then click Save.

      Name Value
      fs.s3a.endpoint <Your Idrive e2 S3 endpoint>
      (Ex: t3t8.sg.idrivee2-30.com)
      fs.s3a.path.style.access true
      fs.s3a.connection.ssl.enabled true

      Under Settings, select Global Storage Settings
    7. In the General tab, enter the Name and credentials for your IDrive® e2 account. Click Save.
      Under Settings, select Global Storage Settings
      The Dremio home page displays all your buckets, as shown below.
      Under Settings, select Global Storage Settings
    8. Select the bucket to directly use the data within your buckets to run queries and analysis.