Data Migration

CDNetworks Object Storage offers different data migration solutions tailored to various origin server scenarios, supporting methods including syncing tool upload, URL retrieval, and mirroring.

Legacy Data Migration Methods

The three common legacy data migration methods are: data migration tool, mirror storage, and URL retrieval.

I. Syncing Tool Upload via CDNetworks Object Storage

The syncing tool is a legacy data import utility developed based on CDNetworks Object Storage API. It supports multipart upload and resumable transfer, synchronizing local data to Object Storage while preserving the original directory structure. This method is ideal for uploading large volumes of files or oversized files, offering high autonomy and low risk.
Additionally, the syncing tool features hash comparison to verify consistency between local files and same-named files in Object Storage.
Syncing Tool Usage Guide

II. Mirror Storage Function

The mirror storage function enables passive synchronization of origin data to CDNetworks Object Storage. “Passive synchronization” means that when a resource is accessed, Object Storage asynchronously pulls the file from the mirrored origin and stores it locally. Subsequent accesses to this resource can then be served directly from CDNetworks Object Storage.
Mirror storage offers simple configuration for rapid service launch, achieving seamless migration without business disruption. It is suitable for scenarios involving small files or limited data volumes.

III. Proactive Data Retrieval via Specified URLs

Compared to the passive mode of mirror storage, URL retrieval operates proactively. Similar to tool uploading, it migrates origin data to cloud storage in advance. For customers unable to install syncing tools on third-party origins, this method downloads resources to Object Storage. However, factors like the third-party origin’s concurrent capacity, bandwidth, etc., may affect download time, making it difficult to guarantee timely service launch.
This method suits migrating third-party origin data, especially for scenarios with large file quantities and oversized files.

Common Scenarios

Scenario 1: Migrating from On-Premise Servers/IDC Hosting to CDNetworks Object Storage

1. Use the CDNetworks Object Storage syncing tool. With technical support assistance, synchronize bulk data to Object Storage.

2. Combine with mirror storage for seamless data migration to CDNetworks Object Storage buckets.

Scenario 2: Migrating from Any Cloud Service to CDNetworks Object Storage

1. URL retrieval method

2. Most cloud storage providers support S3 protocols. Migrate legacy data using S3-compatible syncing tools, or assign S3 migration tasks to CDNetworks.

3. Combine with mirror storage for seamless data migration to CDNetworks Object Storage buckets.

Note: For extremely large datasets, URL retrieval cannot guarantee migration timelines.