Flat File External Source Settings

DataSync allows you to connect to local and remote CSV resources. Refer to the sections below to set the URI parameter to the CSV resource location, in addition to any other parameters necessary to connect to your data source.

• Basic Authentication

• Amazon

• Azure

• Wasabi

• Oracle Cloud

Basic Authentication

	Local	HTTP or HTTPS	SharePoint Online SOAP	FTP or FTPS	SFTP
URI Formats	localPath file://localPath	http://remoteStream https://remoteStream	sp://remotePath	ftp://server:port/remotePath ftps://server:port/remotepath	sftp://server:port/remotePath
User		OPTIONAL	REQUIRED	REQUIRED	OPTIONAL
Password		OPTIONAL	REQUIRED	REQUIRED	OPTIONAL
AuthScheme		OPTIONAL

Connecting to Local Files

Set the URI to a folder containing CSV files.

Below is an example connection string:

URI=C:\folder1;

You can also connect to multiple CSV files that share the same schema. Below is an example of connection string:

URI=C:\folder; AggregateFiles=True;

If you would prefer to expose all of the individual CSV files as tables instead, leave this property at False.

URI=C:\folder; AggregateFiles=False;

Connecting to HTTP

Set the URI to the HTTP or HTTPS URL of the CSV resource you want to access as a table. For example:

URI=http://www.host1.com/streamname1;

To authenticate, set AuthScheme and the corresponding properties. Specify additional headers in CustomHeaders to modify the query string, set CustomUrlParams.

To query the CSV stream, reference streamedtable as the table name.

SELECT * FROM streamedtable

Connecting to SharePoint Online SOAP

Set the URI to a document library containing CSV files. To authenticate, specify the user name, password and SharePoint URL.

For example:

URI=sp://Documents/folder1; User=user1; Password=password1; SharepointUrl=https://subdomain.sharepoint.com;

Connecting to FTP

Set the URI to the address of the server followed by the path to the folder to be used as the root folder. To authenticate, specify the user name and password.

For example:

URI=ftps://localhost:990/folder1; User=user1; Password=password1;

Amazon

	Amazon S3
URI Formats	s3://remotePath
AWSAccessKey	REQUIRED (your AccessKey)
AWSSecretKey	REQUIRED (your SecretKey)
AWSRegion	OPTIONAL

Connecting to Amazon S3

Set the URI to the bucket and folder. Additionally, set the following properties to authenticate:

• AWSAccessKey: Set this parameter to an Amazon Web Services Access Key (a user name).

• AWSSecretKey: Set this parameter to an Amazon Web Services Secret Key.

For example:

URI=s3://bucket1/folder1; AWSAccessKey=token1; AWSSecretKey=secret1; AWSRegion=OHIO;

Optionally, you can also specify the AWSRegion.

Azure

	Azure Blob Storage	Azure Data Lake Store Gen1	Azure Data Lake Store Gen2	Azure Data Lake Store Gen2 with SSL
URI Formats	azureblob://mycontainer/myblob/	adl://remotePath adl://Account.azuredatalakestore.net@remotePath	abfs://myfilesystem/remotePath	abfss://myfilesystem/remotePath
InitiateOAuth		REQUIRED
OAuthClientId		OPTIONAL
OAuthClientSecret		OPTIONAL
OAuthAccessToken		OPTIONAL
AuthScheme		REQUIRED
AzureAccount	REQUIRED	REQUIRED	REQUIRED	REQUIRED
AzureAccessKey	REQUIRED (your AccessKey)		REQUIRED (your AccessKey)	REQUIRED (your AccessKey)

Connect to Azure Blob Storage

Set the URI to the name of your container and the name of the blob. Additionally, set the following properties to authenticate:

• AzureAccount: Set this parameter to the account associated with Azure Blob Storage.

• AzureAccessKey: Set this parameter to the access key associated with Azure Blob Storage.

For example:

URI=azureblob://mycontainer/myblob/; AzureAccount=myAccount; AzureAccessKey=myKey;

Connect to Azure Data Lake Store Gen 2

Set the URI to the name of the file system and the name of the folder which contains your CSV files. Additionally, set the following properties to authenticate:

• AzureAccount: Set this parameter to the account associated with Azure Data Lake Store.

• AzureAccessKey: Set this parameter to the access key associated with Azure Data Lake Store.

For example:

URI=abfs://myfilesystem/folder1; AzureAccount=myAccount; AzureAccessKey=myKey;

URI=abfss://myfilesystem/folder1; AzureAccount=myAccount; AzureAccessKey=myKey;

Wasabi

	Wasabi
URI Formats	wasabi://bucket1/remotePath;
AccessKey	REQUIRED (your AccessKey)
SecretKey	REQUIRED (your SecretKey)
Region	OPTIONAL
OracleNamespace

Connecting to Wasabi

Set the URI to the bucket and folder. Additionally, set the following properties to authenticate:

• AWSAccessKey: Set this parameter to a Wasabi access key (a user name).

• AWSSecretKey: Set this parameter to a Wasabi secret key.

Optionally, you can also specify the AWSRegion.

For example:

URI=wasabi://bucket1/folder1; AWSAccessKey=token1; AWSSecretKey=secret1; AWSRegion=OHIO;

Oracle Cloud

	Oracle Cloud Storage
URI Formats	os://bucket/remotePath;
AccessKey	REQUIRED (your AccessKey)
SecretKey	REQUIRED (your SecretKey)
Region	OPTIONAL
OracleNamespace	REQUIRED

Connecting to Oracle Cloud Storage

Set the URI to the bucket and folder. Additionally, set the following properties to authenticate:

• AccessKey: Set this parameter to an Oracle Cloud access key.

• SecretKey: Set this parameter to an Oracle Cloud secret key.

• OracleNamespace: Set this parameter to an Oracle Cloud namespace.

For example:

URI=os://bucket/remotePath/; AccessKey=token1; SecretKey=secret1; OracleNamespace=myNamespace; Region=us-ashburn-1;

Optionally, you can also specify the Region.