The EXPORT
statement exports tabular data or the results of arbitrary SELECT
statements to CSV files.
Using the CockroachDB distributed execution engine, EXPORT
parallelizes CSV creation across all nodes in the cluster, making it possible to quickly get large sets of data out of CockroachDB in a format that can be ingested by downstream systems. If you do not need distributed exports, you can use the non-enterprise feature to export tabular data in CSV format.
New in v20.2:
EXPORT
no longer requires an enterprise license.
Cancelling export
After the export has been initiated, you can cancel it with CANCEL QUERY
.
Synopsis
Required privileges
Only members of the admin
role can run EXPORT
. By default, the root
user belongs to the admin
role.
Parameters
Parameter | Description |
---|---|
file_location |
Specify the URL of the file location where you want to store the exported CSV data. Note: It is best practice to use a unique destination for each export, to avoid mixing files from different exports in one directory. |
WITH kv_option |
Control your export's behavior with these options. |
select_stmt |
Specify the query whose result you want to export to CSV format. |
table_name |
Specify the name of the table you want to export to CSV format. |
Export file URL
You can specify the base directory where you want to store the exported .csv files. CockroachDB will create the export file(s) in the specified directory with programmatically generated names (e.g., exportabc123-n1.1.csv
, exportabc123-n1.2.csv
, exportabc123-n2.1.csv
, ...). Each export should use a unique destination directory to avoid collision with other exports.
The EXPORT
command returns the list of files to which the data was exported. You may wish to record these for use in subsequent imports.
New in v20.2:
A hexadecimal hash code (abc123...
in the file names above) uniquely identifies each export run; files sharing the same hash are part of the same export. If you see multiple hash codes within a single destination directory, then the directory contains multiple exports, which will likely cause confusion (duplication) on import. We recommend that you manually clean up the directory, to ensure that it contains only a single export run.
For more information, see the following:
Export options
You can control the EXPORT
process's behavior using any of the following key-value pairs as a kv_option
.
delimiter
If not using comma as your column delimiter, you can specify another ASCII character as the delimiter.
Required? | No |
Key | delimiter |
Value | The ASCII character that delimits columns in your rows |
Example | To use tab-delimited values: WITH delimiter = e'\t' |
nullas
Convert SQL NULL values so they match the specified string.
Required? | No |
Key | nullas |
Value | The string that should be used to represent NULL values. To avoid collisions, it is important to pick nullas values that does not appear in the exported data. |
Example | To use empty columns as NULL: WITH nullas = '' |
Success responses
Successful EXPORT
returns a table of (perhaps multiple) files to which the data was exported:
Response | Description |
---|---|
filename |
The file to which the data was exported. |
rows |
The number of rows exported to this file. |
bytes |
The file size in bytes. |
Examples
Export a table
> EXPORT INTO CSV
'azure://acme-co/customer-export-data?AZURE_ACCOUNT_KEY=hash&AZURE_ACCOUNT_NAME=acme-co'
WITH delimiter = '|' FROM TABLE bank.customers;
Export using a SELECT
statement
> EXPORT INTO CSV
'azure://acme-co/customer-export-data?AZURE_ACCOUNT_KEY=hash&AZURE_ACCOUNT_NAME=acme-co'
FROM SELECT * FROM bank.customers WHERE id >= 100;
Non-distributed export using the SQL shell
$ cockroach sql -e "SELECT * from bank.customers WHERE id>=100;" --format=csv > my.csv
View a running export
View running exports by using SHOW QUERIES
:
> SHOW QUERIES;
Cancel a running export
Use SHOW QUERIES
to get a running export's query_id
, which can be used to cancel the export:
> CANCEL QUERY '14dacc1f9a781e3d0000000000000001';
Known limitation
EXPORT
may fail with an error if the SQL statements are incompatible with DistSQL. In that case, export tabular data in CSV format.