Transfer · From Tasks · from_url

Purpose

Imports data from a URL.

Method of use

If the URL needs a username and password to get to the data, please share them with a Onesecondbefore employee to add it as a connection.

Configuration

Example usage

extract:
    conn_id: url
    url: https://api-live.adyen.com/reports/download/Company/Onesecondbefore/payments_accounting_report_{{ task.start_date.strftime('%Y_%m_%d') }}.csv

Properties

propertytyperequireddescription
conn_idstringnoConnection string as handed to you by the Onesecondbefore team.
urlstringyesUrl to download the data from.

Details

itemdescription
Pre-formatted schemaNo. This from task does not come with a pre-formatted schema. Define file and it is required to define the schema if you use Snowflake. BigQuery can auto-detect the source file.