Do tasks handle tasks inside your data lake, e.g. from storage to a table. And flow control tasks like do_zilch or do_continue.
The do_zilch task, does exactly that: Zilch (nothing). It is useful in the job design, if you have e.g. 4 tasks that must be finished before 10 more tasks will start, it is usefull to put a hub inbetween.
task: type: do_zilch
|string||no||Must be |
The do_continue task is a flow control task. The tasks after this task will only be executed if the result of the query is true.
task: type: do_continue extract: query: | SELECT CURRENT_DATE('Europe/Amsterdam') < CURRENT_DATE('Europe/Amsterdam')-1 AS yesno_field validate: - type: yesno field: yesno_field
|Configure a validation like in a from task. You can only add 1 validation and the type must be |