Module pipelines.utils.dump_db.utils

Utilities for the Database Dump flows.

Functions

def build_query_new_columns(table_columns: List[str]) ‑> List[str]

" Creates the query without accents.

def extract_last_partition_date(partitions_dict: dict, date_format: str)

Extract last date from partitions folders

def generate_dump_db_schedules(interval: datetime.timedelta, start_date: datetime.datetime, labels: List[str], db_database: str, db_host: str, db_port: Union[str, int], db_type: str, dataset_id: str, vault_secret_path: str, table_parameters: dict, batch_size: int = 50000, runs_interval_minutes: int = 15) ‑> List[prefect.schedules.clocks.IntervalClock]

Generates multiple schedules for database dumping.