Module pipelines.rj_segovi.dump_ftp_adm_processorio_sicop.tasks

Tasks to dump data from a SICOP FTP to BigQuery

Functions

def download_files(client, files, save_path)

Download files from FTP

def get_files_to_download(client, pattern, dataset_id, table_id, date_format)

Get files to download FTP and GCS

def get_ftp_client(wait=None)

Get FTP client

def parse_save_dataframe(files, save_path, pattern)

Parse and save files from FTP