Module pipelines.rj_cor.meteorologia.precipitacao_cemaden.tasks

Tasks for precipitacao_cemaden

Functions

def check_for_new_stations(dataframe: pandas.core.frame.DataFrame, wait=None) ‑> None

Check if the updated stations are the same as before. If not, consider flow as failed and call attention to add this new station on estacoes_cemaden. I can't automatically update this new station, because I couldn't find a url that gives me the lat and lon for all the stations.

def download_data() ‑> pandas.core.frame.DataFrame

Download data from API

def save_data(dataframe: pandas.core.frame.DataFrame) ‑> Union[str, pathlib.Path]

Save data on a csv file to be uploaded to GCP

def treat_data(dataframe: pandas.core.frame.DataFrame, dataset_id: str, table_id: str, mode: str = 'dev') ‑> Tuple[pandas.core.frame.DataFrame, bool]

Rename cols and filter data using hour and minute from the nearest current timestamp