uataq.filesystem.core.parse_datafiles#

uataq.filesystem.core.parse_datafiles(files, time_range, num_processes=1, driver='pandas')[source]#

Read and parse data files, in parallel, using multiple processes.

Parameters:

  • files (list[DataFile]) – A list of DataFile objects.

  • time_range (TimeRange) – A TimeRange object representing the time range to filter by.

  • num_processes (int | Literal['max']) – The number of processes to use. Defaults to 1.

  • driver (Literal['pandas'] | Literal['xarray']) – The data driver to use. Defaults to ‘pandas’.

Returns:

A DataFrame containing the parsed data.

Return type:

pandas.DataFrame

Raises:

ReaderError – If none of the files could be parsed.