parquet_to_sqlite

Utilities for converting files from Parquet to SQLite.

class graphnet.data.utilities.parquet_to_sqlite.ParquetToSQLiteConverter(parquet_path, mc_truth_table, excluded_fields)[source]

Bases: Logger

Convert Parquet files to a SQLite database.

Each event in the parquet file(s) are assigned a unique event id. By default, every field in the parquet file(s) are extracted. One can choose to exclude certain fields by using the argument exclude_fields.

Construct ParquetToSQLiteConverter.

Parameters:

  • parquet_path (str | List[str]) –

  • mc_truth_table (str) –

  • excluded_fields (str | List[str] | None) –

run(outdir, database_name)[source]

Run Parquet to SQLite conversion.

Parameters:

  • outdir (str) – Output directory for SQLite database.

  • database_name (str) – Name of output SQLite database.

Return type:

None