easy_sql.sql_processor.sql_processor
Module Contents
Classes
Functions
|
- class easy_sql.sql_processor.sql_processor.SqlCollector
- class easy_sql.sql_processor.sql_processor.SqlProcessor(backend, sql, extra_cols=None, variables=None, report_hdfs_path=None, report_task_id=None, report_es_url=None, report_es_index_prefix=None, scala_udf_initializer=None, templates=None, includes=None, config=None, executed_sql_transformer=None)
- Parameters
backend (Union[pyspark.sql.SparkSession, easy_sql.sql_processor.backend.Backend]) –
sql (str) –
extra_cols (Optional[List[easy_sql.sql_processor.common.Column]]) –
variables (Optional[dict]) –
report_hdfs_path (Optional[str]) –
report_task_id (Optional[str]) –
report_es_url (Optional[str]) –
report_es_index_prefix (Optional[str]) –
scala_udf_initializer (Optional[str]) –
templates (Optional[dict]) –
config (Any) –
executed_sql_transformer (Optional[easy_sql.sql_processor.step.ExecutedSqlTransformer]) –
- property extra_cols(self)
- Return type
- run_step(self, step, dry_run)
- Parameters
step (easy_sql.sql_processor.step.Step) –
dry_run (bool) –
- easy_sql.sql_processor.sql_processor.extract_funcs_from_pyfile(funcs_py_file)