Skip to content

yggdrasil.plan.databricks

databricks

Databricks-specific SQL parser extensions.

Extends :class:SQLQueryParser with Databricks SQL features:

  • LATERAL VIEW [OUTER] EXPLODE / POSEXPLODE / INLINE / STACK
  • Date/time functions: DATE_TRUNC, DATE_ADD, DATE_SUB, DATEDIFF, DATE_FORMAT, TO_DATE, TO_TIMESTAMP, DATEADD, CURRENT_DATE, CURRENT_TIMESTAMP, NOW
  • String functions: CONCAT, SUBSTRING, TRIM, UPPER, LOWER, REPLACE, REGEXP_REPLACE, REGEXP_EXTRACT, SPLIT, LPAD, RPAD
  • Null functions: COALESCE, NVL, NVL2, IFNULL, NULLIF
  • Collection: COLLECT_LIST, COLLECT_SET, SIZE, FLATTEN, ARRAY_CONTAINS, ELEMENT_AT, TRANSFORM, FILTER
  • Aggregate: COUNT, SUM, AVG, MIN, MAX, APPROX_COUNT_DISTINCT, PERCENTILE_APPROX
  • Window: ROW_NUMBER, RANK, DENSE_RANK, NTILE, LAG, LEAD, FIRST_VALUE, LAST_VALUE
  • Math: ABS, CEIL, FLOOR, ROUND, MOD, POWER, SQRT, LOG, LN, EXP
  • Type: TRY_CAST
  • Misc: EXPLODE, POSEXPLODE, INLINE, STACK, NAMED_STRUCT, MAP_KEYS, MAP_VALUES, FROM_JSON, TO_JSON, SCHEMA_OF_JSON

DatabricksSQLParser 

DatabricksSQLParser(sql: str, dialect: Dialect)

Bases: SQLQueryParser

Databricks SQL dialect parser.

Extends the base parser with Databricks-specific function recognition and LATERAL VIEW syntax. All standard Databricks functions are recognized as function calls (not columns) even without backtick quoting.