IPython/Jupyter SQL Magic Functions for PySpark | Databases ...
db-blog.web.cern.ch › blogNov 17, 2016 · An example of magic functions for running SQL in pyspark can be found at this link to the code . The following magic functions are defined in the accompanying example code: %sql <statement> - return a Spark DataFrame for lazy evaluation of the SQL %sql_show <statement> - run the SQL statement and show max_show_lines (50) lines %sql_display ...