-
Notifications
You must be signed in to change notification settings - Fork 23
Open
Description
Hi there!
Apologies for the weird question , but I have this code scenario:
from sqlframe import activate
activate("standalone")
from pyspark.sql import SparkSession
# This should be running StandaloneSession object under the hood i guess
spark= SparkSession.builder.appName("ProfilingDemo").getOrCreate()
# ...
# This gives me an error vvv
df = spark.read.parquet("path/to/file")Above gives me this error:
File "C:\Users\XXX\AppData\Local\pypoetry\Cache\virtualenvs\XXX-YYY-py3.13\Lib\site-packages\sqlframe\base\readerwriter.py", line 203, in load
raise NotImplementedError()
Even though when checking the docs of standalone's API, I see the read method available. So am I reading this wrong? When I click on it, it points me to pyspark's docs of read object, which should have parquet() method in it, so why is it not implemented?
Nevertheless, awesome project!
Metadata
Metadata
Assignees
Labels
No labels