Investigate potential implementation of spark.table

[kleverman]

Investigate/Brainstorm how we would implement support for spark.table(table_name)

[vunguyenq]

Ideas:

• Add utility function to scan storage, detect delta tables and register on Metastore
• Adjust storage.read to:
  1. Detect if path param is a path or a table name (containing no slash etc)
  2. If it is a table name, look into metadata of the table, figure out the underlying path and apply isolated storage to the path as usual
  3. It can get complicated when the table name is a view (backed by a SQL) or a temp view (created by createOrReplaceTempView). We may need to trace SQL statements that make up the view to detect the paths. Need more brainstorming here.

[GiorgosPa]

We could use the format parameter.
Storage.read requires the format parameter to be set. If set to table then we can read the metadata and figure out the underlying path if isolation is enabled if not we simply call spark.table(path)