Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-9675

the table does not load if the file path has a dot at start

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • 1.0.0
    • None
    • Python
    • Windows 10

    Description

      Please check the below code. If I uncomment line six then the table written to disk is loaded as an empty table.

      Similar behavior is observed when the directory name starts with `_`. 

      This was not the case in earlier versions.

       

      ```python

      import pyarrow.parquet as pq
      import pyarrow as pa
      import pathlib
      _path = pathlib.Path("abc").resolve()
      _path /= "xyz"
      _path /= ".lmn" # uncomment this has a 'dot' at start of the folder
      _path /= "file_name"
      pq.write_to_dataset(
          table=pa.table(

      {"a": [1], "b": [2]}

      ),
          root_path=_path.as_posix()
      )
      t = pq.read_table(_path)
      print(t.to_pandas())

      ```

      Attachments

        Issue Links

          Activity

            People

              bkietz Ben Kietzman
              spikingneuron Praveen Kulkarni
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: