Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-32207

Error import Pyflink.table.descriptors due to python3.10 version mismatch

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • 1.17.0
    • 1.17.1
    • API / Python
    • None
    • Colab

      Python3.10 

    Description

      Gentlemen,
       
       
       
      I have problem with some apache-flink modules. I am running a 1.17.0 apache- flink and I write test codes in Colab I faced a problem for import modules 
       
       
       
       
      from pyflink.table import DataTypes 
       
      from pyflink.table.descriptors import Schema, Kafka, Json, Rowtime 
       
      from pyflink.table.catalog import FileSystem 
       
       
       
       
      not working for me (python version 3.10) 
       
       
      Any help is highly appreciated the strange is that other modules importing fine.  I checked with your Github but didn't find these on yours too which means modules are not inside your descriptor.py too. I think it needed installation of connectors but it failed too. 
       
       
       
       
      Please see the link below: 
       
       
       
       
       
      https://github.com/aomidvar/scrapper-price-comparison/blob/d8a10f74101bf96974e769813c33b83d7a71f02b/kafkaconsumer1.ipynb
       
       
       
       
      I am running a test after producing the stream (https://github.com/aomidvar/scrapper-price-comparison/blob/main/kafkaproducer1.ipynb) to Confluent server and I like to do a flink job but the above mentioned modules are not found with the following links in collab:
       
       
      That is not probably a bug. Only version of apache-flink now working on colab is 1.17.0. I prefer 3.10 but installed a virtual python 3.8 env and between different modules found out that Kafka and Json modules are not in descriptors.py of version 1.17 Apache-flink default. But modules exist in Apache-flink 1.13 version.
      https://colab.research.google.com/drive/1aHKv8WA6RA10zTdwdzUubB5K0anEmOws?usp=sharing
      https://colab.research.google.com/drive/1eCHJlsb8AjdmJtPc95X3H4btmFVSoCL4?usp=sharing
       
      I've got this error for Json, Kafka ...
      ---------------------------------------------------------------------------
       
       ImportError Traceback (most recent call last) <ipython-input-1-203af9e2c559> in <cell line: 2>() 1 from pyflink.table import DataTypes ----> 2 from pyflink.table.descriptors import Schema, Kafka, Json, Rowtime 3 from pyflink.table.catalog import FileSystem ImportError: cannot import name 'Kafka' from 'pyflink.table.descriptors' (/usr/local/lib/python3.10/dist-packages/pyflink/table/descriptors.py) 
       
      ---------------------------------------------------------------------------
       
       NOTE: If your import is failing due to a missing package, you can manually install dependencies using either !pip or !apt. To view examples of installing some common dependencies, click the "Open Examples" button below.
       
       ---------------------------------------------------------------------------
       
      I have doubt that if current error is related to a version and dependencies then 
       
      I have to ask the developer if I do this python 3.8 env is that possible to get solved?
       
       
      Thanks for your time ,
       

      Attachments

        1. image (2).png
          108 kB
          Alireza Omidvar
        2. image (1).png
          107 kB
          Alireza Omidvar

        Issue Links

          Activity

            People

              Unassigned Unassigned
              aomidvar Alireza Omidvar
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: