Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-4991

issues with kylin on emr-5.32.0

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • v3.1.2
    • None
    • Environment
    • None
    • emr 5.32.0 , kylin 3.1.2
    • Important
    • Committer(Medium) - This is for regular contributors/committers

    Description

      I am not able to run kylin on aws emr emr-5.32.0 . The same works fine on 5.29 but on upgrading to 5.32 we face the below issue 

      Exception in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata@hbase
              at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:101)
              at org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:113)
              at org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTableMigrationTool.java:100)
              at org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:43)
      Caused by: java.lang.reflect.InvocationTargetException
              at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
              at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
              at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
              at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
              at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:94)
              ... 3 more
      Caused by: org.apache.hadoop.hbase.DoNotRetryIOException: org.apache.hadoop.hbase.DoNotRetryIOException: No modification is allowed when hbase.readonly is set to true
              at org.apache.hadoop.hbase.master.HMaster.checkModifiable(HMaster.java:3305)
              at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:1759)
              at org.apache.hadoop.hbase.master.MasterRpcServices.createTable(MasterRpcServices.java:484)
              at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:64096)
              at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2399)
              at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:124)
              at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:311)
              at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:291)        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
              at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
              at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
              at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
              at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:95)
              at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:85)
              at org.apache.hadoop.hbase.client.RpcRetryingCaller.translateException(RpcRetryingCaller.java:245)
              at org.apache.hadoop.hbase.client.RpcRetryingCaller.translateException(RpcRetryingCaller.java:263)
              at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:150)
              at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:4551)
              at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:4543)
              at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsyncV2(HBaseAdmin.java:758)
              at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:679)
              at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:612)
              at org.apache.kylin.storage.hbase.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:357)
              at org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:121)
              at org.apache.kylin.storage.hbase.HBaseResourceStore.<init>(HBaseResourceStore.java:89)
              ... 8 more
      Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.DoNotRetryIOException): org.apache.hadoop.hbase.DoNotRetryIOException: No modification is allowed when hbase.readonly is set to true
              at org.apache.hadoop.hbase.master.HMaster.checkModifiable(HMaster.java:3305)
              at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:1759)
              at org.apache.hadoop.hbase.master.MasterRpcServices.createTable(MasterRpcServices.java:484)
              at org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:64096)
              at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2399)
              at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:124)
              at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:311)
              at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:291)        at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:386)
              at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:94)
              at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:409)
              at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:405)
              at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:103)
              at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:118)
              at org.apache.hadoop.hbase.ipc.BlockingRpcConnection.readResponse(BlockingRpcConnection.java:600)
              at org.apache.hadoop.hbase.ipc.BlockingRpcConnection.run(BlockingRpcConnection.java:334)
              at java.lang.Thread.run(Thread.java:748)
      
      

      any help would be really appreciated as we need to move ot a linux 2 version

      Attachments

        Activity

          People

            Unassigned Unassigned
            gauravbrills Gaurav Rawat
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - 24h
                24h
                Remaining:
                Remaining Estimate - 24h
                24h
                Logged:
                Time Spent - Not Specified
                Not Specified