Uploaded image for project: 'Apache Lens (Retired)'
  1. Apache Lens (Retired)
  2. LENS-278

Lens Server not able to persist on HDFS

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 2.0
    • None
    • None

    Description

      When server.persist location is HDFS then lensserver is not able to persist the server state. And it is silently coming out without throwing any exception

      05 Feb 2015 11:53:27,931 [Shutdown] INFO  org.apache.lens.server.LensServices  - Persisting server state in hdfs://lens/tmp/lensserver
      05 Feb 2015 11:53:27,932 [Shutdown] INFO  org.apache.lens.server.LensServices  - Persisting state of service:session
      05 Feb 2015 11:53:27,945 [Shutdown] INFO  org.apache.lens.server.session.HiveSessionService  - Session service pesristed 0 sessions
      05 Feb 2015 11:53:27,967 [Shutdown] INFO  org.apache.lens.server.LensServices  - Persisted service session to hdfs://lens/tmp/lensserver/session.final
      05 Feb 2015 11:53:27,967 [Shutdown] INFO  org.apache.lens.server.LensServices  - Persisting state of service:query
      05 Feb 2015 11:53:27,970 [Shutdown] INFO  org.apache.lens.driver.hive.HiveDriver  - HiveDriver persisted 0 queries
      05 Feb 2015 11:53:27,970 [Shutdown] INFO  org.apache.lens.driver.hive.HiveDriver  - HiveDriver persisted 0 sessions
      05 Feb 2015 11:53:27,970 [Shutdown] INFO  org.apache.lens.server.query.QueryExecutionServiceImpl  - Persisted 0 queries
      05 Feb 2015 11:53:27,986 [Shutdown] INFO  org.apache.lens.server.LensServices  - Persisted service query to hdfs://lens/tmp/lensserver/query.final
      05 Feb 2015 11:53:27,986 [Shutdown] INFO  org.apache.lens.server.LensServices  - Persisting state of service:metastore
      05 Feb 2015 11:53:28,004 [Shutdown] INFO  org.apache.lens.server.LensServices  - Persisted service metastore to hdfs://lens/tmp/lensserver/metastore.final
      05 Feb 2015 11:53:28,004 [Shutdown] INFO  org.apache.lens.server.LensServices  - Persisting state of service:scheduler
      05 Feb 2015 11:53:28,014 [Shutdown] INFO  org.apache.lens.server.LensServices  - Persisted service scheduler to hdfs://lens/tmp/lensserver/scheduler.final
      05 Feb 2015 11:53:28,014 [Shutdown] INFO  org.apache.lens.server.LensServices  - Persisting state of service:quota
      05 Feb 2015 11:53:28,024 [Shutdown] INFO  org.apache.lens.server.LensServices  - Persisted service quota to hdfs://lens/tmp/lensserver/quota.final
      

      Files with their last modify time

      /usr/local/lens$ hadoop fs -lsr /tmp/lensserver
      lsr: DEPRECATED: Please use 'ls -R' instead.
      drwxrwxrwx   - dataqa supergroup          0 2014-12-21 07:52 /tmp/lensserver/hdfsout
      -rw-r--r--   3 dataqa supergroup          4 2015-02-01 17:20 /tmp/lensserver/metastore.final
      -rw-r--r--   3 dataqa supergroup          4 2015-02-05 11:53 /tmp/lensserver/metastore.out
      -rw-r--r--   3 dataqa supergroup        102 2015-02-01 17:20 /tmp/lensserver/query.final
      -rw-r--r--   3 dataqa supergroup        102 2015-02-05 11:53 /tmp/lensserver/query.out
      -rw-r--r--   3 dataqa supergroup          4 2015-02-01 17:20 /tmp/lensserver/quota.final
      -rw-r--r--   3 dataqa supergroup          4 2015-02-05 11:53 /tmp/lensserver/quota.out
      -rw-r--r--   3 dataqa supergroup          4 2015-02-01 17:20 /tmp/lensserver/scheduler.final
      -rw-r--r--   3 dataqa supergroup          4 2015-02-05 11:53 /tmp/lensserver/scheduler.out
      -rw-r--r--   3 dataqa supergroup         10 2015-02-01 17:20 /tmp/lensserver/session.final
      -rw-r--r--   3 dataqa supergroup         10 2015-02-05 11:53 /tmp/lensserver/session.out
      

      Temporary ".out" file is getting regularly updated but while server is exiting rename from ".out" to ".final" is not happening.

      Attachments

        1. LENS-278.4.patch
          2 kB
          Amareshwari Sriramadasu

        Activity

          People

            amareshwari Amareshwari Sriramadasu
            arshadmatin20 Arshad Matin
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: