Uploaded image for project: 'Apache IoTDB'
  1. Apache IoTDB
  2. IOTDB-4683

100k sensors/dev ,write failed

    XMLWordPrintableJSON

Details

    • 2022-11-Cluster

    Description

      m_1017_f33130b
      1副本,1C1D
      DEVICE_NUMBER=300
      SENSOR_NUMBER=100000
      CLIENT_NUMBER=1
      GROUP_NUMBER=3
      BATCH_SIZE_PER_WRITE=1

      写入超时时间设置为1小时,写入失败(写入期间基本无CPU)。
      0.13 同样元数据配置,只是BATCH_SIZE_PER_WRITE=100
      写入成功

      测试环境
      分布式1副本1C1D
      1. 192.168.10.76 物理机 48CPU 384GB
      ConfigNode
      MAX_HEAP_SIZE="8G" schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
      data_region_consensus_protocol_class=org.apache.iotdb.consensus.multileader.MultiLeaderConsensus

      connection_timeout_ms=120000

      schema_region_ratis_request_timeout_ms = 1200000
      data_region_ratis_request_timeout_ms = 1200000
      schema_region_ratis_max_retry_attempts = 1
      data_region_ratis_max_retry_attempts = 2

      DataNode
      MAX_HEAP_SIZE="256G"
      MAX_DIRECT_MEMORY_SIZE="32G"

      wal_buffer_size_in_byte=211424144

      avg_series_point_number_threshold=100

      max_waiting_time_when_insert_blocked=3600000
      enable_seq_space_compaction=false
      enable_unseq_space_compaction=false
      enable_cross_space_compaction=false
      query_timeout_threshold=36000000

      0.13 测试环境 ( commitID :fe7cc90)
      192.168.10.64 物理机 72CPU 256GB
      MAX_HEAP_SIZE="192G"
      MAX_DIRECT_MEMORY_SIZE="32G"

      wal_buffer_size=211424144
      avg_series_point_number_threshold=100

      max_waiting_time_when_insert_blocked=3600000
      enable_seq_space_compaction=false
      enable_unseq_space_compaction=false
      enable_cross_space_compaction=false
      query_timeout_threshold=36000000

      bm配置文件见附件

      Attachments

        1. mpp.conf
          14 kB
          刘珍
        2. mpp_ip76_dn_stack.out
          188 kB
          刘珍
        3. iotdb_13.conf
          14 kB
          刘珍
        4. image-2022-12-07-14-43-34-966.png
          129 kB
          刘珍

        Issue Links

          Activity

            People

              haonan Haonan Hou
              刘珍 刘珍
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: