No polling for end-of-stream partitions in SystemConsumers

Currently when a stream reached the end, it's not removed from the empty partition set and will be kept polling afterwards, which affects performance a lot.