Details
-
Bug
-
Status: Resolved
-
Critical
-
Resolution: Fixed
-
None
-
None
-
None
Description
- Start Atlas server pointed to an external Kafka instance
- Configure HiveServer2 with Atlas hook pointing to the same Kafka instance.
- Run a hive DDL script like
for i in `seq 1 25`; do ./bin/beeline -u jdbc:hive2://localhost:10000 -n ${user} -p ${pass} -e "create table tbl${i} (col${i}1 int, col${i}2 string);"; done
- While the script is executing, kill -9 the Atlas server
- Let the script complete.
- Verify that all the events are added to the ATLAS_HOOK topic.
- Verify if the tables are added to Atlas.
The observation is that the Kafka topic has all relevant messages, but the tables aren't added to Atlas.