Add automated end-to-end tests

We should add simple tests that exercise all the paths that a user would use when starting a cluster and submitting a program. Preferably with a simple batch program and a streaming program that uses Kafka.

This would have catched some of the bugs that we now discovered right before the release.