[...] I needed to get a Hive cluster running my code and a Confluent cluster that could output Avro messages in the proper format to test.

[...] focus on best practices such as when and why you should use Oozie, and when to use bundles.

A team at a client was using Spark to read and write to a Kafka topic. [...] files that would be written that were completely empty.

We made the change on a Sunday, but four days later, the number of files had not appreciably changed in the YARN logs directory.