[...] I needed to get a Hive cluster running my code and a Confluent cluster that could output Avro messages in the proper format to test.

At a high level, [CGC] is merely going through the cluster, taking inventory of the data and processes that run on the cluster...

[...] we'll discuss some of the ways we can write environment agnostic code, which can be run on any environment within your enterprise.

How do we ensure that GPU jobs run on worker nodes with GPUs without buying expensive GPUs for all of our worker nodes?

I'm going to explore exactly how YARN works with queues, and the various mechanisms available to control how YARN does this.

With the help of tools like Spark’s MLlib ... [making a recommendation engine] is something that many companies have done and you can too.