In the previous blog post, we saw how to start a Spark cluster on EC2 using the inbuilt launch scripts. This is good if you want get something up and running quickly, but it won't allow fine-grained control over our cluster. A lot of times, we would want to customize the machines that we spin up. Let's say … Continue reading Launching A Spark Standalone Cluster

Apache Spark is marketed as "lightning fast cluster computing" and it stands true to its word! It can do amazing things really quickly using a cluster of machines. So how do we assemble that cluster? Let's say you are using a cloud service provider like Amazon Web Services. Do we need to spin up a … Continue reading How To Launch A Spark Cluster On Amazon EC2