Continuum Analytics: Documentation

# Using Anaconda with Spark

These how-tos will show you how to use Anaconda with Apache Spark and PySpark. These how-tos will also show you how to interact with data stored within the Hadoop Distributed File System (HDFS) on the cluster.

While these how-tos are not dependent on each other and can be accomplished in any order, it is recommended that you begin with the Overview of Spark, YARN and HDFS first.

- Overview of Spark, YARN and HDFS
- How to run PySpark as a Spark Standalone job
- How to run PySpark with the YARN resource manager
- How to perform a word count on text data in HDFS
- How to perform distributed natural language processing