Python and Spark – Setup Development Environment – Setup Development Environment for Python and Spark on Windows 10.
Challenges to setup development environment using Windows
- Require external tools such as 7z to uncompress and untar
- Understanding about environment variables
- Compatibility issues with Windows internals (winutils)
- File paths with special characters
- and more
It is very important to set up development environment addressing all the challenges so that we can spend time in development. Most of the above issues is road blocks for beginners.
Hence we created brief course covering all the important aspects of setting up a development environment for Python and Spark.
Once you complete this course, you can proceed with other courses which will cover Spark with Python.