forked from andypetrella/pipeline
-
Notifications
You must be signed in to change notification settings - Fork 0
Docker Volumes
Chris Fregly edited this page Nov 3, 2015
·
1 revision
The following paths will be shared between the Host (ec2-linux or macosx-laptop) and the Docker Container:
/var/lib/boot2docker
/var/lib/docker
Notes:
- The
-v ~/pipeline/notebooksmaps persistent path inside the Docker Container. This way, you won't lose changes to your Apache Zeppelin or Spark-Notebook notebooks while running inside Docker. - Consider everything - both in-memory or on-disk - inside the Docker Container to be scoped to the life of just that Container.
- If the Docker Container crashes or you exit the bash session, you will lose data if you're not using VOLUMES (-v)!
- If you're other assets that you want to persist, make sure to commit/push them to git or save them outside of the ephemeral Docker Container - otherwise they may disappear.
- Be careful with mapping local paths that are under git's control. Things get wonky sometimes. (hand-waving)
Environment Setup
Demos
6. Serve Batch Recommendations
8. Streaming Probabilistic Algos
9. TensorFlow Image Classifier
Active Research (Unstable)
15. Kubernetes Docker Spark ML
Managing Environment
15. Stop and Start Environment