DSA & MUII Wiki

Jupyter Server Memory Issues

Some common errors or symptoms you may see due to memory issues:"Unexpected error while saving file""Error loading notebook Unreadable notebook: <path to notebook" MemoryError()""An unknown error occurred while loading

Moving data files to your group data share

The Case Study and Capstone teams are assigned team data shares to store all their data files. Data files are not to be committed to your shared repository.Instructions: 1. Open a terminal

Error Loading Notebook - Unreadable Notebook

Problem: You receive an error message "Unreadable Notebook: <path to a notebook> NotJSONError("Notebook does not appear to be JSON: "...") Solution: If you look in the Jupyter directory for the notebook,

Installing the University AnyConnect VPN

To access any of the DSA GitLab servers you need to either be on the university network or connect via VPN. To download and install the university’s AnyConnect VPN client: Go to

Downloading Datasets

Some of our students desire to download notebooks and datasets and work on your personal computers. We do not recommend your personal computers for completing your normal course work. The JupyterHub environment and

GPU Resources

Overview There are several GPU nodes in the Europa cluster available to DSA students. 2 3x GPU nodes 2 1x GPU nodes Card Model: Nvidia Tesla P100 GPUs CUDA Capability: 6.0 (Pascal

Maintanenace Windows

Regular Weekly Maintenance WindowsEvery Friday from 10:00 AM to 12:00 PM (CST/CDT)"All Clear" will always be announced in the Datagoggles Slack General channel when systems are back online and

conda

Install conda packages locally

Below is code that can be installed into a code cell of a jupyter notebook to install conda packages.!conda install opencvPlease note that once your container stops and restarts this will reset

R

Install R Packages Locally

To install an R Package, insert the below into a code cell.install.packages("rtweet")Please note that once your container stops and restarts this will reset any change in the environment. Your

jupyterhub

How to reset a Jupyter notebook(to resolve kernel crashes)

A guide to clearing the output of Jupyter notebooks when the results of a code cell makes them unresponsive.

Switching Containers

This is a quick guide for how to switch your current running environment/container.Let's start logged in running the Core container. Click Control PanelClick "Stop My Server"Wait a few seconds for

Leda

Leda is our Legacy Jupyterhub. This machine is meant for accessing notebooks that may not be directly compatible with the Data Science container on Europa. Leda uses a single virtual machine that with

Group Jupyterhub VMs

Access Group WorkspaceLogin C2019GXX.dsa.missouri.edu C2019G01, C2019G02, C2019G03Click Control PanelClick on AdminStart Jovyan serverAccess Jovyan serverThe Jovyan is the group account where your collaboration will happen. Your login account will not

Using Course Containers

What is Docker and how do we use it?Docker is a container platform that allows us to package Jupyter notebooks into deliverable course environments.Install Docker LocallyWindowshttps://docs.docker.com/docker-for-windows/install/

Container Catalog

Below are the base containers and their hierarchy. Since some containers only build on the previous, not all of these are available on Europa. Base - Best for Building a completely customized environment

SSH Landing Zone

DSA supports ssh/sftp for more direct access to your data. How do I connect? Address ssh username@lz.dsa.missouri.edu Windows Users Please refrence RCSS Documentation for MobaXterm Campus/VPN Password

Spawning Notebooks

LoginWhen you first login you will click the "Start My Server" button.Select Container Select the desired container image that is relavent to relavent to the course materal being worked on. For a

R Shiny Web Hosting

R Shiny Web Hosting R Shiny Server Commercial Edition R Version 3.4.1 Hosting is based on files put in the ShinyApps folder in a users home directory. /dsa/home/<Pawprint&

Apache Web Hosting

Apache 2.4 W/ PHP version 7.2 Hosting is based on files put in the public_html folder in a users home directory. This path can be accessed via ssh on lz.

jupyterhub

Europa

Europa is our Primary Jupyterhub. This machine is meant for the bulk of your Data Science & Analytics course work. Europa uses a Kubernetes cluster that allows for flexible resources that coincide with

python

Install Python Packages Locally

Below is code that can be inserted into a cell of a Jupyter notebook to install python packages. #Define PIP Installer import pip def install(package): pip.main(['install','--upgrade', package]) #Notebook Requirements