Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

How to run these tutorials

How to run these tutorials

The tutorials are in the form of Jupyter notebooks, a powerful tool for interactive computing. Jupyter notebooks allow you to write and execute code, view the results, and add explanatory text all in one document. They are widely used in data science, research, and education due to their versatility and ease of use.

You will not need to install any software to work with Jupyter notebooks, as there are several free cloud-based services available for creating, editing, running, and exporting notebooks. These services provide a hassle-free environment where you can focus on your analysis without worrying about software installation or compatibility issues.

Free cloud platforms for running notebooks

ECMWF’s Data Store Service JupyterHub

ECMWF’s Data Store Service JupyterHub.

WEKEO

WEKEO is the EU Copernicus Data and Information Access Service (DIAS) for environmental data. It includes a catalogue, a virtual processing environment and offers skilled user support. You will need to login or create a free account to access the JupyterLab environment for running notebooks.

Binder
Binder

  1. Click on the Binder badge

  2. Wait for the Binder environment to load.

  3. Once loaded, navigate to the desired notebook and click on it to open and interact with it.

Kaggle
Kaggle

  1. Click on the Kaggle badge

  2. If you’re not logged in to Kaggle, sign in or create a free account.

  3. After signing in, you’ll be redirected to the Kaggle notebook interface with the option to open the notebook. Click on it to proceed.

Colab
Colab

  1. Click on the Colab badge

  2. If prompted, sign in to your Google account.

  3. Once signed in, the notebook will open in Google Colab. You can then interact with and run the notebook in the Colab environment.

Run the notebooks locally

Key concepts

If you are considering to work with the Jupyter Notebooks on your own desktop or laptop, it is important that you are aware of some key concepts or information that you’ll find in this tutorial or during the preparation and installation process.

Dependencies

Are all of the software components required by your notebook in for it to work as intended and avoid runtime errors. They can be libraries, frameworks, or other programs.

Packages

Are a way to organize and group together related dependencies. They act like toolboxes, storing and organizing tools making easier to install and manage dependencies.

Conflicting dependencies

Are issues that occur when two or more packages that are sharing dependencies in a project require different versions of the same software component. Because only a single version of a dependency is permitted in any project’s environment.

Environments

Are directories that contain a specific collection of packages that you have installed. You may have several environments with different versions for the same dependecy. If you change one environment, your other environments are not affected. There is a base environment located at the root directory that contains the system installation parameters.

Git

Is a distributed version control system that intelligently tracks changes in files. It is particularly useful when you and a group of people are all making changes to the same files at the same time.

GitHub

Is a cloud-based platform where you can store, share, and work together with others to write code.

Repository

Is the most basic element of GitHub. Here you can find and store the code, the files, and each file’s revision history. Repositories can have multiple collaborators and can be either public, internal, or private.

Terminal

Is a text input and ouput environment. It is a program that allows us to enter commands that the computer processess.

Shell

Is a programme that acts like a command-line interpreter. It interprets and processes the commands entered by the user into the terminal, and outputs the results.

Activation

The activation of an environment makes all its contents available to your terminal or shell.

Deactivation

The deactivation of an environment is the opposite operation of activation, removing from your shell what makes the environment content accessible.

Pip

Is the standard tool for installing or uninstalling Python packages and managing their dependencies. For more information visit pip documentation.

Conda

Is an open-source, cross-platform package manager and environment management system which can be used to create Python and R development environments on many different platforms. It is particularly beneficial for data scientists, researchers, and developers working with diverse software requirements across different projects. For more information visit Conda Documentation

Conda channels

Are the locations where packages are stored. They serve as the base for hosting and managing packages. Remote channels like conda-forge offer a wide range of community-maintained packages, expanding the available options for software development and experimentation.

Conda-forge

Is a community channel made up of thousands of contributors, which contains repositories of conda recipes and thus provides conda packages for a wide range of software. The conda-forge channel is free for all to use. For more information visit conda-forge documentation.

Download a submodule repository

If you have experience using git, we recommend working with git on the command line to download and get access to the Jupyter Notebooks. If you have never used git, you can download the submodules via the GitHub website.

Clone with git

You will need to have git installed to follow the steps below.

Here we show how to download the [reanalysis submodule repository](https://github.com/ecmwf-training/c3s-training-submodule-reanalysiry as an example, but you can follow the same steps for any other submodule repository.

  1. Open a terminal

  2. Clone the repository with

    git clone https://github.com/ecmwf-training/c3s-training-submodule-reanalysis.git

    or (alternatively) use ssh if you have access configured for your GitHub account:

    git clone git@github.com:ecmwf-training/c3s-training-submodule-reanalysis.git

  3. Move into the cloned directory

cd ecmwf-training/c3s-training-submodule-reanalysis
Download from GitHub website

  1. Go to the submodules/ folder and pick the submodule repository you want to download, e.g. reanalysis submodule repository.

  2. First click on the <> Code button and then Download ZIP file.

download repo example

  1. Unzip the file using your favourite tools

  2. Open a terminal inside the unzipped folder

Conda installation

If you would like to run the notebooks in your own environment, we suggest you use Conda. Using conda provides a streamlined approach to package management, platform compatibility, environment isolation, and access to an extensive package ecosystem. Conda is available on Windows, macOS, or Linux and can be used with any terminal application (or shell).

We suggest you use the Miniforge installer, that is maintained by the conda-forge community that comes preconfigured for use with the conda-forge channel.

Basic installations instructions are available below. More detailed instructions are available in this github repository.

Unix-like platforms (Mac OS & Linux)

Download the installer from Miniforge and run from the terminal bash Miniforge3-$(uname)-$(uname -m).sh.

Windows

Download and execute the Windows installer from Miniforge.

Setting a virtual environment

In our notebooks we use packages that don’t come as part of the standard dependencies of Python and some of these packages need specific dependency versions that could be in conflict with other applications or projects in our local environment. The solution to this problem is to create an environment where we are able to set up the versions and conditions to the relevant dependencies. You can easily activate or deactivate environments, which is how you switch between them. You can also share your environment with someone by giving them a copy of your environment.yml file.

With conda, you can create, export, list, remove, and update environments that have different versions of Python and/or packages installed in them. Switching or moving between environments is called activating the environment. You can also share an environment file. For more information about that visit Managing environments

In all our github repositories you can find a environment.yml file, containing the conda channels and a list of python dependencies needed for running our notebooks, as presented in the figure below.

environment.yml file example

The list of dependencies are presented with their relevant and required version in a format “dependency_name == version”. You can specify the version of a dependency using ==,>,>=,<, <=, and so on. Omitting the version specifier installs the latest version.

To create an environment with all the dependencies listed in the environment.yml file you will need to use the terminal following the next steps.

  1. Create the environment from the environment.yml file. The first line of the environment.yml file sets the new environment’s name. conda env create -f environment.yml

  2. Activate the environment file. conda activate example-environment

  3. Verify that the environment is installed correctly and check the list of environments available. conda env list

Installing additional dependencies

In addition to the dependencies installed trought the environment.yml file, there are some additional dependencies that may be required for some particular notebooks and that are not avaliable trought the channels defined in the environment.yml file.

Those dependecies are installed in each particular notebook through the conda install command or through the pip install command.

conda install is the conda installer command that allows you to install a list of packages and softwares into a specified conda environment.

pip install is the Python installer command that allows you to install Python packages and that it is presented in some Jupyter Notebooks due to particular dependencies that are not available trough the conda installer.

Visualization of Notebooks

To visualize and execute the notebooks, we recommend using JupyterLab, a versatile web-based interactive development environment. You can interact with our notebooks in this environment locally. JupyterLab is one of the dependencies listed in the environment.yml file presented in the repository and it is installed as soon as you install and activate the environment.

  1. Launch JupyterLab:

    • After installing JupyterLab, open your terminal or command prompt.

    • Type jupyter lab and press Enter to launch JupyterLab. This will start a local server and open JupyterLab in your default web browser.

    Check the JupyterLab documentation!

  2. Access JupyterLab Interface:

    • Once JupyterLab is launched, you will see the JupyterLab interface in your web browser. It consists of a file browser on the left and a main work area on the right.

    Jupyter Lab Interface

  3. Open a Notebook:

    • Navigate to the directory where your notebook is located using the file browser on the left.

    • Click on the notebook file (usually with a .ipynb extension) to open it in JupyterLab.

    • The notebook will open in a new tab within the main work area of JupyterLab.4

  4. Interact with the Notebook:

    • You can now interact with the notebook by running code cells, editing text, and executing various commands.

    • To run a code cell, select it and either click the “Run” button in the toolbar or press Shift + Enter.

    • Explore the different features of JupyterLab to customize your workflow and make the most out of your notebook experience.

Copernicus Climate Change Service (C3S) Training Book
Copernicus Climate Change Service (C3S) Training Book
Reanalysis
Climatology