class: center, middle # CMIP6 Data Hackathon ## Participant briefing  20th May 2021 --- # Agenda 1. Welcome! * Overview of the event * Introduction to the team 2. Event structure * Projects * Agenda * Communication platforms * Storing code, data and outputs * Using JASMIN * Other resources 3. Support during the event Full details in the online [participant guide](https://cmip6moap.github.io/resources/participant-guide) --- class: middle ### Welcome and thank you for participating! # Overview of the event --- class: middle # Introduction to the team Find out more about the team [on our website](https://cmip6moap.github.io/about/) --- # Projects
([see website](https://cmip6moap.github.io/projects/) for abstracts)
* Everyone has one of their first choice projects .small[ | Title | Participants | | --- | --- | | What is the transient sea level sensitivity in CMIP6 models? | 8 | | How well do the CMIP6 models represent the tropical rainfall belt over Africa? | 12 | | Characterising the marine carbon cycle in CMIP6 | 12 | | Testing proxies of AMOC variability in CMIP6 | 7 | | The atmospheric response to sea-ice loss in the PAMIP experiments and its sensitivity to model biases | 7 | | Differences between 'turning down the sun' and stratospheric sulfate injection | 6 | | Uncertainty in sea-ice-cloud feedbacks across the CMIP6 ensemble | 6 | | Interactive graphics of key CMIP6-based IPCC figures | 6 | | Impacts of changing wind regimes and sea ice on the world's longest migrant | 7 | | Human heat stress in a warming world | 12 | | Rainfall extremes and groundwater recharge in the tropics | 7 | ] * Each project has one or more **project lead** * We recommend that during your first breakout group session, you **nominate a group chair** for your project – they **need not be the project lead** * Keeping group to time, getting group ready to present, collating outputs, etc. ??? Group chair should be responsible for ensuring that the group works to the suggested agenda, the group is ready to present their work during their presentation slot, and that the code/outputs are well organised. This is an excellent way of getting some team management experience and so we emphasise that this person **need not be the project lead listed on the abstract**. --- # Agenda * 9:00am introductory talks * 2 hours of breakout groups * Yoga session before lunch each day * Breakout groups in the afternoon, with an additional talk on the second day * Short presentations from selected groups to round off each day Full agenda on next slides and [on our website](https://cmip6moap.github.io/agenda/) --- # Day 1 Agenda .agenda[ | Time | Activity | Where to go | | ------------- | ------------------------------------------------------------------------------------ | -------------- | | 09:30 – 10:00 | **Hackathon welcome**
Dann Mitchell (Bristol MOAP Chair) | Main room | | 10:00 – 11:55 | **Breakout groups**
Project team introductions and role/task allocation | Breakout rooms | | 12:00 – 12:30 | **Yoga with Cara**
Take some time away from your keyboard | Main room | | 12:30 – 13:30 | Lunch break | | | 13:30 – 17:00 | **Breakout groups** | Breakout rooms | | 17:00 – 17:25 | **Group presentations**
What you hope to achieve during the hackathon | Main room | | 17:25 – 17:30 | **Close of day** | Main room | ] --- # Day 2 Agenda .agenda[ | Time | Activity | Where to go | | ------------- | ------------------------------------------------------------------------------------ | -------------- | | 09:30 – 10:00 | **Welcome talk**
Kate Robson-Brown (Jean Golding Institute Director) | Main room | | 10:00 – 11:55 | **Breakout groups** | Breakout rooms | | 12:00 – 12:30 | **Yoga with Cara** | Main room | | 12:30 – 13:30 | Lunch break | | | 13:30 – 14:00 | **Top tips from a Data Specialist**
James Thomas (Jean Golding Institute) | Main room | | 14:00 – 17:00 | **Breakout groups** | Breakout rooms | | 17:00 – 17:25 | **Groups presentations**
What you hope to achieve during the hackathon | Main room | | 17:25 – 17:30 | **Close of day** | Main room | ] --- # Day 3 Agenda .agenda[ | Time | Activity | Where to go | | ------------- | ------------------------------------------------------------------------------------ | -------------- | | 09:30 – 10:00 | **Working toward COP26**
Jason Lowe (Head of Climate Services at the Met Office) | Main room | | 10:00 – 11:55 | **Breakout groups** | Breakout rooms | | 12:00 – 12:30 | **Yoga with Cara** | Main room | | 12:30 – 13:30 | Lunch break | | | 13:30 – 16:30 | **Breakout groups**
Final steps and ensure code/data/outputs are saved | Breakout rooms | | 16:30 – 16:55 | **Groups presentations**
What you have achieved during the hackathon | Main room | | 16:55 – 17:15 | **Close of the Hackathon and next steps** | Main room | ] --- # Communication platforms .float-right[  ] * **Zoom** for talks and breakout groups 09:15 – 17:30 * **Slack** for text-based chat **\#announcements** **\#help** – for help and support **\#intros** – please introduce yourself! **\#project01** **\#project02** **\#project03** etc. * **Word Online** shared documents ??? We will use one Zoom call for the duration of the event, and you will be able to move between rooms as you need. We have a Slack channel for each project group, plus another channel for support from our team of data scientists. --- # Storing code, data and outputs * **GitHub repository** https://github.com/cmip6moap/project-01 * Directory in the hackathon's **Group Workspace** `/gws/pw/j05/cop26_hackathons/bristol/project01` ### By the end of the hackathon 1. **README** in GitHub repository file 2. Identify **key figures** that could be showcased at COP26 3. **Code**, **notebooks** & other outputs (**figures**, **graphs**, etc.) committed to GitHub 4. **Data** outputs in Group Workspace ??? Note that when using the JASMIN Notebook Service, you only have read-only access to Group Workspaces, however when logged in via SSH you will have full read/write access. GitHub README to identify what work you did, how far you got and what the next steps required are. Data outputs can go on GitHub if small enough. Potentially every member of your team will make contributions to the GitHub repository, or perhaps you will allocate a member of your team who will be responsible for committing everyone's work (see also: group chair). --- # Using JASMIN * Own account or temporary account * **Drop-in sessions** in case of issues Follow [our online guide](https://cmip6moap.github.io/resources/creating-jasmin-account) to ensure you have correct permissions and can log in ### We anticipate * **Notebook Service** for most tasks – e.g. data visualisation and writing a narrative to accompany any analysis But also: * **Scientific analysis servers** to run scripts from the command line (using SSH) or push/pull changes to/from GitHub * **LOTUS job system** to execute batch jobs for long-running jobs processing large amounts of data (this may have been done in advance of the hackathon) ??? Expect all project leads to have own account. If you don't already have an account then we will allocate you a temporary account that you can use for the duration of the hackathon. Bear in mind that all data in temporary accounts will be removed at the end of the hackathon, so you must have saved your data elsewhere. For those of you unfamiliar with Notebooks, we suggest you take a look at some example notebooks linked to on our website. In essence, Notebooks are an interactive computing environment allowing you to combine narrative text (written in Markdown) with code and the output of that code. This means they can be made into a complete and self-contained record of a computation. They are **well-suited to data visualisation and teaching**. Some good examples linked to on website. Note that while all the Scientific analysis servers will allow you to communicate with GitHub using HTTPS, if you wish to use SSH then you will need to use `sci1`, `sci2`, `sci4` or `sci5`. We have 3 TB of GWS space available for *all* hackathons. --- ## JASMIN Notebook Service
--- # Other resources * Setting up a python environment on JASMIN * How to find and use CMIP6 data in the CEDA Archive * Loading CMIP6 data from the CEDA Archive using xarray * Guide to collaborating with Git and GitHub --- # Support during the event .split-lists[ .list-left[ **Climate researchers** from universities of Bristol & Exeter * Methodology questions * What data is available * Bias correction * Accessing unusual data ] .list-right[ **Data Scientists** from the University of Bristol's Jean Golding Institute * Organisation questions * Using JASMIN * Using Jupyter Notebooks * Python technical queries, e.g. `pandas`, `matplotlib`, `xarray` * Best practices for reproducibility * Best practices for visualisation ] ] ### Contact via * **#help channel** on Slack * Email to cmip6moap-hackathonevent2021@bristol.ac.uk ??? Not all leads are experts in CMIP6 or programming – we have a mix. Also have a dedicated help breakout room on Zoom you to in case we need to talk about your question or share screens.