HPC and Big Data Processing Tutorials

7 minute read

Date & TimeLocationInstructorsTitle and DescriptionMaterial
December 18, 2020
1:00pm - 4:30pm
Virtually via ZoomJordan Hayes, Melody Asghari, Isaac Salinas, Abraham Park & Thomas GirkeIntroduction to HPCC’s Cluster Usage
Topics:
1. HPCC Infrastructure (Slides)
2. Linux Basics for HPC (Slides A, Slides B)
3. Cluster Usage (Slides)
4. Special Topic: R on HPC (Slides)
5. Special Topic: R Use Case from Statistics (Slides)
Registration

Agenda

Video Recordings
April 15, 2020
2:45pm - 5:00pm
Virtually via ZoomAbraham Park, Travis Nasser, Jordan HayesIntro to HPCC

This workshop will cover topics including:
* The cluster scheduler, Slurm
* Cluster policies and best practices
* Basic job submissions to the cluster
* and others ..
Registration

HPCC Intro
Basics:

Slides
Video
April 14, 2020
12:15pm - 2:15pm
Virtually via ZoomTravis Nasser, Abraham Park, Jordan HayesIntro to Linux

This workshop will cover topics including:
* Basic Linux commands
* Linux File systems
* Creating Scripts

Registration

Linux Intro
Basics:

Slides
Video
January 29, 2020
1:00pm - 3:15pm
Genomics Bldg Auditorium 1102AJordan HayesIntro to HPCC

This workshop will cover topics including:
* The cluster scheduler, Slurm
* Cluster policies and best practices
* Basic job submissions to the cluster
* and others ..
HPCC Intro
Basics:

Slides
January 27, 2020
1:30pm - 3:15pm
Genomics Bldg Auditorium 1102AAbraham ParkIntro to Linux

This workshop will cover topics including:
* Basic Linux commands
* Linux File systems
* Creating Scripts

Linux Intro
Basics:

Slides
November 7, 2019
1:00pm - 3:00pm
Genomics Bldg Auditorium 1102AJordan Hayes
&
Abraham Park
Intro to Linux and HPCC

This workshop will cover topics including:
* Connecting to the Cluster
* Basic Linux commands
* File systems
* The cluster scheduler, Slurm
* Cluster policies and best practices
* Basic job submissions to the cluster
* and others ..
Linux Intro
Basics:

Slides

HPCC Intro
Basics:

Slides
June 17, 2019
2:00pm - 5:00pm
Genomics Bldg Auditorium 1102ACharles ForsythLinux Basics and HPCC Cluster Introduction

This workshop will cover topics including:
* Connecting to the Cluster
* Basic Linux commands
* File systems
* The cluster scheduler, Slurm
* Cluster policies and best practices
* Basic job submissions to the cluster
* and others ..
Registration

HPCC Linux/Cluster
Basics:

Slides
Files
April 5, 2019
2:00pm - 5:00pm
Genomics Bldg Auditorium 1102ACharles ForsythLinux Basics and HPCC Cluster Introduction

This workshop will cover topics including:
* Connecting to the Cluster
* Basic Linux commands
* File systems
* The cluster scheduler, Slurm
* Cluster policies and best practices
* Basic job submissions to the cluster
* and others ..
Registration

HPCC Linux/Cluster
Basics:

Slides
Files
February 15, 2019
2:00pm - 5:00pm
Genomics Bldg Auditorium 1102ACharles ForsythHPCC Workshop - Linux Basics and HPCC Cluster Introduction

This workshop will cover topics including:
* Connecting to the Cluster
* Basic Linux commands
* File systems
* The cluster scheduler, Slurm
* Cluster policies and best practices
* Basic job submissions to the cluster
* and others ..
Registration

HPCC Linux/Cluster
Basics:

Slides
Files
December 14, 2018
2:00pm - 5:00pm
Genomics Bldg Auditorium 1102ACharles ForsythHPCC Workshop - Linux Basics and HPCC Cluster Introduction

This workshop will cover topics including:
* Connecting to the Cluster
* Basic Linux commands
* File systems
* The cluster scheduler, Slurm
* Cluster policies and best practices
* Basic job submissions to the cluster
* and others ..
Registration

HPCC Linux/Cluster
Basics:

Slides
Files
November, 2, 2018
9:30pm - 4:30pm
Morning: HUB-355; Afternoon: HUB-268/269Amit Majumadar, Nicole Wolter, Mahidhar Tatineni, Robert Sinkovits, Paul Rodriguez, Mai NguyenSan Diego Supercomputer Center Workshop: Workshop presented by staff from the San Diego Super Computer Center. The morning will provide general information and resources, and the afternoon will split into two parallel tracks (Data Science and Compute Intensive Tasks).Registration
Agenda
Slides & Tutorials
October 26, 2018
9:00pm - 12:00pm
Genomics Bldg Auditorium 1102ACharles Forsyth, Jordan Hayes
&
Thomas Girke
Research Computing in UCR’s HPC Center: This event will provide an overview of the resources provided by UCR’s HPC Center along with a usage tutorial. This includes a seminar-style introduction to the center’s hardware and software resources, including usage statistics, training events, online tutorials and access options via subscription and/or ownership models. The introduction will be followed by a tutorial about the general usage of the infrastructure covering the following topics: (i) user accounts, (ii) big data storage and backups, (iii) software management, installs and containerization; (iv) queuing system; (v) web-based access options; and (vi) external alternatives including AWS and XSEDE. During the tutorial section participants are welcome to follow along on their laptops. Guest accounts will be provided to new users.Registration
Agenda
Intro Slides
Tutorial Slides
October 18, 2018
1:00pm - 3:30pm
Genomics Bldg Auditorium 1102ACharles ForsythHPCC Workshop - Introduction to Python

This workshop will cover topics including:
* What is Python
* Logic Control
* Functions and Classes
* Simple Data/File Operations
* Using Python in HPC Environments
* Installing and Importing Python Modules
* and others ..
Registration

Python
Intro:

Slides
Files
October 4, 2018
1:00pm - 3:30pm
Genomics Bldg Auditorium 1102ACharles ForsythHPCC Workshop - Linux Basics and HPCC Cluster Introduction

This workshop will cover topics including:
* Connecting to the Cluster
* Basic Linux commands
* File systems
* The cluster scheduler, Slurm
* Cluster policies and best practices
* Basic job submissions to the cluster
* and others ..
Registration

HPCC Linux/Cluster
Basics:

Slides
Files
September 6, 2018
2:00pm - 5:00pm
Genomics Bldg Auditorium 1102ACharles Forsyth
&
Jordan Hayes
HPCC Workshop - Basic Linux/Cluster Intro and Software Installation

Part One: Basic Linux and Cluster Introduction

Part Two: Installing software on the HPCC Cluster (Python, R, Perl, Basic Compiled Applications).
Registration

HPCC Linux/Cluster
Basics:

Slides
Files

Software Install:
Slides
Files
August 3, 2018
2:00pm - 5:00pm
Genomics Bldg Auditorium 1102ACharles Forsyth
&
Jordan Hayes
HPCC Cluster (Biocluster) Intro Workshop
Three part basic introdution to Linux and the HPCC Cluster along with a user interaction session.
Registration

Linux Basics:
Slides
Video

HPCC Basics:
Slides
Files
Video
June 15, 2018
1:00pm - 4:00pm
Genomics Bldg Auditorium 1102ACharles Forsyth, Jordan Hayes
&
Thomas Girke
Introduction to HPCC Cluster
I. Linux Basics; II. HPCC Cluster; III. How to work in R on HPC systems?
Linux Basics:
Slides

HPCC Basics:
Slides
Files

R on HPCC:
Slides
May 4, 2018
2:00pm - 5:00pm
Genomics Bldg Auditorium 1102ACharles Forsyth
&
Jordan Hayes
HPCC Cluster (Biocluster) Intro Workshop
Three part basic introdution to Linux and the HPCC Cluster along with a user interaction session.
Registration

Linux Basics:
Slides
Video

HPCC Basics:
Slides
Video
April 27, 2018
2:00pm - 3:30pm
Genomics Bldg Auditorium 1102AThomas GirkeAnnual PI and User Meeting of HPC Center
Overview of services, hardware/software resources, usage stats, training and recharging. Followed by discussion of future directions.
Slides
Agenda
April 5, 2018
1:00pm - 2:30pm
Genomics Bldg Auditorium 1102ACharles ForsythHPCC Cloud Service Presentation
Learn about the HPCC Cloud Service (beta). We will demonstrate how to use HPCC and Amazon Web Service (AWS) to quickly create an on-demand HPC Cluster private to you. We also explain important topics such as billing and cost control, cluster operation, types of clusters (GPU, Highmem, etc.), data management and more.
Registration
Slides
April 6, 2018
2:00pm - 5:00pm
Genomics Bldg Auditorium 1102ACharles Forsyth
&
Jordan Hayes
HPCC Cluster (Biocluster) Intro Workshop
Three part basic introdution to Linux and the HPCC Cluster along with a user interaction session.
Registration
Basic Linux
HPCC Cluster Intro
March 9, 2018
2:00pm - 5:00pm
Genomics Bldg Auditorium 1102ACharles Forsyth
&
Jordan Hayes
HPCC Cluster (Biocluster) Intro Workshop
Three part basic introdution to Linux and the HPCC Cluster along with a user interaction session.
Registration
Basic Linux
HPCC Cluster Intro
February 9, 2018
2:00pm - 5:00pm
Genomics Bldg Auditorium 1102ACharles Forsyth
&
Jordan Hayes
HPCC Cluster (Biocluster) Intro Workshop
Three part basic introdution to Linux and the HPCC Cluster along with a user interaction session.
Registration
Basic Linux
HPCC Cluster Intro
December 14, 2017
10:00am - 12:00pm
Genomics Bldg Auditorium 1102ARandy Ridgley - AWS Solutions ArchitectIntroduction to AWS for Research
Introduction to AWS: Overview of Amazon Web Services (AWS), key concepts and terminology for compute, storage, database and networking. AWS for Researchers: With AWS scientists can deploy and test software, analyze their data, and share their results with collaborators around the world. This section will include a demonstration how to build HPC clusters in AWS using cfnCluster and AWSBatch.
Registration, Slides
November 3, 2017
2:00pm - 5:00pm
Genomics Bldg Auditorium 1102ACharles Forsyth
&
Jordan Hayes
HPCC Cluster (Biocluster) Intro Workshop
Three part basic introdution to Linux and the HPCC Cluster along with a user interaction session.
Registration
Basic Linux
HPCC Cluster Intro
October 11, 2017
2:00pm - 4:00pm
ULB 104Charles ForsythLinux, Scripting and HPCC Cluster Intro Workshop
Introdution to Linux concepts basic bash scripting and HPCC Cluster intro focused on job submission.
Slides
September 1, 2017
2:00pm - 5:00pm
Genomics Bldg Auditorium 1102ACharles Forsyth
&
Jordan Hayes
HPCC Cluster (Biocluster) Intro Workshop
Three part basic introdution to Linux and the HPCC Cluster along with a user interaction session.
Registration
Basic Linux
HPCC Cluster Intro
July 24, 2017
9:00am - 11:00am
Genomics Bldg Auditorium 1102ACharles ForsythHPCC Cluster (Biocluster) Intro Workshop
Basic introdution to the HPCC Cluster and Services.
Registration
Jan 20, 2017
12:00pm - 2:00pm
Genomics Bldg 1208Jordan HayesSlurm and Basic Linux Q&A
Job submissions, account managment and basic Linux scripting.
Examples
Last modified July 9, 2021: Updated some old links (f972a29)