Pittsburgh Supercomputing Center 

Advancing the state-of-the-art in high-performance computing,
communications and data analytics.

XSEDE HPC Workshop: BIG DATA

September 2, 2014

 

XSEDE along with the Pittsburgh Supercomputing Center are pleased to announce a one day Big Data workshop, to be held September 2, 2014.

This workshop will focus on topics such as Hadoop and SPARQL.

Agenda

 

11am – 1pm
Eastern Time
Welcome

Big Data Programming with Hadoop and Spark

This session will give an overview of programming big data applications focusing on Hadoop and Spark.

I. Hadoop System Overview
This section will cover the basics of the Hadoop Environment. We will discuss the Map Reduce daemons, the scheduling and monitoring environment, and interacting with the distributed file system (HDFS).

II. Hadoop Jobs
We will write a simple Java Map/Reduce program and run through the process of compiling, packaging, submitting, monitoring, and collecting the output of a Hadoop job. We will also briefly discuss other applications that run on the Hadoop platform such as HBase and Hadoop Streaming.

III. Spark
We will discuss the Spark platform and its concept of Resilient Distributed Datasets. We will cover the relationship between Spark and Hadoop, and we will write and submit an example job. We will also discuss the Spark Machine Learning API.

2pm – 5pm
Eastern Time
Urika Training
  • Learn the Graph Analytic approach to Data analysis, including some real-world examples.
  • Gain an introduction to the RDF data format and the SPARQL query lanquage, with hands-on practice.
  • Learn how to interact with the Sherlock Urika system.

Files for the exercises:

 

Wrap-up

 

Logistics

Due to demand, this workshop will be telecast to several satellite sites.

This workshop is NOT available via a webcast.

You may attend at any of the following sites.

  • Pittsburgh Supercomputing Center
  • Florida State University
  • Ohio Supercomputer Center
  • West Virginia University
  • University of Houston, Clear-Lake
  • Georgia State University
  • Harvey Mudd College
  • Purdue University
  • The University of Michigan
  • The University of South Carolina
  • National Center for Atmospheric Research

 

Register at https://portal.xsede.org/course-calendar/-/training-user/class/296

Please address any questions to Tom Maiden at This email address is being protected from spambots. You need JavaScript enabled to view it.


XSEDE, the Extreme Science and Engineering Discovery Environment, is the most advanced, powerful, and robust collection of integrated digital resources and services in the world. It is a single virtual system that scientists and researchers can use to interactively share computing resources, data, and expertise. XSEDE integrates the resources and services, makes them easier to use, and helps more people use them.