Hadoop and Spark request

To use Hadoop and Spark on Bridges, please complete this form.   We will contact you within one business day once we receive your request.

Programming: Python, Java and Scala are all available.

Framework: Request Hadoop, Spark, or both. If you will use Spark, you can also use HDFS if you choose.

Nodes: Bridges supports Hadoop and Spark on its RSM (128GB) nodes.  You will have the use of all 28 cores on the nodes you request.  You will also be allocated all the local disk associated with those nodes.

Time: Request the amount of time you need in hours.  Note that 28 SUs will be deducted from your allocation for each hour (1 SU = 1 core-hour).

Specific requests: Be sure to describe any special needs you have, such as a specific Hadoop implementation.  

Questions:  Contact bridges@psc.edu with any questions.

If you need more than 30, choose 30 and explain your need in the specific request field below.
If you need more, choose 168 and explain your need in the specific requests field below.


Powered by ChronoForms - ChronoEngine.com

 

Bridges and Bridges-AI Helping COVID-19 Research

Bridges and Bridges-AI offer exceptional capabilities for critical areas of research. Specific, unique strengths include AI, genomics, and collaborative workflows.

Read more about Bridges' capabilities for COVID-19 research.

New on Bridges

Increased time limit on RM and RM-shared

The maximum time limit has been increased to 72 hours on these partitions.
Read more

Omni-Path User Group

The Intel Omni-Path Architecture User Group is open to all interested users of Intel's Omni-Path technology.

More information on OPUG