Hadoop and Spark request

To use Hadoop and Spark on Bridges, please complete this form.   We will contact you within one business day once we receive your request.

Programming: Python, Java and Scala are all available.

Framework: Request Hadoop, Spark, or both. If you will use Spark, you can also use HDFS if you choose.

Nodes: Bridges supports Hadoop and Spark on its RSM (128GB) nodes.  You will have the use of all 28 cores on the nodes you request.  You will also be allocated all the local disk associated with those nodes.

Time: Request the amount of time you need in hours.  Note that 28 SUs will be deducted from your allocation for each hour (1 SU = 1 core-hour).

Specific requests: Be sure to describe any special needs you have, such as a specific Hadoop implementation.  

Questions:  Contact bridges@psc.edu with any questions.

If you need more than 30, choose 30 and explain your need in the specific request field below.
If you need more, choose 168 and explain your need in the specific requests field below.


Powered by ChronoForms - ChronoEngine.com

 

System Status

  • Bridges is Up

     

      < span class="small">Bridges is running normally.

New on Bridges

Filesystems upgrades mean changes in usage for pylon5 and pylon2.
Read more

Omni-Path User Group

The Intel Omni-Path Architecture User Group is open to all interested users of Intel's Omni-Path technology.

More information on OPUG