Hadoop and Spark request

To use Hadoop and Spark on Bridges, please complete this form.   We will contact you within one business day once we receive your request.

Programming: Python, Java and Scala are all available.

Framework: Request Hadoop, Spark, or both. If you will use Spark, you can also use HDFS if you choose.

Nodes: Bridges supports Hadoop and Spark on its RSM (128GB) nodes.  You will have the use of all 28 cores on the nodes you request.  You will also be allocated all the local disk associated with those nodes.

Time: Request the amount of time you need in hours.  Note that 28 SUs will be deducted from your allocation for each hour (1 SU = 1 core-hour).

Specific requests: Be sure to describe any special needs you have, such as a specific Hadoop implementation.  

Questions:  Contact bridges@psc.edu with any questions.

If you need more than 30, choose 30 and explain your need in the specific request field below.
If you need more, choose 168 and explain your need in the specific requests field below.


Powered by ChronoForms - ChronoEngine.com

 

Bridges maintenance announced

  Bridges and all associated VMs and file systems will undergo scheduled maintenance from 8:00AM Eastern Time on Wednesday, October 23, 2019 through 5:00PM Thursday, October 24. 

New on Bridges

Compiler defaults changed

The default versions of some compilers have changed.
Read more

Omni-Path User Group

The Intel Omni-Path Architecture User Group is open to all interested users of Intel's Omni-Path technology.

More information on OPUG