Hadoop/Spark Proxy Setup
PROXY USERNAME: psc
PROXY PASSWORD (to be distributed by administrator)
To access the web interfaces for the Hadoop ecosystem on Bridges you must establish a proxy in your web browser’s settings. This guide describes how to activate the proxy in the Firefox browser. It also describes how to use the optional FoxyProxy add-on to segregate proxy traffic so that normal browsing can also continue in the same browser.
IMPORTANT: Please note that the instructions for the simple proxy are exclusive of the instructions with FoxyProxy. You will do one or the other.
- If you don’t want to access other web pages in your browser while your proxy is active (while you are using the Hadoop ecosystem on Bridges), you can follow the basic instructions.
- If you want to be able to access other web pages in your browser while your proxy is active follow the instructions to install the optional FoxyProxy add-on instead.
Setting the Proxy – Basic Instructions
- In Firefox, Click the menu icon (it looks like 3 horizontal lines) in the upper right corner.
- Click the gear icon.
- Choose Advanced from the menu on the left.
- On the Advanced page select Network at the top.
- Click the Settings button under Connection to open the proxy dialog.
Take note of your original proxy settings as you will need to restore them when you want to resume regular web browsing. Remember that when the proxy is active you will not be able to browse to websites other than the Hadoop web interfaces on Bridges.
- Enter ‘br032.bridges.psc.edu’ into the HTTP Proxy field.
- Enter ‘3128’ into the Port field in that row.
- Check both the “Use this proxy server for all protocols” and Remote DNS checkboxes.
- Click OK.
You can disable and enable the proxy at any time. To disable the proxy simply open this menu and select “No Proxy”, or restore your previous proxy settings to their original state.
Setting the Proxy Using FoxyProxy Standard
You can install the proxy to apply only to the Bridges Hadoop web interfaces, so that you can browse to other websites in the same browser at the same time. To do this, the Firefox browser needs an add-on called FoxyProxy Standard. To set up the proxy using FoxyProxy, follow these steps:
- Click the menu icon (it looks like 3 horizontal lines) in the upper right corner.
- Select Add-Ons (looks like a puzzle piece).
- Select Get Add-ons from the menu on the left.
- Search for FoxyProxy Standard.
Some systems will search all available add-ons by default, but some will not. If FoxyProxy is not found in your search, make sure that Available Add-ons is selected and search again.
- Click the Install button in the FoxyProxy Standard entry.
- When FoxyProxy is installed, restart your browser. There will now be a small fox icon to the right of your address bar.
- Right click the fox icon.
- Select Use proxies based on their pre-defined patterns and priorities if it is not already selected.
- Choose Options.
- Click Add New Proxy on the right.
- Enter ‘br032.bridges.psc.edu’ into the Host or IP Address field.
- Enter ‘3128’ in the Port field.
- Click the URL Patterns tab at the top.
- Click Add New Pattern.
- Enter a name in the Pattern Name field. This is arbitrary, the name “Workshop” is shown in the example.
- Enter ‘*r*.pvt.bridges.psc.edu*’ in the URL pattern field.
- Click OK.
- Right click the fox icon to the right of your address bar.
- Left-click the first option, Use proxies based on their pre-defined patterns and priorities. This will enable the proxy for matching web addresses.