source: proiecte/HadoopJUnit/hadoop-0.20.1/contrib/hdfsproxy/README @ 155

Last change on this file since 155 was 120, checked in by (none), 14 years ago

Added the mail files for the Hadoop JUNit Project

  • Property svn:executable set to *
File size: 1.9 KB
Line 
1HDFSPROXY is an HTTPS proxy server that exposes the same HSFTP interface as a
2real cluster. It authenticates users via user certificates and enforce access
3control based on configuration files.
4
5Starting up an HDFSPROXY server is similar to starting up an HDFS cluster.
6Simply run "hdfsproxy" shell command. The main configuration file is
7hdfsproxy-default.xml, which should be on the classpath. hdfsproxy-env.sh
8can be used to set up environmental variables. In particular, JAVA_HOME should
9be set. Additional configuration files include user-certs.xml,
10user-permissions.xml and ssl-server.xml, which are used to specify allowed user
11certs, allowed directories/files, and ssl keystore information for the proxy,
12respectively. The location of these files can be specified in
13hdfsproxy-default.xml. Environmental variable HDFSPROXY_CONF_DIR can be used to
14point to the directory where these configuration files are located. The
15configuration files of the proxied HDFS cluster should also be available on the
16classpath (hdfs-default.xml and hdfs-site.xml).
17
18Mirroring those used in HDFS, a few shell scripts are provided to start and
19stop a group of proxy servers. The hosts to run hdfsproxy on are specified in
20hdfsproxy-hosts file, one host per line. All hdfsproxy servers are stateless
21and run independently from each other. Simple load balancing can be set up by
22mapping all hdfsproxy server IP addresses to a single hostname. Users should
23use that hostname to access the proxy. If an IP address look up for that
24hostname returns more than one IP addresses, an HFTP/HSFTP client will randomly
25pick one to use.
26
27Command "hdfsproxy -reloadPermFiles" can be used to trigger reloading of
28user-certs.xml and user-permissions.xml files on all proxy servers listed in
29the hdfsproxy-hosts file. Similarly, "hdfsproxy -clearUgiCache" command can be
30used to clear the UGI caches on all proxy servers.
Note: See TracBrowser for help on using the repository browser.