Skip to content

Make namenode rpc and resourcemanager webapp port numbers configurable.#17

Merged
danielcweeks merged 2 commits into
Netflix:masterfrom
Connexity:port_config
Jan 18, 2017
Merged

Make namenode rpc and resourcemanager webapp port numbers configurable.#17
danielcweeks merged 2 commits into
Netflix:masterfrom
Connexity:port_config

Conversation

@jackgene

Copy link
Copy Markdown
Contributor

The namenode RPC port (dfs.namenode.rpc-address....) is currently hardcoded to 9000, and the resourcemanager webapp port (yarn.resourcemanager.webapp.address...) hardcoded to 9032, which isn't typical, and requires users to update the port numbers in the Python scripts.

This update allows the ports to be defined in settings.py.

@jackgene

Copy link
Copy Markdown
Contributor Author

As suggested here:
#3 (comment)

@vaxvms

vaxvms commented Jan 17, 2017

Copy link
Copy Markdown
Contributor

+1 There is several patches flying around about this functionality, it would be nice to get it in the base repo.

For instance, there is also #13 which as more feature (you can configure elasticsearch, namenode and resourcemanager hosts)

@danielcweeks

Copy link
Copy Markdown

Yes, this looks good.

The old ports were an artifact of EMR's port configurations, but even they have moved away from those and gone with the apache defaults.

Do you just want to change the defaults in the settings.py to be the apache defaults?

@jackgene

Copy link
Copy Markdown
Contributor Author

Done. namenode rpc port set to 8020, resourcemanager webapp port set to 8088 by default.

@danielcweeks danielcweeks merged commit a21928e into Netflix:master Jan 18, 2017
@danielcweeks

Copy link
Copy Markdown

Thanks @jackgene !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants