# Amazon EMR

IntelliJ IDEA lets you monitor clusters and nodes in the [Amazon EMR](https://aws.amazon.com/emr/) data processing platform.

> **Note:**
> This functionality relies on the [Metastore Core](https://plugins.jetbrains.com/plugin/21712-metastore-core/reviews) plugin, which is installed automatically if you install the [Spark](big-data-tools-spark.html) or the [Flink](big-data-tools-flink.html) plugin.

Procedure: Connect to an AWS EMR server

1. In the Big Data Tools window, click ![Add a connection](https://resources.jetbrains.com.cn/help/img/idea/2026.2/app-client.expui.general.add.svg) and select AWS EMR.

2. In the Big Data Tools dialog that opens, specify the connection parameters:

![Configure AWS EMR connection](https://resources.jetbrains.com.cn/help/img/idea/2026.2/bdt-aws-emr-connections.png)

* Name: the name of the connection to distinguish it between the other connections.

* Region: select a region to get clusters from.

* Authentication type lets you select the authentication method: * Default credential providers chain: use the credentials from the default provider chain. For more information about the chain, refer to [Using the Default Credential Provider Chain](https://docs.aws.amazon.com/sdk-for-java/v1/developer-guide/credentials.html). * Profile from credentials file: select a profile from your `credentials` file. * Explicit access key and secret key: enter your credentials manually. > **Note:** > If you authenticate using a profile from config or credentials file, IntelliJ IDEA enables you to share your MFA or OAuth 2.0 data across all AWS connections. This means that if you select the same profile in AWS S3, AWS EMR, and AWS Glue, you don't have to perform MFA or OAuth 2.0 authentication again.

With the Default credential providers chain or Profile from credentials file option selected, you can click Open Credentials to locate the directory where the credential file is stored. If you use the default location, it's usually `~/.aws/credentials` on Linux or macOS, or `C:\Users\<USERNAME>\.aws\credentials` on Windows. Or it can be your custom location if you have selected Use custom configs.

Optionally, you can set up:

* Per project: select to enable these connection settings only for the current project. Clear the checkbox if you want this connection to be visible in other projects.

* Enable connection: clear the checkbox if you want to disable this connection. By default, the newly created connections are enabled.

* HTTP Proxy: select if you want to use [IDE proxy settings](settings-http-proxy.html) or specify custom proxy settings.

* Click the Open SSH Key Settings link to create an SSH connection authenticated with a private key file. You need to specify the [Amazon EC2 key pair private key](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-connect-master-node-ssh.html) in the EMR SSH Keystore dialog.

3. Once you fill in the settings, click Test connection to ensure that all configuration parameters are correct. Then click OK.

At any time, you can open the connection settings in one of the following ways:

* Go to the Tools | Big Data Tools Settings settings page `Ctrl+Alt+S` (Windows), `⌘ Comma` (macOS), `⌘ Comma` (IntelliJ IDEA Classic (macOS)), `⌘ Comma` (macOS System Shortcuts), `Ctrl+Alt+S` (XWin), `Ctrl+Alt+S` (GNOME), `Ctrl+Alt+S` (KDE), `Ctrl+Alt+S` (Emacs), `Ctrl+Alt+S` (Sublime Text), `⌘ Comma` (Sublime Text (macOS)), `Ctrl+Alt+S` (NetBeans), `Ctrl+Alt+S` (Visual Studio), `⌘ Comma` (Visual Studio (macOS)), `Ctrl+Alt+S` (Eclipse), `⌘ Comma` (Eclipse (macOS)) .

* Click ![settings](https://resources.jetbrains.com.cn/help/img/idea/2026.2/app.expui.general.settings.svg) on the AWS EMR tool window toolbar.

Once you have established a connection to the server, the AWS EMR tool window appears. You can filter clusters there by typing their name and by selecting their status or the time when they were terminated.

![Filter clusters](https://resources.jetbrains.com.cn/help/img/idea/2026.2/bdt_emr_filter_by_terminated_time.png)

When you select a cluster in the AWS EMR tool window, you can use the following tabs to monitor clusters:

Info:

![Cluster info](https://resources.jetbrains.com.cn/help/img/idea/2026.2/bdt_aws_emr_info.png)

This tab shows details about the selected cluster. You can filter clusters by their names and ID by typing it in the Filter field.

Procedure: Obtain more info

* You can preview the cluster details in the web interface. Click ![Browse the cluster details](https://resources.jetbrains.com.cn/help/img/idea/2026.2/app-client.expui.toolwindow.web.svg) or Open Subnet, Master Security Group, or Core and Tasks Security Group.

* Click ![Open an SFTP connection](https://resources.jetbrains.com.cn/help/img/idea/2026.2/bigdatatools-plugin-rfs.icons.sftp.svg) to establish an SFTP connection to the target server, then specify the path to the config file in your file system.

* You can preview EMR logs for the selected cluster. Click ![Open EMR logs](https://resources.jetbrains.com.cn/help/img/idea/2026.2/bigdatatools-plugin-rfs.icons.storageIcons.amazonS3.svg) to open the logs in the Big Data Tools tool window, in the dedicated [Remote File Systems viewer](big-data-tools-data-files.html).

* For JSON representation of the selected cluster configuration, click ![View JSON representation](https://resources.jetbrains.com.cn/help/img/idea/2026.2/app.expui.fileTypes.json.svg) (Show as JSON).

Steps:

![Cluster steps](https://resources.jetbrains.com.cn/help/img/idea/2026.2/bdt_aws_emr_steps.png)

This tab shows application steps, their IDs, and execution status. You can filter steps by their names and ID by typing it in the Filter field.

Select a step to preview its details on the right side of the tool window, including the main class name, arguments, and link to the log folder.

Procedure: Manage steps

* Click ![Browse the step details](https://resources.jetbrains.com.cn/help/img/idea/2026.2/app-client.expui.toolwindow.web.svg) to preview the application step in the web interface.

* You can add more steps of different types. Click ![More steps](https://resources.jetbrains.com.cn/help/img/idea/2026.2/app.expui.general.add.svg) and select a step type to add. Then, specify its parameters.

![Add an application to Steps](https://resources.jetbrains.com.cn/help/img/idea/2026.2/bdt_emr_add_application.png)

* Click ![Clone a step](https://resources.jetbrains.com.cn/help/img/idea/2026.2/app.expui.general.copy.svg) to duplicate the selected step.

* For JSON representation of the selected step, click ![View JSON representation](https://resources.jetbrains.com.cn/help/img/idea/2026.2/app.expui.fileTypes.json.svg).

Instances:

![Cluster instances](https://resources.jetbrains.com.cn/help/img/idea/2026.2/bdt_aws_emr_instances.png)

This tab shows details about instances of the selected cluster. You can start typing any instance name in the Search field and it will be selected.

Procedure: View instances

* You can preview the instance details in the web interface by clicking ![Browse the cluster details](https://resources.jetbrains.com.cn/help/img/idea/2026.2/app-client.expui.toolwindow.web.svg). You can also click ![Manage                   visibility of instance parameters](https://resources.jetbrains.com.cn/help/img/idea/2026.2/bigdatatools-core.icons.table.configureColumns.svg) to show or hide a particular parameter of instances.

* Click ![Open an SFTP connection](https://resources.jetbrains.com.cn/help/img/idea/2026.2/bigdatatools-plugin-rfs.icons.sftp.svg) to establish an SFTP connection to the target server, then specify the path to the config file in your file system.

* For JSON representation of the selected cluster configuration, click ![View JSON representation](https://resources.jetbrains.com.cn/help/img/idea/2026.2/app.expui.fileTypes.json.svg).

Applications:

![Cluster applications](https://resources.jetbrains.com.cn/help/img/idea/2026.2/bdt_aws_emr_applications.png)

This tab shows applications running on the selected cluster. Click ![Browse the application details](https://resources.jetbrains.com.cn/help/img/idea/2026.2/app-client.expui.toolwindow.web.svg) to preview the cluster details in your default web browser.

Procedure: Open Amazon EMR applications

IntelliJ IDEA lets you open applications installed on your Amazon EMR cluster. You can open it in your default browser right from the AWS EMR tool window. Additionally, if a tool is supported by one of the [Big Data Tools
plugins](big-data-tools-support.html) (such as Hadoop, HDFS, Hive, Spark, or Zeppelin), you can create a connection to it in IntelliJ IDEA. In this case, a dedicated tool window will be opened in your IDE. For example, if you connect to a Zeppelin server, you can open and edit a Zeppelin note in the IntelliJ IDEA editor. Connections to applications are based on SSH tunneling, so you'll have to provide [SSH keys configured in the cluster](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-connect-master-node-ssh.html).

1. In the AWS EMR tool window, select your Amazon EMR cluster.

2. Open the Applications tab and, in the Name column, click the link to an application.

3. For applications that are supported by [Big Data Tools
plugins](big-data-tools-support.html), select where to open it:

* Open in Browser to open it in your default browser.

* Create Connection to create a connection to the application within your IDE. A new connection will be displayed in the Big Data Tools tool window.

4. If this is the first time you try to connect to an application, you will be prompted to create a connection. Click Create and in the dialog that opens select your SSH key file, for example `mykey.pem`.

Once your SSH keys are loaded, you can connect to applications of this cluster just by clicking its name in the Applications tab.

5. In the Create Connection window that opens, select one of the following:

* Use Defaults if you want to initiate a connection right away using the default settings.

* Customize if you want to change some settings before connecting, for example, provide your Zeppelin user name and password.

