tencent cloud

Elastic MapReduce

  • Release Notes and Announcements
  • Product Introduction
  • Purchase Guide
    • EMR on CVM Billing Instructions
    • EMR on TKE Billing Instructions
    • EMR Serverless HBase Billing Instructions
    • EMR Serverless TCBase Billing Overview
  • Getting Started
  • EMR on CVM Operation Guide
    • Planning Cluster
    • Administrative rights
    • Configuring Cluster
    • Managing Cluster
    • Managing Service
    • Monitoring and Alarms
    • TCInsight
  • EMR on TKE Operation Guide
  • EMR Serverless HBase Operation Guide
  • EMR Serverless TCBase Operation Guide
  • EMR Development Guide
    • Hadoop Development Guide
    • Spark Development Guide
    • Hbase Development Guide
    • Phoenix on Hbase Development Guide
    • Hive Development Guide
    • Presto Development Guide
    • Sqoop Development Guide
    • Hue Development Guide
    • Oozie Development Guide
    • Flume Development Guide
    • Kerberos Development Guide
    • Knox Development Guide
    • Alluxio Development Guide
    • Kylin Development Guide
    • Livy Development Guide
    • Kyuubi Development Guide
    • Zeppelin Development Guide
    • Hudi Development Guide
    • Superset Development Guide
    • Impala Development Guide
    • Druid Development Guide
    • TensorFlow Development Guide
    • Kudu Development Guide
    • Ranger Development Guide
    • Kafka Development Guide
    • StarRocks Development Guide
    • Flink Development Guide
    • JupyterLab Development Guide
    • MLflow Development Guide
  • Practical Tutorial
    • Practice of EMR on CVM Ops
    • Data Migration
    • Practical Tutorial on Custom Scaling
  • API Documentation
    • History
    • Introduction
    • API Category
    • Making API Requests
    • Cluster Resource Management APIs
    • Cluster Services APIs
    • User Management APIs
    • Information Query APIs
    • Scaling APIs
    • Configuration APIs
    • Other APIs
    • Cluster Lifecycle APIs
    • Serverless HBase APIs
    • YARN Resource Scheduling APIs
    • Data Types
    • Error Codes
  • FAQs
    • EMR on CVM
  • Service Level Agreement
  • Contact Us
문서Elastic MapReducePractical TutorialPractice of EMR on CVM OpsMigration of HiveServer2 and MetaStore to Router

Migration of HiveServer2 and MetaStore to Router

Download
포커스 모드
폰트 크기
마지막 업데이트 시간: 2025-01-03 15:05:10

Adding Router Node

Log in to the EMR console, select the corresponding cluster in the cluster list, and click the ID/name to enter the cluster details page. On the cluster details page, select Cluster Resources > Resource Management to enter the resource management page, then click Expand to navigate to the cluster Expand page.

On the cluster expansion page, select the node type for scale-out as Router and the service to services to expand as Hive. You can adjust other options according to your needs.



Migrating HiveServer2 and MetaStore

Go to the EMR console, use the Cluster Services to access the configuration management feature of the Hive service, and modify the following parameters in the hive-site.xml configuration file of the Router node:
Parameter
Value
Description
hive.metastore.uris
thrift://${router-ip}:7004
Modify the Hive Metastore address information, directing the Hive metadata storage service address to the added Router node. ${router-ip} refers to the private IP address of the Router node where the MetaStore is located.
After issuing and saving the configuration, go to Cluster Services and select Operation > Role Management for the Hive component. Pause all Hive processes on the Master node and restart the Hive processes on the Router node.


Test HiveServer2 on the Router node. If you can successfully connect and query the existing tables, the migration is successful.
beeline -u jdbc:hive2://${router-ip}:7001 -n hadoop -p hadoop
show tables

Modifying Knox Proxy Address

After the migration of HiveServer2, you need to log in to the Master node and modify the Knox configuration file to proxy Hive and HiveUI to the Router node’s Hive component.
vim /usr/local/service/knox/conf/topologies/emr.xml //Modify HIVE and HIVEUI.
<service>
<role>HIVE</role>
<url>http://Router-ip:7003</url>
<param>
<name>replayBufferSize</name>
<value>8</value>
</param>
</service>
<service>
<role>HIVEUI</role>
<url>http://Router-ip:7003</url>
</service>
Execute the command line to restart Knox.
/usr/local/service/knox/bin/gateway.sh stop ; /usr/local/service/knox/bin/gateway.sh start


도움말 및 지원

문제 해결에 도움이 되었나요?

피드백