Search This Blog

Step by step guide for execution engines usage in Apache Hive.


In this article, We will learn how to use different execution engines in Apache Hive.

1)  Create a table called employee to run next queries. You can check how to create a table in Hive  here.

2)
 Check available execution engine in hive-site.xml.

grep -C2 -i execution.engine /etc/hive/conf/hive-site.xml

Execution engine defined in hive-site.xml is the default execution engine.The image below shows tez is the execution engine defined in hive-site.xml.





3)
Test the default execution engine.

The image below shows Tez execution engine started by Hive query.





4)
Change execution engine in beeline prompt.

The image below shows mr execution engine set before running query.

set hive.execution.engine=mr;
select count(*) from employee;



5)
Most of the latest Hadoop distributions provide TEZ as their default execution . If you want to chage execution engine  at cluster level, You need to modify hive.execution.engine property value using either Ambari (HDP) or Cloudera Manager (CDH) depending on your hadoop distribution.

6)

We can even check execution engine used by a Hive query from Resource manager user interface.




4 comments:

  1. I see the superlative contents on your blog. as we provide Used Audi Engine at affordable prices. for more info visit our website.

    ReplyDelete
  2. Just read your blog.Good one.very informative article on automotive.automotive weatherstrips

    ReplyDelete
  3. Choosing the car, truck, minivan or SUV perfectly suited to you, your family or group can require some diligence. When searching to find exactly the make, model and condition for your rental car, comparison shopping can save you a bundle. Luxury SUV Rental

    ReplyDelete
  4. Very elegantly composed article. It was a wonderful article to peruse. Complete rich substance and completely enlightening. I completely Adored it. Peruse more data about edge trims

    ReplyDelete