Hive Installation Demo On Ubuntu | Hive Installation On Hadoop | Hive Installation on Ubuntu 20.04

ashutosh@ashutosh:~/apache-hive-3.1.2-bin/bin$ schematool -initSchema -dbType derby
Cannot find hadoop installation: $HADOOP_HOME or $HADOOP_PREFIX must be set or hadoop must be in the path
Sir please help asap.
It is showing this error after schematool command

Thank you for the tutorial and for the resources.
do you have any tutorial for installing Hadoop as a cluster?

what is prerequisite to use any RDBMS in hive? do we have to install in our machine first ?

Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
org.apache.hadoop.hive.metastore.HiveMetaException: Failed to get schema version.
Underlying cause: java.sql.SQLException : Failed to start database 'metastore_db' with class loader sun.misc.Launcher$AppClassLoader@ea4a92b, see the next exception for details.
SQL Error code: 40000
Use --verbose for detailed stacktrace.
* schemaTool failed *
facing this error

Follwed the same procedure but while starting hive I am getting the following error: Hive Session ID = 354ea424-88e5-46b6-bc75-7381026b1e8f
Exception in thread "main" java.lang.ClassCastException: class jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to class java.net.URLClassLoader (jdk.internal.loader.ClassLoaders$AppClassLoader and java.net.URLClassLoader are in module java.base of loader 'bootstrap')
at org.apache.hadoop.hive.ql.session.SessionState.<init>(SessionState.java:413)
at org.apache.hadoop.hive.ql.session.SessionState.<init>(SessionState.java:389)
at org.apache.hadoop.hive.cli.CliSessionState.<init>(CliSessionState.java:60)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:705)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
Kindly help me to resolve this issue

Hii can't we use Hive without hadoop

Sir I can not access the hdoop folder which is located in home.

Cannot find hadoop installation: $HADOOP_HOME or $HADOOP_PREFIX must be set or hadoop must be in the path

how much ram and memory have you allocated for the virtual box , please tell , its urgent
when i am running hive queries, my map reducer is getting out of memory

Thanks a lot!

Missing Hive execution Jar

thank you sir

sir please make video on hbase installation

Hi sir, in real time.
Is it recommended to use derby database? Is it safe?
I saw people use MySQL to store metadata coz it's safe and fast.
Plz let me know is it safe to use derby to store huge metadata?


Thanks 😊

Here are the errors that I received: (in hdoop user)
1) Command - rm $HIVE_HOME/lib/guava-19.0.jar
error - rm: cannot remove '/lib/guava-19.0.jar': No such file or directory

2) Command - cp $HADOOP_HOME/share/hadoop/hdfs/lib/guava-27.0-jre.jar $HIVE_HOME/lib/
error - cp: cannot create regular file '/lib/guava-27.0-jre.jar': Permission denied

3) Command - schematool -initSchema -dbType derby
error - schematool: command not found

And when I run hive it says:
hive
Command 'hive' not found

Kindly help

Thank you again ! Just one correction to document .
export HADOOP_HOME=/home/hdoop/hadoop-3.2.1 ; this needs to be updated with 3.2.3 in the document .
Otherwise- we will get the error as "Cannot find hadoop installation: $HADOOP_HOME or $HADOOP_PREFIX must be set or hadoop must be in the path".

GREAT THANKS for this helpful tutorial !

rm: cannot remove '/lib/guava-19.0.jar': No such file or directory
how to solve it?

schematool: command not found ¸??

I am getting a Java error while running hive shell

Exception in thread "main" java.lang.RuntimeException: The dir: /tmp/hive on HDFS should be writable. Current permissions are: rwxr-xr-x

and when i check there is not folder as hive in tmp
but my hive installation was successful

Thanks, please help me to understand, hive can be connected with a remote Hadoop? I mean a Hadoop which is not in the same hive machine?

Error is coming schema tool is not found while running this command : schematool -initSchema -dbType derby

Hey Aman, I'm getting this error, can you plz help.


hdoop@dipak:~/apache-hive-3.1.2-bin/bin$ schematool -initSchema -dbType derby
Cannot find hadoop installation: $HADOOP_HOME or $HADOOP_PREFIX must be set or hadoop must be in the path

such a nice tutorial video... thanks bro

hadoop path should also given or simply hive path is enough?

sir i do installation of hadoop by using ur lecture it succesfully running but now iam trying to install hbase but its is giving same errors which we faced in this video so,pls make a video on hbase installation also on standalone mode

Just too good!

hi, i followed every single step but when i tried to launch it threw an error : log4j:ERROR Could not instantiate class [org.apache.hadoop.hive.shims.HiveEventCounter].
Can you pls help.. Thanks

While making dir user/hive/warehouse ...it is showing mkdir: Call from ........ to localhost:9000 failed on connection

How do I solve this issue?
Exception in thread "main" java.lang.ClassCastException: class jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to class java.net.URLClassLoader

Thank you Sir for this tutorial

I was facing the issue with the installation thanks

Great

Thank you sir

Nice!! Thanks for pointing out the multiple bindings!

Thank you bro ! I was also getting guava error. Now resolved. Great video

sir , if i don't have guava-27.0-jre.jar in hdfs lib what i have to do ?

Throwing me this error plz help me out !!
Cannot find hadoop installation: $HADOOP_HOME or $HADOOP_PREFIX must be set or hadoop must be in the path

Hello man how are you, I installed both hadoop 3.2.2 and hive 3.1.2, at the end of hive installation ($HIVE_HOME/bin/schematool –initSchema –dbType derby), I will faced with this error (HiveSchemaTool:Parsing failed.), how can i solve it??? thanks for your cooperation.

Hello Aman, thanks for this installation video! hey can you please tell me that I am not able to delete guava-19.0.jar file as it is write protected file. How could I do?

While running hive query "Exception in thread "main" java.lang.RuntimeException: java.net.ConnectException:" I got this error,Any solution for this?

Can you done some videos on streaming technologies - Kafka, Storm etc

Thanks! Magnificent tutorial, very well explained and done! Congratulations

bhai hbase v install karwa do

It works.

getting an error schematool: command not found