Skip to main content

Posts

Introduction to R

R is a language and environment for statistical computing and graphics. It is a   GNU project   which is similar to the S language and environment which was developed at Bell Laboratories (formerly AT&T, now Lucent Technologies) by John Chambers and colleagues. R can be considered as a different implementation of S. There are some important differences, but much code written for S runs unaltered under R. R provides a wide variety of statistical (linear and nonlinear modelling, classical statistical tests, time-series analysis, classification, clustering, …) and graphical techniques, and is highly extensible. The S language is often the vehicle of choice for research in statistical methodology, and R provides an Open Source route to participation in that activity. One of R’s strengths is the ease with which well-designed publication-quality plots can be produced, including mathematical symbols and formulae where needed. Great care has been taken over...

Mongodb Installation on Ububtu

MongoDB Installation in Ubuntu ===================================================================== Steps to Install Step1:  First we need to download the mongoDB tar ball  from this link Extract the tar ball hduser@ubuntu:~$ tar -xvf mongodb-linux-x86_64-2.6.6.tgz Step2: Create a directory named mongodb hduser@ubuntu:~$ sudo mkdir /usr/lib/mongodb Step3: Move the extracted package to /usr/lib/mongodb/ hduser@ubuntu:~$ sudo mv mongodb-linux-x86_64-2.6.6 /usr/lib/mongodb/ Step4: Create a directory data directory hduser@ubuntu:~$ sudo mkdir -p /data/db Step5: Give proper permissions hduser@ubuntu:~$ sudo chmod 777 /data/* Step6: Go inside hduser@ubuntu:~$ cd /usr/lib/mongodb/mongodb-linux-x86_64-2.6.6/bin$ Step7: Start mongodb server hduser@ubuntu:/usr/lib/mongodb/mongodb-linux-x86_64-2.6.6/bin$ ./mongod     Step8: Start mongodb client from anot...

HBase Installation on Ubuntu 14.04 LTS

                                                       Step 1 - Download hbase using below command or link              hduser@ubuntu:~$wget  http://mirror.reverse.net /pub /apache/ hbase/stable/           hbase-0.94.15.tar.gz                                                                                            or                                                       Download the tarbal from  here ...

Apache Flume installation

Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms. It uses a simple extensible data model that allows for online analytic application. Steps to Install Step1. Download apache flume from the link http://ftp.heanet.ie/mirrors/www.apache.org/dist/flume/1.5.0.1/ Step2. Extract the tar file $sudo tar -xvf apache-flume-1.5.0.1-bin.tar.gz Create a directory named /usr/lib/flume $sudo mkdir -p /usr/lib/flume Provide permissions for access $sudo chown -R 777 /usr/lib/flume Copy the extracted file to /usr/lib/flume $sudo cp /home/hadoop1/apache-flume-1.5.0.1-bin /usr/lib/flume Step2. Set FLUME_HOME, FLUME_CONF_DIR environment variables in .bashrc file as shown below and add the flume bin directory to ...

Apache hive Installation on single node cluster on Hadoop 1.x

Apache Hive is a data warehouse infrastructure built on top of Hadoop for providing data summarization, query, and analysis. While initially developed by Facebook, Apache Hive is now used and developed by other companies such as Netflix Amazon maintains a software fork of Apache Hive that is included in Amazon Elastic MapReduce on Amazon Web Services Steps for installation 1. First you need to download the apache hive you can download the latest mirror of Apache Hive from here http://www.eu.apache.org/dist/hive/hive-1.2.1/apache-hive-1.2.1-bin.tar.gz 2.Untar the package which id downloaded using the following command: sudo tar –xvzf apache-hive-1.2.1-bin.tar.gz 3. Move the extracted package to hive folder sudo mv apache-hive-1.2.1-bin hive 4. Provide the appropriate permission for the hive folder sudo chown –R hduser:hdgroup hive 5. Next move the folder to /usr/local sudo mv hive /usr/local/ 6.Now edit the ~/.bashrc file and add the following contents a...