Pentaho MySQL Infobright 数据仓库快速安装札记

Pentaho MySQL Infobright 数据仓库快速安装札记

Pentaho MySQL Infobright 数据仓库快速安装笔记

Infobright是一个与MySQL集成的开源数据仓库(Data Warehouse)软件,可作为MySQL的一个存储引擎来使用,SELECT查询与普通MySQL无区别。

一、Infobright的基本特征:

优点:

查询性能高:百万、千万、亿级记录数条件下,同等的SELECT查询语句,速度比MyISAM、InnoDB等普通的MySQL存储引擎快5~60倍

存储数据量大:TB级数据大小,几十亿条记录

高压缩比:在我们的项目中为18:1,极大地节省了数据存储空间

基于列存储:无需建索引,无需分区

适合复杂的分析性SQL查询:SUM, COUNT, AVG, GROUP BY

限制:

不支持数据更新:社区版Infobright只能使用“LOAD DATA INFILE”的方式导入数据,不支持INSERT、UPDATE、DELETE

不支持高并发:只能支持10多个并发查询

二、Infobright 安装与基本用法:

1、下载安装社区版Infobright二进制Linux版本,端口3307

ulimit -SHn 65535

mkdir -p /data0/mysql/3307

/usr/sbin/groupadd mysql

/usr/sbin/useradd -g mysql mysql

cd /usr/local

①、64位系统:

wget http://www.infobright.org/downlo … 1-x86_64-ice.tar.gz

tar zxvf infobright-3.3.1-x86_64-ice.tar.gz

mv infobright-3.3.1-x86_64 infobright

②、32位系统:

wget http://www.infobright.org/downlo … 3.1-i686-ice.tar.gz

tar zxvf infobright-3.3.1-i686-ice.tar.gz

mv infobright-3.3.1-i686 infobright

cd infobright

./install-infobright.sh –datadir=/data0/mysql/3307/data –cachedir=/data0/mysql/3307/cache –config=/data0/mysql/3307/my.cnf –port=3307 –socket=/tmp/mysql3307.sock –user=mysql –group=mysql

2、开始安装,提示以下信息:

Infobright installation script is running…

Checking system configuration…

Infobright license agreement…

System tool ‘Less’ – a text file viewer will be used to display license agreement.

Please only use up/down arrow keys for scrolling license text and press Q when finished reading.

Press R -Read license agreement, N -Exit the installation [R/N]:

选择R,空格翻页到页尾,看到以下提示时,选择Q继续安装:

                     END OF TERMS AND CONDITIONS

============ Press Q to continue installation ==========

(END)

接下来会显示以下信息,选择Y同意:

Press Y -I agree, Any other key -I do not agree [Y/*]:

这时,会提示是否在线注册,选择N不注册:

Installation has been made for system user root and mysql.

Please see README or User guide for instructions related to start/stop the Infobright server and connect to it.

Register your copy of ICE and receive a free copy of the User Manual (a $50 value) as well as a copy of the Bloor Research Spotlight Report “What’s Cool About Columns” which explains the differences and benefits of a columnar versus row database.

Registration will require opening an HTTP connection to Infobright, do you wish to register now? [Y/N]:

3、修改Infobright内存使用限制

vi /data0/mysql/3307/data/brighthouse.ini

根据自身的物理内存大小修改ServerMainHeapSize、ServerCompressedHeapSize、LoaderMainHeapSize的值,有参考:

############  Critical Memory Settings ############

# System Memory    Server Main Heap Size     Server Compressed Heap Size   Loader Main Heap Size

# 32GB                 24000                      4000                       800

# 16GB                 10000                      1000                       800

#  8GB                  4000                &nb

Pentaho MySQL Infobright 数据仓库快速安装札记

相关文章:

你感兴趣的文章:

标签云: