Shulou(Shulou.com)06/03 Report--

LZO creation:

Create table lzoer (id int,name string, ip string) ROW FORMAT DELIMITED

FIELDS TERMINATED BY', 'STORED AS INPUTFORMAT' com.hadoop.mapred.DeprecatedLzoTextInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat'

Create an index for the LZO table:

Hadoop jar / usr/hdp/2.2.6.0-2800/hadoop/lib/hadoop-lzo-0.6.0.2.2.6.0-2800.jar com.hadoop.compression.lzo.DistributedLzoIndexer hdfs://hadoop001:8020/apps/hive/warehouse/hly.db/lzo_aa/1.txt.lzo

TXT creation:

CREATE TABLE wubai (id int,name string,ip string) ROW FORMAT DELIMITED FIELDS TERMINATED BY', 'STORED AS TEXTFILE

ES creation:

CREATE EXTERNAL TABLE eswubai (

Id bigint

Name string

Ip string)

STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'

TBLPROPERTIES ('es.resource' =' wubai/wubai','es.nodes'='ip','es.port'='9200','es.nodes.wan.only'='true','es.mapping.names'='id:esid,name:esname,ip:esage')

LOAD data:

Load data local inpath'/ usr/local/999.txt' into table estest.test01_source

LOAD DATA LOCAL INPATH'/ usr/local/500.txt.lzo' OVERWRITE INTO TABLE lzowubai

INSERT INTO data:

Insert overwrite table eswuk select * from wuk

Insert into eser select * from wu

Insert overwrite table web select s.id, s.name, s.ip, s.time from test01_source s

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.