建站
咨詢
售后
建站咨詢
新聞中心
這篇文章將為大家詳細講解有關Hive中matadata怎么用，小編覺得挺實用的，因此分享給大家做個參考，希望大家閱讀完這篇文章后可以有所收獲。
創(chuàng)新互聯(lián)專注于績溪企業(yè)網(wǎng)站建設,成都響應式網(wǎng)站建設公司,商城系統(tǒng)網(wǎng)站開發(fā)。績溪網(wǎng)站建設公司,為績溪等地區(qū)提供建站服務。全流程定制制作，專業(yè)設計，全程項目跟蹤，創(chuàng)新互聯(lián)專業(yè)和態(tài)度為您提供的服務
Hive元數(shù)據(jù)存儲在MySQL庫里，數(shù)據(jù)存儲HDFS上;查看元數(shù)據(jù)庫存放地址,查看Hive配置文件路徑查看：
$HIVE_HOME/conf/hive-site.xml
javax.jdo.option.ConnectionURL jdbc:mysql://localhost:3306/hive_data?createDatabaseIfNotExist=true&characterEncoding=latin1
查看MySQL元數(shù)據(jù)：
mysql> use hive_data
Database changed
mysql> show tables;
+---------------------------+ | Tables_in_hive_data | +---------------------------+ | bucketing_cols | | cds | | columns_v2 | | database_params | | db_privs | | dbs | | func_ru | | funcs | | global_privs | | idxs | | index_params | | part_col_privs | | part_col_stats | | part_privs | | partition_key_vals | | partition_keys | | partition_params | | partitions | | roles | | sd_params | | sds | | sequence_table | | serde_params | | serdes | | skewed_col_names | | skewed_col_value_loc_map | | skewed_string_list | | skewed_string_list_values | | skewed_values | | sort_cols | | tab_col_stats | | table_params | | tbl_col_privs | | tbl_privs | | tbls | | version | +---------------------------+
----------------------------------------------------------------
1. Hive版本version表有且只有一條數(shù)據(jù)，多一條數(shù)據(jù)Hive會無法啟動
mysql> select * from version; +--------+----------------+---------------------------------------+ | VER_ID | SCHEMA_VERSION | VERSION_COMMENT | +--------+----------------+---------------------------------------+ | 1 | 1.1.0 | Set by MetaStore hadoop@192.168.0.129 | +--------+----------------+---------------------------------------+
2.Hive數(shù)據(jù)庫元數(shù)據(jù)表【dbs】【database_params】
mysql> select DB_ID,DB_LOCATION_URI,NAME from dbs
+-------+----------------------------------------------------------------+---------------+ | db_id | DB_LOCATION_URI | NAME | +-------+----------------------------------------------------------------+---------------+ | 1 | hdfs://192.168.0.129:9000/user/hive/warehouse | default | | 3 | hdfs://192.168.0.129:9000/user/hive/warehouse/hive_data2.db | hive_data2 | | 6 | hdfs://192.168.0.129:9000/user/hive/warehouse/ruozedata_job.db | ruozedata_job | +-------+----------------------------------------------------------------+---------------+
DB_ID -- 數(shù)據(jù)庫ID 【tbls】
DB_LOCATION_URI -- HDFD存放路徑
NAME -- 數(shù)據(jù)庫名
3.Hive表內(nèi)容、結(jié)構(gòu)、屬性
mysql> select TBL_ID,CREATE_TIME,DB_ID,SD_ID,TBL_NAME,TBL_TYPE from tbls;
+--------+-------------+-------+-------+---------------+----------------+ | TBL_ID | CREATE_TIME | DB_ID | SD_ID | TBL_NAME | TBL_TYPE | +--------+-------------+-------+-------+---------------+----------------+ | 7 | 1528299941 | 3 | 7 | emp | EXTERNAL_TABLE | | 10 | 1528311773 | 3 | 10 | emp_bak | MANAGED_TABLE | | 11 | 1528312267 | 3 | 11 | emp1 | EXTERNAL_TABLE | | 16 | 1528403085 | 3 | 16 | dual | MANAGED_TABLE | | 17 | 1528484818 | 3 | 17 | json | MANAGED_TABLE | | 22 | 1529454293 | 3 | 22 | emp_partition | MANAGED_TABLE | | 26 | 1529459118 | 3 | 31 | emp_sqoop111 | MANAGED_TABLE | | 34 | 1529530688 | 6 | 39 | user_click | EXTERNAL_TABLE | | 38 | 1529537107 | 6 | 44 | product_info | EXTERNAL_TABLE | | 39 | 1529593387 | 6 | 45 | city_info | MANAGED_TABLE | | 41 | 1529606647 | 6 | 46 | product_hot | MANAGED_TABLE | +--------+-------------+-------+-------+---------------+----------------+
TBL_ID -- 表ID 【table_params】【partitions】【partition_keys】
DB_ID -- 庫ID
SD_ID -- 序列化ID 【sds】【partitions】
4.Hive文件存儲相關元數(shù)據(jù)：【sds】【serdes】【serde_params】
mysql> select * from sds;
CD_ID --表列ID 【columns_v2】【cds】
SERDE_ID --序列化列ID 【serdes】【serde_params】
mysql> select * from columns_v2;
+-------+---------+--------------+-----------+-------------+
| CD_ID | COMMENT | COLUMN_NAME | TYPE_NAME | INTEGER_IDX |
+-------+---------+--------------+-----------+-------------+
| 7 | NULL | comm | double | 6 |
| 7 | NULL | deptno | int | 7 |
| 7 | NULL | empno | int | 0 |
| 7 | NULL | ename | string | 1 |
| 7 | NULL | hiredate | string | 4 |
| 7 | NULL | job | string | 2 |
| 7 | NULL | mgr | int | 3 |
| 7 | NULL | salary | double | 5 |
| 10 | NULL | comm | double | 6 |
| 10 | NULL | deptno | int | 7 |
| 10 | NULL | empno | int | 0 |
| 10 | NULL | ename | string | 1 |
| 10 | NULL | hiredate | string | 4 |
| 10 | NULL | job | string | 2 |
| 10 | NULL | mgr | int | 3 |
| 10 | NULL | salary | double | 5 |
5.Hive表分區(qū)相關的元數(shù)據(jù)表
mysql> select * from partitions;
+---------+-------------+------------------+-----------------+-------+--------+ | PART_ID | CREATE_TIME | LAST_ACCESS_TIME | PART_NAME | SD_ID | TBL_ID | +---------+-------------+------------------+-----------------+-------+--------+ | 1 | 1529456274 | 0 | pt=2018-06-19 | 26 | 22 | | 6 | 1529530704 | 0 | data=2018-06-20 | 40 | 34 |
PART_ID -- 分區(qū)ID 【partition_key_vasls】【partition_params】
mysql> select * from partition_key_vals;
+---------+--------------+-------------+
| PART_ID | PART_KEY_VAL | INTEGER_IDX |
+---------+--------------+-------------+
| 1 | 2018-06-19 | 0 |
| 6 | 2018-06-20 | 0 |
+---------+--------------+-------------+
PART_ID -- 分區(qū)ID
PART_KEY_VAL -- 分區(qū)字段值
mysql> select * from partition_params;
+---------+-----------------------+-------------+
| PART_ID | PARAM_KEY | PARAM_VALUE |
+---------+-----------------------+-------------+
| 1 | COLUMN_STATS_ACCURATE | true |
| 1 | numFiles | 2 |
| 1 | numRows | 0 |
| 1 | rawDataSize | 0 |
| 1 | totalSize | 734 |
| 1 | transient_lastDdlTime | 1529456274 |
| 6 | COLUMN_STATS_ACCURATE | true |
| 6 | numFiles | 1 |
| 6 | numRows | 0 |
| 6 | rawDataSize | 0 |
| 6 | totalSize | 725264 |
| 6 | transient_lastDdlTime | 1529530704 |
PARAM_KEY -- 分區(qū)屬性
PARAM_VALUE -- 分區(qū)屬性值
總結(jié)：
關于“Hive中matadata怎么用”這篇文章就分享到這里了，希望以上內(nèi)容可以對大家有一定的幫助，使各位可以學到更多知識，如果覺得文章不錯，請把它分享出去讓更多的人看到。
網(wǎng)頁名稱：Hive中matadata怎么用
URL分享：http://www.ef60e0e.cn/article/pcdjjh.html
