HADOOP Command

hadoop dfsadmin -report
hadoop fs -dus [directory]

Hive使用LEFT OUTER JOIN 實現not in 子句

source


查詢在key字段在a表中，但不在b表中的數據
select a.key from a left outer join b on a.key=b.key where b.key1 is null

MAHOUT

MAHOUT Parallel Frequent Pattern Mining

midpoint between two latitude and longitude

Find a center point of multiple lat lng
midpoint between two latitude and longitude

Hive UDF

https://github.com/livingsocial/HiveSwarm/blob/master/README.markdown

FTP 批次移動檔案

ftp: get list of file to get. Retrieve and move them Rename Multiple Files in Bash Using Regular Expressions