Package | Description |
---|---|
org.apache.lens.cube.metadata | |
org.apache.lens.cube.metadata.timeline | |
org.apache.lens.cube.parse |
Modifier and Type | Method and Description |
---|---|
static UpdatePeriod |
UpdatePeriod.fromUnitName(String unitName) |
UpdatePeriod |
FactPartition.getPeriod() |
UpdatePeriod |
TimePartition.getUpdatePeriod() |
UpdatePeriod |
StoragePartitionDesc.getUpdatePeriod() |
static UpdatePeriod |
CubeFactTable.maxIntervalInRange(Date from,
Date to,
Set<UpdatePeriod> updatePeriods)
Get the max update period for the given range and available update periods
|
static UpdatePeriod |
UpdatePeriod.valueOf(String name)
Returns the enum constant of this type with the specified name.
|
static UpdatePeriod[] |
UpdatePeriod.values()
Returns an array containing the constants of this enum type, in
the order they are declared.
|
Modifier and Type | Method and Description |
---|---|
static Map<String,UpdatePeriod> |
JAXBUtils.dumpPeriodsFromStorageTables(XStorageTables storageTables) |
static Map<String,Set<UpdatePeriod>> |
JAXBUtils.getFactUpdatePeriodsFromStorageTables(XStorageTables storageTables) |
Map<String,UpdatePeriod> |
CubeDimensionTable.getSnapshotDumpPeriods() |
Map<String,Map<UpdatePeriod,String>> |
CubeFactTable.getStoragePrefixUpdatePeriodMap() |
Map<String,Set<UpdatePeriod>> |
FactTable.getUpdatePeriods()
Get map of storage to update period mapping
|
Map<String,Set<UpdatePeriod>> |
CubeVirtualFactTable.getUpdatePeriods() |
Map<String,Set<UpdatePeriod>> |
CubeFactTable.getUpdatePeriods() |
static Map<String,Map<UpdatePeriod,String>> |
JAXBUtils.storageTablePrefixMapOfStorage(XStorageTables storageTables) |
Modifier and Type | Method and Description |
---|---|
List<org.apache.hadoop.hive.ql.metadata.Partition> |
Storage.addPartitions(org.apache.hadoop.hive.ql.metadata.Hive client,
String factOrDimTable,
UpdatePeriod updatePeriod,
List<StoragePartitionDesc> storagePartitionDescs,
Map<Map<String,String>,Storage.LatestInfo> latestInfos,
String tableName)
Add given partitions in the underlying hive table and update latest partition links
|
void |
CubeMetastoreClient.addStorage(CubeDimensionTable dim,
String storage,
UpdatePeriod dumpPeriod,
StorageTableDesc storageTableDesc)
Adds storage to dimension and creates corresponding storage table
|
void |
CubeFactTable.addUpdatePeriod(String storage,
UpdatePeriod period)
Add update period to storage
|
void |
CubeDimensionTable.alterSnapshotDumpPeriod(String storage,
UpdatePeriod period)
Alter snapshot dump period of a storage
|
static TimePartitionRange |
TimePartitionRange.between(Date from,
Date to,
UpdatePeriod period) |
int |
UpdatePeriod.UpdatePeriodComparator.compare(UpdatePeriod o1,
UpdatePeriod o2) |
void |
CubeMetastoreClient.dropPartition(String cubeTableName,
String storageName,
Map<String,Date> timePartSpec,
Map<String,String> nonTimePartSpec,
UpdatePeriod updatePeriod)
Add a partition specified by the storage partition desc on the storage passed.
|
boolean |
CubeMetastoreClient.factPartitionExists(String factName,
String storageName,
UpdatePeriod updatePeriod,
Map<String,Date> partitionTimestamp,
Map<String,String> partSpec) |
static void |
MetastoreUtil.filterPartitionsByUpdatePeriod(List<org.apache.hadoop.hive.ql.metadata.Partition> partitions,
UpdatePeriod updatePeriod) |
static Date |
DateUtil.getCeilDate(Date date,
UpdatePeriod interval) |
static Date |
DateUtil.getFloorDate(Date date,
UpdatePeriod interval) |
static String |
MetastoreUtil.getPartitionInfoKeyPrefix(UpdatePeriod updatePeriod,
String partCol) |
List<String> |
CubeFactTable.getPartitions(Date fromDate,
Date toDate,
UpdatePeriod interval)
Get partition value strings for given range, for the specified updateInterval
|
static String |
MetastoreUtil.getPartitionTimelineStorageClassKey(UpdatePeriod updatePeriod,
String partCol) |
String |
CubeMetastoreClient.getStorageTableName(String factOrDimTableName,
String storage,
UpdatePeriod updatePeriod) |
String |
CubeFactTable.getTablePrefix(String storage,
UpdatePeriod updatePeriod) |
static int |
DateUtil.getTimeDiff(Date fromDate,
Date toDate,
UpdatePeriod updatePeriod) |
static TimeRange.Iterable |
TimeRange.iterable(Date fromDate,
Date toDate,
UpdatePeriod updatePeriod,
int increment)
iterable from fromDate(including) to toDate(excluding) incrementing increment units of updatePeriod
|
static TimeRange.Iterable |
TimeRange.iterable(Date fromDate,
int numIters,
UpdatePeriod updatePeriod,
int increment)
iterable from fromDate(including) incrementing increment units of updatePeriod.
|
TimeRange.Iterable |
TimeRange.iterable(UpdatePeriod updatePeriod,
int increment) |
static TimePartition |
TimePartition.of(UpdatePeriod updatePeriod,
Date date) |
static TimePartition |
TimePartition.of(UpdatePeriod updatePeriod,
String dateString) |
static TimePartitionRange |
TimePartitionRange.parseFrom(UpdatePeriod updatePeriod,
String from,
String to) |
boolean |
CubeMetastoreClient.partitionExists(String storageTableName,
UpdatePeriod updatePeriod,
Map<String,Date> partitionTimestamps) |
boolean |
CubeMetastoreClient.partitionExistsByFilter(String cubeTableName,
String storageName,
UpdatePeriod updatePeriod,
String filter) |
void |
CubeFactTable.removeUpdatePeriod(String storage,
UpdatePeriod period)
Remove update period from storage
|
void |
StoragePartitionDesc.setUpdatePeriod(UpdatePeriod updatePeriod) |
TimeRange |
TimeRange.truncate(UpdatePeriod updatePeriod)
Truncate time range using the update period.
|
void |
CubeMetastoreClient.updatePartition(String fact,
String storageName,
org.apache.hadoop.hive.ql.metadata.Partition partition,
UpdatePeriod updatePeriod) |
TimePartition |
TimePartition.withUpdatePeriod(UpdatePeriod period) |
Modifier and Type | Method and Description |
---|---|
void |
CubeMetastoreClient.addStorage(CubeFactTable fact,
String storage,
Set<UpdatePeriod> updatePeriods,
Map<String,StorageTableDesc> storageTableDescs,
Map<UpdatePeriod,String> updatePeriodStoragePrefix)
Adds storage to fact and creates corresponding storage table
|
void |
CubeMetastoreClient.addStorage(CubeFactTable fact,
String storage,
Set<UpdatePeriod> updatePeriods,
Map<String,StorageTableDesc> storageTableDescs,
Map<UpdatePeriod,String> updatePeriodStoragePrefix)
Adds storage to fact and creates corresponding storage table
|
void |
CubeFactTable.alterStorage(String storage,
Set<UpdatePeriod> updatePeriods)
Alter a storage with specified update periods
|
void |
CubeMetastoreClient.createCubeDimensionTable(String dimName,
String dimTblName,
List<org.apache.hadoop.hive.metastore.api.FieldSchema> columns,
double weight,
Map<String,UpdatePeriod> dumpPeriods,
Map<String,String> properties,
Map<String,StorageTableDesc> storageTableDescs)
Create a cube dimension table
|
void |
CubeMetastoreClient.createCubeFactTable(String cubeName,
String factName,
List<org.apache.hadoop.hive.metastore.api.FieldSchema> columns,
Map<String,Set<UpdatePeriod>> storageAggregatePeriods,
double weight,
Map<String,String> properties,
Map<String,StorageTableDesc> storageTableDescs)
Create a cube fact table
|
void |
CubeMetastoreClient.createCubeFactTable(String cubeName,
String factName,
List<org.apache.hadoop.hive.metastore.api.FieldSchema> columns,
Map<String,Set<UpdatePeriod>> storageAggregatePeriods,
double weight,
Map<String,String> properties,
Map<String,StorageTableDesc> storageTableDescs,
Map<String,Map<UpdatePeriod,String>> storageUpdatePeriodMap) |
void |
CubeMetastoreClient.createCubeFactTable(String cubeName,
String factName,
List<org.apache.hadoop.hive.metastore.api.FieldSchema> columns,
Map<String,Set<UpdatePeriod>> storageAggregatePeriods,
double weight,
Map<String,String> properties,
Map<String,StorageTableDesc> storageTableDescs,
Map<String,Map<UpdatePeriod,String>> storageUpdatePeriodMap) |
boolean |
TimeRange.isCoverableBy(Set<UpdatePeriod> updatePeriods) |
static UpdatePeriod |
CubeFactTable.maxIntervalInRange(Date from,
Date to,
Set<UpdatePeriod> updatePeriods)
Get the max update period for the given range and available update periods
|
void |
CubeMetastoreClient.updatePartitions(String factOrDimtableName,
String storageName,
Map<UpdatePeriod,List<org.apache.hadoop.hive.ql.metadata.Partition>> partitions) |
Constructor and Description |
---|
FactPartition(String partCol,
Date partSpec,
UpdatePeriod period,
FactPartition containingPart,
DateFormat partFormat) |
FactPartition(String partCol,
Date partSpec,
UpdatePeriod period,
FactPartition containingPart,
DateFormat partFormat,
Set<String> storageTables) |
StoragePartitionDesc(String cubeTableName,
Map<String,Date> timePartSpec,
Map<String,String> nonTimePartSpec,
UpdatePeriod updatePeriod) |
Constructor and Description |
---|
CubeDimensionTable(String dimName,
String dimTblName,
List<org.apache.hadoop.hive.metastore.api.FieldSchema> columns,
double weight,
Map<String,UpdatePeriod> snapshotDumpPeriods) |
CubeDimensionTable(String dimName,
String dimTblName,
List<org.apache.hadoop.hive.metastore.api.FieldSchema> columns,
double weight,
Map<String,UpdatePeriod> snapshotDumpPeriods,
Map<String,String> properties) |
CubeFactTable(String cubeName,
String factName,
List<org.apache.hadoop.hive.metastore.api.FieldSchema> columns,
Map<String,Set<UpdatePeriod>> storageUpdatePeriods) |
CubeFactTable(String cubeName,
String factName,
List<org.apache.hadoop.hive.metastore.api.FieldSchema> columns,
Map<String,Set<UpdatePeriod>> storageUpdatePeriods,
double weight) |
CubeFactTable(String cubeName,
String factName,
List<org.apache.hadoop.hive.metastore.api.FieldSchema> columns,
Map<String,Set<UpdatePeriod>> storageUpdatePeriods,
double weight,
Map<String,String> properties) |
CubeFactTable(String cubeName,
String factName,
List<org.apache.hadoop.hive.metastore.api.FieldSchema> columns,
Map<String,Set<UpdatePeriod>> storageUpdatePeriods,
double weight,
Map<String,String> properties,
Map<String,Map<UpdatePeriod,String>> storagePrefixUpdatePeriodMap) |
CubeFactTable(String cubeName,
String factName,
List<org.apache.hadoop.hive.metastore.api.FieldSchema> columns,
Map<String,Set<UpdatePeriod>> storageUpdatePeriods,
double weight,
Map<String,String> properties,
Map<String,Map<UpdatePeriod,String>> storagePrefixUpdatePeriodMap) |
Modifier and Type | Method and Description |
---|---|
UpdatePeriod |
PartitionTimeline.getUpdatePeriod() |
Modifier and Type | Method and Description |
---|---|
static PartitionTimeline |
PartitionTimelineFactory.get(CubeMetastoreClient client,
String storageTable,
UpdatePeriod updatePeriod,
String partitionColumn)
Checks in table params if desired implementing class is given.
|
Constructor and Description |
---|
EndsAndHolesPartitionTimeline(String storageTableName,
UpdatePeriod updatePeriod,
String partCol) |
PartitionTimeline(String storageTableName,
UpdatePeriod updatePeriod,
String partCol) |
RangesPartitionTimeline(String storageTableName,
UpdatePeriod updatePeriod,
String partCol) |
StoreAllPartitionTimeline(String storageTableName,
UpdatePeriod updatePeriod,
String partCol) |
Modifier and Type | Method and Description |
---|---|
TreeSet<UpdatePeriod> |
StorageCandidate.getParticipatingUpdatePeriods()
These are the update periods that finally participate in partitions.
|
TreeSet<UpdatePeriod> |
StorageCandidate.getValidUpdatePeriods()
Valid update periods populated by Phase 1.
|
Modifier and Type | Method and Description |
---|---|
static String |
CubeQueryConfUtil.getLookAheadPTPartsKey(UpdatePeriod interval) |
Copyright © 2014–2018 Apache Software Foundation. All rights reserved.