Package com.cognite.client
Class SequenceRows
- java.lang.Object
-
- com.cognite.client.SequenceRows
-
- All Implemented Interfaces:
UpsertTarget<SequenceBody,SequenceBody>
public abstract class SequenceRows extends Object implements UpsertTarget<SequenceBody,SequenceBody>
This class represents the Cognite sequence body/rows api endpoint. It provides methods for reading and writingSequenceBody.
-
-
Field Summary
Fields Modifier and Type Field Description protected static org.slf4j.LoggerLOG
-
Constructor Summary
Constructors Constructor Description SequenceRows()
-
Method Summary
All Methods Static Methods Instance Methods Abstract Methods Concrete Methods Modifier and Type Method Description protected RequestaddAuthInfo(Request request)Adds the required authentication information into the request object.protected Aggregateaggregate(ResourceType resourceType, Request requestParameters)Performs an item aggregation request to Cognite Data Fusion.protected List<String>buildPartitionsList(int noPartitions)Builds an array of partition specifications for parallel retrieval from the Cognite api.protected List<Item>deDuplicate(Collection<Item> itemList)De-duplicates a collection ofItem.List<SequenceBody>delete(List<SequenceBody> sequenceRows)Deletes the given rows of the sequence(s).abstract CogniteClientgetClient()protected Iterator<CompletableFuture<ResponseItems<String>>>getListResponseIterator(ResourceType resourceType, Request requestParameters)protected booleanitemsHaveId(Collection<Item> items)Returns true if all items contain either an externalId or id.protected Iterator<List<String>>listJson(ResourceType resourceType, Request requestParameters, String... partitions)Will return the results from alist / filterapi endpoint.protected Iterator<List<String>>listJson(ResourceType resourceType, Request requestParameters, String partitionKey, String... partitions)Will return the results from alist / filterapi endpoint.protected Map<String,Item>mapItemToId(Collection<Item> items)Maps all items to their externalId (primary) or id (secondary).static SequenceRowsof(CogniteClient client)Construct a newSequenceRowsobject using the provided configuration.protected List<Item>parseItems(List<String> input)Parses a list of item object in json representation to typed objects.protected StringparseName(String json)Returns the name attribute value from a json input.protected StringparseString(String itemJson, String fieldName)Try parsing the specified Json path as aString.Iterator<List<SequenceBody>>retrieve(Request requestParameters)Returns allSequenceBodyobjects (i.e.Iterator<List<SequenceBody>>retrieve(List<Request> requestParametersList)Returns allSequenceBodyobjects (i.e.Iterator<List<SequenceBody>>retrieveComplete(long... id)RetrievesSequenceBodybyinternal id.Iterator<List<SequenceBody>>retrieveComplete(String... externalId)RetrievesSequenceBodybyexternalId.Iterator<List<SequenceBody>>retrieveComplete(List<Item> items)RetrievesSequenceBodybyexternalId / id.protected List<String>retrieveJson(ResourceType resourceType, Collection<Item> items)Retrieve items by id.protected List<String>retrieveJson(ResourceType resourceType, Collection<Item> items, Map<String,Object> parameters)Retrieve items by id.protected List<Map<String,Object>>toRequestItems(Collection<Item> itemList)Converts a list ofItemto a request object structure (that can later be parsed to Json).UploadQueue<SequenceBody,SequenceBody>uploadQueue()Returns an upload queue.List<SequenceBody>upsert(List<SequenceBody> sequenceBodies)Creates or updates a set ofSequenceBodyobjects.
-
-
-
Method Detail
-
of
public static SequenceRows of(CogniteClient client)
Construct a newSequenceRowsobject using the provided configuration. This method is intended for internal use--SDK clients should always useCogniteClientas the entry point to this class.- Parameters:
client- TheCogniteClientto use for configuration settings.- Returns:
- the assets api object.
-
retrieve
public Iterator<List<SequenceBody>> retrieve(Request requestParameters) throws Exception
Returns allSequenceBodyobjects (i.e. sequences rows x columns) that matches the specification set in theRequest. The results are paged through / iterated over via anIterator--the entire results set is not buffered in memory, but streamed in "pages" from the Cognite api. If you need to buffer the entire results set, then you have to stream these results into your own data structure. The sequence bodies are retrieved using multiple, parallel request streams towards the Cognite api. The number of parallel streams are set in theClientConfig.Example:
API Reference - Retrieve rowsList<SequenceBody> listResults = new ArrayList<>(); client .sequences() .rows() .retrieve(Request.create.withRootParameter("id", 1L)) .forEachRemaining(listResults::addAll);- Parameters:
requestParameters- the filters to use for retrieving sequences bodies.- Returns:
- an
Iteratorto page through the results set. - Throws:
Exception- See Also:
retrieve(List),CogniteClient,CogniteClient.sequences(),Sequences.rows()
-
retrieve
public Iterator<List<SequenceBody>> retrieve(List<Request> requestParametersList) throws Exception
Returns allSequenceBodyobjects (i.e. sequences rows x columns) that matches the specification set in the collection ofRequest. By submitting a collection ofRequest, the requests will be submitted in parallel to Cognite Data Fusion, potentially increasing the overall I/O performance. The results are paged through / iterated over via anIterator--the entire results set is not buffered in memory, but streamed in "pages" from the Cognite api. If you need to buffer the entire results set, then you have to stream these results into your own data structure. The sequence bodies are retrieved using multiple, parallel request streams towards the Cognite api. The number of parallel streams are set in theClientConfig.Example:
API Reference - Retrieve rowsList<SequenceBody> listResults = new ArrayList<>(); client .sequences() .rows() .retrieve(List.of(Request.create.withRootParameter("id", 1L))) .forEachRemaining(listResults::addAll);- Parameters:
requestParametersList- the filters to use for retrieving sequences bodies.- Returns:
- an
Iteratorto page through the results set. - Throws:
Exception- See Also:
CogniteClient,CogniteClient.sequences(),Sequences.rows()
-
retrieveComplete
public Iterator<List<SequenceBody>> retrieveComplete(String... externalId) throws Exception
RetrievesSequenceBodybyexternalId. Refer toretrieveComplete(List)for more information.Example:
API Reference - Retrieve rowsList<SequenceBody> listResults = new ArrayList<>(); client .sequences() .rows() .retrieveComplete("1", "2") .forEachRemaining(listResults::addAll);- Parameters:
externalId- TheexternalIdsto retrieve- Returns:
- The retrieved sequence bodies.
- Throws:
Exception- See Also:
retrieveComplete(List),CogniteClient,CogniteClient.sequences(),Sequences.rows()
-
retrieveComplete
public Iterator<List<SequenceBody>> retrieveComplete(long... id) throws Exception
RetrievesSequenceBodybyinternal id. Refer toretrieveComplete(List)for more information.Example:
API Reference - Retrieve rowsList<SequenceBody> listResults = new ArrayList<>(); client .sequences() .rows() .retrieveComplete(1, 2) .forEachRemaining(listResults::addAll);- Parameters:
id- Theidsto retrieve- Returns:
- The retrieved sequence bodies.
- Throws:
Exception- See Also:
retrieveComplete(List),CogniteClient,CogniteClient.sequences(),Sequences.rows()
-
retrieveComplete
public Iterator<List<SequenceBody>> retrieveComplete(List<Item> items) throws Exception
RetrievesSequenceBodybyexternalId / id. The entire Sequence body (i.e. all rows and columns) will be retrieved. The sequence bodies are retrieved using multiple, parallel request streams towards the Cognite api. The number of parallel streams are set in theClientConfig.Example:
API Reference - Retrieve rowsList<Item> items = List.of(Item.newBuilder().setExternalId("1").build()); List<SequenceBody> retrievedSequenceBody = client.sequences().rows().retrieve(items);- Parameters:
items- The sequencesexternalId / idto retrieve rows for.- Returns:
- The retrieved sequence rows / bodies.
- Throws:
Exception- See Also:
retrieve(List),CogniteClient,CogniteClient.sequences(),Sequences.rows()
-
upsert
public List<SequenceBody> upsert(List<SequenceBody> sequenceBodies) throws Exception
Creates or updates a set ofSequenceBodyobjects. ASequenceBodycarries the data cells (columns x rows) to be upserted to a sequence. If the main sequence object hasn't been created in Cognite Data Fusion yet (maybe because of a large job where both sequence headers and bodies are upserted in parallel), this method will create the sequence objects based on the information carried in theSequenceBody. The algorithm runs as follows: 1. Write allSequenceBodyobjects to the Cognite API. 2. If one (or more) of the objects fail, check if it is because of missing sequence objects--create temp headers. 3. Retry the failedSequenceBodyobjects.Example:
API Reference - Insert rowsList<SequenceBody> sequenceBodies = // List of SequenceBody; client.sequences().rows().upsert(sequenceBodies);- Specified by:
upsertin interfaceUpsertTarget<SequenceBody,SequenceBody>- Parameters:
sequenceBodies- The sequences rows to upsert- Returns:
- The upserted sequences rows
- Throws:
Exception- See Also:
CogniteClient,CogniteClient.sequences(),Sequences.rows()
-
uploadQueue
public UploadQueue<SequenceBody,SequenceBody> uploadQueue()
Returns an upload queue. The upload queue helps improve performance by batching items together before uploading them to Cognite Data Fusion.SequenceBodyobjects are quite large, so the queue is tuned with a default size of 10.- Returns:
- The upload queue.
-
delete
public List<SequenceBody> delete(List<SequenceBody> sequenceRows) throws Exception
Deletes the given rows of the sequence(s). This method will delete the rows specified via the sequence externalId/id + row number list in the inputSequenceBodyobjects. You don't need to specify columns or values. All columns will always be removed from the listed row numbers.Example:
API Reference - Delete rowsList<SequenceBody> sequenceRows = // List of SequenceBody; List<SequenceBody> deletedItemsResults = client.sequences().rows().delete(sequenceRows);- Parameters:
sequenceRows-- Returns:
- The deleted rows
- Throws:
Exception- See Also:
CogniteClient,CogniteClient.sequences(),Sequences.rows()
-
getClient
public abstract CogniteClient getClient()
-
buildPartitionsList
protected List<String> buildPartitionsList(int noPartitions)
Builds an array of partition specifications for parallel retrieval from the Cognite api. This specification is used as a parameter together with the filter / list endpoints. The number of partitions indicate the number of parallel read streams. Employ one partition specification per read stream.Example:
List<String> partitions = buildPartitionsList(getClient().getClientConfig().getNoListPartitions());- Parameters:
noPartitions- The total number of partitions- Returns:
- a
Listof partition specifications
-
listJson
protected Iterator<List<String>> listJson(ResourceType resourceType, Request requestParameters, String... partitions) throws Exception
Will return the results from alist / filterapi endpoint. For example, thefilter assetsendpoint. The results are paged through / iterated over via anIterator--the entire results set is not buffered in memory, but streamed in "pages" from the Cognite api. If you need to buffer the entire results set, then you have to stream these results into your own data structure. This method support parallel retrieval via a set ofpartitionspecifications. The specified partitions will be collected and merged together before being returned via theIterator.Example:
Iterator<List<String>> result = listJson(resourceType, requestParameters, partitions);- Parameters:
resourceType- The resource type to query / filter / list. Ex.event, asset, time series.requestParameters- The query / filter specification. Follows the Cognite api request parameters.partitions- An optional set of partitions to read via.- Returns:
- an
Iteratorover the results set. - Throws:
Exception- See Also:
listJson(ResourceType,Request,String,String...)
-
listJson
protected Iterator<List<String>> listJson(ResourceType resourceType, Request requestParameters, String partitionKey, String... partitions) throws Exception
Will return the results from alist / filterapi endpoint. For example, thefilter assetsendpoint. The results are paged through / iterated over via anIterator--the entire results set is not buffered in memory, but streamed in "pages" from the Cognite api. If you need to buffer the entire results set, then you have to stream these results into your own data structure. This method support parallel retrieval via a set ofpartitionspecifications. The specified partitions will be collected and merged together before being returned via theIterator.Example:
Iterator<List<String>> result = listJson(resourceType, requestParameters, partitionKey, partitions);- Parameters:
resourceType- The resource type to query / filter / list. Ex.event, asset, time series.requestParameters- The query / filter specification. Follows the Cognite api request parameters.partitionKey- The key to use for the partitions in the read request. For examplepartitionorcursor.partitions- An optional set of partitions to read via.- Returns:
- an
Iteratorover the results set. - Throws:
Exception
-
retrieveJson
protected List<String> retrieveJson(ResourceType resourceType, Collection<Item> items) throws Exception
Retrieve items by id. Will ignore unknown ids by default.Example:
Collection<Item> items = //Collection of items with ids; List<String> result = retrieveJson(resourceType, items);- Parameters:
resourceType- The item resource type (Event,Asset, etc.) to retrieve.items- The item(s)externalId / idto retrieve.- Returns:
- The items in Json representation.
- Throws:
Exception- See Also:
retrieveJson(ResourceType,Collection,Map)
-
retrieveJson
protected List<String> retrieveJson(ResourceType resourceType, Collection<Item> items, Map<String,Object> parameters) throws Exception
Retrieve items by id. This version allows you to explicitly set additional parameters for the retrieve request. For example:<"ignoreUnknownIds", true>and<"fetchResources", true>.Example:
Collection<Item> items = //Collection of items with ids; Map<String, Object> parameters = //Parameters; List<String> result = retrieveJson(resourceType, items, parameters);
-
aggregate
protected Aggregate aggregate(ResourceType resourceType, Request requestParameters) throws Exception
Performs an item aggregation request to Cognite Data Fusion. The default aggregation is a total item count based on the (optional) filters in the request. Some resource types, for exampleEvent, supports multiple types of aggregation.Example:
Aggregate aggregateResult = aggregate(resourceType,requestParameters);- Parameters:
resourceType- The resource type to perform aggregation of.requestParameters- The request containing filters.- Returns:
- The aggregation result.
- Throws:
Exception- See Also:
- Cognite API v1 specification
-
addAuthInfo
protected Request addAuthInfo(Request request) throws Exception
Adds the required authentication information into the request object. If the request object already have complete auth info nothing will be added. The following authentication schemes are supported: 1) API key. When using an api key, this service will look up the corresponding project/tenant to issue requests to.Example:
Request requestParams = addAuthInfo(request);- Parameters:
request- The request to enrich with auth information.- Returns:
- The request parameters with auth info added to it.
- Throws:
Exception
-
getListResponseIterator
protected Iterator<CompletableFuture<ResponseItems<String>>> getListResponseIterator(ResourceType resourceType, Request requestParameters) throws Exception
- Throws:
Exception
-
parseItems
protected List<Item> parseItems(List<String> input) throws Exception
Parses a list of item object in json representation to typed objects.Example:
List<String> input = //List of json; List<Item> resultList = parseItems(input);- Parameters:
input- the item list in Json string representation- Returns:
- the parsed item objects
- Throws:
Exception
-
toRequestItems
protected List<Map<String,Object>> toRequestItems(Collection<Item> itemList)
Converts a list ofItemto a request object structure (that can later be parsed to Json).Example:
Collection<Item> itemList = //Collection of items; List<Map<String, Object>> result = toRequestItems(itemList);- Parameters:
itemList- The items to parse.- Returns:
- The items in request item object form.
-
deDuplicate
protected List<Item> deDuplicate(Collection<Item> itemList)
De-duplicates a collection ofItem.Example:
Collection<Item> itemList = //Collection of items; List<Item> result = deDuplicate(itemList);- Parameters:
itemList-- Returns:
-
itemsHaveId
protected boolean itemsHaveId(Collection<Item> items)
Returns true if all items contain either an externalId or id.Example:
Collection<Item> items = //Collection of items; boolean result = itemsHaveId(items);- Parameters:
items-- Returns:
-
mapItemToId
protected Map<String,Item> mapItemToId(Collection<Item> items)
Maps all items to their externalId (primary) or id (secondary). If the id function does not return any identity, the item will be mapped to the empty string. Via the identity mapping, this function will also perform deduplication of the input items.Example:
Collection<Item> items = //Collection of items; Map<String, Item> result = mapItemToId(items);- Parameters:
items- the items to map to externalId / id.- Returns:
- the
Mapwith all items mapped to externalId / id.
-
parseString
protected String parseString(String itemJson, String fieldName)
Try parsing the specified Json path as aString.Example:
String json = //String of json object String result = parseString(json, "name");- Parameters:
itemJson- The Json stringfieldName- The Json path to parse- Returns:
- The Json path as a
String.
-
-