Does anyone know if you can pull and then modify data from the Data Lake using Amazon S3 commands? If so what buckets are they in? Or do you have to use an API?

Does anyone know if you can pull and then modify data from the Data Lake using Amazon S3 commands? If so what buckets are they in? Or do you have to use an API?

There really isnt a lot of documentation about the inner workings of the Data Lake at this time or maybe I havent found it but I know it is just Amazon s3 buckets and im trying to get read/edit access to that in the MT cloud. Any suggestions?

Maybe use a replication set?

  • Mike Kalinowski

    Hey Randal,

    Access to the files is exposed through the APIs which you can find through the ION API application in the App Menu and drilling down to Infor ION > Data Lake API (datalakeapi endpoint) and using the list, StreamByID, and StreamByFilter methods.

    We're working on developing a file browser in the future as well to simplify file management, browsing, grouping, and more.

  • MICHAELRASINK

    In reply to Mike Kalinowski:

    Hi Mike,

    I have tested the API using the Compass using:

    1: /v1/compass/jobs
    Enter my query

    2: /v1/compass/jobs/{queryId}/status
    Checked the status and when finished

    3: /v1/compass/jobs/{queryId}/result
    Result shown

    How to get this in a document flow? if I create a IONAPI connection point I cannot select the Compass APIs.

    Any idea?
  • Mike Kalinowski

    In reply to MICHAELRASINK:

    Hey Michael,

    You should find it under ION Desk (suite level) and you can further filter down for "Compass".

    Just a heads up, we're enhancing ION AnySQL to support reading from the Data Lake early next year. You'll be able to graphically model your data retrieval with the same incremental features.

  • MICHAELRASINK

    In reply to Mike Kalinowski:

    Thanks Mike for the update.
    Yesterday it was fixed in Infor OS by Cloud team. Now I am able to see the API for Datalake.
    is there an example how to retrieve data via API to local file/database?