Initializing Lookup Manager data from CSV files and database

When you use at least one ITE application together with the Lookup Manager, which provides enrichment data, you must first initialize the Lookup Manager. In the case described here you are using CSV files and a database as the data source.

When you use CSV files and database, you must select the file source processing by prefixing “file_” or post fixing “_file” to the command in the command file. For example, you write “file_update” to update the shared repository with data that is contained in CSV files. For the database, you must not define any pre- or postfixes. For example, the initialization command for a database is always “init”.

Before you begin

Compile the Lookup Manager by using a LookupMgrCustomizing.xml file that contains all data source definitions, all segments with appropriate ITE applications, the required mapping to a access specification in the connections.xml file and the indexes that are defined in the CSV input files.

In your command file you use the init command.

Ensure that the database is up and running.

Start the ITE and Lookup Manager applications by submitting them to an IBM Streams instance.

About this task

Initialize the Lookup Manager’s enrichment data from CSV files and database.

Procedure

  1. Create your CSV enrichment data files and move them to the directory configured with lm.file.directory

  2. Create the command file that contains the init command and affected segments. Remember to use file_ prefix or _file postfix for command if you use CSV files as source. Move the file into the directory that is configured with lm.commandsDirectory. Remember to use the ‘.cmd’ extension.

  3. Monitor the states of your jobs with the Streams Console

  4. When the applications are in RUN state, initialization finished successfully and you can use your applications