org.embulk.spi

Interface InputPlugin

public interface InputPlugin

The main class that an Input Plugin implements.

An Input Plugin reads a sequence of data records from the configured source into PageOutput so that the read input is read from an Output Plugin, or a Filter Plugin.

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static interface	InputPlugin.Control A controller of the following tasks provided from the Embulk core.

Method Summary

Modifier and Type	Method and Description
void	cleanup(org.embulk.config.TaskSource taskSource, org.embulk.spi.Schema schema, int taskCount, List<org.embulk.config.TaskReport> successTaskReports) Cleans up resources used in the transaction.
org.embulk.config.ConfigDiff	guess(org.embulk.config.ConfigSource config) Performs the guess for the partially configured input.
org.embulk.config.ConfigDiff	resume(org.embulk.config.TaskSource taskSource, org.embulk.spi.Schema schema, int taskCount, InputPlugin.Control control) Resumes an input transaction.
org.embulk.config.TaskReport	run(org.embulk.config.TaskSource taskSource, org.embulk.spi.Schema schema, int taskIndex, org.embulk.spi.PageOutput output) Runs each input task.
org.embulk.config.ConfigDiff	transaction(org.embulk.config.ConfigSource config, InputPlugin.Control control) Processes the entire input transaction.

Method Detail

transaction

org.embulk.config.ConfigDiff transaction(org.embulk.config.ConfigSource config,
                                         InputPlugin.Control control)

Processes the entire input transaction.

Parameters:

config - a configuration for the Input Plugin given from a user

control - a controller of the following tasks provided from the Embulk core

Returns:

ConfigDiff to represent the difference the next incremental run

resume

org.embulk.config.ConfigDiff resume(org.embulk.config.TaskSource taskSource,
                                    org.embulk.spi.Schema schema,
                                    int taskCount,
                                    InputPlugin.Control control)

Resumes an input transaction.

Parameters:

taskSource - a configuration processed for the task from ConfigSource

schema - Schema of the input

taskCount - the number of tasks

control - a controller of the following tasks provided from the Embulk core

Returns:

ConfigDiff to represent the difference the next incremental run

cleanup

void cleanup(org.embulk.config.TaskSource taskSource,
             org.embulk.spi.Schema schema,
             int taskCount,
             List<org.embulk.config.TaskReport> successTaskReports)

Cleans up resources used in the transaction.

Parameters:

taskSource - a configuration processed for the task from ConfigSource

schema - Schema of the input

taskCount - the number of tasks

successTaskReports - reports of successful tasks

run

org.embulk.config.TaskReport run(org.embulk.config.TaskSource taskSource,
                                 org.embulk.spi.Schema schema,
                                 int taskIndex,
                                 org.embulk.spi.PageOutput output)

Runs each input task.

Parameters:

taskSource - a configuration processed for the task from ConfigSource

schema - Schema of the input

taskIndex - the index number of the task

output - PageOutput to write read input so that the input is read from an Output Plugin, or a Filter Plugin

Returns:

a report from the task

guess

org.embulk.config.ConfigDiff guess(org.embulk.config.ConfigSource config)

Performs the guess for the partially configured input.

Parameters:

config - a partial configuration for the Input Plugin given from a user

Returns:

a new configuration guessed based on config