Creating a streams flow manually
You can manually design a streams flow that best meets your data and analytic needs. Creating a streams flow manually gives you the greatest control over its design. This method gives you maximum flexibility to get the most value from your data. Use this method rather than the wizard when you have a more complicated streams flow.
You don’t need to get involved in creating the streams flow – we do that for you. You need to set up the source, target, analytic, and alert operators.
For example, you can add multiple sources and targets to your streams flow. Based on real-time analytics that you need to perform, you can aggregate, filter, and run your own code. You can even send email notification to interested parties from strategic places in your streams flow! If needed, you can perform real-time analysis on the streaming data, and then store selected data in a target for further analysis later.
Watch the following video to see how to create a streams flow manually in the streams flow canvas.
The source data can be in any format, including binary data. If the source format is in JSON format, it can be parsed automatically, see Parsing values from JSON. Or, you can parse it using a Code operator.
You must have either the Editor role or the Admin role.
The following instances must be associated with the project where the streams flow runs:
Cloud Object Storage instance
Streaming Analytics service instance
To check that the instances are associated, go to the Projects page of the project, and then click the Settings tab.
To create an instance, go to your account in IBM Cloud Dashboard. Click Create resource, and then follow the prompts.
To manually create a streams flow, perform the following steps:
In the Projects menu, click View All Projects, and then click the name of the project to add your streams flow to. Alternatively, to create a project for the streams flow, click New project.
In the Project page, click the Assets tab, and then click New streams flow.
In the Blank tab of the New Streams Flow page, type in a unique name. Click Manual, and then click Create.
Construct your streams flow by using the streams flow editor.
Click the Save icon to save the streams flow, and then click the Metrics icon to open the streams flow in the Metrics page.
In the Metrics page, the newly created streams flow is shown. Click the Run icon to begin streaming.
- Troubleshooting streams flow
- How data types are handled in a streams flow
- JSON path
- Aggregation examples
- Code operator examples
- Filter operator examples
- Python Model operator
- Installing other Python packages
- MQTT operator
- HTTP operator
- Event Streams operator
- SPSS Model operator
- Streams operators
- Kafka operators