Release Notes

• 1: Release 1.0.2
• 2: Release 1.0.3
• 3: Release 1.0.4
• 4: Release 2.0.1
• 5: Release 2.0.2

1 - Release 1.0.2

New

• The new Services Overview is a useful page to monitor and manage all platform services.
• The Configuration Manager is a central point to manage configurations for all deployed services.
• The Executor Framework is a powerful new utility that enables creating, orchestrating, sequencing and running of pretty much any combination of jobs and services.
• With the Job Scheduler we have added a newly embedded console for scheduling, running and monitoring jobs, without the need of embedding third-party job scheduler.
• We have introduced a new Workflow Manager to support the building of processes, including four-eye reviews, approval chains and quality gates.
• We have integrated our Slack Support Channel into the Control Center menu so that you can contact us directly and easily with your questions.
• To get quicker access to the most frequently used services and components we’ve built a list of Platform Services links and placed them into the Control Center navigation.
• We have added a new File Storage capability for creating and uploading files and managing buckets.
• Introduced a new User Interface and Navigation.
• Made important improvements of Access Rights Management.

Changed

• no changes to report

Improved

• We have improved the Files Manager and in particular Files Onboarding Monitor to embed user credentials and therefore to make the files uploading and management more user specific.
• We have taken further strides to streamline and simplify the User Management. Creating users and assign their own secured container (working space) is now fully automated - albeit not yet self-service

Fixed

• no fixes to report

2 - Release 1.0.3

New

• We have introduced a Tagging capability, which enables users to tag almost any data element on the platform making it easy and user friendly to navigate through the application and find items.
• The Checks Framework greatly improves the data quality monitoring around any kind of data sources, data types and event types.
• The Topics & Consumer Monitor listens in on Kafka and provides an up-to-the-second view of data sourcing and streaming.
• New Service Logs can be used to track all services running within the network as well as their logs and events that occur between them. Each log or event have their own data stored within elasticsearch and can be filtered by numerous fields.
• Jupyter Auto Deploy makes the onboarding of new users even faster and self-serviced.
• Events are stored and managed in the new Event Registry.

Changed

• no changes to report

Improved

• We have improved elements of the Security and Access Rights Management in the areas of User and Access Management (Keycloak), Certificates Management as well as Authentication and Authorization (OpenID). Each role has its own set of permissions, which makes it possible to restrict users access to specific areas of the platform based on their role.
• Parametrised Workflows can be defined with by users with easy json files by following a specific set of rules. Complex use cases are supported such as chaining multiple actions one by another and having control over what happens in a different scenarios. Built in approval capability for each workflow action is supported and easy to implement by default.
• The new StreamZero Executor has become even better and more powerful. Add any Python, SQL or JSON to execute any type of jobs.
• The Scheduler is now fully embedded with the Executor.
• Files Upload has improved and is integrated with the Workflow and Approvals functionality. Files have type specific validation and are stored in different buckets. Bucket creation can be done within the same FAB module.
• The StreamZero Application Builder (FAB) is now capable of auto generating new pages (UI) on the fly.

Fixed

• no fixes to report

3 - Release 1.0.4

New

• We have collected our growing list StreamZero APIs and documented them in a Service Inventory.
• Introduced Projects as a new concept, enabling the of grouping of like processes as well as the security based segregation of them.
• Integrated StreamZero with Voilà, turning Jupyter notebooks into standalone web applications.
• Live logs are there, providing real-time log data.

Changed

• no changes to report

Improved

• The self-service onboarding has received further improvement. The onboarding flow as well as the corresponding documentation have been made even easier to follow.
• The FAB (StreamZero Application Builder) has improved in the area performance.
• We have linked Minio to the FAB UI, API and Database.
• The Executor framework is being continuosly improved.
• Tags have been implemented across all StreamZero components.

Fixed

• A number of general bug fixes have been implement.

4 - Release 2.0.1

New

• We have introduced the Simple StreamZero Dashboard (Landing Page/Dashboard) developed in ReactJS to provide insights and analytics around typical platform related metrics mostly related to Data Ops and detailed event handling. It can be finetuned and tailored to customer specific needs. The details can be found under the Landing Page(Dashboard) subcategory in the User Guide.
• The first version of the Open API REST Server - Generator has been built which can be used for generating standardised REST APIs from the OpenAPI specification.
• Created Dashboard API which is used for feeding various charts on StreamZero Dashboard including statistics for Executions by status, trigger type, average time of executions, number of executions per package etc.
• Introduction of manifest.json files which can be uploaded with a package and used to define package execution entrypoint (name of the script that will be executed), order of scripts execution, schedule, tags, trigger event, etc.
• Added Execution Context to ferris_ef package which is accessible to any .py script at runtime and can be used for fetching configuration, secrets, parameters, information of the executing package and for manipulating the package state.

Changed

• PostgreSQL wrapper was added to StreamZero CLI

Improved

• Overall performance of the UI was enhanced

Fixed

• Synchronisation of Git Repositories that contain empty packages

5 - Release 2.0.2

New

• Introduction of Secrets Management UI & API that can be used for securely storing and accessing secrets on the Platform and Project level.

Changed

• Re-enabling of the Project/Package/Git Repository/Execution deletion feature.
• Version 2 of ferris_cli package published to public Pypi repository.

Improved

• Executor fx_ef package adjusted for local development.
• Various changes on the StreamZero UI.

Fixed

• no fixes to report