Does Confluent support streaming data to Redshift

The Internet protocol TCP / IP (Transmission Control Protocol) has been the standard protocol for almost two decades for sending data across continents, systems and platforms.
However, the simplicity of this protocol becomes a major concern when sharing sensitive corporate data or credit card information, or basically any data that is not intended to be seen by others.
For this purpose, the data must be transmitted over a secure connection.
In the field of cryptography, certain United States standards also apply. This is the Federal Information Processing Standard (FIPS).
With the z9 enterprise / business class, IBM already brought an adapter onto the market with the Crypto Express2, which was an asynchronous cryptographic coprocessor or accelerator. The adapter contained two cryptographic engines that can be configured independently as a coprocessor or as an accelerator.
Our solutions tcVISION and tcACCESS support the current cryptography solutions from IBM and are also compliant with the requirements of FIPS.

Transaction security when streaming data to Kafka

Kafka now supports transactions and, in conjunction with tcVISION, opens up the possibility of ensuring transaction security when entering data according to Kafka.
In this context, a transaction is a sequence of processing steps that may only be carried out jointly or not at all in order to keep a database in a consistent state. The changes to the transaction should therefore only be adopted when the transaction has been completely processed. If for any reason the transaction is aborted before completion, for example due to a program error or a power failure, the data must be reset to the state before the transaction began. This step is called "rollback". If the end of the transaction is reached as expected, the change to the data is confirmed by a commit command and saved permanently.
This feature ensures that either all or none of the messages sent in a transaction arrive. An error during processing cancels the entire transaction, so none of the messages are transmitted. This also works when sending messages in several topics within a transaction.
To be able to use this, a librdkakfa version 1.4.0 or newer must be installed, as transactions were only implemented in this version.

COVID-19 statement

Every day we are confronted with new information about the COVID-19 virus and its effects on our daily lives, on our economy, on global markets and companies of all sizes and industries.
The world is in a state of emergency. Taking this into account, we have set up our business operations in such a way that we can guarantee our customers and partners continuity in our cooperation at all times. Our team is divided between different locations. In addition, employees are free to work from their home office. Our infrastructure is designed in such a way that you can do all work from there. Our telephone system is programmed so that all BOS employees can still be reached via their office numbers. In addition, extensive technical options are available for web conferences as an alternative communication medium for meetings, training courses, workshops and presentations.
In these times of uncertainty, we have decided that until further notice, all contacts with customers and partners will only take place in the form of web and video conferences or by phone or email. All business travel and attending conferences have been suspended until the situation has stabilized. The health and safety of our employees are the focus of our measures so that we can maintain our service for our customers and partners at all times and without interruption in the usual quality.
We are aware that these times of uncertainty can last for weeks and months and represent a great challenge for every individual. However, we are convinced that we will master this successfully together. It is a time of change that we will master with flexibility, creativity and team spirit.
We are happy to answer any questions you may have.

OOP - software meets business

The OOP isthe Software architecture conference. From February 3rd to 7th, 2020, over 170 lectures and workshops will give you the opportunity to deepen topics such as agility, digital transformation, domain-driven design, programming languages ​​or software development and gain new insights.
We are happy to be there as a silver sponsor. Visit us at our booth for everything to do with data integration in heterogeneous IT landscapes!

B.O.S. Software Service und Vertrieb GmbH named "Top 10 IBM Solution Providers 2019" by CIO Applications Europe.

B.O.S. Software Service und Vertrieb GmbH was chosen by CIO Applications Europe Magazine as the cover story of the special issue "Top-10-IBM Solution Providers 2019". CIO Applications Europe recognizes that B.O.S. Software Service und Vertrieb GmbH is one of the leading providers of outstanding solutions in the area of ​​IBM z mainframe architecture.
With this award, B.O.S. confirmed in their role of creating space for innovations. The integration solutions from B.O.S. are both a driving force and a springboard for innovations.
You can find the detailed article here.

tcVISION supports Amazon Redshift

The data synchronization solution tcVISION now also supports the data warehouse service Redshift in the Amazon cloud. The connection between tcVISION and Amazon Redshift enables companies to quickly and easily integrate data from the mainframe or from the distributed environment into Amazon Redshift. The tcVISION change data capture technology ensures that the data warehouse is always supplied with the latest data in real time. In addition to a high level of parallelization of the queries, the Redshift data warehouse technology is characterized by the fact that the administrative effort otherwise associated with a data warehouse is completely eliminated. Thus, tcVISION presents itself as the ideal addition to the integration of data into the Redshift data warehouse technology for customers with a high demand for up-to-date information.

tcVISION supports Elasticsearch

Elasticsearch is a frequently used search and analysis module for full text search, security intelligence, business analytics and operational intelligence. Elasticsearch automatically saves the original documents and adds a searchable reference to the document in the index cluster.
tcVISION can quickly and easily transfer data to Elasticsearch in real time, thus saving time and effort. Thanks to tcVISION's mainframe sources, company-critical mainframe data can be used for analysis purposes in Elasticsearch at the push of a button.

Extension of tcVISION support for Microsoft Azure Cloud

Additional relational databases that are operated in a Microsoft Azure cloud are now supported. In addition, the EventHub and the blob storage are supported with the security procedures provided by Microsoft. The integrated blob storage support enables resource-efficient processing. The processing can be optimally adapted to the customer-specific environment, as various methods can optionally be used.

tcVISION supports Adabas for zIIP

tcVISION has been expanded to include the many advantages of Adabas for zIIP. Infrastructure or application functions can be outsourced to the lower-cost IBM z Integrated Information Processor (zIIP). Adabas for zIIP enables significant cost reductions and increases capacities, while performance and security are not impaired. Adabas for zIIP can now also be used with tcVISION.

tcVISION on the AWS Marketplace

tcVISION Amazon Machine Images (AMIs) are now available on the AWS Marketplace. Business-critical data in mainframe environments can be made available in databases within a few minutes - with minimal administrative effort.
With the data modeling and mapping functions of the tcVISION GUI and the uncomplicated migration to AWS, the modernization of large mainframe systems via AWS is quick and easy. Bi-directional data synchronization in real time enables changes, for example in a PostgreSQL table on AWS, to be replicated on the mainframe.

B.O.S. is a Confluent partner

Confluent was founded by the developers of the open source solution Apache Kafka and offers a leading streaming platform that enables companies to maximize the value of their data.
The partnership with Confluent enables users to easily and quickly integrate data from enterprise applications from mainframes and distributed systems into their streaming platform in real time and to access these real-time streams with company data.
Real-time analytics and BI solutions as well as the modernization of applications, which involve the relocation of data and applications, are made considerably easier by using tcVISION. The effort for the implementation and realization of the Confluent streaming platform with integration of real-time data from mainframe and distributed systems is considerably reduced by tcVISION and can be realized in a shorter time.
B.O.S. tcVISION offers one of the leading data integration solutions for the comprehensive implementation of data exchange solutions (data synchronization / replication / migration / distribution) in heterogeneous system environments. The integrated "minimal impact" change data capture technology for a variety of mainframe, LUW and cloud-based data sources accelerates the construction of modern real-time enterprise data architectures.
tcVISION is a complete integration platform. It includes the complete data exchange process, i.e. the extraction of the data at the data source, the transformation of the data for preparation for the data targets, as well as the direct APPLY in the data targets without the need for intermediate storage.

B.O.S. implements an agentless connection to Db2 z / OS

The tcVISION solution from B.O.S. offers connections to a large number of databases and file systems on a z / OS or z / VSE or z / VM as well as different operating systems in the open world (Linux, UNIX, Windows). Detailed information can be found here.
An additional, new connection type has been added for active log processing in Db2 z / OS:
A permanently active tcVISION agent is no longer required on the z / OS mainframe to record changes from the active log of a Db2 on z / OS. This “agentless” connection analyzes the Db2's active log and extracts the change data via a Db2 UDT (User Defined Table) and a connection via DRDA or a Db2 client to the Db2 z / OS.
Heinrich von Parseval, Head of Development: “This additional agentless connection has made installation in a Db2 z / OS environment even easier. A host agent is no longer required for tcVISION. Nevertheless, changes to the Db2 z / OS can be recognized and processed almost in real time without noticeably using mainframe resources. An interesting perspective - also for any future further developments of the tcVISION. "

B.O.S. Partner conference in Haar

Partnerships are the prerequisite for a successful representation in the world.
The B.O.S. Software Service und Vertrieb GmbH works with renowned software houses in the USA, Europe, Asia, South Africa and Australia. The existing customer base in these parts of the world is proof that these partnerships are successful.
B.O.S. invite their international partners to a conference. So this year too. The conference took place in April in Haar near Munich. The B.O.S. presented their current developments to the partners and gave insights and impressions on upcoming innovations and versions of the software solutions tcVISION and tcACCESS.
The partners were also actively involved in the conference. The dynamics of the IT world, caused by BigData, cloud computing and new database technologies, were presented and demonstrated how the solutions from B.O.S. work with these new technologies. Implementations were presented to customers and strategies for continued successful cooperation were developed.
The B.O.S. is convinced that the partnerships * will continue to guarantee the successful distribution of the software solutions tcVISION and tcACCESS in the future.

* Partner of the B.O.S .:
  • Treehouse Software - USA
  • The amod - United States
  • Bateleur - South Africa
  • CCA Software - Australia
  • Yam Pong Corporation - Taiwan
  • JVL / Syspertec - France
  • UP Consulting - Spain
  • Team Data - Scandinavia
  • B.O.S. Software S.r.l. - Italy
  • Formula Opensoft - Benelux
  • B19 Data Solutions Ltd. - United Kingdom

tcVISION supports MySQL / MariaDB

The relational databases MySQL and especially MariaDB are enjoying increasing popularity all over the world. MariaDB is available as an open source database management system and is therefore a cost-free and license-free alternative to licensed relational databases in the client-server environment.
B.O.S. Software Service and Sales have taken this trend into account: tcVISION now supports MySQL and MariaDB as target systems for replications.
Both databases can also be used as a repository for tcVISION.
The MySQL / MariaDB APPLY function is available for entering data from other data sources such as mainframe Db2, Adabas, IMS / DB, VSAM or Oracle, Db2 LUW and others in the distributed environment. The internal MySQL / MariaDB loader can be used to load the MySQL / MariaDB databases (BULKLOAD) quickly and efficiently. The connection of the two database systems was realized via the official MySQL / MariaDB interface. The diverse range of database systems and platforms supported by tcVISION is unique. This is also underpinned by the constantly growing number of installations around the world.

B.O.S. Products support the new z / OS 2.3

The current version 2.3 of the z / OS operating system has been generally available since September 29, 2017. In addition to many innovations and technical enhancements, this version is positioned as an answer to the growing challenges of modern, hybrid IT infrastructures on the part of IBM.
The B.O.S. Solutions tcVISION and tcACCESS support this new version of the z / OS operating system.
Heinrich von Parseval, head of the B.O.S. Product development: “We always endeavor to adapt our software solutions to new versions of the IBM z / OS and z / VSE operating systems as quickly as possible so that our customers can migrate to the new versions immediately. This philosophy of the B.O.S. basically applies to all operating system platforms on which our software solutions are used (see also: environments supported by tcVISION) ”.
Users of tcACCESS and tcVISION who use version z / OS 2.3 can download the current product versions from the website.

tcACCESS and tcVISION in the list of "Software developers supporting z / OS V2R3"

IBM publishes an overview of all software products that support the new version 2.3 of the z / OS operating system. The link to this list can be found here.
Elisabeth Schwarz, Managing Director of B.O.S .: “It is our aim to support new operating systems directly with our solutions. In the case of z / OS 2.3 - as in the past - we provided support promptly. Both tcACCESS and tcVISION are included in the list of software products published by IBM that support z / OS 2.3. "
Users of tcACCESS and tcVISION who use version z / OS 2.3 can download the current product versions from the website.

B.O.S. supports the new POWER8 platform from IBM

The IBM POWER Systems are servers that are built with open technology and are intended for business-critical applications. Today's IT demands servers that are designed and optimized for big data and that can cope with the constantly growing workload requirements.
The software solutions from B.O.S. help customers share and exchange their data in real time between platforms that include a mainframe, distributed systems, Hadoop and cloud.
B.O.S. supports this new POWER8 platform with its software solutions. Heinrich von Parseval, Head of Product Development: "We are impressed by Linux on an IBM POWER8, the excellent performance and the scalability of this trend-setting technology."

tcVISION supports SAP Hana

Mainframe data and data from the Distributed Applications Environment (LUW) can now be quickly and easily replicated or migrated to SAP Hana with tcVISION. Programming effort is not required for this.
  • Additional middleware is not necessary.
  • The data exchange volume is reduced to a minimum (compressed and transfer in raw format).
  • Comprehensive data mapping simplifies the selection of data and creates transparency
  • Intuitive user interface and numerous wizards reduce implementation times to a minimum.
  • Automatic character translation between the systems and platforms.
  • The integration of data from different source data models (relational and non-relational) on the various platforms according to SAP Hana is comprehensively supported.

PostgreSQL support is now available in tcVISION

tcVISION replicates data based on changes in real time and automatically updates the changes in the target systems. With immediate effect, the object-oriented, relational DBMS, which is available as open source and thus represents a cost-free and license-free alternative to licensed relational DBMS in the client-server environment. PostgreSQL is supported as the source and target of a data replication or synchronization with tcVISION. As an optional component, tcVISION has a PostgreSQL Change Data Capture option, which automatically detects changes to the PostgreSQL DBMS and thus enables real-time replication of the change data in target systems in other DBMS. The PostgreSQL APPLY option is available for entering data from other data sources such as mainframe Db2, Adabas, IMS / DB or VSAM or Oracle, Db2 LUW and others in the distributed environment. With tcVISION, data can be exchanged quickly and easily in heterogeneous system environments without any programming effort. Special database know-how is not necessary for this.

tcVISION now supports IAM files - a solution from Innovation Data Processing

“The Innovation Access Method (IAM) is a transparent alternative to VSAM KSDS, ESDS and (as a cost option) AIX and RRDS files. The savings achieved over VSAM can vary, but IAM typically uses 40-80% less I / Os, 20-70% less CPU and 30-70% less DASD. Savings in batch elapsed times and online response times can range from 20-80%. "(INNOVATION Data Processing)
With tcVISION, users of IAM files now have the option of replicating data in real time in any DBMS, including NoSQL DBMS systems in the distributed systems environment, in cloud and Hadoop platforms, and can thus quickly and easily use modern technologies for analytics and business Use intelligence.
tcVISION also supports bidirectional synchronization between IAM files and DBMS in the distributed environment. This means that data can be synchronized in real time between Oracle, SQL Server, Db2 LUW, Informix, Adabas LUW, for example, without any programming effort in IAM. The transparent integration of IAM files in a heterogeneous system environment can thus be implemented quickly and easily.

Fully integrated connection of mainframe data to Apache Kafka

tcVISION now allows the direct streaming of change data to Apache Kafka.
New features:
  • Propagation of change data to Apache Kafka in real time
  • Currently supported protocols are JSON, Avro and CSV
  • Connection via official interfaces guarantees quick and easy implementation
  • The data source can be any data source supported by tcVISION:
    • Mainframe: Adabas, Db2, VSAM, CICS, DATACOM, IMS and others
    • Open world: Adabas, Oracle, Microsoft SQL Server, Db2 LUW and others

Replication of data to MongoDB

tcVISION now fully supports MongoDB as an output target
New features:
  • Merge several tables into one MongoDB document
  • No message queuing necessary
  • No additional middleware necessary
  • Available for UNIX / Linux and Windows
  • Parallelization of load processes for highly efficient transmission
  • Own key management for non-indexed data
  • Comprehensive monitoring, logging and integrated alert notification

Direct access to mainframe data from Hadoop systems

The tcACCESS JDBC server now supports direct access to mainframe data from Hadoop systems.
New features:
  • JDBC access to relational mainframe data sources such as Db2
  • JDBC access to non-relational mainframe data sources such as Adabas, VSAM, Datacom, IMS, etc.
  • Mainframe data access completely transparent via JDBC drivers
  • No additional middleware required
  • No mainframe knowledge required for Hadoop programming

B.O.S. User forum 2016

06-07 June 2016 x
From June 6th to 7th the meeting of the B.O.S. Users in Munich. This time, too, the user forum was jointly organized by the users and the B.O.S. designed. Interesting lectures and experience reports as well as information on current IT topics (BigData, Cloud, NoSQL databases) and new versions of tcACCESS and tcVISION were the highlights of the successful event.