Release Notes

DB2 for i replication (on IBM iSeries AS/400 platform) was expanded to include log mining of journals, in addition to trigger-based change capture.

MariaDB support was expanded to include log mining of the binary log, in addition to trigger-based change capture.

Replicate changes from Progress OpenEdge database or load data from other databases into it. OpenEdge is a relational database management system with a 4GL programming language for building business applications. This dialect has bi-directional support that includes change data capture, sub-setting, transformations, and initial loads.

Compare and Repair feature allows comparison of data between a source database and one or more target databases. The user has options of all or specific tables, level of comparison, immediate or scheduled, and whether to report or repair data. Comparison can use checksums at a table or chunk level to minimize use of the network. Parallel threads are used on each database per comparison request (compare.queue.per.request.count) with a maximum number of threads available on each server (compare.thread.per.server.count). A report of matching, different, missing, and extra rows can be kept, including a SQL file of changes that can be viewed or applied automatically to the target database.

The Insights Manager is a sliding panel on the left side of the Dashboard that presents the user with proactive AI-generated recommendations that can help optimize and enhance the system. The user can choose to approve actions, schedule reminders for a later time, or dismiss altogether. Insights are collected across all nodes in the system and use pattern matching and rules collected from support cases.

Screens now use lazy initialization to reduce the time it takes to login and navigate. The Manage → Jobs screen has a new history icon that opens a listing of job runs from the past 30 days along with a graph of job statistics.

Web console users can be put into a hierarchy of roles, giving them permission to create or modify users at or below their current role. Web console users can be given a "break glass" indicator that prevents login unless another user breaks the glass for a temporary, time-based password to the account. Web console users can now authenticate with single sign-on (SSO) using the SAML security standard with a third party identity provider.

Purge now uses "exists" clause instead of "in" clause for correlated deletes if the database supports it. File sync now stages file changes to improve response time for pull sync requests, which also helps with network timeouts. Routing now uses a cached list of enabled nodes it can route changes to for each batch it creates. The default push and pull intervals were changed to 10 seconds to reduce the sync time experienced by new users.

Old data gaps are marked as expired by routing for performance, but left in the system for purge service to track and remove after a longer time period (purge.expired.data.gap.retention.minutes). If purge service finds data in an expired gap, it will repair the data by queuing reloads of the rows by primary key values. The sym_outgoing_error table was added to mirror sym_incoming_error and allow users to provide resolution for data conflicts on the outgoing side. All HTTP error codes now use 600 series to distinguish from any network devices that use standard 500 series. In some cases, more specific HTTP error codes are now used that may cause older clients to log only a general error message with the error code, which include 601 bad request, 602 engine not found, and 605 client already connected.

The symconsole command line utility can now perform operations with the license key.

H2 database version 2 is now included. Users with existing H2 1.x databases may need to add ";MODE=LEGACY" to the end of db.url or "set MODE LEGACY" to db.init.sql (the Pro installer will do this automatically). Spring framework libraries were updated to version 6. Spring Boot 3 is now used to run the Jetty web server in standalone mode. Java 17 or later is now required.

3.15.0 (Pro)
1613 - Add the ability to resend a batch by reload that has been ignored or has had a row ignored
5591 - Add symconsole subcommands to REST API
5758 - Add break glass users
5830 - Allow console users to login using SAML authentication
5838 - Log miner for MariaDB database
5917 - Add insight manager to dashboard and replace integrity checks with insights
5945 - Compare and repair with remote nodes
5952 - Add job trending insight
5953 - Replace unsent batch monitor with one for online nodes and another for offline nodes

3.15.0
4034 - Create tables based on target table name and column names set by routers and transforms
5545 - Add support for H2 2.x and upgrade the H2 driver to the latest version
5926 - Adding a corresponding sym_outgoing_error table connected to sym_incoming_error

3.15.1 (Pro)
6000 - Add import-cert subcommand to symadmin
6031 - Add connection reset insight
6037 - Add LOB insight
6042 - Add Registration → Show Rejected menu option to Manage Nodes screen
6049 - Add connection pool insight
6056 - Add priority column and Control → Toggle Priority button to Manage Nodes screen
6075 - Add stranded data insight

3.15.1
6015 - Add :SOURCE_NODE_ID, :SOURCE_EXTERNAL_ID, and :SOURCE_NODE_GROUP_ID variables to column match routers
6079 - Make it possible to use DBCompare’s --config option to specify a suffix for each column in the order by clause
6094 - Add symadmin take-snapshot subcommand

3.15.2 (Pro)
6063 - Add support for RabbitMQ
6108 - Make it possible to log in via LDAP without having a corresponding console user
6111 - Make it possible to log in via SAML without having a corresponding console user
6123 - Add Unknown Certificate Authority insight

3.15.2
6154 - Add parameters that can disable specific types of conflict resolution

3.15.3 (Pro)
6218 - Subselect router support for SOURCE_NODE_ID variable

3.15.3
6188 - Add boolean data type support for Oracle 23c

3.15.4 (Pro)
6231 - Time-Based Capture Feature

3.15.4
6243 - Support H2 version 2.2

3.15.0 (Pro)
5137 - Upgrade to Vaadin 24
5589 - Move REST API to SymmetricDS Pro
5637 - Set SET MODE LEGACY in db.init.sql for H2 databases in engines, remove DB_CLOSE_ON_EXIT from db URL if AUTO_SERVER also set
5769 - Optimize startup of all screens by waiting until they’re opened to query and populate data
5789 - Move and enhance monitors and notifications for SymmetricDS Pro
5796 - MongoDB bidirectional nested data sync
5861 - Improve accuracy of CPU monitor
5928 - Use sym_outgoing_error table to ignore a row in outgoing batch
5941 - Enhance User Roles with Hierarchy
5963 - License key command line operations
5972 - Unlock feature of Nodes Panel should be in Registration dropdown

3.15.0
5641 - Increase default db.pool.max.active connections to match what is needed for http.concurrent.workers.max
5740 - Have file sync make better use of staging
5770 - Use 600 series HTTP codes to distinguish from network devices
5778 - Change timestamp size on sym tables with a timestamp as a primary key
5784 - Cache list of enabled nodes used by routing
5792 - Better logging when ack fail
5827 - Track expired data gaps and repair any data missed by routing
5840 - Purge should use "exists" clause instead of "in" clause for performance
5842 - Purge retention for monitor events and console events
5843 - Change default push/pull to 10 seconds
5860 - Increase the statement query timeout
5927 - Use sym_outgoing_error table to ignore a row in outgoing batch

3.15.1 (Pro)
5882 - Postgres Log Mining Enhancements
5995 - Load screens should not reset their sort order on refresh
5997 - Selecting a multi-node row on the Manage Nodes screen should select all of the child rows
6009 - Connect Database Wizard should prevent the user from using the Microsoft driver for SQL Server 2005 or older
6022 - Oracle log miner should skip the SQL statement instead of throwing an exception when the SQL is empty or the schema is null
6038 - Upgrade to Vaadin 24.2 and use the new SvgIcon class
6045 - Improve details of CPU and memory monitor events
6054 - Move Unlock feature of Manage Nodes screen back to the Control dropdown
6058 - Dashboard Health panel should have a separate message for system batches
6061 - Add Table(s) Wizard should not query for metadata when filtering table names
6066 - "Open Web Console" button in SymmetricDS Pro Control Center should get the hostname from the host.bind.name property
6068 - Windows service fails to start when desktop is slow to initialize
6102 - Add more details to the Rest Keys section of the User Guide

3.15.1
6003 - Upgrade Gradle Docker Plugin to latest version and get it working
6007 - Prevent node from starting up if the sync.url is invalid
6017 - DDL Create Table Oracle with varchar columns that have a size > 4000
6035 - Use the value of javax.net.ssl.trustStoreType as the truststore type if specified
6041 - Reject node registration request
6057 - Multi-threaded routing by channel
6069 - Slow extract and load when using $(targetExternalId) variable
6081 - Improve name and documentation for DBExport’s --symmetric option
6083 - SQLite nodes do not insert into sym_context correctly when disabling sync triggers
6086 - Improve watchdog job and enable it by default
6096 - Contains big LOB check can be fooled by commas in data
6097 - Cache trigger template hashcode
6104 - Add indexes to sym_outgoing_batch

3.15.2 (Pro)
6114 - Add process info to support snapshot
6125 - Ensure subset data wizard does not create a router id that exceeds max length of table
6126 - Prevent users from creating triggers for a load-only node group via the Add Tables Wizard
6149 - Set query time out for log based support to match trigger based

3.15.2
6106 - Some Bulk loaders don’t process before filters
6132 - Too many "Expected but did not receive an ack for batch"
6146 - Additional trigger template variable to suppor primary key joins without an alias
6148 - Remove individual jobs stats for push and pull and uri handlers

3.15.3 (Pro)
6136 - Look into using Launch4j to start java on Windows
6169 - Improving and Re-evaluating the Email Verification Process
6172 - Windows service executable that launches Java
6191 - SQL-Server log mining should not require snapshot isolation
6200 - Remove securityToken parameter from /outgoingBatchSummary REST API call
6202 - Make "Active Errors" dialog display all severe monitor events
6225 - Compare and repair subsets, also fixes for scale, sort column names, viewing scripts

3.15.3
6165 - During an upgrade, log DDL before executing it instead of afterwards
6174 - Could not find trigger history, causes error of had X columns but expected Y
6178 - Snapshot util timeout for taking too long on table definitions
6184 - Multi-threaded routing and gap detection
6185 - Unnecessary unrouted batch appears along with routed batch
6189 - Issue with syncing BIGINT, INT, TINYINT, SMALLINT, and BIT data types to Oracle and Tibero databases
6198 - Record failed sync trigger attempts to database in trigger history and stats
6206 - Add LOB Mapping for SQL Server 2005 and later
6210 - "Node failed to authenticate" in server logs after server restarts or client session expires

3.15.4 (Pro)
6228 - Prevent empty identifier on configure screens
6236 - Add logging for if the Bulk Loader Screen has a failure
6239 - Deleting items on a Configure screen should not create the UI for the form
6242 - Improve performance of table selection in Add Tables Wizard
6247 - Unknown monitor type with older nodes causes excessive logging
6249 - CPU monitor should use Java routine if native command not available
6254 - Blocked transaction monitor continuously logs error if missing permissions
6255 - Snowflake default connection to continue to use JSON instead of Apache Arrow
6290 - MSSQL Bulk Loader (BCP) parameter to allow the instance value to be omitted from the command
6293 - Compare repair UI improvements
6294 - Compare repair allow tables without PK if user sets sync key names
6304 - Progress OpenEdge platform should have a dirty SQL template
6305 - Compare repair snapshot and logging

3.15.4
6201 - Add support for NTypes in XML
6240 - Failed to update a table_reload_request as processed for loadId
6256 - Add virtual column to sym_file_snapshot for easier routing by column match and bean shell routers
6272 - Startup logging for specific node securities that can’t decrypt
6278 - Change file sync processing to make immediate request when batches are received or sent
6279 - Make File Sync Tracker transactions smaller to minimize locking collision problems
6292 - File sync BeanShell script should place files in a separate error directory if they are not writable
6301 - Update Rest Keys docs to reflect correct error code

3.15.5 (Pro)
6261 - Table group support with log based and time based captures
6287 - Add table wizard checks configured tables based on trigger id rather than table name

3.15.0 (Pro)
4968 - Oracle log miner SQL parser exception from backslash value
5868 - Ignore Row Count not getting updated in outgoing batch table when a row is ignored

3.15.0
2530 - postgresql infinity timestamp
2826 - Monitor event duplicate key when syncing
3505 - SYM_TABLE_RELOAD_REQUEST is updated via DateTime which sometimes fails due to precision mismatch
5835 - column name containing a "/" causes error
5857 - Security Vulnerability in Spring Framework and h2 database
5925 - Ignore Row Count not getting updated in outgoing batch table when a row is ignored
6039 - CVE-2016-1000027 - /opt/symmetric-server/web/WEB-INF/lib/spring-web-5.3.27.jar

3.15.1 (Pro)
5998 - Error viewing job history on Manage → Jobs screen
6020 - Oracle log miner stuck on resetting SCN number ORA-01281
6024 - JsonSyntaxException when deserializing monitor event details
6027 - SQL Server Bulk issue when batch column count is different than target table column count
6029 - LogMinerService debug log issue when logging close of miner and start and end SCN ids
6048 - Oracle statement parser does not handle the case when the column names in the where clause are prefixed with the table name
6053 - List of table names in Add Table(s) Wizard can extend below the bottom edge of the layout
6060 - Sybase ASE generated column query fails on versions older than 16
6070 - Compare and repair table using Sybase reserved keyword
6077 - Protect against exceptions in CPU monitor
6078 - db.init.sql parsing needs to allow values to contain semicolons, specified as 2 semicolons in the value
6085 - ElasticSearch Data Writer should use upsert functionality when updating records
6088 - Spring Boot builds unnecessary ElasticsearchRestClientAutoConfiguration bean when elastic search module jars are installed
6089 - Elastic Search module needs httpclient from apache to be installed
6090 - Log off not closing session
6093 - Add Table(s) Wizard should not specify the catalog/schema name for a new trigger if it is the default catalog/schema
6105 - Setting up a new log based or extract only node via the Add Database Wizard causes a JdbcSQLFeatureNotSupportedException

3.15.1
6004 - SQL Explorer grid editor causes error in browser and "Edit" button is initially invisible
6012 - Do not attempt to "create or alter" triggers on SQL Server 2016 RTM
6016 - Missing Kafka dependencies when installing Kafka module
6023 - SQLException when updating a non-OK outgoing batch on some database platforms
6040 - maxFormContentSize and maxFormKeys are no longer used
6044 - ConcurrentConnectionManager expects nodeId-channel in the white list, but only the nodeId is put in the white list
6046 - The watchdog job should not allow a node to detect itself as offline
6052 - Sybase ASE result set has already been closed during trigger exists check
6072 - sym_node gets updated unnecessarily when heartbeat.update.node.with.batch.status parameter is disabled
6074 - Sync triggers fails when checking for multiple active trigger histories if Sybase ASE page size is 2K
6087 - Upgrade from pre-3.15 to 3.15 loses H2 databases
6099 - Many router types attempt to handle non-DML data event types when they do not support them
6100 - Engine "filesync" not found

3.15.2 (Pro)
6109 - Web console is unresponsive after logging in via SAML
6110 - Logging in via SAML results in the web console repeatedly reloading itself
6120 - JsonIOException fails to deserialize log summary event
6121 - Save As Copy in GUI always keeps saved object as selected
6138 - Refresh loop after hitting refresh button in browser
6142 - Postgres log miner parsing exception with NULL value
6147 - SQL-Server bulk load bcp integrated security
6157 - Getting logged out after returning to SymmetricDS with 'Session Limit Exceeded'
6158 - Upgrade of module can fail on Windows because files are locked

3.15.2
6115 - Cancel of load at target does not clean up everything at the source and still shows active at target
6128 - Dbfill of nchar/nvarchar and avoid timestamp/rowversion
6139 - Jtds driver does not work with Sybase ASE
6140 - DB compare was incorrectly hex-encoding Unitype columns
6144 - Postgres timestamp with time zone columns get their values formatted incorrectly when extracted for a load
6145 - Purge fails with incorrect syntax near 'd' on SQL Server
6152 - DDL replication errors on SQL-Server with renaming columns and deadlocks
6155 - Conflict resolver does not handle unique index violations correctly when a unique index ignores null values
6156 - Repair of unrouted data should go through routing
6159 - Firebird sym_hex UDF can cause an access violation

3.15.3 (Pro)
6005 - "Enter" keyboard shortcut in wizards does not consistently work when using Chrome or Edge
6033 - Work queued via BackgroundRefresherService sometimes does not get done
6161 - Mail Server checked wrong class for encryption type and password
6167 - Checking for root user during installation fails even when user is root
6180 - "Allow changes from SQL to be captured" checkbox doesn’t work when sending SQL
6182 - Table name filter in Load Data Wizard doesn’t work
6186 - Configure → Table Routing screen stuck in bulk edit mode
6187 - Enabling change tracking on MSSQL should not use brackets
6197 - Failed to queue work because the background refresher service has been shut down
6204 - Selection on Manage Installed Triggers screen does not behave correctly when filtering the grid
6213 - Encrypted parameter values need to be decrypted before saving into the batch file when synchronizing
6215 - Violation Edit Panel throws exceptions when parsing JSON text for reset of statistics dates and when generating JSON strings
6216 - MySQL Bulk Loading documentation in appendix missing images
6220 - Incoming Panel on dashboard does not show bulk loading correctly

3.15.3
4617 - Corrupted row data during extract
6163 - Snapshot error from database time on Sybase ASE/ASA
6168 - File sync push is rejected because of a lack of a reservation
6171 - Cookies required error when both http and https enabled
6176 - Upgrade Jetty
6193 - Adjusting unique indexes to non-unique when columns can be null should be able to be turned off by parameter
6194 - Postgres XML incorrectly identifies "BOOLEAN" as "BIT"
6195 - symadmin module error when file exists without a dot
6205 - Syncing a NCLOB from Oracle to Postgres results in an error
6207 - Reverse initial load sometimes doesn’t start when also using forward initial load
6212 - Registration error: sym_parameter changes causing sync triggers need to be limited to DML changes
6214 - SQLite sync error on sym_table_reload_request when db.treat.date.time.as.varchar.enabled
6224 - Imported configuration sometimes gets deleted from sym_data

3.15.4 (Pro)
6137 - take snapshot from license violation screen does not show the snapshots to download them
6183 - Terminal on Manage Nodes screen does not work
6227 - If import config during first setup contains license, don’t prompt for license
6230 - DB2 AS400 iSeries failed to mine log for numeric data types that had a scale.
6232 - Node group summary database icons sometimes broken
6233 - SAML authentication does not work with a load balancer
6237 - Health panel should not count insights
6238 - When the Process Builder returns non-zero for the Bulk Loader Screen, an UnknownFormatException can occur
6241 - Switching engine not taking effect on Manage Comparison panel
6250 - Registration failing when registering node is remote and SMTP Mail Server authentication is configured
6257 - Design wizard creates lookup table router with unknown type
6258 - Lookup table router with log mining
6260 - Comparison screen views repair script as garbage binary when encrypted staging is enabled
6268 - Registration failing when registering node is remote and SMTP password is set to null in sym_parameter
6284 - Remote status with websockets broken after Spring Boot transition
6286 - IndexOutOfBoundsException occurs when trying to access incoming batch data in error via the UI
6289 - Compare request can’t update status, loops creating new request IDs
6295 - Compare repair table request gets stuck in inconsistent state
6307 - Syntax error when updating sym_table_reload_status using a Progress OpenEdge database
6309 - LOBs should not be included in where clauses when using a Progress OpenEdge database

3.15.4
6170 - DB Compare incorrectly comparing values
6217 - Schema information missing from drop index query generated by DDL on PostgreSQL
6226 - H2 DDL Builder incorrectly adds size information to "UUID" data type
6229 - Old stage files used after node is rebuilt
6246 - Cancel Load needs to make sure processes threads shut down before updating outstanding load request records
6251 - BSH column transform column names can conflict with built-in variable names
6252 - ASE large column types for primary keys need to limit max size based on page size
6253 - Issue with Initial loads when using Sybase ASE Unitypes while using JTDS driver
6259 - Sync triggers is mis-detecting last update time on sym triggers
6264 - Include source_node_id in the where clause when updating or deleting from sym_table_reload_status
6267 - Prevent columns from being created with a size of 0
6270 - Prevent OracleSymmetricDialect from underestimating the current value of a sequence
6271 - Finding trigger histories should treat null or blank as default catalog/schema
6275 - FileSyncDataRouter gets FileTriggerRouters from database instead of cache
6283 - Spring Framework URL Parsing with Host Validation
6285 - Memory leak in MSSQL JDBC driver 10.2.0
6288 - Writing table definitions from xml for indexes that do not have a corresponding platform index
6296 - DefaultDatabaseWriter sql(…​) method parsing sql statement during exception needs changed
6297 - Upgrade mysql, postgres, vaadin, jetty libraries
6300 - Hot spot removing old node sessions in mixed environment with versions < 3.11
6302 - Unable to set web context path with symmetric.server.web.home