Skip to content
SAP, DATEV and Dynamics experts
Technical questions

How performant is synchronization with large data volumes?

Answer

Performance depends on the chosen integration pattern, the target system's interface and the data volume. As a guide from practice: with REST APIs, typically 500 to 2,000 records per minute are realistic, while via message queues we can process 10,000 to 50,000 messages per minute (project experience). The limiting factor is usually not our middleware but the throttling of the connected ERP.

For the initial import of large catalogs with 100,000 products or more, we use bulk import strategies with parallel processing and sensible batch sizes so the source system is not overloaded. In ongoing operations, delta synchronization takes over: only records that have actually changed are transferred, which makes the daily reconciliations significantly faster and more resource-friendly than a full import.