Skip to content

Automated Test: kafka-consumer-parallel-after #328

Commits on Jul 16, 2025

  1. feat(uptime): Add ability to use queues to manage parallelism (#95633)

    One potential problem we have with batch processing is that any one slow
    item will clog up the whole batch. This pr implements a queueing method
    instead, where we keep N queues that each have their own workers.
    There's still a chance of individual items backlogging a queue, but we
    can try increased concurrency here to reduce the chances of that
    happening
    
    <!-- Describe your PR here. -->
    Dan Fuller authored and GitHub committed Jul 16, 2025
    Configuration menu
    Copy the full SHA
    33f4fdd View commit details
    Browse the repository at this point in the history