Skip to content

Make autoscaling load signals pluggable #2134

Open
Open
Make autoscaling load signals pluggable#2134
Labels
enhancementNew feature or request.t-toolingIssues with this label are in the ownership of the tooling team.
Milestone
2.0

Description

@vdusek
vdusek
opened on Aug 7, 2026

SystemStatus (src/crawlee/_autoscaling/system_status.py) hardcodes the CPU, memory, event loop and client signals with fixed thresholds, so adding a custom signal or dropping an existing one is not possible. Introduce a load signal abstraction that the autoscaling system accepts as a list.

JS implementation: apify/crawlee#3917, apify/crawlee#3976

✍️ Drafted by Claude Code

Activity

  1. vdusek
    added
    enhancementNew feature or request.
    t-toolingIssues with this label are in the ownership of the tooling team.
    on Aug 7, 2026
  2. vdusek
    added this to the 2.0 milestone on Aug 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request.t-toolingIssues with this label are in the ownership of the tooling team.

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions