Prototype state

Crawl jobs

Crawls defined as data, with per-cycle item counts and anomaly alarms.

Mock data

  • catalogue-crawl

    Alarm

    40 seeds · robots: respect · last 28m ago · next in 1h 8m

    Items per cycle (12)

    Cycle 1: 374Cycle 2: 456Cycle 3: 450Cycle 4: 408Cycle 5: 445Cycle 6: 438Cycle 7: 400Cycle 8: 385Cycle 9: 447Cycle 10: 433Cycle 11: 418Cycle 12: 0
    Last cycle
    0
    Diff +/~/−
    +11 / ~51 / −7
    DLQ
    0

    Zero-result anomaly — selector may have changed

  • lane-rates-weekly

    Succeeded

    12 seeds · robots: respect · last 59m ago · next in 15m

    Items per cycle (12)

    Cycle 1: 899Cycle 2: 957Cycle 3: 1072Cycle 4: 937Cycle 5: 1002Cycle 6: 1075Cycle 7: 1021Cycle 8: 1059Cycle 9: 939Cycle 10: 963Cycle 11: 934Cycle 12: 960
    Last cycle
    960
    Diff +/~/−
    +4 / ~19 / −7
    DLQ
    1

  • carrier-directory

    Running

    25 seeds · robots: respect · last 1h 21m ago · next in 1h 30m

    Personal data · DPIA required

    Items per cycle (12)

    Cycle 1: 2182Cycle 2: 2307Cycle 3: 2357Cycle 4: 2380Cycle 5: 2001Cycle 6: 2259Cycle 7: 2184Cycle 8: 2285Cycle 9: 2038Cycle 10: 2091Cycle 11: 2108Cycle 12: 2167
    Last cycle
    2,167
    Diff +/~/−
    +16 / ~51 / −2
    DLQ
    1

  • fuel-index

    Succeeded

    3 seeds · robots: respect · last 34m ago · next in 1h 26m

    Items per cycle (12)

    Cycle 1: 53Cycle 2: 51Cycle 3: 52Cycle 4: 48Cycle 5: 47Cycle 6: 51Cycle 7: 48Cycle 8: 48Cycle 9: 52Cycle 10: 51Cycle 11: 54Cycle 12: 52
    Last cycle
    52
    Diff +/~/−
    +24 / ~35 / −2
    DLQ
    0

  • port-schedules

    Alarm

    8 seeds · robots: respect · last 15m ago · next in 13m

    Items per cycle (12)

    Cycle 1: 279Cycle 2: 326Cycle 3: 322Cycle 4: 332Cycle 5: 338Cycle 6: 337Cycle 7: 288Cycle 8: 338Cycle 9: 323Cycle 10: 323Cycle 11: 292Cycle 12: 118
    Last cycle
    118
    Diff +/~/−
    +12 / ~40 / −9
    DLQ
    1

    Item count dropped 62% vs 7-day median

  • broker-notices

    Failed

    6 seeds · robots: respect · last 11m ago · next in 1h 16m

    Items per cycle (12)

    Cycle 1: 81Cycle 2: 73Cycle 3: 74Cycle 4: 76Cycle 5: 77Cycle 6: 74Cycle 7: 77Cycle 8: 77Cycle 9: 76Cycle 10: 76Cycle 11: 72Cycle 12: 74
    Last cycle
    74
    Diff +/~/−
    +26 / ~9 / −7
    DLQ
    10

  • weather-advisories

    Queued

    4 seeds · robots: respect · last 42m ago · next in 5m

    Items per cycle (12)

    Cycle 1: 131Cycle 2: 123Cycle 3: 127Cycle 4: 114Cycle 5: 109Cycle 6: 113Cycle 7: 112Cycle 8: 128Cycle 9: 109Cycle 10: 119Cycle 11: 127Cycle 12: 124
    Last cycle
    124
    Diff +/~/−
    +32 / ~60 / −2
    DLQ
    1