Skip to content

[Bug]: large downloads sometimes stall and never complete or abort. #364

@markjoldham

Description

@markjoldham

Issue Category

Content Downloads (ZIM, Maps, Collections)

Bug Description

Axios stream timeout only covers the initial connection, not the body. Once streaming starts, a stalled server would hang indefinitely.

Partial fix could be:
Added stallTimeout param (default 60s) to DoResumableDownloadParams
Reset a timer on every received chunk; abort if no data arrives within the window
Treat stall errors as retriable network errors in doResumableDownloadWithRetry so partial downloads can resume from where they left off

Steps to Reproduce

  1. start downloading many things (I want the largest collection of everything of course).
  2. watch the downloads, when it gets to a big one like the full large wikipedia, it will download for hours, starting out fast, then slowing down as it goes, until it finally stalls and stops downloading.
  3. it never fails out or aborts, it just stops sucking data from the internet.

Expected Behavior

download all packages until complete
If it stops getting data for a period of time, abort the download.
if the already collected data is good, leave it in a resumable state.
If it is not in a resumable state, clean up the partial files.

Actual Behavior

Just stops downloading.

N.O.M.A.D. Version

1.29.1

Operating System

Other (not yet officially supported)

Docker Version

29.3.0

Do you have a dedicated GPU?

Not sure

GPU Model (if applicable)

No response

System Specifications

Intel Core I7 10750H CPU @ 2.6G x 12
Quadro T2000 with Max-Q Design/PCIe/SE2 / Mesa Intel UHD Graphicsd
512 G disk (mostly empty, only has Zorin installed)
16G Ram
Zorin OS 17.3 Core

Service Status (if relevant)

No response

Relevant Logs

Browser Console Errors (if UI issue)

Screenshots

No response

Additional Context

1G FiOS, internet is stable. Power saver settings turned off. Have started over several times from fresh OS install.

Made some code changes (see bug description), which got me a lot further, but I'm still having the slowdown/halt when trying to download the larger files, such as the full Wikipedia.

I downgraded from Zorin 18 to Zorin 17 at the recommendation of others on Discord.

Great product, looking forward to having it fully implemented.

Pre-submission Checklist

  • I have searched for existing issues that might be related to this bug
  • I am running the latest version of Project N.O.M.A.D. (or have noted my version above)
  • I have redacted any personal or sensitive information from logs and screenshots
  • This issue is NOT related to running N.O.M.A.D. on an unsupported/non-Debian-based OS

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions