Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: add git clone eof error troubleshooting #1009

Merged

Conversation

Danyal-Faheem
Copy link
Contributor

@Danyal-Faheem Danyal-Faheem commented Feb 27, 2024

Issue

  • Git throws an EOF error while cloning large repositories on slow/unstable networks.
RUN mkdir -p /openedx/edx-platform &&     git clone https://github.com/openedx/edx-platform.git --branch open-release/quince.1 --depth 1 /openedx/edx-platform:
Cloning into '/openedx/edx-platform'...
fatal: the remote end hung up unexpectedly
fatal: early EOF
fatal: index-pack failed
  • This error is thrown while cloning edx-platform during the build process of the openedx/openedx-dev image.
    RUN mkdir -p /openedx/edx-platform && \
    git clone $EDX_PLATFORM_REPOSITORY --branch $EDX_PLATFORM_VERSION --depth 1 /openedx/edx-platform
    WORKDIR /openedx/edx-platform

Changes

  • Added a troubleshooting guide for the issue thrown by git while cloning large repositories on slow/unstable networks.
  • Since this issue is subjective to every users network connection, I have instead just added a troubleshooting guide to reduce resources in the buildkit which does fix the issue.

This error has been reported by multiple users, for example here and here. I myself have faced this as well.
The max I could try it out was on a 25 Mb/s wired connection and it still threw the error.

@Danyal-Faheem Danyal-Faheem requested a review from regisb February 27, 2024 10:25
@Danyal-Faheem Danyal-Faheem self-assigned this Feb 27, 2024
@DawoudSheraz DawoudSheraz self-requested a review March 12, 2024 09:18
@Danyal-Faheem Danyal-Faheem force-pushed the danyalfaheem/document-git-eof-issue branch from 8dfab0d to b9c7972 Compare March 13, 2024 06:40
fatal: the remote end hung up unexpectedly / fatal: early EOF / fatal: index-pack failed
----------------------------------------------------------------------------------------

This issue can occur due to problems with your network while cloning edx-platform which is a fairly large repository.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In what situation does this error occur? Unless I'm mistaken, this happens whenever we run tutor images build ... command, right? We should tell the reader that, such that they feel confident that the error that we are describing matches their experience.

Also, try to avoid the "you" pronoun whenever possible. For instance, some of the sentences can be rewritten as:

This issue can occur due to network problems while cloning edx-platform which is a fairly large repository.

First, try to run again the same command to see if it works.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've updated the title with the sample command.

I've removed the "you" pronoun as well.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You left out the "your network" :) (and below as well)


This issue can occur due to problems with your network while cloning edx-platform which is a fairly large repository.

You should first of all try to rerun the command you were trying to run to see if it works.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is good advice, but it does not inspire confidence. How many times should the user try to re-run the same command? Why should they do that?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've added that the command should be run once again and why it should be run again.


You should first of all try to rerun the command you were trying to run to see if it works.

If that does not work, you can follow the tutorial above for `High resource consumption <#high-resource-consumption-on-tutor-images-build-by-docker>`_ and set `max-parallelism = 1` so that while edx-platform is being cloned, the network is not being utilized by another command.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Setting max-parallelism=1 is not great advice. I would suggest just forwarding the user to the above tutorial, and they can figure out by themselves what is the right paralellism value.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've removed that part and just forwarded the user to the other tutorial.

@Danyal-Faheem Danyal-Faheem requested a review from regisb March 27, 2024 09:40
@hinakhadim
Copy link
Contributor

@regisb Would be please again have a look into it?

fatal: the remote end hung up unexpectedly / fatal: early EOF / fatal: index-pack failed
----------------------------------------------------------------------------------------

This issue can occur due to problems with your network while cloning edx-platform which is a fairly large repository.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You left out the "your network" :) (and below as well)

@Danyal-Faheem Danyal-Faheem requested a review from regisb April 9, 2024 10:36
Copy link
Contributor

@regisb regisb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@DawoudSheraz DawoudSheraz merged commit 675719e into overhangio:master Apr 16, 2024
2 checks passed
@DawoudSheraz DawoudSheraz deleted the danyalfaheem/document-git-eof-issue branch April 16, 2024 07:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Development

Successfully merging this pull request may close these issues.

4 participants