Re: [jgit-dev] JGit-Lfs performance

[Egor Baykov <Egor.Baykov@xxxxxxxxxx>]

Christian,

 

you can see same behavior on LFS GitHub repo: git@xxxxxxxxxx:BayeNN/gsdk_lfs_test.git

 

Windows Cmd Git clones this repo for less than 2 mins

v5.12.0.202105051250-m2 EGit (JGit) – 12% after first 10 mins, then I stopped.

 

Similar from the code:

 

BuiltinLFS.register();

LfsFactory

.getInstance()

.getInstallCommand()

.call();

 

Git

.cloneRepository()

.setURI(git@xxxxxxxxxx:BayeNN/gsdk_lfs_test.git)

.setDirectory(new File("c:\\temp\\jgit"))

.call();

 

 

 

Thanks!

-Egor

 

 

 

From: Christian Halstrick <christian.halstrick@xxxxxxxxx>
Sent: Friday, July 2, 2021 2:54 AM
To: Egor Baykov <Egor.Baykov@xxxxxxxxxx>
Cc: jgit-dev@xxxxxxxxxxx
Subject: Re: [jgit-dev] JGit-Lfs performance

 

CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe.

 

I guess you can't share the repo, or?

 

On Thu, Jul 1, 2021 at 9:06 PM Egor Baykov <Egor.Baykov@xxxxxxxxxx> wrote:

Hello,

 

question please on LFS (org.eclipse.jgit.lfs):

 

I’m using JGit + LFS to clone the huge LFS repo located on Bitbucket Server.

The repo size is ~3 Gb with a lot of binaries there stored as LFS files.

 

Cloning of such repo using JGit+LFS takes ~20 hours.

Cloning using Windows Git cmd (with LFS support) takes ~15 mins.

 

When I clone some non-LFS repo: the performance for Git cmd vs JGit is about the same, even for the ~1GB repo.

 

All the testing is done on Windows, Bitbucket repos.

I’m using “v5.12.0.202105051250-m2” tag to clone & build JGit repo.

 

For JGit LFS I’m using built-in LFS command:

 

       BuiltinLFS.register();

       LfsFactory

       .getInstance()

      .getInstallCommand()

       .call();

 

       Git

       .cloneRepository()

       .setURI("ssh://<>")

       .setDirectory(new File("c:\\temp\\jgit"))

       .call();

 

I will really appreciate if any ideas how I could speed up the clone(checkout) process for the LFS.

 

Few more notes please:

• I have to use the BuiltInLFS command instead of external one due to minimize the dependencies: 
  the JGit is planned to be used in a standalone application which shall not rely on any user’s installed Git.
• I’m using ssh connection since http does not work; Seems like a know issue:  https://bugs.eclipse.org/bugs/show_bug.cgi?id=535814
• I also tried to clone the LFS repo using EGit (5.12.0.202106070339-r) – same ~20 hours result

 

Thanks!

 

-Egor

_______________________________________________
jgit-dev mailing list
jgit-dev@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/jgit-dev