Jump to content

Enable Parallel Downloading In Pacman In Arch Linux


Recommended Posts

abarbarian

https://ostechnix.com/enable-parallel-downloading-in-pacman-in-arch-linux/


 

Quote

 

The latest pacman version is 6.0. The major change for this release is the implementation of parallel downloads. Yes, this feature downloads multiple files at the same time!

For instance, if you install something that need 4 dependencies, all files are downloaded in parallel by the same pacman instance, rather than one after the other.

 

 

😎

  • Thanks 1
Link to post
Share on other sites
securitybreach

Yeah, I forgot to post that last week. I first used 10 and then worked my way up to 100 on Linode VPS, I finally settled on 20 on all my machines as I have a gigabit connection


 

# Misc options
Color
CheckSpace
VerbosePkgLists
ILoveCandy
ParallelDownloads = 20

 

Using 100 parallels in Action: https://i.imgur.com/qq4g1R5.mp4  (Just installing gnome in a vm to see how fast it would go).

  • +1 1
Link to post
Share on other sites
abarbarian
Posted (edited)
11 minutes ago, securitybreach said:

Yeah, I forgot to post that last week. I first used 10 and then worked my way up to 100 on Linode VPS, I finally settled on 20 on all my machines as I have a gigabit connection


 



# Misc options
Color
CheckSpace
VerbosePkgLists
ILoveCandy
ParallelDownloads = 20

 

Using 100 parallels in Action: https://i.imgur.com/qq4g1R5.mp4  (Just installing gnome in a vm to see how fast it would go).

 

Wow yer downloads must be as fast as .................................................................................  😎

Edited by abarbarian
Link to post
Share on other sites
securitybreach
1 minute ago, abarbarian said:

 

Wow yer downloads must be as fast as ................................................................................. I can nto get the link to work in FF ? 😎

 

Odd as its just an imgur link. Open the link in another tab

Link to post
Share on other sites
abarbarian
12 minutes ago, securitybreach said:

Odd as its just an imgur link. Open the link in another tab

 

Working now, must have been a stray gremlin.

 

However,
 

# Misc options
#UseSyslog
Color
TotalDownload
CheckSpace
#VerbosePkgLists
ParallelDownloads = 10

 

# Misc options
#UseSyslog
Color
TotalDownload
CheckSpace
#VerbosePkgLists
ParallelDownloads=10

 

gets me

 

warning: config file /etc/pacman.conf, line 37: directive 'ParallelDownloads' in section 'options' not recognised

 

?????????????????

Link to post
Share on other sites
securitybreach
19 minutes ago, abarbarian said:

 

Working now, must have been a stray gremlin.

 

However,
 


# Misc options
#UseSyslog
Color
TotalDownload
CheckSpace
#VerbosePkgLists
ParallelDownloads = 10

 


# Misc options
#UseSyslog
Color
TotalDownload
CheckSpace
#VerbosePkgLists
ParallelDownloads=10

 

gets me

 


warning: config file /etc/pacman.conf, line 37: directive 'ParallelDownloads' in section 'options' not recognised

 

?????????????????

 

Sounds like you haven't updated pacman:

 

pacman -Qi pacman

 

Link to post
Share on other sites
abarbarian
Posted (edited)
28 minutes ago, securitybreach said:

Sounds like you haven't updated pacman:

 

Yeah I realised that eventually. Did the update and changed out the .pacnew file.

 

Tried to do an update check and now me AUR stuff don't seem to be updating,

 

QJMxAVh.png

 

9s6gPpa.png

 

?????????????????

 

Hmm looks like it is a problem with pacaur.

 

-->paci steam
:: Package steam not found in repositories, trying AUR...
:: resolving dependencies...
auracle: error while loading shared libraries: libalpm.so.12: cannot open shared object file: No such file or directory
auracle: error while loading shared libraries: libalpm.so.12: cannot open shared object file: No such file or directory
auracle: error while loading shared libraries: libalpm.so.12: cannot open shared object file: No such file or directory
:: no results found for steam

 

🤕

Edited by abarbarian
Link to post
Share on other sites
securitybreach
8 hours ago, abarbarian said:

 

Yeah I realised that eventually. Did the update and changed out the .pacnew file.

 

Tried to do an update check and now me AUR stuff don't seem to be updating,

 

QJMxAVh.png

 

 

?????????????????

 

Well, like it mentions... "auracle: error while loading shared libraries: libalpm.so"

 

You just need to reinstall auracle, I had to do the same with yay

 

wget https://aur.archlinux.org/cgit/aur.git/snapshot/auracle-git.tar.gz\
tar -xzf auracle-git.tar.gz
cd auracle-git
makepkg -si
Link to post
Share on other sites
abarbarian
On 6/8/2021 at 1:27 PM, securitybreach said:

You just need to reinstall auracle, I had to do the same with yay

 

Yep I did a rebuild but pacaur would not rebuild. So I left it overnight and tired again and this time things worked in the main. Pacaur can update and install most things However there is a problem with steam.

 

 lib32-orc is not present in AUR -- skipping
:: lib32-p11-kit is not present in AUR -- skipping
:: lib32-pam is not present in AUR -- skipping
:: lib32-pango is not present in AUR -- skipping
:: lib32-pcre is not present in AUR -- skipping
:: lib32-pixman is not present in AUR -- skipping
:: lib32-polkit is not present in AUR -- skipping
:: lib32-readline is not present in AUR -- skipping
:: lib32-rest is not present in AUR -- skipping
:: lib32-sdl2 is not present in AUR -- skipping
:: lib32-sqlite is not present in AUR -- skipping
:: lib32-systemd is not present in AUR -- skipping
:: lib32-tdb is not present in AUR -- skipping
:: lib32-util-linux is not present in AUR -- skipping
:: lib32-v4l-utils is not present in AUR -- skipping
:: lib32-vkd3d is not present in AUR -- skipping
:: lib32-vulkan-icd-loader is not present in AUR -- skipping
:: lib32-wayland is not present in AUR -- skipping
:: lib32-xz is not present in AUR -- skipping
:: lib32-zlib is not present in AUR -- skipping
:: lib32-zstd is not present in AUR -- skipping
:: steam is not present in AUR -- skipping
:: wine-staging is not present in AUR -- skipping
:: winetricks is not present in AUR -- skipping
 there is nothing to do

 

The install of steam I have runs ok but it will not update. I am guessing that the Arch version of steam has not been updated with the pacman 6 stuff. I will give it a couple of days and try again. Hopefully it will sort itself out.

😎

 

Link to post
Share on other sites
securitybreach

Nope, I'm running the latest version of steam with no problems.

 

Link to post
Share on other sites
securitybreach

Of I know your problem. The multilib repo is disabled in pacman.conf. You must of let it overwrite your config file. That's why stream won't update and you are getting all of the lib32 packages not found.

Link to post
Share on other sites
abarbarian
28 minutes ago, securitybreach said:

Of I know your problem. The multilib repo is disabled in pacman.conf. You must of let it overwrite your config file. That's why stream won't update and you are getting all of the lib32 packages not found.

 

Almost correct. I had done the .pacnew thing but forgot,

 

#[multilib]
Include = /etc/pacman.d/mirrorlist

 

😅🤣😂

Link to post
Share on other sites
securitybreach

Right and remove the # before [multilib]

Link to post
Share on other sites
abarbarian

Blimey what wiv the .zst and parallel(10) downloads updating is super fast. 😎

Link to post
Share on other sites
abarbarian
Posted (edited)
20 hours ago, securitybreach said:

.zst?

 

as in,

 

auracle-git-r366.8739929-1-x86_64.pkg.tar.zst

 

😎

Edited by abarbarian
Link to post
Share on other sites
securitybreach

Ah, I don't use many AUR packages so haven't ran across the new archive yet.

Link to post
Share on other sites
sunrat

Good to see Arch is catching up. My recent Debian upgrade came down at 25MB/s. 😎😉 I only have a meagre 256Mb/s pipe though so can't test how fast it would be with gigabit.

Link to post
Share on other sites
securitybreach

Well I wouldn't say catching up as I always had fast updates, just only one at a time downloaded

Link to post
Share on other sites
abarbarian
23 hours ago, securitybreach said:

Ah, I don't use many AUR packages so haven't ran across the new archive yet.

 

On 6/16/2021 at 9:14 AM, abarbarian said:

auracle-git

 

Thought you rebuilt and installed the latest above. Did you not check your install or did things happen so fast you could not keep up 🤣

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...