Keka, p7zip, Cores, Performance

Talk about Keka
Forum rules
Talk about Keka here. For bugs go to Issues.
KBHB
Keka & Me
Keka & Me
Posts: 3
Joined: Wed Mar 07, 2018 10:51 pm

Keka, p7zip, Cores, Performance

Postby KBHB » Wed Mar 07, 2018 11:07 pm

Hi,

at the moment I have do handle large files (150 GB) and make them smaller.
On Linux I used pbzip2, the p in the name means parallel multicore.
Stuffing uses all my 4 cores by 100% each (400%)
On Linux it took the hole night using bzip2. With pbzip2 it took only 2,5 h

On macOS Keka uses 4 cores but not with full power (ca. 100% - 140%)
But my p7zip commandline tool I got on my macbook using homebrew uses 4 * 100% (400%)
Keka is based on 7zip right?

Any chance to make Keka work faster by using all cores on full power?

Thanx

KBHB

User avatar
aone
Mr. Keka
Mr. Keka
Posts: 227
Joined: Sun Feb 26, 2012 8:42 pm
Contact:

Re: Keka, p7zip, Cores, Performance

Postby aone » Thu Mar 08, 2018 7:13 am

Are you compressing in Bzip2 format on both Linux and Mac?
aone ~

KBHB
Keka & Me
Keka & Me
Posts: 3
Joined: Wed Mar 07, 2018 10:51 pm

Re: Keka, p7zip, Cores, Performance

Postby KBHB » Thu Mar 08, 2018 9:26 am

I made further tests
Macbook Pro 15", i7, 4 cores 2,3 Ghz
source: SSD
target: SSD on USB3

pbzip2 decompression and compression uses only about 100% CPU (4 * 25)
compressing a VM in 7zip-format Keka uses 520% CPU (full power)

With p7zip in terminal I am getting all cores under full power even extracting bz2-files

greetings

KBHB

User avatar
aone
Mr. Keka
Mr. Keka
Posts: 227
Joined: Sun Feb 26, 2012 8:42 pm
Contact:

Re: Keka, p7zip, Cores, Performance

Postby aone » Thu Mar 08, 2018 9:42 am

Thanks for all your feedback KBHB!

Note that for tarballs (tgz or tbz2) the current stable version of Keka (1.0.13 as of this writing) is using bsdtar, that is not multithread. Only for on file compression in gzip or bzip2 the p7zip binary is used.

The current beta uses pigz and lbzip2 for both gz and bzip2 that are multithread. You can also chose to use pbzip2 instead of lbzip2: https://github.com/aonez/Keka/wiki/Hidd ... extraction.

You can try the beta right here: http://beta.kekaosx.com
aone ~

KBHB
Keka & Me
Keka & Me
Posts: 3
Joined: Wed Mar 07, 2018 10:51 pm

Re: Keka, p7zip, Cores, Performance

Postby KBHB » Thu Mar 08, 2018 11:22 am

Hi anone,

thanx for the reply.
bzip2 is the fileformat I am getting in compressed form at the moment. I have to decompress them here.
Only for on file compression in gzip or bzip2 the p7zip binary is used.

So decompression of bzip2 is not using the p7zip?
As far as I ca see, it does. 4 Cores are involved, but not 100% each. I can see that on htop.

I tested the keka compression into gzip2. About 100% CPU only instead auf 400%
The filextension is .tbz2... t means tar?
So the tar-part is single threaded?
So one core should go 100%

I do not understand how the Mac ist using it's Cores


Thanx for the Link to the new beta5.
That one is runnig with full speed!

A suggestion for the next update:
Presets with some settings like number of cores, algorythm, max CPU%, CPU-priority (nice parameter) would be great.
Just make the switches of the CLI tools work.
Sometimes You want it fast, but the Mac is not usable for other things meanwhile
Sometimes You like to work and in the backround You like to compress something

Again, thank YOu very much for the fast help and the Beta!

KBHB

alessiomarkz
I know Keka
I know Keka
Posts: 1
Joined: Mon Apr 23, 2018 11:59 am

Re: Keka, p7zip, Cores, Performance

Postby alessiomarkz » Mon Apr 23, 2018 1:07 pm

It was all of those which perform that cores


Return to “Chat”

Who is online

Users browsing this forum: No registered users and 1 guest