To get a higher compression ratio and save a greater amount of disk space, more CPU processing time will be required. There is an important trade off here between the compression levels between CPU processing time and the compression ratio. Compression level 9 on the other hand is the best possible compression level, however it will take the longest amount of time to complete. A compression level of 1 indicates that the compression will be fastest but the compression ratio will not be as high so the file size will be larger. The linux-3.18.19.tar file was compressed and decompressed 9 times each by gzip, bzip2 and xz at each available compression level from 1 to 9. This file was 580,761,600 Bytes in size prior to compression. With XZ it is possible to specify the amount of threads to run which can greatly increase performance, for further information see example 9 here.Īll tests were performed on linux-3.18.19.tar, a copy of the Linux kernel from. The server had 4 CPU cores and 16GB of available memory, during the tests only one CPU core was used as all of these tools run single threaded by default, while testing this CPU core would be fully utilized. The test server was running CentOS with kernel 3.10.0-229.11.1 in use, all updates to date are fully applied. Gcc: error trying to exec 'cc1plus': execvp: No such file or directoryĮrror: command 'gcc' failed with exit status 1Ĭommand "/usr/bin/python3.6 -u -c "import setuptools, tokenize _file_='/tmp/pip-install-e07ios_o/python-snappy/setup.py' f=getattr(tokenize, 'open', open)(_file_) code=f.read().replace('\r\n', '\n') f.close() exec(compile(code, _file_, 'exec'))" install -record /tmp/pip-record-k7rd94ik/install-record.Gzip, Bzip2 and XZ are all popular compression tools used in UNIX based operating systems, but which should you use? Here we are going to benchmark and compare them against each other to get an idea of the trade off between the level of compression and time taken to achieve it.įor further information on how to use gzip, bzip2 or xz see our guides below: Gcc -pthread -Wno-unused-result -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector -param=ssp-buffer-size=4 -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -I/usr/include/python3.6m -c snappy/ -o build/temp.linux-x86_64-3.6/snappy/snappymodule.o usr/lib64/python3.6/distutils/dist.py:261: UserWarning: Unknown distribution option: 'cffi_modules'Ĭreating build/lib.linux-x86_64-3.6/snappyĬopying snappy/snappy_cffi.py -> build/lib.linux-x86_64-3.6/snappyĬopying snappy/snappy_formats.py -> build/lib.linux-x86_64-3.6/snappyĬopying snappy/snappy.py -> build/lib.linux-x86_64-3.6/snappyĬopying snappy/_init_.py -> build/lib.linux-x86_64-3.6/snappyĬopying snappy/snappy_cffi_builder.py -> build/lib.linux-x86_64-3.6/snappyĬopying snappy/_main_.py -> build/lib.linux-x86_64-3.6/snappyĬopying snappy/hadoop_snappy.py -> build/lib.linux-x86_64-3.6/snappyĬreating build/temp.linux-x86_64-3.6/snappy errorĬomplete output from command /usr/bin/python3.6 -u -c "import setuptools, tokenize _file_='/tmp/pip-install-e07ios_o/python-snappy/setup.py' f=getattr(tokenize, 'open', open)(_file_) code=f.read().replace('\r\n', '\n') f.close() exec(compile(code, _file_, 'exec'))" install -record /tmp/pip-record-k7rd94ik/install-record.txt -single-version-externally-managed -compile: Running setup.py install for python-snappy. Installing collected packages: python-snappy I'm trying to install python-snappy in Amazon Linux EC2 instance but I keep getting the below error, Any idea how to fix this issue: sudo python3.6 -m pip install python-snappy
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |