humikacpIT, Linux, Script - linux

Linux command collection

matrilinux

Contains:

This is not a standalone topic. Here I will write down a few often used, not common commands.

[Postgres]
pg_dump -U postgres -p 9999 user_table > user_table_backup.sql Create dump from postgres with postgres user which connect on port 9999 from user_table and redirect output to user_table_backup.sql.
select * from pg_shadow; Check postgres users.
[Common] – Create / use time-stamp:

In operation we have a lot of case, when better if we have readable-filenames. Like we want to create database-dumps or create ldap backup with timestamp. So here is what I use:

dump-$( date '+%Y-%m-%d_%H-%M-%S' ).sql

Result: dump-2016-01-19_20-36-52.sql

Explanation: YYYY[year]-MM[month]-DD[day]_HH[hour]-MM[min]-SS[sec].sql

[LDAP] – Delete form LDAP:

Not as easy as the name of it. So you must to create an *.ldif file which contains your entry what you would like to delete from LDAP. This example will explain how to delete group from LDAP:

Command:

ldapdelete -f delete_group.ldif -W -D "cn=Devops, dc=norris,dc=hu" -v -Z

where “delete_group.ldif” contain:

cn=report,ou=blog,o=platform,dc=devops,dc=hu
[yaml] – Encode / decode GPG-encrypted password

Yaml language is often used, like in puppet. It is also usable to store password in encrypted state. Here is a short tutorial, how to crypt / decrypt password.

 

[root@test] /home/pmikaczo #  eyaml encrypt -n gpg -s "devops.norris.hu" --gpg-recipients test.tesgpgkey
string: ENC[GPG,hQEMA76syyq/z6lnAQf9EcmNh15ijlcd1WDDpFeYFrG20UkGeP/SXPnD82tpo/z8jhZw05DdUJTCNDWFt37B6O2GQzIOIbW/PcUkjxKqOudSnYT/OFh9QdnOYulqQYmS2EUrtKXIpS2hjMbOFiB8wPbqwQ72Dc7Kfm7IJ8IebxbwcsMpahO2wUz3bZqtkUYyfyWyagzfw0W4n4dFzpM9JpEOeIoy+A+d4OuULRESkki6TxVqorw4CRd+8iw79/K6/a56AqE3YtyalZIjsw433kasdgjla5t3kFMYU6gRKkQFP2+jcTQz0dx1fTMTkiE+/j568gslwE7pMaEdJ+x1t0sJk9r+GDAe6tjt8gAW/NJOAaIPzVgWLnXVABeXBnn6bx+W2zltFczgOtXcs5XRRQEKDwld1l2HJjbRv4D/nEelt2ASEZqHNUwMxqWoZyN3t7YzToQ3+QCPYdmlnLWr]

OR

block: >
    ENC[GPG,hQEMA76syyq/z6lnAQf9EcmNh15ijlcd1WDDpFeYFrG20UkGeP/SXPnD82tp
    o/z8jhZw05DdUJTCNDWFt37B6O2GQzIOIbW/PcUkjxKqOudSnYT/OFh9QdnO
    YulqQYmS2EUrtKXIpS2hjMbOFiB8wPbqwQ72Dc7Kfm7IJ8IebxbwcsMpahO2
    wUz3bZqtkUYyfyWyagzfw0W4n4dFzpM9JpEOeIoy+A+d4OuULRESkki6TxVq
    orw4CRd+8iw79/K6/a56AqE3YtyalZIjsw433kasdgjla5t3kFMYU6gRKkQF
    P2+jcTQz0dx1fTMTkiE+/j568gslwE7pMaEdJ+x1t0sJk9r+GDAe6tjt8gAW
    /NJOAaIPzVgWLnXVABeXBnn6bx+W2zltFczgOtXcs5XRRQEKDwld1l2HJjbR
    v4D/nEelt2ASEZqHNUwMxqWoZyN3t7YzToQ3+QCPYdmlnLWr]
[root@test] /home/pmikaczo #  eyaml decrypt -n gpg -s  ENC[GPG,hQEMA76syyq/z6lnAQf9EcmNh15ijlcd1WDDpFeYFrG20UkGeP/SXPnD82tpo/z8jhZw05DdUJTCNDWFt37B6O2GQzIOIbW/PcUkjxKqOudSnYT/OFh9QdnOYulqQYmS2EUrtKXIpS2hjMbOFiB8wPbqwQ72Dc7Kfm7IJ8IebxbwcsMpahO2wUz3bZqtkUYyfyWyagzfw0W4n4dFzpM9JpEOeIoy+A+d4OuULRESkki6TxVqorw4CRd+8iw79/K6/a56AqE3YtyalZIjsw433kasdgjla5t3kFMYU6gRKkQFP2+jcTQz0dx1fTMTkiE+/j568gslwE7pMaEdJ+x1t0sJk9r+GDAe6tjt8gAW/NJOAaIPzVgWLnXVABeXBnn6bx+W2zltFczgOtXcs5XRRQEKDwld1l2HJjbRv4D/nEelt2ASEZqHNUwMxqWoZyN3t7YzToQ3+QCPYdmlnLWr] --gpg-recipients test.tesgpgkey
devops.norris.hu

For more practice related to eyaml hiera data crypt / decrypt topic, please visit this site.

[Search] – common
grep -Ril "WeeklyCycleAfterBackup" ./

 – Find “StRiNg” on the give path’s all file (inside file!)

[Search] – Deleted files which blocked by used processes without lsof

Typically when you deleted some file to free up some space, but it is not appeared as usable, free space.

[root@localhost locale]# find /proc/*/fd -xtype f -printf "%l\n" | grep -P '^/(?!dev|proc|sys)' | sort | uniq -c | sort -n | grep deleted
      1 /tmp/ffiHeQcW7 (deleted)
[root@localhost locale]# find /proc/*/fd -xtype f -printf "%l\n" | grep -P '^/(?!dev|proc|sys)' | sort | uniq -c | sort -n
      1 /etc/udev/hwdb.bin
      1 /run/crond.pid
      1 /run/lvmetad.pid
      1 /tmp/ffiHeQcW7 (deleted)
      1 /var/lib/NetworkManager/dhclient-2a8aed26-da88-488f-a758-a211142ba313-enp0s8.lease
      1 /var/lib/NetworkManager/dhclient-9574cf80-c8d2-4f5d-9250-b1b4fe4bf02e-enp0s3.lease
      1 /var/lib/postfix/master.lock
      1 /var/log/audit/audit.log
      1 /var/log/cron
      1 /var/log/maillog
      1 /var/log/messages
      1 /var/log/secure
      1 /var/log/tuned/tuned.log
      1 /var/log/wpa_supplicant.log
      1 /var/spool/postfix/pid/master.pid
      2 /run/log/journal/37c661fd155048cc9bc85380b10cd24f/system.journal
[root@localhost locale]# find /proc/*/fd -xtype f -printf "%l\n" | grep -P '^/(?!dev|proc|sys)' | sort | uniq -c | sort -n | grep deleted
      1 /tmp/ffiHeQcW7 (deleted)
[Nagios] – check before restart

You can check the actual nagios configuration stored on config-files with this command. It is useful before you would like to restart it avoid outage of monitoring.

nagios -v /etc/nagios/nagios.cfg
[Space]

Check free space in shorted by size:

[root@localhost /]# du -Sh | sort -rh | head -n 50
du: cannot access ‘./proc/967/task/967/fd/4’: No such file or directory
du: cannot access ‘./proc/967/task/967/fdinfo/4’: No such file or directory
du: cannot access ‘./proc/967/fd/4’: No such file or directory
du: cannot access ‘./proc/967/fdinfo/4’: No such file or directory
102M    ./usr/lib/locale
98M     ./boot
66M     ./usr/lib64
65M     ./usr/bin
47M     ./var/cache/yum/x86_64/7/updates/gen
45M     ./var/lib/rpm
39M     ./usr/sbin
37M     ./usr/lib/firmware
26M     ./var/cache/yum/x86_64/7/base/gen
24M     ./var/cache/yum/x86_64/7/epel/gen
19M     ./usr/share/backgrounds
15M     ./root/.gem/specs/rubygems.org%443
11M     ./usr/lib/udev/hwdb.d
9.5M    ./usr/lib/firmware/brcm
9.2M    ./usr/lib64/python2.7
9.1M    ./var/cache/yum/x86_64/7/updates
9.0M    ./usr/share/cracklib
8.2M    ./usr/libexec/postfix
8.0M    ./usr/lib/firmware/bnx2x
7.3M    ./usr/lib64/gconv
7.0M    ./usr/share/hwdata
6.8M    ./usr/lib64/httpd/modules
6.7M    ./usr/share/perl5/pod
6.7M    ./usr/lib/systemd
6.7M    ./etc/udev
6.3M    ./usr/share/i18n/locales
6.3M    ./run/log/journal/37c661fd155048cc9bc85380b10cd24f
6.2M    ./usr/lib/firmware/liquidio
6.1M    ./usr/share/man/man1
5.5M    ./var/cache/yum/x86_64/7/base
5.4M    ./usr/lib64/nagios/cgi-bin
5.3M    ./var/cache/yum/x86_64/7/epel
5.1M    ./usr/lib/firmware/radeon
5.0M    ./usr/lib/grub/i386-pc
4.8M    ./etc/selinux/targeted/modules/active/modules
4.4M    ./usr/lib/firmware/mrvl
4.2M    ./usr/lib/firmware/amdgpu
4.0M    ./usr/share/locale/fr/LC_MESSAGES
3.9M    ./usr/share/locale/uk/LC_MESSAGES
3.9M    ./usr/lib64/python2.7/lib-dynload
3.7M    ./etc/selinux/targeted/policy
3.6M    ./usr/lib/firmware/cxgb4
3.4M    ./usr/share/locale/es/LC_MESSAGES
3.4M    ./usr/lib/firmware/asihpi
3.3M    ./usr/share/locale/pl/LC_MESSAGES
3.3M    ./usr/share/i18n/charmaps
3.3M    ./usr/lib/modules/3.10.0-327.el7.x86_64/kernel/drivers/hwmon
3.3M    ./usr/lib/modules/3.10.0-327.36.2.el7.x86_64/kernel/drivers/hwmon
3.3M    ./root/.gem/specs/api.rubygems.org%443
3.3M    ./boot/grub2/locale
[root@localhost /]#
[Find]
find /home/pmaster/ -name "*[0-9][0-9]" -mtime +2 -size +50M  -exec echo {} \;

*[0-9][0-9] –> Patter, which find all file-name with end of two digit number

[root@localhost pmaster]# find /home/pmaster/ -name "*[0-9][0-9]"  -exec echo {} \;
/home/pmaster/12
[root@localhost pmaster]# ll
total 12
-rw-r--r--. 1 root root  17 Nov 12 11:49 0305_log
-rw-r--r--. 1 root root   7 Nov 12 11:53 12
-rw-r--r--. 1 root root 101 Nov 12 11:49 test

-mtime +2 –> All file which’s last modification time is older than 2 day.

[root@localhost pmaster]# ls -la
total 24
drwx------. 2 pmaster pmaster  94 Nov 12 11:53 .
drwxr-xr-x. 3 root    root     20 Oct 20 09:25 ..
-rw-r--r--. 1 root    root     17 Nov 12 11:49 0305_log
-rw-r--r--. 1 root    root      7 Nov 12 11:53 12
-rw-r--r--. 1 pmaster pmaster  18 Nov 20  2015 .bash_logout
-rw-r--r--. 1 pmaster pmaster 193 Nov 20  2015 .bash_profile
-rw-r--r--. 1 pmaster pmaster 231 Nov 20  2015 .bashrc
-rw-r--r--. 1 root    root    101 Nov 12 11:49 test
[root@localhost pmaster]# find /home/pmaster/ -mtime +2  -exec echo {} \;
/home/pmaster/.bash_logout
/home/pmaster/.bash_profile
/home/pmaster/.bashrc

-size +50M –> All file which grater than 50Mb.

[root@localhost locale]# find /usr/lib/locale/ -size +50M  -exec echo {} \;
/usr/lib/locale/locale-archive
[root@localhost locale]# ls -ltrha
total 102M
-rw-r--r--.  1 root root 102M Oct 20 09:38 locale-archive
-rw-r--r--.  1 root root    0 Oct 20 09:38 locale-archive.tmpl
dr-xr-xr-x. 26 root root 4.0K Nov 12 09:51 ..
-rw-r--r--.  1 root root  183 Nov 12 11:59 devops.norris.hu
drwxr-xr-x.  2 root root   76 Nov 12 11:59 .
[root@localhost locale]# find /usr/lib/locale/ -size +50M  -exec echo {} \;
/usr/lib/locale/locale-archive

-exec echo {} \; –> echo out result. Good practice that before you use delete / copy / compress / modify, echo out the result. After it replace echo with your command.

[root@localhost locale]# ls -ltrha
total 102M
-rw-r--r--.  1 root root 102M Oct 20 09:38 locale-archive
-rw-r--r--.  1 root root    0 Oct 20 09:38 locale-archive.tmpl
dr-xr-xr-x. 26 root root 4.0K Nov 12 09:51 ..
-rw-r--r--.  1 root root  183 Nov 12 11:59 devops.norris.hu
drwxr-xr-x.  2 root root   76 Nov 12 11:59 .
[root@localhost locale]# find /usr/lib/locale/ -size +50M  -exec echo {} \;
/usr/lib/locale/locale-archive
[root@localhost locale]# find /usr/lib/locale/ -size +50M  -exec gzip {} \;
[root@localhost locale]# ls -ltrh
total 23M
-rw-r--r--. 1 root root 23M Oct 20 09:38 locale-archive.gz
-rw-r--r--. 1 root root   0 Oct 20 09:38 locale-archive.tmpl
-rw-r--r--. 1 root root 183 Nov 12 11:59 devops.norris.hu

Leave a Reply