Colection of Opensource Project

https://saradmin.ru/?p=2851

Protocols

IMAP/POP3

Dovecot (http://www.dovecot.org/)

IMAP and POP3 server written primarily with security in mind.

Cyrus (http://cyrusimap.org/)

Intended to be run on sealed servers, where normal users are not permitted to log in.

Qpopper (http://www.eudora.com/products/unsupported/qpopper/)

One of the oldest and most popular server implementations of POP3.

DBMail (https://github.com/pjstevns/dbmail)

Fast and scalable email services, storage of mail messages in a relational database.

Courier (http://www.courier-mta.org/imap/)

Fast, scalable, enterprise IMAP and POP3 server.

HTTP

Nginx (http://nginx.org/)

Reverse proxy, load balancer, HTTP cache, and web server.


GWAN (http://gwan.com)

Tiny, fast & efficient web & app server. All in one 300k executable.

Varnish (https://www.varnish-cache.org/)

HTTP based web application accelerator focusing on optimizing caching and compression.

Caddy (https://caddyserver.com/)

Caddy is a lightweight, general-purpose web server.

Cherokee (http://cherokee-project.com/)

Lightweight, high-performance web server/reverse proxy.

Apache (http://httpd.apache.org/)

Most popular web server.

HAProxy (http://www.haproxy.org/)

Software based load Balancing, SSL offloading and performance optimization, compression, and general web routing.

uWSGI (https://github.com/unbit/uwsgi/)

The uWSGI project aims at developing a full stack for building hosting services.

Tomcat (http://tomcat.apache.org)

Apache Tomcat is an open source software implementation of the Java Servlet and JavaServer Pages technologies.

Lighttpd (http://www.lighttpd.net/)

Web server more optimized for speed-critical environments.

SMTP

Maildrop (https://github.com/m242/maildrop)

Open Source disposable email SMTP server, also useful for development.

MailHog (https://github.com/mailhog/MailHog)

Inspired by MailCatcher written in Go, SMTP MTA, web UI and retrieve them with the JSON API.

Haraka (http://haraka.github.io/)

A high-performance, pluginable SMTP server written in JavaScript.

Postfix (http://www.postfix.org/)

Fast, easy to administer, and secure Sendmail replacement.

MailDev (http://djfarrelly.github.io/MailDev/)

SMTP Server + Web Interface for viewing and testing emails during development.

OpenSMTPD (https://opensmtpd.org/)

Secure SMTP server implementation from the OpenBSD project.

Qmail (http://cr.yp.to/qmail.html)

Secure Sendmail replacement.

Exim (http://www.exim.org/)

Message transfer agent (MTA) developed at the University of Cambridge.

MailCatcher (http://mailcatcher.me/)

Ruby gem that deploys a simply SMTP MTA gateway that accepts all mail and displays in web interface. Useful for debugging or development.

Sendmail (http://www.sendmail.com/sm/open_source/)

Message transfer agent (MTA).

iRedMail (http://www.iredmail.org/)

An open source mailserver solution.NEW

DNS

PowerGate (https://github.com/bobsta63/powergate)

PowerGate is a simple web application built for managing PowerDNS records.

Designate (https://wiki.openstack.org/wiki/Designate)

DNS REST API that support several DNS servers as its backend.

PowerDNS (https://www.powerdns.com/)

DNS server with a variety of data storage back-ends and load balancing features.

NSD (http://www.nlnetlabs.nl/projects/nsd/)

Authoritative only, high performance, simple name server.

Yadifa (http://yadifa.eu/)

Lightweight authoritative Name Server with DNSSEC capabilities powering the .eu top-level domain.

Knot (https://www.knot-dns.cz/)

High performance authoritative-only DNS server.

Unbound (http://unbound.net/)

Validating, recursive, and caching DNS resolver.

djbdns (http://cr.yp.to/djbdns.html)

A collection of DNS applications, including tinydns.

Bind (https://www.isc.org/downloads/bind/)

The most widely used name server software.

dnsmasq (http://www.thekelleys.org.uk/dnsmasq/doc.html)

A lightweight service providing DNS, DHCP and TFTP services to small-scale networks.

LDAP

Fusion Directory (http://www.fusiondirectory.org)

Improve the Management of the services and the company directory based on OpenLDAP.

pGina (http://pgina.org/)

Pluggable credential Provider.

FreeIPA (http://www.freeipa.org)

FreeIPA is an integrated security information management solution combining Linux (Fedora), 389 Directory Server, MIT Kerberos, NTP, DNS, Dogtag (Certificate System).

OpenLDAP (http://openldap.org/)

Developed by the OpenLDAP Project.

OpenDJ (http://opendj.forgerock.org/)

Fork of OpenDS.

389 Directory Server (http://port389.org)

Developed by Red Hat.

Apache Directory Server (http://directory.apache.org/)

Apache Software Foundation project written in Java.

OpenDS (https://opends.java.net/)

Another directory server written in Java.

SSH

ssh-cert-authority (https://github.com/cloudtools/ssh-cert-authority)

A democratic SSH certificate authority.

autossh (http://www.harding.motd.ca/autossh/)

Automatically respawn ssh session after network interruption.

DSH (http://www.netfort.gr.jp/~dancer/software/dsh.html.en)

Dancer’s shell / distributed shell — Wrapper for executing multiple remote shell commands from one command line.

sshmux (https://github.com/joushou/sshmux)

SSH multiplexing library, allowing you to write «jump host» style proxies.

Clustershell (http://cea-hpc.github.io/clustershell/)

Run commands on multiple hosts in parallel. Clustershell can operate on predefined groups of hosts.

Mosh (http://mosh.mit.edu/)

The mobile shell.

putty (http://www.chiark.greenend.org.uk/~sgtatham/putty/)

Free and open source terminal emulator.

VPN

SoftEther (https://www.softether.org/)

Multi-protocol software VPN with advanced features.

Pritunl (http://pritunl.com/)

OpenVPN based solution. Easy to set up.

FreeLan (https://github.com/freelan-developers/freelan)

Full-mesh, secure, easy-to-setup, multi-platform, open-source, highly-configurable VPN software.

PeerVPN (https://github.com/peervpn/peervpn)

Virtual network built by PeerVPN uses a full mesh topology.

tinc (http://www.tinc-vpn.org/)

Distributed p2p VPN.

strongSwan (http://www.strongswan.org/)

Complete IPsec implementation for Linux.

OpenVPN (https://community.openvpn.net)

Uses a custom security protocol that utilizes SSL/TLS for key exchange.


Cloud and Virtualization

Cloud Computing

OpenNode (http://opennodecloud.com)

Builds open-source infrastructure management software and implements cloud systems.

The Foreman (http://theforeman.org/)

Foreman is a complete lifecycle management tool for physical and virtual servers. FOSS.

OpenStack (https://www.openstack.org/)

Open source software for building private and public clouds.

Tsuru (https://tsuru.io)

Tsuru is an extensible and open source Platform as a Service software.

CoreOS (https://coreos.com/)

Open Source Projects for Linux Containers

OpenNebula (http://opennebula.org/)

An user-driven cloud management platform for sysadmins and devops.

Flynn (https://flynn.io)

Open source PaaS

Cracow Cloud One (https://github.com/cc1-cloud/cc1/)

The CC1 system provides a complete solution for Private Cloud Computing.

OpenShift (http://www.openshift.org)

OpenShift is a platform as a service product from Red Hat.

Archipel (http://archipelproject.org/)

Manage and supervise virtual machines using Libvirt.

Mesos (http://mesos.apache.org/)

Develop and run resource-efficient distributed systems.

CloudStack (http://cloudstack.apache.org/)

Cloud computing software for creating, managing, and deploying infrastructure cloud services.

Cobbler (http://www.cobblerd.org/)

Cobbler is a Linux installation server that allows for rapid setup of network installation environments.

Project-FiFo (https://project-fifo.net)

Open source SmartOS cloud management with a focus on availability.

AppScale (http://github.com/AppScale/appscale)

Open source cloud software with Google App Engine compatibility.

Eucalyptus (https://www.eucalyptus.com/)

Open source private cloud software with AWS compatibility.

Cloud Orchestration

Mina (http://nadarei.co/mina/)

Really fast deployer and server automation tool (rake based).

Overcast (http://andrewchilds.github.io/overcast/)

Deploy VMs across different cloud providers, and run commands and scripts across any or all of them in parallel via SSH.

Rocketeer (http://rocketeer.autopergamene.eu/)

PHP task runner and deployment tool.

Rundeck (http://rundeck.org/)

Simple orchestration tool.

BOSH (http://docs.cloudfoundry.org/bosh/)

IaaS orchestration platform originally written for deploying and managing Cloud Foundry PaaS, but also useful for general purpose distributed systems.

SaltStack (http://www.saltstack.com/)

Extremely fast and scalable systems and configuration management software.

Cloudify (http://www.getcloudify.org/)

Open source TOSCA-based cloud orchestration software platform written in Python and YAML.

StackStorm (http://stackstorm.com/)

Event Driven Operations and ChatOps platform for infrastructure management. Written in Python.

Capistrano (http://www.capistranorb.com/)

Deploy your application to any number of machines simultaneously, in sequence or as a rolling set via SSH (rake based).

CloudSlang (http://www.cloudslang.io)

Flow-based orchestration tool for managing deployed applications, with Docker capabilities.

Marathon (https://mesosphere.github.io/marathon/)

A cluster-wide init and control system for services in cgroups or Docker containers.

Juju (https://juju.ubuntu.com/)

Cloud orechestration tool which manages services as charms, YAML configuration and deployment script bundles.

MCollective (http://puppetlabs.com/mcollective)

Ruby framework to manage server orchestration, developed by Puppet labs.

Xen Orchestra (https://xen-orchestra.com)

Xen Orchestra offers a powerful web UI for controlling a complete XenServer or Xen infrastructure.

Cloud Storage

sandstorm (https://github.com/sandstorm-io/sandstorm)

Personal Cloud Sandbox, install apps to create documents, spreadsheets, blogs, git repos, task lists and more.

Syncthing (http://syncthing.net/)

Open Source system for private, encrypted and authenticated distrobution of data.

Pydio (https://pyd.io)

Pydio is a mature open source software solution for file sharing and synchronization.

Swift (http://docs.openstack.org/developer/swift/)

A highly available, distributed, eventually consistent object/blob store.

git-annex assistant (http://git-annex.branchable.com/assistant/)

A synchronised folder on each of your OSX and Linux computers, Android devices, removable drives, NAS appliances, and cloud services.

ownCloud (https://owncloud.org)

Provides universal access to your files via the web, your computer or your mobile devices.

Seafile (http://seafile.com)

Another Open Source Cloud Storage solution.

SparkleShare (http://sparkleshare.org/)

Provides cloud storage and file synchronization services. By default, it uses Git as a storage backend.

Nextcloud (https://nextcloud.com/)

Next cloud is a fork of OwnCloud.NEW

Virtualization

Ganeti (https://code.google.com/p/ganeti/)

Cluster virtual server management software tool built on top of KVM and Xen.

Proxmox (http://pve.proxmox.com/wiki/Main_Page)

Open Source Server Virtualization Platform, based on KVM and OpenVZ.

Packer (http://www.packer.io/)

A tool for creating identical machine images for multiple platforms from a single source configuration.

Xen (http://www.xenproject.org/)

Virtual machine monitor for 32/64 bit Intel / AMD (IA 64) and PowerPC 970 architectures.

LXC — Linux Containers (https://linuxcontainers.org/)

System containers which offer an environment as close to possible as the one you’d get from a VM, but without the overhead that comes with running a separate kernel and simulating all the hardware.

rkt (https://coreos.com/rkt/docs/latest/)

A fast, composable, and secure App Container runtime for Linux.

KVM (http://www.linux-kvm.org)

Linux kernel virtualization infrastructure.

oVirt (http://www.ovirt.org/)

Manages virtual machines, storage and virtual networks.

Vagrant (https://www.vagrantup.com/)

Tool for building complete development environments.

VirtualBox (https://www.virtualbox.org/)

Virtualization product from Oracle Corporation.

Software Containers

SmartOS (https://smartos.org/)

SmartOS is a hypervisor.

Flocker (https://github.com/ClusterHQ/flocker)

Flocker is an open-source Container Data Volume Manager for your Dockerized applications.

Rancher (http://rancher.com/)

A complete infrastructure platform for running Docker in production.

Docker (http://www.docker.com/)

Open platform for developers and sysadmins to build, ship, and run distributed applications.

Kubernetes (http://kubernetes.io/)

Kubernetes is an open source orchestration system for Docker containers.

OpenVZ (http://openvz.org)

Container-based virtualization for Linux.

ElasticKube (https://elastickube.com)

Enterprise container management for Kubernetes


Messaging

Log Management

Octopussy (http://www.octopussy.pm)

Log Management Solution (Visualize / Alert / Report).

Kibana (http://www.elasticsearch.org/overview/kibana/)

Visualize logs and time-stamped data.

Flume (https://flume.apache.org/)

Distributed log collection and aggregation system.

Fluentd (http://www.fluentd.org/)

Log Collector and Shipper.

Heka (http://hekad.readthedocs.org/en/latest/)

Stream processing system which may be used for log aggregation.

Graylog2 (http://graylog2.org/)

Pluggable Log and Event Analysis Server with Alerting options.

Logstash (http://logstash.net/)

Tool for managing events and logs.

ElasticSearch (http://www.elasticsearch.org/)

A Lucene Based Document store mainly used for log indexing, storage and analysis.

Solr (http://lucene.apache.org/solr/)

Solr is fast search platform built on Apache Lucene.

Queuing

Gearman (http://gearman.org/)

Fast multi-language queuing/job processing platform.

ZeroMQ (http://zeromq.org/)

Lightweight queuing system.

RabbitMQ (http://www.rabbitmq.com/)

Robust, fully featured, cross distro queuing system.

NSQ (http://nsq.io/)

A realtime distributed messaging platform.

BeanstalkD (http://kr.github.io/beanstalkd/)

A simple, fast work queue.

Apache Kafka (http://kafka.apache.org)

A high-throughput distributed messaging system.

ActiveMQ (https://activemq.apache.org)

Open source java message broker

Sidekiq (https://github.com/mperham/sidekiq)

Simple, efficient background processing for Ruby.

QPid (https://qpid.apache.org/)

Apache QPid, open source AMQP 1.0 Server and framework.


Storage

Cloning

Redo Backup (http://redobackup.org/)

Easy Backup, Recovery and Restore.

Fog (http://www.fogproject.org/)

Another computer cloning solution.

Clonezilla (http://clonezilla.org/)

Partition and disk imaging/cloning program.

OPSI (http://www.opsi.org)

OPSI is an open source Client Management System for Windows clients and is based on Linux servers

Backups

Elkarbackup (https://github.com/elkarbackup/elkarbackup)

Backup solution based on RSnapshot with a simple web interface.

Burp (http://burp.grke.org/)

Network backup and restore program.

ZBackup (http://zbackup.org/)

A versatile deduplicating backup tool

Backupninja (https://labs.riseup.net/code/projects/backupninja)

Lightweight, extensible meta-backup system.

Obnam (http://obnam.org/)

Network backup and restore, with snapshotting, deduplication and encryption.

Bareos (https://www.bareos.org/)

A fork of Bacula backup tool.

Yadis! Backup (http://www.codessentials.com/)

Yadis! Backup is a real time Backup application.

BorgBackup (https://borgbackup.readthedocs.org/en/stable/#)

BorgBackup is a deduplicating backup program.

Bacula (http://www.bacula.org)

Another Client-server model backup tool.

Lsyncd (https://github.com/axkibe/lsyncd)

Watches a local directory trees for changes, and then spawns a process to synchronize the changes. Uses rsync by default.

Amanda (http://www.amanda.org/)

Client-server model backup tool.

UrBackup (http://www.urbackup.org/)

Another client-server backup system.

Rsnapshot (http://www.rsnapshot.org/)

Filesystem Snapshotting Utility.

Snebu (http://www.snebu.com)

Snebu is an efficient incremental snapshot style client/server disk-based backup system for Unix / Linux systems.

Backuppc (http://backuppc.sourceforge.net/)

Client-server model backup tool with file pooling scheme.

Attic (https://attic-backup.org)

Attic is a deduplicating backup program written in Python.

SafeKeep (http://safekeep.sourceforge.net/)

Centralized pull-based backup using rdiff-backup.

Duplicity (http://duplicity.nongnu.org/)

Encrypted bandwidth-efficient backup using the rsync algorithm.

Relax and Recover (http://relax-and-recover.org/)

Bare metal backup software.

Cobian Backup (http://www.cobiansoft.com/cobianbackup.htm)

Cobian Backup is a easy Backup software.

Duply (http://duply.net/)

Duply is a frontend for duplicity, which is python based shell application that makes encrypted incremental backups to remote storages.

Duplicati (http://www.duplicati.com)

Duplicati is a backup client that securely stores encrypted, incremental, compressed backups on cloud storage services and remote file servers.

rdiff-backup (http://www.nongnu.org/rdiff-backup/)

Incremental File Backup software.

Deja Dup (https://launchpad.net/deja-dup)

Deja Dup is a simple backup tool with GUI.

Box Backup (https://www.boxbackup.org/)

Is another backup system.

Distributed Filesystems

GlusterFS (http://www.gluster.org/)

Scale-out network-attached storage file system.

Ceph (http://ceph.com/)

Distributed object store and file system.

XtreemFS (http://www.xtreemfs.org/)

XtreemFS is a fault-tolerant distributed file system for all storage needs.

MooseFS (http://www.moosefs.org/)

Fault tolerant, network distributed file system.

Sheepdog (https://sheepdog.github.io/sheepdog/)

Sheepdog is a distributed object storage system for volume and container services and manages the disks and nodes intelligently.

LeoFS (http://leo-project.net)

Unstructured object/data storage and a highly available, distributed, eventually consistent storage system.

DRBD (http://www.drbd.org/)

Disributed Replicated Block Device.

MogileFS (http://mogilefs.org/)

Application level, network distributed file system.

Lustre (http://lustre.opensfs.org/)

A type of parallel distributed file system, generally used for large-scale cluster computing.

TahoeLAFS (https://tahoe-lafs.org/trac/tahoe-lafs)

secure, decentralized, fault-tolerant, peer-to-peer distributed data store and distributed file system.

OpenAFS (http://www.openafs.org/)

Distributed network file system with read-only replicas and multi-OS support.

HDFS (http://hadoop.apache.org/)

Distributed, scalable, and portable file-system written in Java for the Hadoop framework.

BeeGFS (http://www.beegfs.com/content/)

BeeGFS is the leading parallel cluster file system, developed with a strong focus on performance.

RDBMS

Firebird (http://www.firebirdsql.org/)

True universal open source database.

PostgreSQL-XL (http://www.postgres-xl.org/)

Scalable Open Source PostgreSQL-based database cluster.

Galera (http://galeracluster.com/)

Galera Cluster for MySQL is an easy-to-use high-availability solution with high system up-time, no data loss, and scalability for future growth.

MariaDB (https://mariadb.org/)

Community-developed fork of the MySQL.

Crate (https://crate.io/)

Another easy to use, fast and scalable database system.

Percona Server (http://www.percona.com/software)

Enhanced, drop-in MySQL replacement.

TokuDB (http://www.tokutek.com/tokudb-for-mysql/)

TokuDB is an open source, high-performance storage engine for MySQL, MariaDB, and Percona Server that dramatically improves scalability and operational efficiency.

MySQL (http://dev.mysql.com/)

Most popular RDBMS server.

SQLite (http://sqlite.org/)

Library that implements a self-contained, serverless, zero-configuration, transactional SQL DBS.

PostgreSQL (http://www.postgresql.org/)

Object-relational database management system (ORDBMS).

NoSQL

Redis (http://redis.io/)

Networked, in-memory, key-value data store with optional durability.

LevelDB (https://code.google.com/p/leveldb/)

Google’s high performance key/value database.

MongoDB (http://www.mongodb.org/)

Another document-oriented database system.

FlockDB (https://github.com/twitter/flockdb)

Twitter’s distributed, fault-tolerant graph database.

CouchDB (http://couchdb.apache.org/)

Ease of use, with multi-master replication document-oriented database system.

Riak (http://basho.com/riak/)

Another fault-tolerant key-value NoSQL database.

Cassandra (http://cassandra.apache.org/)

Distributed DBMS designed to handle large amounts of data across many servers.

RethinkDB (http://www.rethinkdb.com/)

Open source distributed document store database, focuses on JSON.

Neo4j (http://www.neo4j.org/)

Open source graph database.

Apache HBase (http://hbase.apache.org/)

Hadoop database, a distributed, big data store.

Hypertable (http://hypertable.org/)

C++ based BigTable-like DBMS, communicates through Thrift and runs either as stand-alone or on distributed FS such as Hadoop.

RavenDB (http://ravendb.net/)

Document based database with ACID/Transactional features.

OrientDB (http://orientdb.com)

Multi-Model Database, mainly Graph Database.


Monitoring

Statistics

Piwik (http://piwik.org/)

Free and open source web analytics application.

GoAccess (http://goaccess.io/)

Open source real-time web log analyzer and interactive viewer that runs in a terminal.

Webalizer (http://www.webalizer.org/)

Fast, free web server log file analysis program.

Monitoring

Log.io (http://logio.org/)

Real-time log monitoring.

Bloonix (https://bloonix.org)

Bloonix is your next-gen monitoring solution!

Sensu (http://sensuapp.org/)

Open source monitoring framework.

Shinken (http://www.shinken-monitoring.org/)

Another monitoring framework.

Zabbix (http://www.zabbix.com/)

Enterprise-class software for monitoring of networks and applications.

Adagios (http://adagios.org/)

Adagios is a web based Nagios configuration interface.

Dash (https://github.com/afaqurk/linux-dash)

A low-overhead monitoring web dashboard for a GNU/Linux machine.

Alerta (https://github.com/guardian/alerta)

Distributed, scaleable and flexible monitoring system.

Sentry (https://getsentry.com/)

Application monitoring, event logging and aggregation.

Icinga (https://www.icinga.org/)

Fork of Nagios.

PHP Server Monitor (http://sourceforge.net/projects/phpservermon/)

Open source tool to monitor your servers and websites

Cabot (http://cabotapp.com/)

Monitoring and alerts, similar to PagerDuty.

Flapjack (http://flapjack.io/)

Monitoring notification routing & event processing system.

zmon (https://github.com/zalando/zmon)

ZMON is Zalando’s open-source platform monitoring tool.

Open Monitoring Distribution (http://omdistro.org/)

Monitoring solution based on Nagios.

Riemann (http://riemann.io/)

Flexible and fast events processor allowing complex events/metrics analysis.

Cacti (http://www.cacti.net)

Web-based network monitoring and graphing tool.

Monit (http://mmonit.com/monit/#home)

Small Open Source utility for managing and monitoring Unix systems.

BandwidthD (http://bandwidthd.sourceforge.net/)

BandwidthD tracks usage of TCP/IP network subnets and builds html files with graphs to display utilization.

LibreNMS (https://github.com/librenms/librenms/)

fork of Observium.

Centreon (https://www.centreon.com/en/)

Centreon is real-time IT performance monitoring and diagnostics management tool.

Nagios (http://www.nagios.org/)

Computer system, network and infrastructure monitoring software application.

NetXMS (http://www.netxms.org/)

NetXMS is an enterprise grade multi-platform open source network management and monitoring system.

Selena (https://github.com/allegro/selena)

Selena is a tool for monitoring website performance by monitoring response times, response codes and site content.

Pandora FMS (http://pandorafms.com/)

Flexible Monitoring System, a Nagios and Zabbix alternative

netdata (https://github.com/firehol/netdata/)

Real-time performance monitoring, done right!

check_mk (http://mathias-kettner.com/check_mk.html)

Collection of extensions for Nagios.

Zenoss (http://community.zenoss.org)

Application, server, and network management platform based on Zope.

Thruk (http://www.thruk.org/)

Multibackend monitoring webinterface with support for Naemon, Nagios, Icinga and Shinken.

MuninMX (https://www.muninmx.com)

MuninMX is a collector and frontend replacement for the Open Source Munin Monitoring Tool and is compatible with deployed munin-nodes which it also uses.

OpenNMS (http://www.opennms.org)

OpenNMS is enterprise grade network management application platform.

Naemon (http://www.naemon.org/)

Network monitoring tool based on the Nagios 4 core with performance enhancements and new features.

Munin (http://munin-monitoring.org/)

Networked resource monitoring tool.

Observium (http://www.observium.org/)

SNMP monitoring for servers and networking devices. Runs on linux.

EyesOfNetwork (https://www.eyesofnetwork.com)

EyesOfNetwork is the OpenSource solution combining a pragmatic usage of ITIL processes and a technological interface allowing their workaday application.

Monitorix (http://www.monitorix.org/)

Monitorix is a lightweight system monitoring tool.

Metric and Metric Collection

Prometheus (http://prometheus.io/)

An open-source service monitoring system and time series database.

Stashboard (http://www.stashboard.org/)

Status dashboard software.

Packetbeat (http://packetbeat.com)

Captures network traffic and displays it in a custom Kibana dashboard for easy viewing.

Tessera (https://github.com/urbanairship/tessera)

Easy to configure dashboard for Graphite

Dashing (http://dashing.io/)

Ruby gem that allows for rapid statistical dashboard development. An all HTML5 approach allows for big screen displays in data centers or conference rooms.

Cachet (https://cachethq.io/)

Status page system.

Graphite (http://graphite.readthedocs.org/en/latest/)

Open source scaleable graphing server.

Logstalgia (http://logstalgia.io/)

A website access visualiziation tool.

Statsd (https://github.com/etsy/statsd/)

Application statistic listener.

Collectl (http://collectl.sourceforge.net/)

High precision system performance metrics collecting tool.

Gource (http://gource.io/)

Gource is a software version control visualiziation tool.

Smokeping (https://oss.oetiker.ch/smokeping/)

Network analytic tool.

Grafana (http://grafana.org/)

A Graphite & InfluxDB Dashboard and Graph Editor.

Ganglia (http://ganglia.sourceforge.net/)

High performance, scalable RRD based monitoring for grids and/or clusters of servers. Compatible with Graphite using a single collection process.

OpenTSDB (http://opentsdb.net/)

Store and server massive amounts of time series data without losing granularity.

DalmatinerDB (https://dalmatiner.io)

Fast distributed metric store for high throughput environments.

InfluxDB (http://influxdb.com/)

Open source distributed time series database with no external dependencies.

RRDtool (http://oss.oetiker.ch/rrdtool/)

Open source industry standard, high performance data logging and graphing system for time series data.

Collectd (http://collectd.org/)

System statistic collection daemon.

KairosDB (https://code.google.com/p/kairosdb/)

Fast distributed scalable time series database, fork of OpenTSDB 1.x.


Automation

Configuration Management

Ansible (http://www.ansibleworks.com/)

It’s written in Python and manages the nodes over SSH.

Boxstarter (http://boxstarter.org)

Config management for Windows OS

Fabric (http://www.fabfile.org/)

Python library and cli tool for streamlining the use of SSH for application deployment or systems administration tasks.

Pallet (http://palletops.com/)

Infrastructure definition, configuration and management via a Clojure DSL.

Chef (http://www.opscode.com/chef/)

It’s written in Ruby and Erlang and uses a pure-Ruby DSL.

Puppet (http://puppetlabs.com/)

It’s written in Ruby and uses Puppet’s declarative language or a Ruby DSL.

CFEngine (http://cfengine.com/)

Lightweight agent system. Configuration state is specified via a declarative language.

Terraform (http://www.terraform.io)

Terraform provides a common configuration to launch infrastructure from physical and virtual servers to email and DNS providers.

Configuration Management Database

Clusto (https://github.com/clusto/clusto)

Helps you keep track of your inventory, where it is, how it’s connected, and provides an abstracted interface for interacting with the elements of the infrastructure.

iTop (http://www.combodo.com/-Overview-.html)

A complete open source, ITIL, web based service management tool.

i-doit (http://www.i-doit.org/)

Open Source IT Documentation and CMDB.

Service Discovery

ZooKeeper (http://zookeeper.apache.org/)

ZooKeeper is a centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services.

Doozerd (https://github.com/ha/doozerd)

Doozer is a highly-available, completely consistent store for small amounts of extremely important data.

Consul (http://www.consul.io/)

Consul is a tool for service discovery, monitoring and configuration.

etcd (https://github.com/coreos/etcd)

A highly-available key value store for shared configuration and service discovery.

Network Configuration Management

Oxidized (https://github.com/ytti/oxidized)

A modern take on network device configuration monitoring with web interace and GIT storage.

GestióIP (http://www.gestioip.net/)

An automated web based IPv4/IPv6 IP Address Management tool.

rConfig (http://www.rconfig.com/)

Another network device configuration management tool.

RANCID (http://www.shrubbery.net/rancid/)

Monitors network device’s configurarion and maintain history of changes.

trigger (https://github.com/trigger/trigger)

Robust network automation toolkit written in Python.

PHPIpam (http://phpipam.net/)

Light, modern and useful web IP address management application

Continuous Integration and Continuous Deployment

Go (http://www.go.cd/)

Open source continuous delivery server.

Drone (https://github.com/drone/drone)

Continuous integration server built on Docker and configured using YAML files.

Jenkins (http://jenkins-ci.org/)

An extendable open source continuous integration server.

Buildbot (http://buildbot.net/)

Python-based toolkit for continuous integration.

GitLab CI (https://www.gitlab.com/gitlab-ci/)

Based off of ruby. They also provide GitLab, which manages git repositories.


Support software

Control Panels

Senatora (http://www.sentora.org/)

Sentora provides a robust open-source web hosting control panel for small to medium ISPs.

Cockpit Project (http://cockpit-project.org)

Cockpit makes it easy to administer your GNU/Linux servers via a web browser.

Ajenti (http://ajenti.org/)

Control panel for Linux and BSD.

Lan Management System (https://github.com/lmsgit/lms)

LAN Management System is a package of applications for managing LAN networks.

Panamax (http://panamax.io/)

An open-source project that makes deploying complex containerized apps as easy as Drag-and-Drop.

ZPanel (http://www.zpanelcp.com/)

Control panel for Linux, BSD, and Windows.

Webmin (http://webmin.com/)

Webmin is an individual Server Control Panel.

tipboard (https://github.com/allegro/tipboard)

Tipboard is a system for creating dashboards, written in JavaScript and Python.

PDNS Gui (https://github.com/odoucet/pdns-gui)

Web based GUI which aids in administering domains and records for the PowerDNS with MySQL backend.

ISPConfig (http://www.ispconfig.org)

Hosting control panel for Linux.

EasySCP (http://www.easyscp.net/)

EasySCP is another server webinterface.

Feathur (http://feathur.com)

VPS Provisioning and Management Software.

VestaCP (http://www.vestacp.com/)

Hosting panel for Linux but with Nginx.

Atomia DNS (http://atomiadns.com/)

Free and open source DNS management system.

Centos Web Panel (http://centos-webpanel.com/)

Free CentOS Linux Web Hosting control panel designed for quick and easy management.

NethServer (http://www.nethserver.org/)

NethServer is an operating system for Linux enthusiasts, designed for small offices and medium enterprises.

ispmanager (https://www.ispsystem.com/software/ispmanager-en)

Panel for shared web hosting

i-MSCP (https://i-mscp.net/)

Webhosting control panel.

Poweradmin (http://www.poweradmin.org/)

Friendly web-based DNS administration tool for PowerDNS server.

Froxlor (http://www.froxlor.org/)

Easy to use panel for Linux with Nginx and PHP-FPM support.

WebVirtMgr (https://retspen.github.io)

libvirt-based Web interface for managing virtual machines.

Glances (https://nicolargo.github.io/glances/)

Glances is a cross-platform curses-based system monitoring tool written in Python.

Bright Game Panel (http://www.bgpanel.net/)

Bright Game Panel is an open source gameserver control panel.

Easy-WI (https://easy-wi.com/)

Easy WI is a professional gameserver control panel.

Virtualmin (http://www.virtualmin.com/)

Control panel for Linux based on webmin.

ViMbAdmin (http://www.vimbadmin.net/)

Provides a web based virtual mailbox administration system, allowing mail administrators to manage domains, mailboxes and aliases.

iF.SVNAdmin (http://svnadmin.insanefactory.com/)

WebGUI to manage Subversion repositories and User/Group permissions.

Postfix Admin (http://postfixadmin.sourceforge.net/)

Web interface to manage postfix mailboxes, virtual domains and aliases.

OpenVZ Web Panel (http://owp.softunity.com.ru/)

Web panel to control your OpenVZ servers.

WebSVN (http://www.websvn.info/)

Opensource web subversion repository browser.

Webmails

Modoboa (http://modoboa.org)

Modoboa is a mail hosting and management platform including a modern and simplified Web User Interface. It provides useful components such as an administration panel or a webmail.

RainLoop (http://www.rainloop.net)

Very nice webmail with IMAP/SMTP Support and multi accounting.

Mailpile (https://www.mailpile.is/)

A modern, fast web-mail client with user-friendly encryption and privacy features.

Citadel (http://citadel.org)

Citadel is a free, open source groupware system.

Horde (http://www.horde.org)

Webmail and groupware client.

Roundcube (http://roundcube.net/)

Browser-based IMAP client with an application-like user interface.

Newsletters

Servers for Hackers (http://serversforhackers.com/)

Newsletter for programmers who find themselves needing to know their way around a server.

LibreMailer (https://github.com/averna-syd/LibreMailer)

Libre Mailer is a modest and simple web based email marketing application.

phpList (http://www.phplist.com/)

Newsletter manager written in PHP.

Lewsnetter (https://github.com/bborn/lewsnetter)

E-mail marketing application, includes subscription management, delivery, bounce and complaint notification, templates and some stats.

Web Operations Weekly (http://webopsweekly.com)

A weekly newsletter on Web operations, infrastructure, performance, and tooling, from the browser down to the metal.

DadaMail (http://dadamailproject.com/)

Mailing List Manager, written in Perl.

Project Management

OpenProject (https://www.openproject.org)

Project collaboration with open source.

Taiga (https://taiga.io/)

Agile, Free, Open Source Project Management Tool based on the Kanban and Scrum methods.

Phabricator (http://phabricator.org/)

Written in PHP.

CaseBox (https://www.casebox.org)

Manage all your organisation’s information in one system.

Gogs (http://gogs.io/)

Written in Go.

Wekan (http://wekan.io/)

Wekan is an open-source and collaborative kanban board application.

kanboard (http://kanboard.net/)

Kanboard is a project management software that uses the Kanban methodology.

GitBucket (https://github.com/takezoe/gitbucket)

Clone of GitHub written in Scala.

Restyaboard (http://restya.com/board/index.html)

Trello like kanban board. Restyaboard is based on Restya platform.

Kallithea (http://kallithea-scm.org/)

OpenSource Git and mercurial sources management.

GitLab (https://www.gitlab.com/)

Clone of GitHub written in Ruby.

Trac (http://trac.edgewall.org/)

Written in python.

Redmine (http://www.redmine.org/)

Written in ruby on rails.

Ticketing systems

osTicket (http://osticket.com/)

Open source support ticket system.

Cerb (http://www.cerberusweb.com/)

A group-based e-mail management project built with a commercial open source license.

Flyspray (http://flyspray.org)

Web-based bug tracking system written in PHP.

Otrs (http://www.otrs.com/)

A free and open-source trouble ticket system software package that a company, organization, or other entity can use to assign tickets to incoming queries and track further communications about them.

Request Tracker (http://www.bestpractical.com/rt/)

Ticket-tracking system written in Perl.

MantisBT (http://www.mantisbt.org/)

Another web-based bug tracking system.

TheBugGenie (http://www.thebuggenie.com)

Open source ticket system with extremely complete users rights granularity.

Bugzilla (http://www.bugzilla.org/)

General-purpose bugtracker and testing tool originally developed and used by the Mozilla project.

IT Asset Management

Snipe IT (http://snipeitapp.com/)

Asset & license management software.

Ralph (https://github.com/allegro/ralph)

Asset management, DCIM and CMDB system for large Data Centers as well as smaller LAN networks.

RackTables (http://racktables.org/)

Datacenter and server room asset management like document hardware assets, network addresses, space in racks, networks configuration.

OCS Inventory NG (http://www.ocsinventory-ng.org/en/)

Enables users to inventory their IT assets.

GLPI (http://www.glpi-project.org/spip.php?lang=en)

Information Resource-Manager with an additional Administration Interface.

Open-AudIT (http://www.open-audit.org/index.php)

Open-AudIT is an application to tell you exactly what is on your network, how it is configured and when it changes.

Wikis

MoinMoin (http://moinmo.in/)

An advanced, easy to use and extensible WikiEngine with a large community of users.

XWiki (http://www.xwiki.org/xwiki/bin/view/Main/WebHome)

XWiki is a professional wiki that has powerful extensibility features such as scripting in pages, plugins and a highly modular architecture.

DokuWiki (https://www.dokuwiki.org/dokuwiki)

Simple to use and highly versatile wiki that doesn’t require a database.

ikiwiki (http://ikiwiki.info/)

A wiki compiler.

TiddlyWiki (http://tiddlywiki.com)

Complete interactive wiki in JavaScript.

Gollum (https://github.com/gollum/gollum)

A simple, Git-powered wiki with a sweet API and local frontend.

TWiki (http://twiki.org/)

TWiki — the Open Source Enterprise Wiki and Web Application Platform

TikiWiki (https://tiki.org/)

Free Wiki system.

PmWiki (http://www.pmwiki.org)

Wiki-based system for collaborative creation and maintenance of websites.

Mediawiki (http://www.mediawiki.org/wiki/MediaWiki)

Used to power Wikipedia.

Olelo Wiki (https://github.com/minad/olelo)

A a wiki that stores pages in a Git repository.

Sphinx (http://www.sphinx-doc.org/)

Python Documentation Generator

Code Review

Review Board (https://www.reviewboard.org/)

Available as free software uner the MIT License.

Gerrit (https://code.google.com/p/gerrit/)

Based on the Git version control, it facilitates software developers to review modifications to the source code and approve or reject those changes.

Collaborative Software

SOGo (https://www.sogo.nu/)

Collaborative software server with a focus on simplicity and scalability.

Mattermost (http://www.mattermost.org/)

Mattermost brings all your team communication into one place, making it searchable and accessible anywhere.

Kolab (https://www.kolab.org)

Another groupware suite.

Zimbra (https://www.zimbra.com/community/)

Collaborative software suite, that includes an email server and web client.

EGroupware (http://www.egroupware.org/)

Groupware software written in PHP.

Citadel/UX (http://www.citadel.org/)

Collaboration suite (messaging and groupware) that is descended from the Citadel family of programs.

Horde Groupware (http://www.horde.org/apps/groupware)

PHP based collaborative software suite that includes email, calendars, wikis, time tracking and file management.

Communication

Lets-Chat (http://sdelements.github.io/lets-chat/)

A self hosted chat suite written in Node.

Kandan (http://getkandan.com/)

Open source self hosted Chat.

Hack.Chat (https://hack.chat/)

Chat for hacker from hackers 🙂

Jappix (https://jappix.org/)

Web-based chat client

Kaiwa (http://getkaiwa.com)

Web based chat client in the style of common paid alternatives.

Openfire (http://www.igniterealtime.org/projects/openfire/)

Real time collaboration (RTC) server.

Metronome IM (http://www.lightwitch.org/metronome)

Fork of Prosody IM.

Rocket.Chat (https://rocket.chat/)

Web chat platform.

MongooseIM (https://www.erlang-solutions.com/products/mongooseim-massively-scalable-ejabberd-platform)

Fork of ejabberd.

Tigase (https://projects.tigase.org/projects/tigase-server)

XMPP server implementation in Java.

Discourse (http://www.discourse.org/)

Civilsied discussions.

Alfresco (https://www.alfresco.com/community)

The Alfresco Enterprise Content Management platform is an open, powerful ECM platform.

Candy (http://candy-chat.github.io/candy)

Multi user XMPP client written in Javascript.

Prosody IM (http://prosody.im/)

XMPP server written in Lua.

ejabberd (http://www.ejabberd.im/)

XMPP instant messaging server written in Erlang/OTP.

Jitsi Meet (https://jitsi.org/Projects/JitsiMeet)

Jitsi Meet is an OpenSource (MIT) WebRTC JavaScript application that uses Jitsi Videobridge to provide high quality, scalable video conferences.

HumHub (https://github.com/humhub/humhub/)

Social communication network kit.NEW

Spreed.Me (https://www.spreed.me/?far)

Spreed WebRTC implements a WebRTC audio/video call and conferencing server and web client.NEW


Essentials

Editors

neovim (http://neovim.org/)

The Vim text editor has been loved by a generation of users. This is the next generation.

Lime (http://limetext.org/)

Aims to provide an open source solution to Sublime Text.

Light Table (http://www.lighttable.com/)

The next generation code editor.

ICEcoder (http://icecoder.net)

Code editor awesomeness, built with common web languages.

Haroopad (http://pad.haroopress.com/)

Markdown editor with live preview.

Vim (http://www.vim.org)

A highly configurable text editor built to enable efficient editing.

Atom (https://atom.io/)

A hackable text editor from Github.

Brackets (http://brackets.io/)

Open source code editor for web designers and front-end developers.

jotgit (https://github.com/jdleesmiller/jotgit)

Git-backed real-time collaborative code editing.

TextMate (https://github.com/textmate/textmate/)

A graphical text editor for OS X.

Notepad++ (https://notepad-plus-plus.org/)

Notepad++ is a free source code editor and Notepad replacement that supports several languages.

KDevelop (https://www.kdevelop.org)

An open source IDE by the people behind KDE.

Geany (http://www.geany.org/)

GTK2 text editor.

nano (http://www.nano-editor.org/)

GNU Nano is a clone of the Pico text editor with some enhancements.

Eclipse (http://eclipse.org/)

IDE written in Java with an extensible plug-in system.

GNU Emacs (http://www.gnu.org/software/emacs/)

An extensible, customizable text editor-and more.

NetBeans IDE (https://netbeans.org)

NetBeans IDE lets you quickly and easily develop Java desktop, mobile, and web applications, as well as HTML5 applications with HTML, JavaScript, and CSS.NEW

Repositories

ElRepo (http://elrepo.org/tiki/tiki-index.php)

The ELRepo Project focuses on hardware related packages to enhance your experience with Enterprise Linux.

Dotdeb (http://www.dotdeb.org/)

Repository with LAMP updated packages for Debian.

Pulp (http://www.pulpproject.org/)

Pulp is a platform for managing repositories of content, such as software packages, and pushing that content out to large numbers of consumers.

Remi (http://rpms.famillecollet.com/)

Repository with LAMP updated packages for RHEL/Centos/Fedora.

SCM Manager (https://www.scm-manager.org/)

The easiest way to share and manage your Git, Mercurial and Subversion repositories.

EPEL (https://fedoraproject.org/wiki/EPEL)

Repository for RHEL and compatibles (CentOS, Scientific Linux).

Software Collections (https://www.softwarecollections.org/en/)

Community Release of Red Hat Software Collections. Provides updated packages of Ruby, Python, etc. for CentOS/Scientific Linux 6.x.

IUS Community Project (https://iuscommunity.org/pages/Repos.html)

A better way to upgrade RHEL.

RepoForge (http://repoforge.org/)

ex-RpmForge

Security

Bro (http://www.bro.org)

Bro is a powerful framework for network analysis and security monitoring.

BlackBox (https://github.com/StackExchange/blackbox)

Safely store secrets in Git/Mercurial. Privides tooling to automatically encrypt secrets like passwords.

Linux Malware Detect (https://www.rfxn.com/projects/linux-malware-detect/)

A malware scanner for Linux designed around the threats faced in shared hosted environments.

Pass (http://www.passwordstore.org/)

Password manager based around gpg and git, with a bit of setup allowing easy collaboration.

Suricata (http://suricata-ids.org/)

Suricata is a high performance Network IDS, IPS and Network Security Monitoring engine.

OpenVAS (http://www.openvas.org/vm.html)

Open source intrusion detection system

Snort (https://www.snort.org/)

Snort is a free and open source network intrusion prevention system and network intrusion detection system.

OsSec (http://www.ossec.net/)

Open Source IDS

Kali Linux (https://www.kali.org/)

Kali Linux is a Open Source Penetration software.

LookingGlass (https://github.com/telephone/LookingGlass)

LookingGlass for hosting on own server.

RatticDB (http://rattic.org/)

RatticDB is a password management database.

OPNsense (https://opnsense.org/)

OPNsense is an open source, easy-to-use and easy-to-build FreeBSD based firewall and routing platform.

OpenAS (https://openas.org/)

An self-hosted email spam filter.

Fail2Ban (http://www.fail2ban.org/wiki/index.php/Main_Page)

Scans log files and takes action on IPs that show malicious behavior.

AlienVault OSSIM (https://www.alienvault.com/products/ossim)

OSSIM provides you with a feature-rich open source SIEM, complete with event collection, normalization and correlation.

Denyhosts (http://denyhosts.sourceforge.net/)

Thwart SSH dictionary based attacks and brute force attacks.

VyOS (http://vyos.net/)

VyOS is a community fork of Vyatta, a Linux-based network operating system that provides software-based network routing, firewall, and VPN functionality.

MailBorder (http://www.mailborder.com/)

Free E-Mail Antivirus/Spam Gateway.

EFA Project (https://efa-project.org/)

Great EMail Filter Appliance.

Rspamd (https://rspamd.com/)

Advanced spam filtering system that allows evaluation of messages by a number of rules including regular expressions, statistical analysis and custom services such as URL black lists.

WinMTR (http://winmtr.net/)

Free Network diagnostic tool.

Smoothwall (http://www.smoothwall.org/)

Software Firewall.

IPCop (http://www.ipcop.org/)

Secure firewall distribution.

PacketFence (http://www.packetfence.org)

PacketFence is a fully supported, trusted, Free and Open Source network access control (NAC) solution.

Untangle (https://www.untangle.com/)

Free firewall distribution based on debian with paid addons.

OSQuery (https://osquery.io)

Query your servers status and info using a SQL like interface.

Devil Linux (http://www.devil-linux.org/home/index.php)

Security distribution which runs from a usb stick or cd.

pfSense (https://www.pfsense.org/)

Firewall and Router FreeBSD distribution.

lcsam (https://github.com/LiveConfig/lcsam)

Another Spamassassin milter.

KeePass (http://keepass.info/)

Keepass is a great and secure password storage tool.

SpamAssassin (https://spamassassin.apache.org/)

A powerful and popular email spam filter employing a variety of detection techniques.

chkrootkit (http://www.chkrootkit.org/)

chkrootkit is a tool to locally check for signs of a rootkit.

rkhunter (http://rkhunter.sourceforge.net/)

Rootkit Hunter is a tool that scans for rootkits, backdoors and possible local exploits.

ClamAV (http://www.clamav.net/)

Antivirus software

BlackArch (https://blackarch.org/)

Is an excellent pentesting distribution.

Vaultier (https://www.vaultier.org/)

Collaborative password manager that uses PKINEW

Vault (https://www.vaultproject.io)

Vault secures, stores, and tightly controls access to tokens, passwords, certificates, API keys, and other secrets in modern computing.NEW

Version control

Fossil (http://www.fossil-scm.org/)

Distributed version control with built-in wiki and bug tracking.

GitKraken (http://www.gitkraken.com)

Beautiful cross-platform Git client.

Git (http://git-scm.com/)

Distributed revision control and source code management (SCM) with an emphasis on speed.

GNU Bazaar (http://bazaar.canonical.com/)

Distributed revision control system sponsored by Canonical.

Mercurial (http://mercurial.selenic.com/)

Another distributed revision control.

Subversion (http://subversion.apache.org/)

Client-server revision control system.

Packaging

omnibus-ruby (https://github.com/opscode/omnibus-ruby)

Full stack, cross distro packaging software (Ruby).

FPM (https://github.com/jordansissel/fpm)

Easily create any kind of package

Poky (https://www.yoctoproject.org/tools-resources/projects/poky)

The Yocto Project provides templates, tools and methods to help you create custom Linux-based systems for embedded products.

Troubleshooting

Sysdig (http://www.sysdig.org/)

Capture system state and activity from a running Linux instance, then save, filter and analyze.

Wireshark (http://www.wireshark.org/)

The world’s foremost network protocol analyzer.

Books

UNIX and Linux System Administration Handbook (http://www.admin.com/)

Approaches system administration from a practical perspective.

Debian Administrator HandBook (https://debian-handbook.info/get/now/)

This book teaches the essentials to anyone who wants to become an effective and independent Debian GNU/Linux administrator

Cybrary (https://www.cybrary.it/)

Free security tutorials.

The Practice of System and Network Administration (http://everythingsysadmin.com/books.html)

The first and second editions describes the best practices of system and network administration, independent of specific platforms or technologies.

The Visible Ops Handbook: Implementing ITIL in 4 Practical and Auditable Steps (http://www.itpi.org/the-visible-ops-handbook-review.html)

Is a methodology designed to jumpstart implementation of controls and process improvement.

The Linux Command Line (http://linuxcommand.org/tlcl.php)

A book about the Linux command line by William Shotts.

The Phoenix Project: A Novel about IT, DevOps, and Helping Your Business Win (http://itrevolution.com/books/phoenix-project-devops-book/)

How DevOps techniques can fix the problems that happen in IT organizations.

Add new HDD to LVM group

First step: use gdisk (or fdisk)

#gdisk /dev/sdb
and select part code 8e00 -  LVM partition

we need to prepare our new partitions for LVM 

#pvcreate /dev/sdb1

Check pvs
#pvdisplay

Second step: extends the logical partition as far as it can. No need to check and calculate GBs or blocks in various methods.

#vgextend /dev/ubuntu-vg /dev/sdb1

Third step: Extent the logical to max of new extented VG 

#lvresize -l +100%FREE /dev/ubuntu-vg/ubuntu-lv

Step 4 extends the file system to the size of the logical partition.
#resize2fs /dev/mapper/ubuntu--vg-ubuntu--lv

PS: On Ubuntu 18.04 I have to reboot or remount (mount-a) to update the full new space

Test:
Let’s shrink it to 10GB again:

#lvreduce -L10G /dev/ubuntu-vg/ubuntu-lv

#lvdisplay

— Logical volume —
LV Path /dev/ubuntu-vg/ubuntu-lv
LV Name ubuntu-lv
VG Name ubuntu-vg
LV UUID 3SfTpe-ZyKo-UDLI-2JRM-VTbP-GL0D-4cMyi6
LV Write Access read/write
LV Creation host, time ubuntu-server, 2018-08-14 04:30:49 +0000
LV Status available
# open 1
LV Size 10.00 GiB
Current LE 2560
Segments 1
Allocation inherit
Read ahead sectors auto
– currently set to 256
Block device 253:0

Try another 10GB

#lvreduce -L10G /dev/ubuntu-vg/ubuntu-lv

#lvdisplay

— Logical volume —
LV Path /dev/ubuntu-vg/ubuntu-lv
LV Name ubuntu-lv
VG Name ubuntu-vg
LV UUID 3SfTpe-ZyKo-UDLI-2JRM-VTbP-GL0D-4cMyi6
LV Write Access read/write
LV Creation host, time ubuntu-server, 2018-08-14 04:30:49 +0000
LV Status available
# open 1
LV Size 10.00 GiB
Current LE 2560
Segments 1
Allocation inherit
Read ahead sectors auto
– currently set to 256
Block device 253:0

Google Cloud Storage Nearline Personal Linux Desktop Backup

https://scottlinux.com/2016/11/22/google-cloud-storage-nearline-personal-linux-desktop-backup/

Backup data to the cloud for cheap with Google Cloud and Nearline storage. I use Google Cloud Storage Nearline to backup my desktop, openmediavault NAS, servers, and more. Here is how I do it!


1. First, sign in here. It may prompt to setup billing if that has not been done:

https://console.cloud.google.com


2. Next, create a project, and then create a cloud storage bucket.

For example, my project is called ‘personal-backup’ and an example bucket for this demo is ‘something_bkup’, nearline storage class.


3. Ok once a bucket has been created, next install the app gsutil:

$ sudo pip install gsutil

4. After installing, run gsutil config to generate authorization. This will give a link to click on to authorize access to the google cloud account.

$ gsutil config

5. Next, create a small script (and sudo chmod +x to make executable) which will specify which directories to backup to the bucket. The options below will work like rsync to keep the backup in sync with local.

(There are other gsutil options available if desired – see the help info.)

Example backup script file name and location:

/usr/local/bin/gcbackup

And contents of /usr/local/bin/gcbackup for user jsmith:

#!/usr/bin/env bash
#
# Backup selected directories to a GoogleCloud Nearline bucket
#
# Example daily cron:
# @daily /usr/local/bin/gcbackup >/dev/null 2>&1
#

# Directories to backup to the cloud 
dir=( "/home/jsmith/Documents" "/home/jsmith/Music" "/home/jsmith/syncthing" "/home/jsmith/Pictures" "/home/jsmith/Videos" )

# Bucket name 
bucket=something_bkup

# Backup specified directories!
for i in "${dir[@]}"; do      
    /usr/local/bin/gsutil -m rsync -r -d $i gs://$bucket/$(hostname)$i
done

6. Add a daily cron:

$ crontab -e

# backup to google cloud nearline
@daily /usr/local/bin/gcbackup >/dev/null 2>&1

Done.


This can even be used to backup servers, a NAS, or any Linux directories on any rig. For example this is backing up /var/backups and /var/www for a host:

#!/usr/bin/env bash
#
# Backup selected directories to a GoogleCloud Nearline bucket
#
# Example daily cron:
# @daily /usr/local/bin/gcbackup >/dev/null 2>&1
#

# Directories to backup to the cloud 
dir=( "/var/backups" "/var/www" )

# Bucket name 
bucket=something_bkup

# Backup specified directories!
for i in "${dir[@]}"; do      
    /usr/local/bin/gsutil -m rsync -r -d $i gs://$bucket/$(hostname)$i
done

As with any service, be sure to review the rates, fees, and charges before starting.

Create Haskintos USB

Step 1: Down load Unibeat anh MultiBeat from  https://www.tonymacx86.com/resources/categories/tonymacx86-downloads.3/

Step 2: Download Mac OS HighSierra from app Store ( not the full image/package)

Step 3:  After down load HighSierra from step 2, run these command to prepare/create img file for Unibeat:

Open Terminal and run: sudo -s
Enter admin credentials to gain root access and cut-n-paste the following 3 commands

mkdir /Applications/Install\ macOS\ High\ Sierra.app/Contents/SharedSupport
cd /macOS\ Install\ Data
find . -mount | cpio -pvdm /Applications/Install\ macOS\ High\ Sierra.app/Contents/SharedSupport

PS: Wait /enter until it complete

 

Step4: Insearch a 16GB USB and format it with GUID / Extend Journal Mac

Step 5:  run Unibeat and create USB installer of MacOS

Step 6: on the PC need to install MacOS , boot to Bios and set EFI boot, AHCI Sata mode…

Step 7: Boot from USB installer of MacOS  and install MacOS

Step 8: Install multibeat on HDD

Full instruction over here: https://www.tonymacx86.com/threads/unibeast-install-macos-high-sierra-on-any-supported-intel-based-pc.235474/

Add/remove passphrase to a private key

https://security.stackexchange.com/questions/59136/can-i-add-a-password-to-an-existing-private-key/59164

Of course you can add/remove a passphrase at a later time.

  • add one (assuming it was an rsa key, else use dsa)
    openssl rsa -aes256 -in your.key -out your.encrypted.key
    mv your.encrypted.key your.key
    

    the -aes256 tells openssl to encrypt the key with AES256.

    As ArianFaurtosh has correctly pointed out: For the encryption algorithm you can use aes128aes192aes256camellia128camellia192camellia256des (which you definitely should avoid), des3 or idea

  • remove it
    openssl rsa -in your.key -out your.open.key
    

    you will be asked for your passphrase one last time
    by omitting the -aes256 you tell openssl to not encrypt the output.

    mv your.open.key your.key

How to detect changes in a directory with Bash

https://www.jpablo128.com/how-to-detect-changes-in-a-directory-with-bash/

Sometimes it may be useful to have a script detect whether the contents in a directory have changed since the last time script was run, but excluding some of the files or directories inside. This may be used, among other things, to make backups, for example: there are situations where, instead of doing incremental backups, one might want to do a full backup, but only if there are any changes. Notice that I’m not talking about “monitoring” a directory in real time to detect changes (for that, check out inotify).

The stat way

To check a complete directory without excluding anything inside it, it’s probaly enough to use stat.

You can use a script like this:

The way it works is quite simple. The script somehow needs to keep track of the results of running stat on the directory from one time to the next. To do this, it just uses a text file (specified by the variable OLD_STAT_FILE): if the file exists, it will load its contents in the variable OLD_STAT, if not, it will just set OLD_STAT to any string (‘nothing’, in the example). Then, the script just runs stat on the directory, and compares the result with the OLD_STAT value, if they differ, it means that there was some change in the directory. In such case, you can do whatever you want (backup the directory, or whatever) and then you need to update the contents of the text file where you keep the result of stat -t.

Excluding things from the directory

If we want to check whether the directory has changed but excluding one or more files or directories inside the main directory, we can take a different route. The general process is the same: keep and “old status” of the directory and compare with the “new status”, but instead of using stat we can use a series of commands.

Here’s the code for the new script:

The structure of this script is similar to the previous one. Instead of using stat we are using the sha1sum of something to control whether things have changed or not. The key line in this script is where we assign NEW_SUM, let’s disect it:

  • find $DIR_TO_CHECK/* \! -path "$PATH_TO_EXCLUDE" -print0: First, we get a list of all the files in the directory withfind. Using the parameter -path preceded with \! tells find to exclude the specified path. You may specify more than one path repeating that same structure (\! -path $PATH_1 \! -path $PATH_2 ...). We use -print0 to force findto separate the file names with a null character, instead of a new line (we need that to pipe things properly intoxargs).
  • xargs -0 du -b --time --exclude=$PATH_TO_EXCLUDE: We get a list of all those files (excluding the path or paths that we want to ignore) with their disk usage (size), and a date and time of last modification. That is, each line of the output has the form ” 
  • sort -k4,4: We sort the previous list by the 4th field, which is the full path of the file or directory. This sorted list, in a way, reflects the “status” of the whole directory we want to check. If a file or directory is added, removed or renamed, or the size or modification time of any line in this listing changes, this listing will reflect that change.
  • sha1sum: A sum (for example a sha1 sum) of the previous listing is a way to encode the “status” of our directory (excluding whatever we want to exclude). So, at this point, doing the sha1sum of the list we obtain a piece of data that encodes somehow a particular state of the directory.
  • awk '{print $1}': This is done just to clean up the output of sha1sum.

That’s all there is to it. Each time the script is run, it calculates this key sum. If the current sum differs from the old one (that was read from the file), we can be sure that something changed in our directory.