Linux Server Setup: A Beginner's Guide Updated

Linux
1

If you’re venturing into the world of Linux, setting up a Linux server offers a hands-on way to deepen your understanding of Linux and server administration. Whether for hosting services, running applications, or building a home lab, a Linux server provides exceptional flexibility, performance, and control.

This guide will lead you through the essential steps to set up a robust and secure Linux server, paving the way for more advanced projects.

Key Takeaways

  • Distribution Choice: Select a distribution that aligns with your experience level and project requirements.
  • Security First: Implement SSH key authentication, firewalls, and tools like Fail2Ban to protect against unauthorized access.
  • System Stability: Use monitoring tools (htop, glances) and log analysis (journalctl, /var/log files) to identify potential issues early.
  • Smart Automation: Schedule updates and backups, but always test them in a non-production environment first.
  • Hands-On Learning: Experiment with containers, web servers, or media services to enhance your skills.

Why Build a Linux Server?

Unlike pre-configured hosting solutions, creating and managing your own Linux server allows you to explore the underlying technologies that drive modern applications and services. It’s an excellent option if you’re looking to expand your knowledge or establish a foundation for future Linux-based projects.

By building your own Linux server, you can:

  • Learn networking, system administration, and security best practices.
  • Run custom applications or services tailored to your specific needs.
  • Maintain control over your data and ensure its privacy.
  • Avoid vendor lock-in and the limitations of proprietary solutions.

Whether you aim to build a homelab, host a website, or explore advanced IT topics, a Linux server is a versatile tool that adapts to your evolving skills and knowledge.

Choosing the Right Linux Distribution

Selecting the right Linux distribution is a critical decision when setting up your server. Your choice will influence the available tools, the level of support you can access, and the overall management experience.

Some popular distributions include:

  • Ubuntu Server: Known for its user-friendliness and extensive community support, Ubuntu Server is an excellent starting point for Linux newcomers.
  • Debian: Boasting a vast software repository, Debian is a solid choice for building a reliable and stable server.
  • OpenSUSE: Equipped with powerful tools like YaST, OpenSUSE offers a versatile platform for managing server configurations.
  • Fedora: Based on Red Hat Enterprise Linux (RHEL), Fedora appeals to those who prefer to stay on the cutting edge of Linux technology.
  • AlmaLinux and Rocky Linux: These distributions offer compatibility with RHEL, making them suitable for enterprise environments.

Each distribution has unique strengths, so carefully consider your specific needs and goals before making a selection.

Choosing Your Hardware or Virtual Machine (VM)

Selecting the appropriate hardware or virtual machine (VM) is essential for creating a Linux server that meets your requirements. The primary question to consider is whether you prefer a self-hosted server or one hosted by a cloud provider.

Hardware

For self-hosting (or a homelab), even older hardware can be a cost-effective way to get started. However, for production environments and resource-intensive applications, cloud infrastructure is generally the preferred choice.

From a processor perspective, consumer-grade hardware like Intel Core i5/i7 or AMD Ryzen 5/7 is typically sufficient for self-hosted setups. For production workloads, server-grade processors such as Intel Xeon or AMD EPYC are recommended.

RAM is another crucial factor. While 1 GB might suffice for basic setups, databases or container orchestration will require more. In general, more RAM is better.

SSDs (Solid State Drives) are essential for faster read/write performance, especially if you plan to host databases or serve numerous files. You might also benefit from RAID arrays, a technique that combines multiple drives for enhanced redundancy or performance.

Your network connection is also important. Ethernet is preferable to Wi-Fi for stability and performance. Gigabit Ethernet is now standard for most setups. If you plan to host your server in the cloud, providers typically offer high-performance network connections.

Virtual Machine (VM)

If you prefer to run a Virtual Machine (VM) on a host machine, ensure that the host has adequate resources to support the VM. A hypervisor such as Proxmox, VirtualBox, VMware, or KVM allows you to easily create and manage virtual servers. As with hardware, allocate sufficient CPU cores, RAM, and disk space based on the workload.

Cloud providers offer Linux VMs on reliable hardware. If you prefer not to manage hardware, this is a convenient and cost-effective solution.

VMs also allow for seamless snapshots, which are invaluable for testing configurations or updating software. Regularly taking snapshots enables you to revert to a previous state if something goes wrong, saving time and effort in recovery.

By carefully planning your hardware or VM setup, you’ll establish a solid foundation for your Linux server. Services offer preconfigured and optimized VMs to streamline the process.

Installing Linux and Initial Setup

The first step is to install Linux. The process is similar for both hardware and self-hosted virtual machines. Here, we’ll focus on installing Linux on self-hosted hardware.

Note: For a Linux VM from a cloud hosting provider, these steps are usually unnecessary, as the installation is often completed with a few clicks on the provider’s website.

Step 1: Download the ISO.
Go to the website of your chosen Linux distribution and download the latest ISO. For example, if you’re installing Ubuntu Server go to ubuntu.com/server.

Step 2: Create Bootable Media.
Use tools like Rufus (Windows), BalenaEtcher (Linux/Windows/Mac) or dd (Linux command-line) to create a bootable USB or virtual CD-ROM.

Step 3: Boot and Install.
Insert the bootable media into your machine and boot the system. Follow the installer’s prompts to set up partitions, select software and configure the base system. Most distributions have a guided installation for beginners.

Once Linux is installed, you’ll need to configure the system for your specific server use.

Setting a Static IP

The most effective method to assign a Static IP address to your server is to configure it directly through your router’s settings.

Here’s how:

  1. Access Your Router’s Configuration Page:
    Open a web browser and enter your router’s IP address. Common addresses include 192.168.1.1 or 192.168.0.1.

  2. Navigate to the DHCP Settings:
    Look for sections labeled “DHCP Server,” “LAN Settings,” or similar. The exact location varies by router model.

  3. Find the Static IP Assignment or Reservation Section:
    Many routers offer a feature to assign static IPs to specific devices based on their MAC address. This is often called “Address Reservation” or “Static DHCP.”

  4. Add a New Reservation:
    Enter the server’s MAC address (you can find this by running ip addr on the server) and the desired static IP address within your network’s IP range.

  5. Save and Reboot:
    Save the changes and reboot your router and server. The server should now consistently receive the assigned static IP address.

Here’s another way to manually set a static IP on Ubuntu server using Netplan (a Ubuntu utility that simplifies network configuration using YAML files, making it easier to manage IP addresses and routes):

Step 1: Find your network interface with ip a or ifconfig.

Step 2: Edit the network configuration file.
The location of the file is typically in the /etc/netplan/ directory. The specific file name often ends with .yaml (e.g., 01-netcfg.yaml or 50-cloud-init.yaml).

Example File Path:

/etc/netplan/01-netcfg.yaml

You can list all Netplan configuration files in the directory to confirm:

ls /etc/netplan/

Edit the file with a text editor like nano or vim:

sudo vi /etc/netplan/01-netcfg.yaml

Example file changes:

network:
  version: 2
  renderer: networkd
  ethernets:
    eth0:
      addresses:
        - 192.168.1.100/24
      gateway4: 192.168.1.1
      nameservers:
        addresses:
          - 8.8.8.8
          - 8.8.4.4

Save and apply the changes with sudo netplan apply.

Step 3: Restart your network service to ensure the new configuration takes effect.

Static IPs can also be configured via your router’s settings.

Creating a New User with Administrator Privileges

Working as root is discouraged as it gives full access to the system and can lead to accidental or malicious damage. Instead, create a new user with admin (sudo) privileges:

Step 1: Add a new user:

adduser yourusername

Step 2: Grant administrative privileges:

usermod -aG sudo yourusername

Step 3: Test the new user:
Log out of the root account and log in with the new username. Use the sudo command to ensure administrative access works:

sudo apt update && sudo apt upgrade

Now your server will have a stable identity on the network and a secure user setup to manage it.

Fail2Ban and Similar Tools

Fail2Ban is a security tool that helps protect your server from brute-force and other attacks by monitoring log files and banning IP addresses that exhibit malicious behavior.

Installing and Configuring Fail2Ban

Step 1: Install Fail2Ban:

sudo apt install fail2ban  # For Debian/Ubuntu
sudo dnf install fail2ban  # For Fedora/AlmaLinux

Step 2: Create a local configuration file:

sudo cp /etc/fail2ban/jail.conf /etc/fail2ban/jail.local

Step 3: Enable SSH protection:
Edit the jail.local file and ensure the [sshd] section is enabled:

[sshd]
enabled = true
port = ssh
logpath = /var/log/auth.log  # Adjust for your distribution
maxretry = 5

Step 4: Restart Fail2Ban:

sudo systemctl restart fail2ban

Step 5: Check active bans:

sudo fail2ban-client status sshd

Other tools like DenyHosts and CSF (ConfigServer Security & Firewall) are also useful for server security and can work alongside or instead of Fail2Ban depending on your needs.
With this in place, your server will be significantly more secure against unauthorized access and malicious activity.

Automating Updates

Automation can save time and ensure your server remains up to date and secure; however, be cautious, as unattended updates can occasionally introduce compatibility issues or break services. So is usually not recommended in production environments. Always test updates in a staging environment if possible.

Step 1: Unattended Upgrades:
Automatically install security updates on Debian/Ubuntu systems.

sudo apt install unattended-upgrades
sudo dpkg-reconfigure unattended-upgrades

Step 2: Cron Jobs:
Schedule tasks such as cleaning up temporary files or running system updates.Edit your crontab:

sudo crontab -e

Add a job to update and upgrade the system every day:

0 3 * * * apt update && apt upgrade -y

By leveraging these tools and practices, you can maintain optimal server performance with minimal manual intervention.

Key Concepts for Linux Server Setup

When setting up a Linux server, you need to understand a few basic concepts that will help you manage and secure your system. The building blocks of server administration, for secure connections, stable operation, and successful troubleshooting.

From setting up secure access protocols, to firewalls and system performance monitoring, understanding these will let you unlock your server’s full potential. Let’s take a look.

SSH (Secure Shell)

SSH is an important protocol used for securely accessing and managing your server. By default, it uses encryption so the data between your device and the server is secure. This makes SSH an essential tool for remote Linux server administration.

You can use SSH to log in to your server remotely and execute commands in a terminal emulator, restart services, transfer files with SFTP (Secure File Transfer Protocol), and monitor your server’s health. It is an indispensable tool for remote Linux server management.

Most Linux distributions include OpenSSH, making it easy to get started. To increase security, we recommend setting up SSH key authentication instead of password-based login. Not only is SSH key authentication more secure against brute-force attacks, but it’s also more convenient, and less prone to authentication errors.

Configuring SSH Key Authentication

Here’s how to set it up:

Step 1: Generate an SSH key pair on your local machine:

ssh-keygen -t rsa -b 4096 -C "your_email@example.com"

Save the key in the default location (e.g., ~/.ssh/id_rsa) and set a passphrase for added security.

Step 2: Copy the public key to your server:
Use the ssh-copy-id command to add your public key to the server:

ssh-copy-id username@your_server_ip

Alternatively, you can manually copy the contents of your ~/.ssh/id_rsa.pub file to the server’s ~/.ssh/authorized_keys file.

Step 3: Test the setup:
Log in again using your private key:

ssh username@your_server_ip

Step 4: Disable password-based authentication:
Edit the SSH configuration file on your server:

sudo nano /etc/ssh/sshd_config

Set the following options:

PasswordAuthentication no
PermitRootLogin no

Restart the SSH service:

sudo systemctl restart sshd

Firewalls

A firewall is a security feature that controls incoming and outgoing network traffic to your server. It acts as a barrier, preventing unauthorized access while allowing legitimate traffic to pass through.

Firewalls work by managing “ports,” which are like doors that allow data to flow to specific services on your server. By closing unnecessary ports, you reduce the risk of unauthorized access.

Configuring a firewall, such as UFW (Uncomplicated Firewall), firewalld, or Nftables is one of the first steps in securing your server. UFW often includes profiles for services like SSH, Nginx and others, making it easy to allow necessary traffic while blocking others. Reviewing and updating your firewall rules periodically ensures your server remains secure as you add or remove services.

Setting Up a Basic Firewall

The most effective method to configure a basic firewall for your Linux server is using firewalld due to its dynamic nature and ease of management. It is particularly effective because it allows for runtime and permanent rule changes without restarting services.

Here’s how to set up a basic firewall using firewalld on distributions like Fedora and AlmaLinux:

Step 1: Start and enable firewalld:

sudo systemctl start firewalld
sudo systemctl enable firewalld

Step 2: Allow SSH traffic:

sudo firewall-cmd --permanent --add-service=ssh
sudo firewall-cmd --reload

Step 3: Verify the rules:

sudo firewall-cmd --list-all

The most common tools for managing firewalls on Linux are UFW (Uncomplicated Firewall) and firewalld. Here are two quick examples:

Using UFW (Ubuntu):

Step 1: Allow SSH traffic:

sudo ufw allow SSH

Step 2: Enable the firewall:

sudo ufw enable

Step 3: Check the status:

sudo ufw status

System Services

A Linux server is a blank canvas for innovation and learning. Services are background programs running on your Linux server, such as web servers (e.g., Apache, Nginx), databases (e.g., MySQL, MongoDB), file-sharing systems (e.g., Samba, Nextcloud), scripting platforms (e.g., PHP, Python), containerization platforms (e.g., Docker, Podman), mail servers (e.g., Postfix, Exim), and many others.

They are essential to delivering functionality. Properly managing these services ensures that your server performs efficiently and remains secure.

Running a Media Server

Turn your server into a multimedia hub by setting up a media server. Tools like Plex, Emby or Jellyfin can stream movies, music and photos to devices across your network.

  • Plex: Offers a user-friendly interface and remote streaming capabilities.
  • Jellyfin: A free and open-source alternative with no subscription required.
  • Emby: Intuitive media organization for seamless access across devices.
  • Universal Media Server: A free, versatile media server supporting many devices.
  • Serviio: Stream media to TVs, Blu-ray players, and consoles with ease.

Host a Website or Blog

With a Linux server, you can host your own website or blog using web servers like Apache or Nginx. Combine them with tools like WordPress or Hugo for easy content management.

  • LAMP/LEMP Stack: Set up a Linux, Apache/Nginx, MySQL, and PHP stack for dynamic websites.
  • CMS: Content Management Systems like WordPress, Magento, Joomla, or Discourse for websites and e-commerce.
  • Hugo: A static site generator for creating fast, secure, and simple websites.
  • Ghost: A modern platform for professional blogging, optimized for speed and flexibility.
  • Security: Use SSL certificates with tools like Let’s Encrypt to secure your site.

Build Your Own Cloud or NAS

Turn your server into a network-attached storage (NAS) device or personal cloud with tools like Nextcloud, ownCloud, or alternatives like Seafile and Syncthing.

  • Nextcloud: A popular option for hosting personal or shared storage with additional features like calendars and document editing.
  • ownCloud: Similar to Nextcloud, offering reliable file synchronization and sharing with enterprise-focused extensions.
  • Seafile: Known for its high-performance and efficient data synchronization.
  • Syncthing: A fully open-source and decentralized file synchronization solution.
  • RAID: For local NAS setups, consider using RAID for data redundancy.

Building and managing your first Linux server provides unlimited opportunities to learn and experiment, so with a solid distribution, the right resources, a secure configuration, and reliable monitoring, you’ve laid a strong foundation.