Optimizing Redis Server Performance and Kernel Tuning on Linux
Redis is an essential component in modern cloud architectures, acting as an in-memory database, cache layer, and message broker. However, running Redis with default out-of-the-box settings on high-traffic Linux hosts can lead to latency spikes and memory allocation failures.
1. Tuning Linux Kernel Memory Parameters
When Redis writes snapshot dumps (RDB) to disk, it forks background child processes. If the Linux kernel lacks sufficient virtual memory headroom, forks fail. Fix this by setting memory overcommit rules in /etc/sysctl.conf:
# Open sysctl config
sudo nano /etc/sysctl.conf
# Add the following kernel performance parameters:
vm.overcommit_memory = 1
net.core.somaxconn = 65535
# Apply changes live without rebooting
sudo sysctl -p
2. Disabling Transparent Huge Pages (THP)
Transparent Huge Pages degrade Redis latency and increase memory usage significantly. Disable THP permanently by creating a systemd service at /etc/systemd/system/disable-thp.service:
[Unit]
Description=Disable Transparent Huge Pages (THP) for Redis
DefaultDependencies=no
After=sysinit.target local-fs.target
Before=redis-server.service
[Service]
Type=oneshot
ExecStart=/bin/sh -c 'echo never > /sys/kernel/mm/transparent_hugepage/enabled'
[Install]
WantedBy=basic.target
Enable the service:
sudo systemctl daemon-reload
sudo systemctl enable --now disable-thp.service
3. Configuring MaxMemory and Eviction Policies
Edit /etc/redis/redis.conf to prevent Redis from consuming 100% of host RAM:
# Cap Redis memory usage to 75% of available server RAM
maxmemory 4gb
# Automatically evict least recently used (LRU) keys when maxmemory is hit
maxmemory-policy allkeys-lru
Comments