David/xpeditis2.0
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
55e44ab21c
xpeditis2.0/docker/portainer-stack-staging.yml
David-Henri ARNAUD 5d06ad791f feat: Portainer stacks for staging & production deployment with Traefik 
🐳 Docker Deployment Infrastructure
Complete Portainer stacks with Traefik reverse proxy integration for zero-downtime deployments

## Stack Files Created

### 1. Staging Stack (docker/portainer-stack-staging.yml)
**Services** (4 containers):
- `postgres-staging`: PostgreSQL 15 (db.t3.medium equivalent)
- `redis-staging`: Redis 7 with 512MB cache
- `backend-staging`: NestJS API (1 instance)
- `frontend-staging`: Next.js app (1 instance)

**Domains**:
- Frontend: `staging.xpeditis.com`
- Backend API: `api-staging.xpeditis.com`

**Features**:
- HTTP → HTTPS redirect
- Let's Encrypt SSL certificates
- Health checks on all services
- Security headers (HSTS, XSS protection, frame deny)
- Rate limiting via Traefik
- Sandbox carrier APIs
- Sentry monitoring (10% sampling)

### 2. Production Stack (docker/portainer-stack-production.yml)
**Services** (6 containers for High Availability):
- `postgres-prod`: PostgreSQL 15 with automated backups
- `redis-prod`: Redis 7 with persistence (1GB cache)
- `backend-prod-1` & `backend-prod-2`: NestJS API (2 instances, load balanced)
- `frontend-prod-1` & `frontend-prod-2`: Next.js app (2 instances, load balanced)

**Domains**:
- Frontend: `xpeditis.com` + `www.xpeditis.com` (auto-redirect to non-www)
- Backend API: `api.xpeditis.com`

**Features**:
- **Zero-downtime deployments** (rolling updates with 2 instances)
- **Load balancing** with sticky sessions
- **Strict security headers** (HSTS 2 years, CSP, force TLS)
- **Resource limits** (CPU, memory)
- **Production carrier APIs** (Maersk, MSC, CMA CGM, Hapag-Lloyd, ONE)
- **Enhanced monitoring** (Sentry + Google Analytics)
- **WWW redirect** (www → non-www)
- **Rate limiting** (stricter than staging)

### 3. Environment Files
- `docker/.env.staging.example`: Template for staging environment variables
- `docker/.env.production.example`: Template for production environment variables

**Variables** (30+ required):
- Database credentials (PostgreSQL, Redis)
- JWT secrets (256-512 bits)
- AWS configuration (S3, SES, region)
- Carrier API keys (Maersk, MSC, CMA CGM, etc.)
- Monitoring (Sentry DSN, Google Analytics)
- Email service configuration

### 4. Deployment Guide (docker/PORTAINER_DEPLOYMENT_GUIDE.md)
**Comprehensive 400+ line guide** covering:
- Prerequisites (server, Traefik, DNS, Docker images)
- Step-by-step Portainer deployment
- Environment variables configuration
- SSL/TLS certificate verification
- Health check validation
- Troubleshooting (5 common issues with solutions)
- Rolling updates (zero-downtime)
- Monitoring setup (Portainer, Sentry, logs)
- Security best practices (12 recommendations)
- Backup procedures

## 🏗️ Architecture Highlights

### High Availability (Production)
```
Traefik Load Balancer
    ├── frontend-prod-1 ──┐
    └── frontend-prod-2 ──┼── Sticky Sessions
                          │
    ├── backend-prod-1 ───┤
    └── backend-prod-2 ───┘
            │
            ├── postgres-prod (Single instance with backups)
            └── redis-prod (Persistence enabled)
```

### Traefik Labels Integration
- **HTTPS Routing**: Host-based routing with SSL termination
- **HTTP Redirect**: Automatic HTTP → HTTPS (permanent 301)
- **Security Middleware**: Custom headers, HSTS, XSS protection
- **Compression**: Gzip compression for responses
- **Rate Limiting**: Traefik-level + application-level
- **Health Checks**: Automatic container removal if unhealthy
- **Sticky Sessions**: Cookie-based session affinity

### Network Architecture
- **Internal Network**: `xpeditis_internal_staging` / `xpeditis_internal_prod` (isolated)
- **Traefik Network**: `traefik_network` (external, shared with Traefik)
- **Database/Redis**: Only accessible from internal network
- **Frontend/Backend**: Connected to both networks (internal + Traefik)

## 📊 Resource Allocation

### Staging (Single Instances)
- PostgreSQL: 2 vCPU, 4GB RAM
- Redis: 0.5 vCPU, 512MB cache
- Backend: 1 vCPU, 1GB RAM
- Frontend: 1 vCPU, 1GB RAM
- **Total**: ~4 vCPU, ~6.5GB RAM

### Production (High Availability)
- PostgreSQL: 2 vCPU, 4GB RAM (limits)
- Redis: 1 vCPU, 1.5GB RAM (limits)
- Backend x2: 2 vCPU, 2GB RAM each (4 vCPU, 4GB total)
- Frontend x2: 2 vCPU, 2GB RAM each (4 vCPU, 4GB total)
- **Total**: ~13 vCPU, ~17GB RAM

## 🔒 Security Features

1. **SSL/TLS**: Let's Encrypt certificates with auto-renewal
2. **HSTS**: Strict-Transport-Security (1 year staging, 2 years production)
3. **Security Headers**: XSS protection, frame deny, content-type nosniff
4. **Rate Limiting**: Traefik (50-100 req/min) + Application-level
5. **Secrets Management**: Environment variables, never hardcoded
6. **Network Isolation**: Services communicate only via internal network
7. **Health Checks**: Automatic restart on failure
8. **Resource Limits**: Prevent resource exhaustion attacks

## 🚀 Deployment Process

1. **Prerequisites**: Traefik + DNS configured
2. **Build Images**: Docker build + push to registry
3. **Configure Environment**: Copy .env.example, fill secrets
4. **Deploy Stack**: Portainer UI → Add Stack → Deploy
5. **Verify**: Health checks, SSL, DNS, logs
6. **Monitor**: Sentry + Portainer stats

## 📦 Files Summary

```
docker/
├── portainer-stack-staging.yml      (250 lines) - 4 services
├── portainer-stack-production.yml   (450 lines) - 6 services
├── .env.staging.example             (80 lines)
├── .env.production.example          (100 lines)
└── PORTAINER_DEPLOYMENT_GUIDE.md    (400+ lines)
```

Total: 5 files, ~1,280 lines of infrastructure-as-code

## 🎯 Next Steps

1. Build Docker images (frontend + backend)
2. Push to Docker registry (Docker Hub / GHCR)
3. Configure DNS (staging + production domains)
4. Deploy Traefik (if not already done)
5. Copy .env files and fill secrets
6. Deploy staging stack via Portainer
7. Test staging thoroughly
8. Deploy production stack
9. Setup monitoring (Sentry, Uptime Robot)

## 🔗 Related Documentation

- [DEPLOYMENT.md](../DEPLOYMENT.md) - General deployment guide
- [ARCHITECTURE.md](../ARCHITECTURE.md) - System architecture
- [PHASE4_SUMMARY.md](../PHASE4_SUMMARY.md) - Phase 4 completion status

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-15 11:55:59 +02:00

254 lines
11 KiB
YAML
Raw Blame History

version: '3.8'
# Xpeditis - Stack STAGING/PREPROD
# Portainer Stack avec Traefik reverse proxy
# Domaines: staging.xpeditis.com (frontend) | api-staging.xpeditis.com (backend)
services:
# PostgreSQL Database
postgres-staging:
image: postgres:15-alpine
container_name: xpeditis-postgres-staging
restart: unless-stopped
environment:
POSTGRES_DB: ${POSTGRES_DB:-xpeditis_staging}
POSTGRES_USER: ${POSTGRES_USER:-xpeditis}
POSTGRES_PASSWORD: ${POSTGRES_PASSWORD:?error}
PGDATA: /var/lib/postgresql/data/pgdata
volumes:
- postgres_data_staging:/var/lib/postgresql/data
networks:
- xpeditis_internal_staging
healthcheck:
test: ["CMD-SHELL", "pg_isready -U ${POSTGRES_USER:-xpeditis}"]
interval: 10s
timeout: 5s
retries: 5
# Redis Cache
redis-staging:
image: redis:7-alpine
container_name: xpeditis-redis-staging
restart: unless-stopped
command: redis-server --requirepass ${REDIS_PASSWORD:?error} --maxmemory 512mb --maxmemory-policy allkeys-lru
volumes:
- redis_data_staging:/data
networks:
- xpeditis_internal_staging
healthcheck:
test: ["CMD", "redis-cli", "--raw", "incr", "ping"]
interval: 10s
timeout: 3s
retries: 5
# Backend API (NestJS)
backend-staging:
image: ${DOCKER_REGISTRY:-docker.io}/${BACKEND_IMAGE:-xpeditis/backend}:${BACKEND_TAG:-staging-latest}
container_name: xpeditis-backend-staging
restart: unless-stopped
depends_on:
postgres-staging:
condition: service_healthy
redis-staging:
condition: service_healthy
environment:
# Application
NODE_ENV: staging
PORT: 4000
# Database
DATABASE_HOST: postgres-staging
DATABASE_PORT: 5432
DATABASE_NAME: ${POSTGRES_DB:-xpeditis_staging}
DATABASE_USER: ${POSTGRES_USER:-xpeditis}
DATABASE_PASSWORD: ${POSTGRES_PASSWORD:?error}
DATABASE_SYNC: "false"
DATABASE_LOGGING: "true"
# Redis
REDIS_HOST: redis-staging
REDIS_PORT: 6379
REDIS_PASSWORD: ${REDIS_PASSWORD:?error}
# JWT
JWT_SECRET: ${JWT_SECRET:?error}
JWT_ACCESS_EXPIRATION: 15m
JWT_REFRESH_EXPIRATION: 7d
# CORS
CORS_ORIGIN: https://staging.xpeditis.com,http://localhost:3000
# Sentry (Monitoring)
SENTRY_DSN: ${SENTRY_DSN:-}
SENTRY_ENVIRONMENT: staging
SENTRY_TRACES_SAMPLE_RATE: 0.1
SENTRY_PROFILES_SAMPLE_RATE: 0.05
# AWS S3 (or MinIO)
AWS_REGION: ${AWS_REGION:-eu-west-3}
AWS_ACCESS_KEY_ID: ${AWS_ACCESS_KEY_ID:?error}
AWS_SECRET_ACCESS_KEY: ${AWS_SECRET_ACCESS_KEY:?error}
S3_BUCKET_DOCUMENTS: ${S3_BUCKET_DOCUMENTS:-xpeditis-staging-documents}
S3_BUCKET_UPLOADS: ${S3_BUCKET_UPLOADS:-xpeditis-staging-uploads}
# Email (AWS SES or SMTP)
EMAIL_SERVICE: ${EMAIL_SERVICE:-ses}
EMAIL_FROM: ${EMAIL_FROM:-noreply@staging.xpeditis.com}
EMAIL_FROM_NAME: Xpeditis Staging
AWS_SES_REGION: ${AWS_SES_REGION:-eu-west-1}
# Carrier APIs (Sandbox)
MAERSK_API_URL: ${MAERSK_API_URL_SANDBOX:-https://sandbox.api.maersk.com}
MAERSK_API_KEY: ${MAERSK_API_KEY_SANDBOX:-}
MSC_API_URL: ${MSC_API_URL_SANDBOX:-}
MSC_API_KEY: ${MSC_API_KEY_SANDBOX:-}
# Security
RATE_LIMIT_GLOBAL: 200
RATE_LIMIT_AUTH: 10
RATE_LIMIT_SEARCH: 50
RATE_LIMIT_BOOKING: 30
volumes:
- backend_logs_staging:/app/logs
networks:
- xpeditis_internal_staging
- traefik_network
labels:
- "traefik.enable=true"
- "traefik.docker.network=traefik_network"
# HTTPS Route
- "traefik.http.routers.xpeditis-backend-staging.rule=Host(`api-staging.xpeditis.com`)"
- "traefik.http.routers.xpeditis-backend-staging.entrypoints=websecure"
- "traefik.http.routers.xpeditis-backend-staging.tls=true"
- "traefik.http.routers.xpeditis-backend-staging.tls.certresolver=letsencrypt"
- "traefik.http.routers.xpeditis-backend-staging.priority=100"
- "traefik.http.services.xpeditis-backend-staging.loadbalancer.server.port=4000"
- "traefik.http.routers.xpeditis-backend-staging.middlewares=xpeditis-backend-staging-headers,xpeditis-backend-staging-security"
# HTTP → HTTPS Redirect
- "traefik.http.routers.xpeditis-backend-staging-http.rule=Host(`api-staging.xpeditis.com`)"
- "traefik.http.routers.xpeditis-backend-staging-http.entrypoints=web"
- "traefik.http.routers.xpeditis-backend-staging-http.priority=100"
- "traefik.http.routers.xpeditis-backend-staging-http.middlewares=xpeditis-backend-staging-redirect"
- "traefik.http.routers.xpeditis-backend-staging-http.service=xpeditis-backend-staging"
- "traefik.http.middlewares.xpeditis-backend-staging-redirect.redirectscheme.scheme=https"
- "traefik.http.middlewares.xpeditis-backend-staging-redirect.redirectscheme.permanent=true"
# Middleware Headers
- "traefik.http.middlewares.xpeditis-backend-staging-headers.headers.customRequestHeaders.X-Forwarded-Proto=https"
- "traefik.http.middlewares.xpeditis-backend-staging-headers.headers.customRequestHeaders.X-Forwarded-For="
- "traefik.http.middlewares.xpeditis-backend-staging-headers.headers.customRequestHeaders.X-Real-IP="
# Security Headers
- "traefik.http.middlewares.xpeditis-backend-staging-security.headers.frameDeny=true"
- "traefik.http.middlewares.xpeditis-backend-staging-security.headers.contentTypeNosniff=true"
- "traefik.http.middlewares.xpeditis-backend-staging-security.headers.browserXssFilter=true"
- "traefik.http.middlewares.xpeditis-backend-staging-security.headers.stsSeconds=31536000"
- "traefik.http.middlewares.xpeditis-backend-staging-security.headers.stsIncludeSubdomains=true"
- "traefik.http.middlewares.xpeditis-backend-staging-security.headers.stsPreload=true"
# Rate Limiting
- "traefik.http.middlewares.xpeditis-backend-staging-ratelimit.ratelimit.average=100"
- "traefik.http.middlewares.xpeditis-backend-staging-ratelimit.ratelimit.burst=200"
# Health Check
- "traefik.http.services.xpeditis-backend-staging.loadbalancer.healthcheck.path=/health"
- "traefik.http.services.xpeditis-backend-staging.loadbalancer.healthcheck.interval=30s"
- "traefik.http.services.xpeditis-backend-staging.loadbalancer.healthcheck.timeout=5s"
healthcheck:
test: ["CMD", "node", "-e", "require('http').get('http://localhost:4000/health', (r) => process.exit(r.statusCode === 200 ? 0 : 1))"]
interval: 30s
timeout: 10s
retries: 3
start_period: 40s
# Frontend (Next.js)
frontend-staging:
image: ${DOCKER_REGISTRY:-docker.io}/${FRONTEND_IMAGE:-xpeditis/frontend}:${FRONTEND_TAG:-staging-latest}
container_name: xpeditis-frontend-staging
restart: unless-stopped
depends_on:
- backend-staging
environment:
NODE_ENV: staging
NEXT_PUBLIC_API_URL: https://api-staging.xpeditis.com
NEXT_PUBLIC_APP_URL: https://staging.xpeditis.com
NEXT_PUBLIC_SENTRY_DSN: ${NEXT_PUBLIC_SENTRY_DSN:-}
NEXT_PUBLIC_SENTRY_ENVIRONMENT: staging
NEXT_PUBLIC_GA_MEASUREMENT_ID: ${NEXT_PUBLIC_GA_MEASUREMENT_ID:-}
# Backend API for SSR (internal)
API_URL: http://backend-staging:4000
networks:
- xpeditis_internal_staging
- traefik_network
labels:
- "traefik.enable=true"
- "traefik.docker.network=traefik_network"
# HTTPS Route
- "traefik.http.routers.xpeditis-frontend-staging.rule=Host(`staging.xpeditis.com`)"
- "traefik.http.routers.xpeditis-frontend-staging.entrypoints=websecure"
- "traefik.http.routers.xpeditis-frontend-staging.tls=true"
- "traefik.http.routers.xpeditis-frontend-staging.tls.certresolver=letsencrypt"
- "traefik.http.routers.xpeditis-frontend-staging.priority=100"
- "traefik.http.services.xpeditis-frontend-staging.loadbalancer.server.port=3000"
- "traefik.http.routers.xpeditis-frontend-staging.middlewares=xpeditis-frontend-staging-headers,xpeditis-frontend-staging-security,xpeditis-frontend-staging-compress"
# HTTP → HTTPS Redirect
- "traefik.http.routers.xpeditis-frontend-staging-http.rule=Host(`staging.xpeditis.com`)"
- "traefik.http.routers.xpeditis-frontend-staging-http.entrypoints=web"
- "traefik.http.routers.xpeditis-frontend-staging-http.priority=100"
- "traefik.http.routers.xpeditis-frontend-staging-http.middlewares=xpeditis-frontend-staging-redirect"
- "traefik.http.routers.xpeditis-frontend-staging-http.service=xpeditis-frontend-staging"
- "traefik.http.middlewares.xpeditis-frontend-staging-redirect.redirectscheme.scheme=https"
- "traefik.http.middlewares.xpeditis-frontend-staging-redirect.redirectscheme.permanent=true"
# Middleware Headers
- "traefik.http.middlewares.xpeditis-frontend-staging-headers.headers.customRequestHeaders.X-Forwarded-Proto=https"
- "traefik.http.middlewares.xpeditis-frontend-staging-headers.headers.customRequestHeaders.X-Forwarded-For="
- "traefik.http.middlewares.xpeditis-frontend-staging-headers.headers.customRequestHeaders.X-Real-IP="
# Security Headers
- "traefik.http.middlewares.xpeditis-frontend-staging-security.headers.frameDeny=true"
- "traefik.http.middlewares.xpeditis-frontend-staging-security.headers.contentTypeNosniff=true"
- "traefik.http.middlewares.xpeditis-frontend-staging-security.headers.browserXssFilter=true"
- "traefik.http.middlewares.xpeditis-frontend-staging-security.headers.stsSeconds=31536000"
- "traefik.http.middlewares.xpeditis-frontend-staging-security.headers.stsIncludeSubdomains=true"
- "traefik.http.middlewares.xpeditis-frontend-staging-security.headers.stsPreload=true"
- "traefik.http.middlewares.xpeditis-frontend-staging-security.headers.customResponseHeaders.X-Robots-Tag=noindex,nofollow"
# Compression
- "traefik.http.middlewares.xpeditis-frontend-staging-compress.compress=true"
# Health Check
- "traefik.http.services.xpeditis-frontend-staging.loadbalancer.healthcheck.path=/api/health"
- "traefik.http.services.xpeditis-frontend-staging.loadbalancer.healthcheck.interval=30s"
- "traefik.http.services.xpeditis-frontend-staging.loadbalancer.healthcheck.timeout=5s"
healthcheck:
test: ["CMD-SHELL", "curl -f http://localhost:3000/api/health || exit 1"]
interval: 30s
timeout: 10s
retries: 3
start_period: 40s
networks:
xpeditis_internal_staging:
driver: bridge
name: xpeditis_internal_staging
traefik_network:
external: true
volumes:
postgres_data_staging:
name: xpeditis_postgres_data_staging
redis_data_staging:
name: xpeditis_redis_data_staging
backend_logs_staging:
name: xpeditis_backend_logs_staging
Reference in New Issue View Git Blame Copy Permalink