124-webapp/README.md

414 lines
11 KiB
Markdown
Raw Normal View History

2025-10-07 13:02:29 +02:00
# Studio EinsZwoVier Web Application
2025-09-11 16:01:32 +02:00
2025-10-07 13:02:29 +02:00
**FastAPI-based PDF print cost calculator** with automated ink coverage analysis, Matrix integration, and multi-service hub for Studio EinsZwoVier Maker Space.
2025-09-11 16:01:32 +02:00
2025-10-07 13:02:29 +02:00
[![Docker](https://img.shields.io/badge/Docker-Ready-2496ED?logo=docker)](https://www.docker.com/)
[![FastAPI](https://img.shields.io/badge/FastAPI-0.104+-009688?logo=fastapi)](https://fastapi.tiangolo.com/)
[![Matrix](https://img.shields.io/badge/Matrix-Integrated-000000?logo=matrix)](https://matrix.org/)
2025-10-02 12:20:11 +02:00
---
2025-10-07 13:02:29 +02:00
## 🎯 Features
2025-10-02 12:20:11 +02:00
2025-10-07 13:02:29 +02:00
### Core Application
- **📄 PDF Cost Calculator**: Automated ink coverage analysis with color/B&W detection
- **🖼️ Course Management**: Dynamic course list with image gallery and modal viewer
- **📊 Cost Estimation**: Per-page breakdown with configurable rates (€/m²)
- **💬 Matrix Integration**: Automatic order submission to Matrix room
### Integrated Services
- **📚 BookStack Wiki**: Documentation and knowledge base (port 6875)
- **🤖 Ollama + Open WebUI**: Local LLM chatbot interface (port 8080)
- **📨 Matrix Synapse**: Print order collection and payment tracking (port 8008)
- **🐳 Portainer**: Container management dashboard (port 9000)
- **🔄 Watchtower**: Automatic container updates every 24 hours
2025-10-02 12:20:11 +02:00
---
2025-10-07 13:02:29 +02:00
## 🏗️ Architecture
2025-10-02 12:20:11 +02:00
2025-10-07 13:02:29 +02:00
```mermaid
graph TB
subgraph "Studio EinsZwoVier Web App (Port 80)"
LP[🏠 Landing Page<br/>studio-einszwovier.local]
About[ About Page<br/>/about<br/>Courses + Team Info]
Cost[💰 Cost Calculator<br/>/cost<br/>PDF Analysis]
2025-10-02 12:20:11 +02:00
2025-10-07 13:02:29 +02:00
LP --> About
LP --> Cost
end
2025-10-02 12:20:11 +02:00
2025-10-07 13:02:29 +02:00
subgraph "Course Management"
CSV[📝 courses.csv<br/>Title, Description, Dates, Image]
Images[🖼️ Course Images<br/>static/images/courses/]
Modal[🔍 Image Modal<br/>Click to Enlarge]
2025-10-02 12:20:11 +02:00
2025-10-07 13:02:29 +02:00
About --> CSV
CSV --> Images
Images --> Modal
end
2025-09-11 16:01:32 +02:00
2025-10-07 13:02:29 +02:00
subgraph "PDF Processing Pipeline"
Upload[📤 Upload PDF]
Analysis[🔬 Analyze<br/>- Dimensions<br/>- Ink Coverage<br/>- Color Detection]
Quote[📋 Quote Generation<br/>Per-page Breakdown]
2025-09-11 16:01:32 +02:00
2025-10-07 13:02:29 +02:00
Cost --> Upload
Upload --> Analysis
Analysis --> Quote
end
2025-09-17 19:12:31 +02:00
2025-10-07 13:02:29 +02:00
subgraph "Matrix Integration"
MatrixRoom[💬 Matrix Room<br/>Print Orders]
PDF_Upload[📎 PDF Attachment]
Summary[📊 Order Summary<br/>German Language]
2025-09-17 19:12:31 +02:00
2025-10-07 13:02:29 +02:00
Quote --> MatrixRoom
Quote --> PDF_Upload
Quote --> Summary
2025-09-17 19:21:22 +02:00
end
2025-10-07 13:02:29 +02:00
subgraph "Integrated Services"
BookStack[📚 BookStack Wiki<br/>:6875]
Ollama[🤖 Ollama LLM<br/>:11434]
OpenWebUI[💭 Open WebUI<br/>:8080]
Portainer[🐳 Portainer<br/>:9000]
Synapse[📨 Matrix Synapse<br/>:8008]
2025-09-17 19:21:22 +02:00
2025-10-07 13:02:29 +02:00
LP -.-> BookStack
LP -.-> OpenWebUI
LP -.-> Portainer
OpenWebUI --> Ollama
MatrixRoom --> Synapse
2025-09-17 19:21:22 +02:00
end
2025-10-07 13:02:29 +02:00
subgraph "Data Persistence"
Uploads[📁 data/uploads/<br/>PDF Files]
Courses[📋 data/courses.csv<br/>Course List]
MatrixDB[(🗄️ Matrix DB<br/>homeserver.db)]
BookDB[(🗄️ BookStack DB<br/>MariaDB)]
Upload --> Uploads
CSV --> Courses
Synapse --> MatrixDB
BookStack --> BookDB
2025-10-02 12:20:11 +02:00
end
2025-10-07 13:02:29 +02:00
classDef webapp fill:#e3f2fd,stroke:#1976d2,stroke-width:2px
classDef service fill:#fff3e0,stroke:#f57c00,stroke-width:2px
classDef data fill:#f3e5f5,stroke:#7b1fa2,stroke-width:2px
classDef matrix fill:#e8f5e9,stroke:#388e3c,stroke-width:2px
class LP,About,Cost,Upload,Analysis,Quote webapp
class BookStack,Ollama,OpenWebUI,Portainer,Synapse service
class Uploads,Courses,MatrixDB,BookDB data
class MatrixRoom,PDF_Upload,Summary,CSV,Images,Modal matrix
```
---
## 🚀 Quick Start
### Prerequisites
- **Docker** & **Docker Compose** installed
- **Poppler** (for pdf2image - included in Docker)
- **Port availability**: 80, 8008, 8080, 6875, 9000, 11434
### Installation
1. **Clone the repository:**
```bash
git clone https://github.com/arontaupe/124-webapp.git
cd 124-webapp
```
2. **Configure environment:**
```bash
cp .env.example .env
nano .env # Update SERVER_HOSTNAME and passwords
```
3. **Start the stack:**
```bash
docker compose up -d --build
```
4. **Access services:**
- Web App: http://localhost (or http://your-server)
- BookStack: http://localhost:6875
- Open WebUI: http://localhost:8080
- Portainer: http://localhost:9000
- Matrix: http://localhost:8008
### First-Time Setup
1. **Get Matrix Room ID:**
```bash
python get_room_id.py
```
2. **Update .env with room ID:**
```bash
MATRIX_ROOM="!YourRoomID:${SERVER_HOSTNAME}"
```
3. **Restart web container:**
```bash
docker compose restart web
```
---
## 📚 Course Management
Courses are managed via CSV file with optional images:
### Add a Course
1. **Edit `data/courses.csv`:**
```csv
title,description,dates,offen_fuer,image
My Course,Learn cool stuff,"Oct '25",Grade 10,/static/images/courses/my-course.jpg
```
2. **Add course image (optional):**
```bash
cp my-image.jpg static/images/courses/my-course.jpg
```
3. **Changes apply immediately** (no restart needed)
### Course Image Features
- **Thumbnail view**: 80x80px next to course info
- **Hover zoom**: Expands to 200x200px on hover
- **Click to enlarge**: Opens full-size modal viewer
- **Auto-cropping**: `object-fit: cover` ensures uniform display
See [data/KURSE_README.md](data/KURSE_README.md) for detailed documentation.
---
## 🔧 Configuration
### Environment Variables
Key variables in `.env`:
```bash
# Server Configuration
SERVER_HOSTNAME=your-server.com
# Print Rates (€/m²)
RATE_PER_M2_BLACK=4.0
RATE_PER_M2_COLOR=5.0
# Matrix Integration
MATRIX_USER="@einszwovier:${SERVER_HOSTNAME}"
MATRIX_PASS="your_password"
MATRIX_HOMESERVER="http://${SERVER_HOSTNAME}:8008"
MATRIX_ROOM="!RoomID:${SERVER_HOSTNAME}"
# Service Ports
SYNAPSE_PORT=8008
OLLAMA_PORT=11434
OPENWEBUI_PORT=8080
BOOKSTACK_PORT=6875
PORTAINER_PORT=9000
```
See [.env.example](.env.example) for full configuration.
---
## 🐳 Docker Services
| Service | Image | Port | Purpose | Resources |
|---------|-------|------|---------|-----------|
| **web** | Custom (FastAPI) | 80 | Main application | 1 CPU, 1GB RAM |
| **synapse** | matrixdotorg/synapse | 8008 | Matrix homeserver | 2 CPU, 2GB RAM |
| **ollama** | ollama/ollama | 11434 | LLM inference | 6 CPU, 16GB RAM |
| **open-webui** | ghcr.io/open-webui/open-webui | 8080 | LLM chat UI | 2 CPU, 2GB RAM |
| **bookstack** | lscr.io/linuxserver/bookstack | 6875 | Documentation wiki | Default |
| **bookstack-mariadb** | lscr.io/linuxserver/mariadb | 3306 | Database for BookStack | Default |
| **portainer** | portainer/portainer-ce | 9000, 9443 | Container management | Default |
| **watchtower** | containrrr/watchtower | - | Auto-updates (24h) | Default |
### Health Checks
All services have health checks configured:
- **web**: `curl http://localhost:8000/`
- **synapse**: `curl http://localhost:8008/_matrix/static/`
- **ollama**: `curl http://localhost:11434/`
- **open-webui**: `curl http://localhost:8080/`
- **bookstack**: `curl http://localhost/`
- **mariadb**: MariaDB query test
- **portainer**: API status check
- **watchtower**: Process check
---
## 📖 Documentation
- **[SECURITY.md](SECURITY.md)** - Security best practices and secrets management
- **[PORTABILITY.md](PORTABILITY.md)** - Server migration guide
- **[PRE_RELEASE_CHECKLIST.md](PRE_RELEASE_CHECKLIST.md)** - Pre-publication verification
- **[data/KURSE_README.md](data/KURSE_README.md)** - Course management guide
---
## 🔐 Security
**Before deploying to production:**
1. ✅ Change all passwords in `.env`
2. ✅ Generate new `BOOKSTACK_APP_KEY`
3. ✅ Update Matrix credentials
4. ✅ Configure firewall (restrict Portainer access)
5. ✅ Set up HTTPS/SSL
6. ✅ Enable automated backups
See [SECURITY.md](SECURITY.md) for comprehensive security guidelines.
**Security Disclosure:** If you discover a vulnerability, email `einszwovier@gvb-gymnasium.de` instead of opening a public issue.
---
## 🔄 Backup & Restore
### Backup All Data
```bash
./backup.sh
```
Creates timestamped backups of:
- BookStack database & files
- Matrix homeserver data
- PDF uploads
- Course data & images
- Environment configuration
### Restore from Backup
```bash
./restore.sh YYYYMMDD_HHMMSS
```
---
## 🚢 Deployment & Portability
This application is designed to be **fully portable**. To move to a new server:
1. **On old server:**
```bash
./backup.sh
```
2. **On new server:**
```bash
git clone <repo-url>
cd 124-webapp
cp .env.example .env
# Update SERVER_HOSTNAME in .env
./restore.sh YYYYMMDD_HHMMSS
docker compose up -d
```
See [PORTABILITY.md](PORTABILITY.md) for detailed migration guide.
---
## 🛠️ Development
### Local Development
```bash
# Option 1: Direct Python (with auto-reload)
python run_app.py
# Option 2: Docker Compose
docker compose up --build
```
### Project Structure
```
.
├── main.py # FastAPI application
├── cost_calculator.py # PDF analysis logic
├── mailer.py # Matrix integration
├── templates/ # Jinja2 templates
│ ├── base.html
│ ├── landing.html
│ ├── about.html
│ ├── cost-calculator.html
│ └── result.html
├── static/ # CSS, images, fonts
│ ├── css/style.css
│ ├── images/
│ └── fonts/
├── data/
│ ├── courses.csv # Course database
│ └── uploads/ # PDF uploads
├── docker-compose.yml # Service orchestration
├── Dockerfile # Web app container
└── requirements.txt # Python dependencies
```
### Key Technologies
- **FastAPI** - Modern Python web framework
- **PyPDF2** - PDF metadata extraction
- **pdf2image** - PDF to image conversion
- **Pillow + NumPy** - Image processing & ink analysis
- **matrix-nio** - Matrix protocol client
- **Jinja2** - Template engine
- **Gunicorn + Uvicorn** - Production WSGI/ASGI servers
---
## 🤝 Contributing
Contributions are welcome! This is part of **Studio EinsZwoVier**, a collaborative Maker Space.
1. Fork the repository
2. Create a feature branch (`git checkout -b feature/amazing-feature`)
3. Commit your changes (`git commit -m 'Add amazing feature'`)
4. Push to the branch (`git push origin feature/amazing-feature`)
5. Open a Pull Request
---
## 📄 License
This project is part of Studio EinsZwoVier educational initiative.
---
## 📞 Contact
**Studio EinsZwoVier**
Gabriele-von-Bülow-Gymnasium
Tile-Brügge-Weg 63, 13509 Berlin (Tegel)
- **Email**: einszwovier@gvb-gymnasium.de
- **Team**: Aron Petau & Friedrich Weber
- **Hours**: Tuesday - Thursday, 11:00 - 16:00
- **Location**: Room 124
---
## 🙏 Acknowledgments
- Matrix.org for the communication protocol
- Ollama team for local LLM support
- BookStack for the documentation platform
- FastAPI community
- All contributors and students of Studio EinsZwoVier
---
**Made with ❤️ at Studio EinsZwoVier Maker Space**