Skip to content

feat: web UI with FastAPI backend, React frontend, and unified launcher#1094

Closed
Ege-BULUT wants to merge 1 commit into
ScrapeGraphAI:pre/betafrom
Ege-BULUT:pr/web-ui-launcher
Closed

feat: web UI with FastAPI backend, React frontend, and unified launcher#1094
Ege-BULUT wants to merge 1 commit into
ScrapeGraphAI:pre/betafrom
Ege-BULUT:pr/web-ui-launcher

Conversation

@Ege-BULUT

Copy link
Copy Markdown
Contributor

Summary

Adds a complete web interface for ScrapeGraphAI: a FastAPI backend with JSONL logging and debug log viewer, a React 19 + Vite + Tailwind frontend, and a unified launcher script to run everything with a single command.

What's included

Launcher (launcher.py)

Single entry point with flags:

  • --poe: launch via poe tasks (requires poethepoet)
  • --backend-only / --frontend-only: run only one side
  • Auto-detects available tools and starts both servers

Backend (webapp/backend/)

FastAPI application with:

  • /scrape endpoint accepting prompt, source URL, model selection, and backend choice
  • /models endpoint listing available LLM providers and models
  • /logs endpoint streaming JSONL-formatted debug logs
  • JSONL logging with rotation (configurable via environment)
  • Pydantic v2 schemas for request/response validation

Frontend (webapp/frontend/)

React 19 + Vite + Tailwind CSS v3 with:

  • ScraperForm with source URL, prompt, model, and backend selectors
  • LogViewer for real-time debug log streaming
  • ResultViewer with formatted output display
  • Tutorial modal with step-by-step guide
  • TypeScript throughout

Poe tasks

New poe tasks for development:

  • poe web-backend - start the FastAPI dev server
  • poe web-frontend - start the Vite dev server
  • poe web - run both concurrently

Usage

# Quick start (auto-detects tools)
python launcher.py

# Via poe
poe web

Notes

  • Requires Node.js 18+ for the frontend (npm install in webapp/frontend/)
  • Docker Compose also available in webapp/docker-compose.yml
  • Backend runs on port 8000, frontend dev server on port 5173

Add a complete web interface for ScrapeGraphAI with:
- FastAPI backend with JSONL logging and debug log viewer API
- React 19 + Vite + Tailwind frontend with tutorial modal and LogViewer
- Port-aware launcher with --poe, --backend-only, --frontend-only flags
- Docker support for both backend and frontend
- Poe task shortcuts for web development
@dosubot dosubot Bot added size:XXL This PR changes 1000+ lines, ignoring generated files. enhancement New feature or request labels Jun 23, 2026
@VinciGit00 VinciGit00 closed this Jun 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request size:XXL This PR changes 1000+ lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants