Shadow-System

Introduction

The Shadow-System project aims to develop a website capable of scraping data from various online sources, including subreddits, comments, and Google Maps. Additionally, the project seeks to implement an automated system for distributing and marketing the website across social media platforms.

System Overview

The Shadow-System is designed to efficiently gather and process data from the internet, focusing on specific platforms such as Reddit and Google Maps. The system will also incorporate automated marketing and distribution strategies to enhance the website's visibility and reach without relying on traditional social media posting methods.

Functional Requirements

• As a User, I should be able to scrape data from specific subreddits.
• As a User, I should be able to scrape comments from Reddit posts.
• As a User, I should be able to scrape location data from Google Maps.
• As a User, I should be able to automate the distribution of website content across social media platforms.
• As a User, I should be able to automate marketing strategies to increase website visibility without manual social media posting.

User Personas

• Data Analyst: Interested in collecting and analyzing data from various online sources.
• Marketing Specialist: Focused on automating marketing strategies and increasing website reach.
• General User: Uses the website to gather information and insights from scraped data.

Core User Flows

• Data Analyst selects subreddit -> initiates data scraping -> reviews collected data.
• Marketing Specialist configures automated distribution -> selects social media platforms -> monitors reach and engagement.
• General User accesses website -> searches for specific data insights -> views results.

Visuals Colors and Theme

• primary: #2B3A67 (deep indigo)
• primary_light: #4C5A8A (light indigo)
• secondary: #F28C28 (amber)
• accent: #E63946 (vibrant red)
• highlight: #FFD166 (warm gold)
• bg: #F7F9FC (light gray)
• surface: rgba(255, 255, 255, 0.8) (white)
• text: #1D1E22 (dark gray)
• text_muted: #6C757D (muted gray)
• border: rgba(0, 0, 0, 0.1) (light black)

Signature Design Concept

The Shadow-System homepage will feature an interactive galaxy map where each star represents a different feature or section of the website. Users can click on a star to open a task card, drag to rotate the galaxy cluster, and hover to highlight connections between features. This dynamic and engaging interface will be built using @react-three/fiber and @react-three/drei for 3D interactions, providing a unique and memorable user experience.

Interaction Model & Motion Direction

The landing page will utilize a "parallax" interaction model, creating a layered depth effect as users scroll. Decorative elements like atmospheric blobs and distant shapes will translate at different speeds, while real content remains in the normal flow. This approach is ideal for storytelling and creating a visually rich first impression.

Non-Functional Requirements

• The system should efficiently handle large volumes of data scraping without performance degradation.
• The automated marketing system must comply with social media platform policies and guidelines.
• The website should be responsive and accessible across various devices and screen sizes.

Tech Stack

• Frontend: React for Web
• Backend: Python, FastAPI
• Database: MongoDB
• AI Models: Not specified
• AI Tools: Not specified
• Local Orchestration: Docker, docker-compose
• Server-side Orchestration: Kubernetes

Assumptions and Constraints

• The system assumes access to public APIs for data scraping from Reddit and Google Maps.
• The automated marketing system will focus on platforms where the user has existing accounts.
• The project will adhere to legal and ethical guidelines for data scraping and distribution.

Glossary

• Scraping: The process of extracting data from websites.
• Automated Marketing: Using technology to perform marketing tasks without manual intervention.
• Parallax: A visual effect where background images move slower than foreground images, creating an illusion of depth.