infini-satellite

byDarshan Daivadnya

Title: Multi-Modal Disaster Damage Assessment from Satellite and Social Media Data Description: Build a system that fuses satellite imagery and geotagged social media posts to generate a unified, prioritized damage severity map. Satellite imagery provides spatial coverage while social media posts contribute real-time human observations, and a dual-modality pipeline combines both to guide early resource deployment decisions. Domain: Disaster Response / Humanitarian Aid Expected Outcome: A working prototype that ingests both image patches and geotagged text, produces a severity score per area segment, and visualizes results as a layered damage map. Evaluation should include ablation results showing the individual and combined contribution of each modality.develop an responsive end to end working model in real time

LandingLoginDamageMap
Landing

Comments (0)

No comments yet. Be the first!

System Requirements

System Requirement Document
Page 1 of 4

infini-satellite System Requirements Document

Introduction

The "infini-satellite" project aims to develop a multi-modal disaster damage assessment system that fuses satellite imagery with geotagged social media data. This system will generate a unified, prioritized damage severity map to aid in disaster response and humanitarian aid efforts. By integrating broad spatial coverage from satellite images with real-time human observations from social media, the project seeks to enhance situational awareness and guide early resource deployment decisions.

System Overview

The infini-satellite system will ingest both satellite imagery and geotagged social media posts. It will utilize a dual-modality pipeline to analyze and combine these data sources, producing a severity score for each area segment. The results will be visualized as a layered damage map, providing disaster response teams with critical insights for prioritizing resource deployment. The system will also include evaluation metrics to assess the individual and combined contributions of each modality.

Functional Requirements

  • As a Disaster Response Team Member, I should be able to view a layered damage severity map to prioritize resource deployment.
  • As a Data Analyst, I should be able to ingest satellite images and geotagged social media posts into the system.
  • As a System Administrator, I should be able to manage data sources and ensure data integrity.
  • As a Researcher, I should be able to evaluate the contribution of each data modality to the overall accuracy of the damage assessment.
Page 2 of 4

User Personas

  • Disaster Response Team Member: Utilizes the damage severity map to make informed decisions about resource allocation and deployment.
  • Data Analyst: Responsible for ingesting and processing satellite and social media data.
  • System Administrator: Manages the system's data sources and maintains data integrity.
  • Researcher: Evaluates the system's performance and the effectiveness of data fusion.

Visuals Colors and Theme

  • primary: #1E3A8A (Deep Blue)
  • primary_light: #3B82F6 (Sky Blue)
  • secondary: #F97316 (Vibrant Orange)
  • accent: #10B981 (Emerald Green)
  • highlight: #F59E0B (Amber)
  • bg: #F3F4F6 (Light Gray)
  • surface: rgba(255, 255, 255, 0.9) (Soft White)
  • text: #111827 (Dark Gray)
  • text_muted: #6B7280 (Muted Gray)
  • border: rgba(209, 213, 219, 0.5) (Light Gray)
Page 3 of 4

Signature Design Concept

The infini-satellite homepage will feature an interactive galaxy map where each star represents a different disaster event or data source. Users can click on a star to open a detailed view of the damage assessment for that area. The galaxy map will rotate and zoom as users navigate, providing a dynamic and engaging experience. This concept will be implemented using @react-three/fiber for 3D rendering and gsap for smooth animations and transitions. The interactive elements will allow users to explore data in an intuitive and visually appealing manner.

Interaction Model & Motion Direction

The landing page will utilize a "parallax" interaction model, creating a layered depth effect as users scroll through the content. Decorative elements such as atmospheric blobs and distant shapes will move at different speeds, enhancing the storytelling aspect of the page. Real content will remain in the normal flow, ensuring a natural scrolling experience. Internal pages, such as dashboards and settings, will adopt a "static" model to prioritize layout clarity and reading speed.

Non-Functional Requirements

  • The system should support real-time data ingestion and processing.
  • The user interface must be responsive and accessible across various devices and screen sizes.
  • The system should ensure data security and privacy, particularly for sensitive social media data.
Page 4 of 4

Tech Stack

  • Frontend: React for Web
  • Backend: Python, FastAPI
  • Database: MySQL or MariaDB, with alembic for migrations
  • AI Models: GPT 5.4 for user-friendly responses, Claude 4.6 Opas for academic or coding work
  • AI Tools: Litellm for LLM Routing, Langchain
  • Local Orchestration: Docker, docker-compose
  • Server-side Orchestration: Kubernetes

Assumptions and Constraints

  • The system assumes access to reliable satellite imagery and geotagged social media data.
  • The system must operate within the constraints of data privacy regulations and ethical guidelines.
  • The prototype will focus on a specific geographic region for initial testing and evaluation.

Glossary

  • Dual-Modality Pipeline: A system that processes and combines two different types of data sources.
  • Severity Score: A numerical value representing the level of damage in a specific area.
  • Ablation Results: Analysis showing the impact of removing one or more components of a system to understand their contribution to the overall performance.

This document outlines the updated system requirements for the infini-satellite project, incorporating the user's request and context to ensure a comprehensive and tailored approach to disaster damage assessment.

Landing design preview
Landing: View Galaxy Map
Login: Sign In
Dashboard: View Pipeline Status
DataIngestion: Upload Satellite Images
DataIngestion: Import Social Media Posts
Pipeline: Configure Fusion Settings
Pipeline: Run Dual-Modality Analysis
Results: Review Severity Scores
Results: Export Assessment Data
DataSources: Manage Feeds