
Automated data collection across 4,200+ dark stores — capturing pricing, availability, and ranking signals twice daily to power your brand analytics.
Manage scraping sources across web, mobile, quick commerce, dark store APIs, and competitor intelligence feeds. Toggle sources on or off to control data ingestion.
E-commerce websites & marketplaces
Mobile-optimized storefronts & PWA apps
Blinkit, Zepto, Instamart, BigBasket, JioMart
Partner API integrations for real-time inventory
Rival pricing, promotions & listing intelligence
Real-time ingestion status across 4,200+ dark stores. Data refreshes twice daily with continuous validation and anomaly detection.
Monitor data integrity across all sources with automated schema checks, uniqueness verification, and range validation. Review flagged errors by source and type before downstream processing.
| Rule Name | Check Type | Status | Last Checked |
|---|---|---|---|
| SKU Format Validation | Schema | Pass | 2026-06-26 09:42 UTC |
| Price Range Check | Range | Pass | 2026-06-26 09:42 UTC |
| Product URL Uniqueness | Uniqueness | Pass | 2026-06-26 09:41 UTC |
| Availability Flag Schema | Schema | Pass | 2026-06-26 09:42 UTC |
| Discount Percentage Range | Range | Fail | 2026-06-26 09:40 UTC |
| Store ID Uniqueness | Uniqueness | Pass | 2026-06-26 09:41 UTC |
| Timestamp Format Compliance | Schema | Pass | 2026-06-26 09:42 UTC |
| Inventory Count Range | Range | Fail | 2026-06-26 09:39 UTC |
Connect market-intelligence to your internal systems with our REST API. Follow these four steps to start scraping QuickCommerce data in minutes.
Create an API key from the Settings → API Keys dashboard. Store it securely as an environment variable. The key authenticates all requests to the Scraper API and grants access to QuickCommerce data across Blinkit, Zepto, Instamart, BigBasket, and JioMart.
# market-intelligence API credentials
MARKET_INTEL_API_KEY=mi_live_k8xR2vP9qL7mN3wF5tY
MARKET_INTEL_API_SECRET=ms_sec_hJ6dG1bC4nA8sX0eW2uV
MARKET_INTEL_BASE_URL=https://api.market-intelligence.io/v2
# Optional: proxy configuration for enterprise deployments
MARKET_INTEL_PROXY_HOST=proxy.internal.corp
MARKET_INTEL_PROXY_PORT=8080
Configure a webhook URL in the Scraper → Webhooks panel. market-intelligence sends a POST request with a signed payload when each scrape job completes, succeeds, or fails. Verify the signature using your webhook secret to ensure payload integrity.
POST /webhooks/scraper HTTP/1.1
Host: your-app.example.com
X-MI-Signature: sha256=8f3a9b2c1d4e5f6a7b8c9d0e1f2a3b4c
Content-Type: application/json
{
"event": "scrape.completed",
"job_id": "scr_j8kL5mN2pQ4rS6tU",
"platform": "blinkit",
"skus_processed": 247,
"status": "success",
"timestamp": "2026-06-26T10:15:30Z",
"summary": {
"price_changes": 12,
"stockouts_detected": 3,
"new_listings": 5
}
}
The Scraper API accepts a platform identifier and SKU list as input, returning structured data including pricing, availability, search rank, and competitor information. All timestamps use ISO 8601 UTC format and monetary values are in INR (paise).
// Request
{
"platform": "zepto",
"location": "mumbai",
"skus": ["BRD-001", "BRD-002"],
"depth": "full"
}
// Response
{
"results": [{
"sku": "BRD-001",
"price_inr": 249.00,
"availability": "in_stock",
"search_rank": 3,
"competitor_count": 7,
"collected_at": "2026-06-26T10:15:00Z"
}]
}
Use the curl commands below to test your integration. A successful response returns HTTP 200 with the scrape job ID and an estimated completion time. Monitor the job status via the GET endpoint until it reaches "completed".
# Start a new scrape job
curl -X POST https://api.market-intelligence.io/v2/scrape \
-H "Authorization: Bearer $MARKET_INTEL_API_KEY" \
-H "Content-Type: application/json" \
-d '{"platform":"blinkit","skus":["BRD-001"],"depth":"quick"}'
# Expected response (HTTP 201)
{
"job_id": "scr_x9Yk2Lm4Np6Qr8St",
"status": "queued",
"estimated_completion": "2026-06-26T10:18:00Z"
}
# Check job status
curl -X GET https://api.market-intelligence.io/v2/scrape/scr_x9Yk2Lm4Np6Qr8St \
-H "Authorization: Bearer $MARKET_INTEL_API_KEY"
# Expected: {"job_id":"scr_x9Yk2Lm4Np6Qr8St","status":"completed"}
market-intelligence maintains rigorous security standards with SOC 2 Type II and ISO 27001 certifications, GDPR and PDPB compliance, and AES-256 encryption across all data operations.
| Timestamp | Method | Endpoint | Status | Duration |
|---|---|---|---|---|
| 10:32:45 UTC | GET | /api/v1/scrape/products | 200 | 234ms |
| 10:32:12 UTC | POST | /api/v1/scrape/sources | 201 | 89ms |
| 10:31:58 UTC | GET | /api/v1/data/validate | 200 | 412ms |
| 10:31:33 UTC | PUT | /api/v1/config/retention | 200 | 56ms |
| 10:31:05 UTC | DELETE | /api/v1/cache/invalidate | 200 | 23ms |
| 10:30:48 UTC | GET | /api/v1/audit/logs | 200 | 187ms |
| 10:30:22 UTC | POST | /api/v1/compliance/check | 200 | 345ms |
| 10:29:57 UTC | GET | /api/v1/scrape/status | 429 | 12ms |
No comments yet. Be the first!