scraping-instagram-posts-by-hashtag

Savant verdict: Review advised

Security analysis or source-hub review identified patterns requiring attention.

Live evaluation

Not evaluated yet. Workspaces can request a live evaluation.

Security assessment

Scan pending.

Structure

• 1 referenced file isn't in the packagescripts/run_actor.js. They may be binary, too large to catalog, or missing upstream.
• The source hub's security checks flagged this skillGen Agent Trust Hub: warn (The skill facilitates Instagram data scraping through the Apify platform. It includes functionality for dynamic JavaScript code execution via a mapping function and ingests untrusted content from social media, presenting an indirect prompt injection surface.); Snyk: warn (Risk: MEDIUM · 1 issue)

SKILL.md

---
name: scraping-instagram-posts-by-hashtag
description: >
  Scrapes Instagram posts for any hashtag using apidojo's Instagram scraper on Apify.
  Triggers when the user asks to: get Instagram posts for a hashtag, scrape Instagram
  content by tag, export Instagram post data for a keyword or topic, fetch posts under
  an Instagram challenge or trend, collect Instagram media for a specific tag, or
  download Instagram post metadata by hashtag. Returns post URL, caption, like count,
  comment count, author handle, and timestamp per post.
  Ideal for trend analysts, UGC collectors, and social media researchers.
license: Apache-2.0
metadata:
  author: apidojo
  version: "1.0"
  apify-actor: apidojo/instagram-hashtag-scraper
---

# Scraping Instagram Posts by Hashtag

Raw Instagram post dataset for any hashtag. Returns post-level metadata including engagement and author info.

## Prerequisites

- `APIFY_TOKEN` environment variable set
- Optional: Apify MCP server installed

## Inputs

| Parameter | Type | Required | Default | Notes |
|-----------|------|----------|---------|-------|
| `startUrls` | array | Optional | `[]` | Instagram hashtag search URLs |
| `keyword` | string | Optional | — | Hashtag keyword to search (e.g. `fitness`) |
| `getReels` | boolean | Optional | `false` | Include Reels in results |
| `getPosts` | boolean | Optional | `true` | Include regular posts in results |
| `until` | string | Optional | — | Date filter (YYYY-MM-DD) |
| `maxItems` | number | Optional | Unlimited | Maximum posts to return |
| `customMapFunction` | string | Optional | — | JavaScript function to transform each output object |

## Workflow

```
Progress:
- [ ] Step 1: Normalize hashtag input
- [ ] Step 2: Run instagram-scraper
- [ ] Step 3: Poll for SUCCEEDED
- [ ] Step 4: Deliver post dataset
```

### Step 2: Run the Actor


**Recommended — run_actor.js (handles waiting, output, and file saving automatically):**
```bash
# Quick answer (prints table to chat)
node scripts/run_actor.js \
  --actor "apidojo~instagram-hashtag-scraper" \
  --input '{"param": "value"}'

# Save as CSV
node scripts/run_actor.js \
  --actor "apidojo~instagram-hashtag-scraper" \
  --input '{"param": "value"}' \
  --output YYYY-MM-DD_results.csv --format csv

# Save as JSON
node scripts/run_actor.js \
  --actor "apidojo~instagram-hashtag-scraper" \
  --input '{"param": "value"}' \
  --output YYYY-MM-DD_results.json --format json
```
> `APIFY_TOKEN` must be set in environment or `.env` file.

**If Apify MCP is available:**
```
Tool: apify:run-actor
Actor: "apidojo~instagram-hashtag-scraper"
Input:
{
  "keywords": ["tag1", "tag2"],
  "maxItems": 100,
  "mediaType": "all"
}
```

**REST API fallback:**
```bash
curl -X POST \
  "https://api.apify.com/v2/acts/apidojo~instagram-hashtag-scraper/runs?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"keywords": ["tag1"], "maxItems": 100}'
```

Save `id` as `RUN_ID`. Poll until `status = SUCCEEDED`:
```bash
curl "https://api.apify.com/v2/actor-runs/$RUN_ID?token=$APIFY_TOKEN" | grep '"status"'
```

Fetch results:
```bash
curl "https://api.apify.com/v2/actor-runs/$RUN_ID/dataset/items?token=$APIFY_TOKEN&format=json"
```

### Step 3: Handle Edge Cases

- **Banned hashtag**: Instagram hides some hashtags — returns 0. Try parent category.
- **Only top posts returned**: Instagram limits hashtag feeds; very popular tags may return only top posts.
- **Private account posts**: Post metadata visible but media URL may be restricted.

## Output Format

```
# Instagram Post Dataset: #<hashtag>
Posts collected: N | Media type: all/image/video

| Post ID | Author | Caption (truncated) | Likes | Comments | Type | Timestamp |
|---------|--------|---------------------|-------|----------|------|-----------|
| ...     | ...    | ...                 | ...   | ...      | ...  | ...       |

Available fields: id, ownerUsername, caption, likesCount, commentsCount, type,
timestamp, url, mediaUrl, hashtags, mentions
```

## Troubleshooting

**0 results:** Hashtag may be banned or restricted by Instagram.
**Rate limiting:** Keep `maxItems` ≤ 200 per run; space runs 5 minutes apart.