LinkedIn Scraper
Overview
This skill finds LinkedIn job postings by running tools/jobspy_scraper.py, a thin wrapper
around the JobSpy library. It handles installation,
parameter construction, execution, and result interpretation.
Quick Start
Install the dependency once (requires Python 3.10+):
python3.12 -m pip install -U python-jobspy --break-system-packages
Run the scraper:
python3.12 tools/jobspy_scraper.py \
--search "software engineer" \
--location "San Francisco, CA" \
--results 25 \
--output .tmp/jobs.csv
Results are saved as CSV and printed as a summary table.
Workflow
Step 1 — Understand the request
Identify from the user's message:
- Search term — job title, role, or keyword (required)
- Location — city, state, or "Remote" (optional but recommended)
- Results wanted — default to 25 if not specified
- Recency —
hours_old filter if user wants recent posts (e.g. "last 48 hours")
- Company filter —
linkedin_company_ids if targeting a specific company
- Full descriptions — set
--fetch-descriptions if user needs job description text
If anything is ambiguous (e.g. "find AI jobs"), pick reasonable defaults and tell the user what you used.
Step 2 — Construct the command
Build the tools/jobspy_scraper.py command using the parameters below.
Always save output to .tmp/ so it's disposable and easy to find.
python tools/jobspy_scraper.py \
--search "<term>" \
--location "<location>" \
--results <N> \
[--hours-old <N>] \
[--fetch-descriptions] \
[--company-ids <id1,id2>] \
[--job-type fulltime|parttime|contract|internship] \
[--remote] \
--output .tmp/<descriptive_filename>.csv
Note: --hours-old and --easy-apply cannot be used together (LinkedIn API constraint).
Step 3 — Run the script
Execute the command. The script will print a progress message and a summary of results found.
If the script is not found at tools/jobspy_scraper.py, check whether the file needs to be created
by reading skills/linkedin-job-scraper/scripts/jobspy_scraper.py and copying it to tools/.
Step 4 — Interpret and present results
After the run:
- Report how many jobs were found
- Show a brief table: Title | Company | Location | Salary | Posted
- Note the output file path so the user can open it
- If 0 results: suggest broadening the search term or removing the location filter
Parameters Reference
| Flag | Description | Default |
|---|
--search | Job title / keywords | required |
--location | City, state, or country | none |
--results | Number of results to fetch | 25 |
--hours-old | Only jobs posted within N hours | none |
--fetch-descriptions | Fetch full job descriptions (slower) | false |
--company-ids | Comma-separated LinkedIn company IDs | none |
--job-type | fulltime, parttime, contract, internship | any |
--remote | Filter for remote jobs only | false |
--output | Path for CSV output | .tmp/jobs.csv |
Output Columns
The CSV output includes:
| Column | Description |
|---|
TITLE | Job title |
COMPANY | Employer name |
LOCATION | City / State / Country |
IS_REMOTE | True/False |
JOB_TYPE | fulltime, contract, etc. |
DATE_POSTED | When the listing was posted |
MIN_AMOUNT | Minimum salary |
MAX_AMOUNT | Maximum salary |
CURRENCY | Currency code |
JOB_URL | Direct link to the LinkedIn posting |
DESCRIPTION | Full job description (if --fetch-descriptions used) |
JOB_LEVEL | Seniority level (LinkedIn-specific) |
COMPANY_INDUSTRY | Industry classification |
Common Use Cases
Find recent engineering roles at a startup:
python tools/jobspy_scraper.py --search "growth engineer" --location "New York" \
--results 50 --hours-old 72 --output .tmp/growth_eng_nyc.csv
Monitor what a specific company is hiring for:
# First find the LinkedIn company ID from the company's LinkedIn URL
python tools/jobspy_scraper.py --search "engineer" --company-ids 1234567 \
--results 100 --fetch-descriptions --output .tmp/company_hiring.csv
Find remote contract roles:
python tools/jobspy_scraper.py --search "data analyst" --remote \
--job-type contract --results 30 --output .tmp/remote_contracts.csv
Error Handling
| Error | Fix |
|---|
ModuleNotFoundError: jobspy | Run pip install -U python-jobspy |
| 0 results returned | Broaden search term, remove location, increase --results |
| Rate limited / blocked | Wait a few minutes; avoid running back-to-back large scrapes |
hours_old and easy_apply cannot both be set | Remove one of those flags |
Script Location
The scraper script lives at tools/jobspy_scraper.py.
If it doesn't exist, copy it from skills/linkedin-scraper/scripts/jobspy_scraper.py to tools/:
cp skills/linkedin-job-scraper/scripts/jobspy_scraper.py tools/