datasketch Resource Deduplication Starter
SkillAI & modelsUse this skill to scan a tiny resource registry sample for near-duplicate text records with MinHash LSH.
Available today. Use it from your connected AI after setup.
No other account needed.
Connect ahel once, and every AI you use reads what you have installed.
Then ask your AI: use the datasketch Resource Deduplication Starter skill
About this capability
A framework for discovering, compiling, and validating reusable skills for scientific agents.
What this skill tells your AI
The instructions your AI receives, as published by ma-compbio-lab/skillfoundry in skills/meta-maintenance/datasketch-resource-deduplication-starter/SKILL.md and read by ahel’s review.
Use this skill to scan a tiny resource registry sample for near-duplicate text records with MinHash LSH.
What This Skill Does
- reads a toy JSONL resource list
- tokenizes title and summary text
- builds MinHash sketches with
datasketch - returns candidate duplicate pairs above a configurable threshold
Signals
- GitHub stars
- 39
- Forks
- 5
- Last commit
- Sep 2026
Advanced
- Catalog kind
- skill
- Gateway key
datasketch-resource-deduplication-starter- Source
- github.com/ma-compbio-lab/skillfoundry