Ergs - Datahoarder's Paradise

A flexible data fetching and indexing tool that collects information from various sources and makes it searchable. Perfect for digital packrats who want to hoard and search their data.

Quick Start

1. Build & Install

git clone https://github.com/your-username/ergs
cd ergs
make build

Or grab a binary release from https://github.com/rubiojr/ergs/releases.

2. Initialize

./ergs init

4. Fetch Data

./ergs fetch

5. Search Everything

# Search all your data
./ergs search --query "language typescript"

# Search specific datasource
./ergs search --datasource github --query "rust"

6. Web Interface

# Start web interface with search and browsing
./ergs web --port 8080

# Then visit http://localhost:8080

7. Run Continuously

# Fetches new data every 30 minutes by default
./ergs serve

Available Datasources

• GitHub - Your GitHub activity, starred repos, and interactions
• HackerNews - Stories, comments, jobs, and polls from Hacker News
• RSS - Articles from RSS/Atom feeds (blogs, news sites, etc.)
• Firefox - Complete browsing history with full-text search
• Codeberg - Codeberg activity and repository events
• Zed Threads - Chat history from Zed editor
• Gas Stations - Local gas station prices and info
• Timestamp - Simple timestamp logging (useful for testing)

Common Commands

# See what datasources you have
./ergs datasource list

# Check your data stats
./ergs stats

# List recent items from a datasource
./ergs list --datasource github --limit 5

# Start web interface for browsing and search
./ergs web

Configuration

Your config lives at ~/.config/ergs/config.toml. You can edit it directly or use the CLI commands. Each datasource gets its own SQLite database with full-text search.

Need Help?

• Check the datasource documentation for detailed setup instructions
• See docs/web-interface.md for web interface and API documentation
• See docs/queries.md for FTS5 search syntax and examples
• See docs/datasource.md if you want to create your own datasources
• Run ./ergs --help for all available commands

Start hoarding! 📦