A server for the EOSC Data Commons project MatchMaker service, providing natural language search over open-access datasets. It exposes an HTTP POST endpoint and supports the to help users discover datasets and tools via a Large Language Model–assisted search.
🔭 Search server to access data from various open access data publishers
The search system needs to connect to a PostgreSQL database to store authenticated users conversations.
Deploy and initialize the metadata-warehouse, in these instructions we expect the metadata-warehouse folder to be alongside the data-commons-search,in the same folder.
cd ../metadata-warehouse
docker compose up postgres
To initialize db, run from the metadata-warehouse repo:
uv run --directory scripts/postgres_data create_db.py --db appdb --reset
[!IMPORTANT]
For publicly available environments you will want to update the app user password:
ALTER USER app WITH PASSWORD 'newpassword';
Reset db:
docker compose down --volumes --remove-orphans
Export the schema from db.py to the metadata-warehouse (command to run at the root of the data-commons-search repo):
uv run scripts/export_db_schema.py ../metadata-warehouse/scripts/postgres_data/create_sql/appdb/tables.sql
You can deploy the matchmaker frontend in dev on the side pointing to this dev server:
cd ../matchmaker
npm run dev
[!TIP]
Example curl request:
curl -X POST http://localhost:8000/chat -H "Content-Type: application/json" \
-d '{"items": [{"type": "message", "role": "user", "content": [{"text": "Educational datasets from Switzerland covering student assessments, language competencies, and learning outcomes, including experimental or longitudinal studies on pupils or students."}]}], "model": "cesnet/agentic"}'
SEARCH_API_KEY can be used to add a layer of protection against bots that might spam the LLM, if not provided no API key will be needed to query the API.
PYTHONPATH=tests/security uv run garak --config tests/security/garak.yaml
Run stress tests (20 concurrent uses) of the API:
uv run tests/stress_api.py -c 20
🧹 Format code and type check
uvx ruff format && uvx ruff check --fix && uvx ty check
♻️ Reset the environment
Upgrade uv:
uv self update
Clean uv cache:
uv cache clean
🔧 Maintenance
Pre-compute stats for the datasets in the db to src/data_commons_search/stats.json:
uv run --env-file prod.env scripts/compute_stats.py
Update dependencies in pyproject.toml:
uvx uv-bump
🏷️ Release process
Run the release script providing the version bump: fix, minor, or major
.github/release.sh fix
Or an explicit version, e.g. to align with the frontend version:
.github/release.sh 0.10.0
This will create a git tag, github release, and publish a docker image
🤝 Acknowledments
The LLM provider cesnet is a service provided by e-INFRA CZ and operated by CERIT-SC Masaryk University
Computational resources were provided by the e-INFRA CZ project (ID:90254), supported by the Ministry of Education, Youth and Sports of the Czech Republic.
Noch keine Tool-Liste. Remote-Server erhalten eine nach dem ersten Health-Check.
FAQ
Fragen
Wie installiere ich Data Commons Search?
Kopieren Sie auf dieser Seite die stdio-Konfiguration für Cursor, Claude Desktop, Claude Code oder VS Code. Sie nutzt die Installation des Herausgebers, keinen PlugMCP-Proxy.
Benötigt Data Commons Search einen API-Schlüssel?
In diesem Eintrag ist keine erforderliche Umgebungsvariable aufgeführt.
Welchen Transport verwendet Data Commons Search?
Data Commons Search läuft lokal über stdio.
Wann wurde Data Commons Search zuletzt geprüft?
Zuletzt geprüft: 2026-10-27. 🔭 Search server to access data from various open access data publishers