romfast/game-library
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Rebuild extraction pipeline infrastructure (Faza 0 prep)

Browse Source 
Implements the approved plan to replace the broken regex/index-master
extraction with an LLM-subagent pipeline. Four parallel lanes:

Lane A — scripts/extract_common.py (PDF/docx/doc/pptx/html/zip, no
  max_pages truncation), normalize_sources.py, chunk_sources.py
  (~20pg chunks + overlap, manifest registry), activity_schema.json.
Lane B — app/config_taxonomy.py (16 fixed category slugs), schema
  rebuilt from scratch in app/models/ with content_type, language,
  source_files, source_excerpt, normalized_name, extraction_confidence,
  needs_review; FTS5 + 3 triggers extended with materials_list and
  skills_developed.
Lane C — build_database.py (--rebuild, atomic swap, schema + fuzzy
  source_excerpt validation, dedup with needs_review band),
  validate_extractions.py, review_queue.py, new run_extraction.py
  orchestrator, SUBAGENT_PROMPT.md.
Lane D — search.py content_type/language filters (default search
  excludes non-game content), E7 schema-compat audit; fixed a NULL
  keywords AttributeError in _boost_search_relevance.

Removes 8 orphaned/dead scripts and app/services/parser.py +
indexer.py. Adds tests/ (70 passing, 1 skipped — libreoffice absent).

Note: Lane D made one additive edit to app/models/database.py
(_update_category_counts) to surface content_type/language in
get_filter_options, outside its nominal lane boundary but after
Lane B completed.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
Claude Agent
2026-05-19 17:43:38 +00:00
parent e0080edf85
commit 66ae831c36
37 changed files with 4101 additions and 1881 deletions
Download Patch File Download Diff File Expand all files Collapse all files

29
app/templates/results.html
View File

@@ -24,7 +24,29 @@
<option value="">Toate categoriile</option>
{% for category in filters.category %}
<option value="{{ category }}" {% if applied_filters.category == category %}selected{% endif %}>
{{ category }}
{{ display_names.get(category, category) }}
</option>
{% endfor %}
</select>
{% endif %}
{% if filters.content_type %}
<select name="content_type" class="filter-select compact">
<option value="">Doar jocuri și activități</option>
{% for content_type in filters.content_type %}
<option value="{{ content_type }}" {% if applied_filters.content_type == content_type %}selected{% endif %}>
{{ display_names.get(content_type, content_type) }}
</option>
{% endfor %}
</select>
{% endif %}
{% if filters.language %}
<select name="language" class="filter-select compact">
<option value="">Toate limbile</option>
{% for language in filters.language %}
<option value="{{ language }}" {% if applied_filters.language == language %}selected{% endif %}>
{{ display_names.get(language, language) }}
</option>
{% endfor %}
</select>
@@ -109,7 +131,10 @@
{{ activity.name }}
</a>
</h3>
<span class="activity-category">{{ activity.category }}</span>
<span class="activity-category">{{ display_names.get(activity.category, activity.category) }}</span>
{% if activity.needs_review %}
<span class="activity-badge needs-review" title="Această activitate necesită verificare">⚠ De verificat</span>
{% endif %}
</header>
<div class="activity-content">