Skip to content

feat(ai-importer): RM-16907 scan found llms.txt files for reference to other llms.txt files#9

Merged
xavierandueza merged 1 commit into
mainfrom
fix/rm-16907-investigate-fix-missing-pages-in-results-issues
Jun 6, 2026
Merged

feat(ai-importer): RM-16907 scan found llms.txt files for reference to other llms.txt files#9
xavierandueza merged 1 commit into
mainfrom
fix/rm-16907-investigate-fix-missing-pages-in-results-issues

Conversation

@xavierandueza
Copy link
Copy Markdown
Contributor

🚥 Resolves RM-16907

🧰 Changes

This introduces functionality where we scan llms.txt files that we find for references to other llms.txt files, and fetch them.

This makes a huge difference for particularly enterprise customers, with us going from ~50 files to 6000 in one instance.

🧬 QA & Testing

Tested on:
https://docs.snowflake.com

Where they have this pattern.

@xavierandueza xavierandueza self-assigned this Jun 5, 2026
@xavierandueza xavierandueza merged commit 9ff45b1 into main Jun 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants