ai/agentic-ai-test-suite
Watch
1
Code Issues Pull requests Projects Releases Packages Activity Actions

chore: use javascript ast for evaluation #3

Merged
SethFalco merged 1 commit from js-ast into main 2026-02-21 22:29:39 +00:00
Conversation 2 Commits 1 Files changed 13 +249 -99
SethFalco commented 2026-02-21 22:29:31 +00:00 (Migrated from gitlab.com)
Copy link

I've made quite a few changes at once here, but just for project health and test improvements. No new tests/prompts.

Formatting

I'm going to be proofreading prompts to omit all formatting related sections. This should be handled by a linter and looped on by an agent, but not described to the agent via context. I've already removed some instructions for it, and including a note in the README.

JavaScript AST

I use a JavaScript parser to build and check against an AST instead now. This will be much more versatile than my previous solution. Before we just checked the file entirely, or only checked if it parsed. Now we can specifically check for things like private variables.

I've made quite a few changes at once here, but just for project health and test improvements. No new tests/prompts. ## Formatting I'm going to be proofreading prompts to omit all formatting related sections. This should be handled by a linter and looped on by an agent, but not described to the agent via context. I've already removed some instructions for it, and including a note in the README. ## JavaScript AST I use a JavaScript parser to build and check against an AST instead now. This will be much more versatile than my previous solution. Before we just checked the file entirely, or only checked if it parsed. Now we can specifically check for things like private variables.
SethFalco commented 2026-02-21 22:29:40 +00:00 (Migrated from gitlab.com)
Copy link

mentioned in commit d1f85afc11

mentioned in commit d1f85afc114145c2a875d5f8257669f5f3a96e67
SethFalco (Migrated from gitlab.com) merged commit d1f85afc11 into main 2026-02-21 22:29:40 +00:00
SethFalco commented 2026-02-21 22:49:28 +00:00 (Migrated from gitlab.com)
Copy link

mentioned in merge request !4

mentioned in merge request !4
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
ai/agentic-ai-test-suite!3
No description provided.