Pytest setup

Your first crewChapter 10 of 141 min read

Install pytest and write schema validation tests to catch YAML configuration errors before executing language models.

Install pytest#

Install pytest into your active virtual environment:

Terminal

1(env)$ pip install pytest==9.1.1

Test the config#

Create test_config.py to validate that all required keys exist across agent and task configurations:

test_config.py

1# test_config.py
2
3from review_crew import agents_config, tasks_config
4
5
6def test_every_agent_has_a_role_goal_and_backstory():
7    for name, agent in agents_config.items():
8        assert {"role", "goal", "backstory"} <= agent.keys(), name
9
10
11def test_every_task_has_a_description_and_expected_output():
12    for name, task in tasks_config.items():
13        assert {"description", "expected_output"} <= task.keys(), name

These assertions evaluate in-memory dictionaries without making network requests or incurring LLM API costs.

Execute the test suite:

Terminal

1(env)$ python -m pytest
2
3test_config.py ..                                                        [100%]
4
5======================== 2 passed, 11 warnings in 3.42s ========================

Verify your current workspace layout:

Project structure

contract-crew├── .env├── .gitignore├── config│   ├── agents.yaml│   └── tasks.yaml├── contracts│   └── acme-saas-agreement.md├── explain.py├── output│   └── review.md├── review_crew.py├── summarize.py└── test_config.py