Skip to content

API Overview

The Open Reviewer API is organized into four main areas:

Core Components

Module Description
Evaluators Core evaluation classes for single and multi-model review
Data Models Pydantic models for test cases, results, and configuration
Semantic Analysis AST parsing, repository mapping, and code search
Embeddings Vector storage and embedding generation

Quick Import

from review_eval import (
    # Core evaluators
    ReviewEvaluator,
    MultiModelEvaluator,
    DocsAwareEvaluator,
    SemanticEvaluator,
    create_semantic_evaluator,

    # Data models
    GoldenTestCase,
    ModelConfig,
    ModelReviewResult,
    MultiModelResult,
    ReviewResult,

    # Model configurations
    DEFAULT_MODELS,
    BENCHMARK_MODELS,

    # Utilities
    print_multi_model_report,
)

Package Structure

review_eval/
├── __init__.py              # Public API exports
├── evaluator.py             # ReviewEvaluator
├── multi_model_evaluator.py # MultiModelEvaluator
├── docs_aware_evaluator.py  # DocsAwareEvaluator
├── semantic_evaluator.py    # SemanticEvaluator
├── models.py                # Pydantic data models
├── docs_loader.py           # Documentation discovery
├── index_repo.py            # CLI: index repository
├── update_embeddings.py     # CLI: update embeddings
└── semantic/
    ├── ast_parser.py        # Python AST parsing
    ├── repo_map.py          # Repository mapping
    ├── search.py            # Semantic search
    ├── models.py            # Semantic data models
    └── embeddings/
        ├── chunker.py       # Code chunking
        ├── client.py        # Embedding client
        └── vector_store.py  # Qdrant integration