TypeSafe Jev¶

Jev evaluates claims, selects finite options, and scores described rubrics. It is not a free-form text generator. Kedi exposes it through the Pydantic AI and LangChain adapters using the optional kedi-typesafe package.

Installation¶

For a published compatible release:

uv add 'kedi[typesafe]'
# For LangChain, also install the classifier integration:
uv add 'kedi[langchain,typesafe]' 'kedi-typesafe[langchain]'

The current typesafe and codex-model/terminal-bench extras pin incompatible Pydantic AI release lines. Install them in separate environments; uv rejects the unsupported combined selections explicitly.

Set TYPESAFE_API_KEY in the environment. The extended API described here requires kedi-typesafe 0.2.1, which includes the decision evidence used by Kedi bindings.

Claims and Thresholds¶

See Claims and Thresholds.

Typed Criteria¶

See Typed Criteria.

Outputs and Limitations¶

See Outputs and Limitations.

Decision Evidence in Kedi¶

See Decision Evidence in Kedi.

Python API¶

from typing import Annotated
from pydantic import BaseModel
from pydantic_ai import Agent
from kedi_typesafe import Probability, TypeSafeModel

class Assessment(BaseModel):
    supported: bool
    probability: Probability

async def assess():
    async with TypeSafeModel(threshold=0.9) as model:
        result = await Agent(model, output_type=Assessment).run(
            "Reference: Ankara is Turkey's capital. Claim: Turkey's capital is Ankara."
        )
        return result.output

LangChain uses kedi_typesafe.integrations.langchain.TypeSafeChatModel and with_structured_output(Assessment, include_raw=True). Raw results expose decision evidence, provider probabilities/confidence when available, and usage. Evidence is metadata, not an additional generated output field. Streaming exposes the completed assessment; it does not simulate token-by-token Jev generation.

Reuse model instances for warm connections. Close owned models using their context manager or aclose; caller-supplied clients remain caller-owned. Configure transport timeout on the constructor. Unsupported generation settings are rejected.

Capture Decisions from Python Calls¶

See Capture Decisions from Python Calls.

Explicit Tool Routing¶

See Explicit Tool Routing.

Migration from 0.1¶

See Migration from 0.1.