Skip to content

lang_tools.words.ingestion.static_list

Static word-list ingestion (worldly-words style).

Accepts a list of dicts with at minimum text and language keys, plus optional normalized. Extra fields are ignored.

Functions:

load_static_list 

load_static_list(entries: Iterable[dict]) -> Iterator[Word]

Yield Word objects from a minimal list of dicts.

Parameters:

  • entries (Iterable[dict]) –

    Iterable of dicts. Each dict must contain text and language; normalized is filled in automatically when absent.

Yields:

  • Word –

    Word instances tagged with sources=["static_list"].

Source code in src/lang_tools/words/ingestion/static_list.py 
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
def load_static_list(entries: Iterable[dict]) -> Iterator[Word]:
    """Yield `Word` objects from a minimal list of dicts.

    Args:
        entries: Iterable of dicts. Each dict must contain ``text`` and
            ``language``; ``normalized`` is filled in automatically when absent.

    Yields:
        `Word` instances tagged with ``sources=["static_list"]``.
    """
    for entry in entries:
        yield Word(
            text=entry["text"],
            language=entry["language"],
            normalized=entry.get("normalized", ""),
            sources=["static_list"],
        )