56 lines
3.8 KiB
Plaintext
56 lines
3.8 KiB
Plaintext
|
+
|
|||
|
|
Vj]
|
|||
|
|
ã ól € R t ^ RIHt ^ RIHt ^ RIHtHtHtH t ] ! R R4 4 t
|
|||
|
|
! R R4 t R# ) zMLLM Adapter
|
|||
|
|
|
|||
|
|
Thin abstraction over a concrete LLM backend (local or remote).
|
|||
|
|
)Ú annotations)Ú dataclass)ÚAnyÚCallableÚDictÚOptionalc ót € ] tR t^ t$ RtR]R& R]R& RtR]R& RtR]R& RtR ]R
|
|||
|
|
& Rt R ]R & R
|
|||
|
|
R lt
|
|||
|
|
Rt R# )Ú LLMResponsez'Container for a single LLM interaction.ÚstrÚpromptÚresponseNz
|
|||
|
|
Optional[int]Ú
|
|||
|
|
tokens_promptÚtokens_responseú
|
|||
|
|
Optional[str]Ú
|
|||
|
|
model_nameúDict[str, Any]Úmetadatac ó € V ^8„ d QhRR/# )é Úreturnr © )Úformats "ÚLLMCompress/llm_adapter.pyÚ __annotate__ÚLLMResponse.__annotate__ s € ÷
|
|||
|
|
ñ
|
|||
|
|
˜ ñ
|
|||
|
|
ó c
|
|||
|
|
óª € R V P RV P RV P RV P RV P RV P
|
|||
|
|
;' g / /# ©r r r
|
|||
|
|
r r r r )Úselfs &r Úto_dictÚLLMResponse.to_dict sN € à �d—k‘kØ ˜Ÿ
|
|||
|
|
™
|
|||
|
|
Ø ˜T× /Ñ /Ø ˜t× 3Ñ 3Ø ˜$Ÿ/™/Ø ˜Ÿ
|
|||
|
|
™
|
|||
|
|
×+Ð+¨ð
|
|||
|
|
|
|||
|
|
ð
|
|||
|
|
r r ) Ú__name__Ú
|
|||
|
|
__module__Ú __qualname__Ú__firstlineno__Ú__doc__Ú__annotations__r
|
|||
|
|
r r r r Ú__static_attributes__r r r r r sA ‡ á1à ƒK؃MØ#'€M�=Ó'Ø%)€O�]Ó)Ø $€J�
|
|||
|
|
Ó$Ø #€HˆnÓ#÷
|
|||
|
|
ñ
|
|||
|
|
r r c ó6 € ] tR t^"tRtRR R lltR R ltRtR# ) Ú
|
|||
|
|
LLMAdapterzçAdapter around a concrete LLM backend.
|
|||
|
|
|
|||
|
|
backend: Callable that takes (prompt, **kwargs) and returns:
|
|||
|
|
- str
|
|||
|
|
- or dict with keys like:
|
|||
|
|
- response
|
|||
|
|
- tokens_prompt
|
|||
|
|
- tokens_response
|
|||
|
|
- model_name
|
|||
|
|
Nc ó$ € V ^8„ d QhRRRRRR/# )r ÚbackendzCallable[..., Any]r r r ÚNoner )r s "r r ÚLLMAdapter.__annotate__. s( € ÷ 3ñ 3à#ð3ð "ð3ð
|
|||
|
|
ñ 3r c ó4 € Wn T;' g R V n R# )ÚunknownN©Ú_backendÚ _model_name)r r+ r s &&&r Ú__init__ÚLLMAdapter.__init__. s € ð
|
|||
|
|
Œ
|
|||
|
|
Ø%×2Ð2¨ˆÖr c ó$ € V ^8„ d QhRRRRRR/# )r r r
|
|||
|
|
Úkwargsr r r r )r s "r r r- 6 s! € ÷ &
|
|||
|
|
ñ &
|
|||
|
|
˜#ð &
|
|||
|
|
¨ð &
|
|||
|
|
°ñ &
|
|||
|
|
r c
|
|||
|
|
|
|||
|
|
óF € V P ! V3/ VB p\ V\ 4 ' d \ VVV P / R7 # \ V\
|
|||
|
|
4 ' dŽ \ T\ VP
|
|||
|
|
RR4 4 VP
|
|||
|
|
R4 VP
|