146 lines
17 KiB
Plaintext
146 lines
17 KiB
Plaintext
|
+
|
|||
|
|
þÜ0j˜1 ã óü a € R t0 t R t^ RIt^ RIHtHtHtHtHt ^ RI H
|
|||
|
|
t
|
|||
|
|
^ RI H t ^ RI t ]P ! ]4 tRtRtRtRtRtRtRR R
|
|||
|
|
R R R
|
|||
|
|
RR/t] ^ k ]
|
|||
|
|
! R R4 4 t ! R R4 tRs] ^k R R ltR# )aÑ VRAM + Resonance Manager.
|
|||
|
|
|
|||
|
|
Combines computational VRAM limits with symbolic resonance:
|
|||
|
|
- Monitors GPU VRAM (8GB GTX1080)
|
|||
|
|
- Adjusts model loading based on glyph resonance
|
|||
|
|
- Prevents crashes from simultaneous Forge + Janus
|
|||
|
|
- Dynamic VRAM budgeting from glyph activation
|
|||
|
|
|
|||
|
|
Usage:
|
|||
|
|
from dual_layer.vram_manager import VRAMManager
|
|||
|
|
|
|||
|
|
manager = VRAMManager()
|
|||
|
|
if manager.can_activate_glyph(glyph_routing_result):
|
|||
|
|
manager.activate(glyph_routing_result)
|
|||
|
|
N)ÚDictÚListÚAnyÚOptionalÚTuple)Ú dataclass)Údatetimeg @g @g @Úllamag @Úforgeg @Újanusg @Ú google_aig ø?c ó0 a € ] tR t^*t o RtV 3R ltRtV tR# )ÚGlyphActivationzActive glyph reservation.c óz <€ V ^8„ d Qh/ S[ ;R& S[ ;R& S[ ;R& S[;R& S[;R& S[;R& S[;R& S[;R& # ) é Úglyph_idÚspecialized_typeÚmodelÚ vram_budgetÚresonance_scoreÚ power_boostÚ activated_atÚpriority)ÚstrÚfloatr )ÚformatÚ
|
|||
|
|
__classdict__s "€Ú./home/t420/2125_GCE/dual_layer/vram_manager.pyÚ __annotate__Ú GlyphActivation.__annotate__* sj ø‡ ‚ ñ �Mñ ñ Ññ ñ
|
|||
|
|
�Jñ ñ Ññ
|
|||
|
|
ñ Ññ ñ Ññ ñ Ññ ñ �Oò ó © N)Ú__name__Ú
|
|||
|
|
__module__Ú __qualname__Ú__firstlineno__Ú__doc__Ú__annotate_func__Ú__static_attributes__Ú__classdictcell__©r s @r r r * s ø‡ € á#÷ ƒ r r c óÌ a € ] tR t^7t o Rt]3V 3R lR lltV 3R lR ltV 3R lR ltV 3R lR lt V 3R
|
|||
|
|
lR lt
|
|||
|
|
V 3R lR
|
|||
|
|
lt V 3R lR lt V 3R lR lt
|
|||
|
|
V 3R lR ltRtV tR# )Ú VRAMManagerz/Manages VRAM + resonance for dual-layer system.c ó <€ V ^8„ d QhRS[ /# )r Ú
|
|||
|
|
total_vram©r )r r s "€r r ÚVRAMManager.__annotate__: s ø€ ÷ #ñ #¡5ñ #r c óœ € Wn / V n R V n \ P ! 4 V n RRRRRRRR/V n RV n RV n R# )g r Fr
|
|||
|
|
r r N) r. Ú
|
|||
|
|
active_glyphsÚ
|
|||
|
|
vram_usageÚasyncioÚLockÚ_lockÚ
|
|||
|
|
loaded_modelsÚ
|
|||
|
|
_forge_activeÚ
|
|||
|
|
_janus_active)Úselfr. s &&r Ú__init__ÚVRAMManager.__init__: sU € Ø$ŒØ9;ˆÔØ!$ˆŒÜ —\’\“^ˆŒ
|
|||
|
|
ð
|
|||
|
|
�UØ �UØ �UØ ˜ð /
|
|||
|
|
ˆÔð #ˆÔØ "ˆÖr c ó6 <€ V ^8„ d QhRS[ S[S[3, /# ©r Úreturn©r r r )r r s "€r r r0 L s ø€ ÷ ñ ¡t©C±¨H¥~ñ r c ƒ ó " € V P ;_uu_4 GRj x€L
|
|||
|
|
RV P RV P RV P V P ,
|
|||
|
|
RV P V P , ^d, R\ V P 4 RV P \
|
|||
|
|
8¬ RV P \ 8¬ R V P R
|
|||
|
|
V P R V P /
|
|||
|
|
uuRRR4 GRj x€L
|
|||
|
|
# LÐ L + GRj x€L
|
|||
|
|
' g i R# ; i5i) zGet current VRAM status.NÚ
|
|||
|
|
total_vram_gbÚ used_vram_gbÚavailable_vram_gbÚ
|
|||
|
|
usage_percentr2 ÚwarningÚcriticalr7 Ú forge_activeÚ janus_active)
|
|||
|
|
r6 r. r3 Úlenr2 ÚVRAM_WARNING_GBÚVRAM_CRITICAL_GBr7 r8 r9 )r: s &r Úget_vram_statusÚVRAMManager.get_vram_statusL s¯ é € à—:—:—:“:à § ¡ Ø §¡Ø# T§_¡_°t·±Õ%FØ $§/¡/°D·O±OÕ"CÀsÕ!JØ ¤ T×%7Ñ%7Ó!8ؘ4Ÿ?™?¬oÑ=ؘDŸO™OÔ/?Ñ ?Ø ×!3Ñ!3Ø × 2Ñ 2Ø × 2Ñ 2ð ÷ —:—:—:—:—:�:üsK ‚D
|
|||
|
|
›C,œD
|
|||
|
|
ŸB:C0Ã
|
|||
|
|
D
|
|||
|
|
Ã&C.Ã'D
|
|||
|
|
Ã.D
|
|||
|
|
Ã0D
|
|||
|
|
Ã6C9Ã7
|
|||
|
|
D
|
|||
|
|
ÄD
|
|||
|
|
Ä D
|
|||
|
|
c óN <€ V ^8„ d QhRS[ RS[ RS[RS[RS[S[S[ 3, /# )r r r r r r? )r r r Úbool)r r s "€r r r0 \ sF ø€ ÷ 0ñ 0áð0ñ ð0ñ ð 0ñ
|
|||
|
|
ð 0ñ
|
|||
|
|
‰t‘SˆyÕ ñ
|
|||
|
|
0r c óì € V P \ 8¼ d RRV P R
|
|||
|
|
R23# VR8X d V P ' d R# VR8X d V P ' d R# V P V, pWPP 8” dD V P VVV4 pV' g) RRVR
|
|||
|
|
RV P V P ,
|
|||
|
|
R
|
|||
|
|
R 23# V\ 8¼ d% \ P R
|
|||
|
|
V R VR
|
|||
|
|
R \ R
|
|||
|
|
24 R# )a Check if glyph can be activated without VRAM crash.
|
|||
|
|
|
|||
|
|
Args:
|
|||
|
|
glyph_id: Glyph identifier
|
|||
|
|
model: Model to use (llama, forge, janus, google_ai)
|
|||
|
|
vram_budget: Requested VRAM budget
|
|||
|
|
priority: Glyph priority (higher = more authority)
|
|||
|
|
|
|||
|
|
Returns:
|
|||
|
|
(can_activate, reason)
|
|||
|
|
FzCritical VRAM: ú.2fzGB usedr
|
|||
|
|
r zInsufficient VRAM: need z GB, have z GB availablezGlyph z' activation will trigger VRAM warning (zGB >= úGB))Fz8Forge cannot run while Janus is active (VRAM crash risk))Fz8Janus cannot run while Forge is active (VRAM crash risk))TÚOK) r3 rL r9 r8 r. Ú_can_free_vram_forrK ÚloggerrF )r: r r r r Úprojected_usageÚcan_frees &&&&& r Úcan_activate_glyphÚ VRAMManager.can_activate_glyph\ s € ð& �?‰?Ô .Ô .ؘO¨D¯O©O¸CÐ+@ÀÐHÐHÐ Hð �GÔ × 2× 2Ð 2ØTÐ Tà �GÔ × 2× 2Ð 2ØTÐ Tð Ÿ/™/¨KÕ7ˆØ Ÿ_™_Ô ,à×.Ñ.ØØØóˆH÷
|
|||
|
|
Ø Ð 8¸ÀSÐ8IÈÐSW×SbÑSbÐei×etÑetÕStÐuxÐRyð zFð Gð Gð Gð œoÔ -Ü �N‰Nؘ˜
|
|||
|
|
ð #Ø# CÐ(¨¬Ð.?¸sðDô
|
|||
|
|
ð
|
|||
|
|
Ðr c ó2 <€ V ^8„ d QhRS[ RS[ RS[RS[/# )r Ú needed_vramr r r? )r r rP )r r s "€r r r0 Ž s3 ø€ ÷ ñ áðñ ðñ ð ñ
|
|||
|
|
|
|||
|
|
ñ r c óD € V P V P ,
|
|||
|
|
pV P P 4 UUu. uF w rVVP V8 g K WV3NK pppVP R R7 TpV F w r–W†P ,
|
|||
|
|
pW�8¼ g K R# R# u uppi )z@Check if we can free VRAM by deactivating lower-priority glyphs.c ó( € V ^, P # ©é ©r ©Úxs &r Ú<lambda>Ú0VRAMManager._can_free_vram_for.<locals>.<lambda>Ÿ ó € °°1µ· ² r ©ÚkeyTF)r. r3 r2 Úitemsr Úsortr )
|
|||
|
|
r: r\ r r Ú availableÚgidÚ
|
|||
|
|
activationÚlower_priority_glyphsÚpotential_freeÚ_s
|
|||
|
|
&&&& r rU Ú VRAMManager._can_free_vram_forŽ s¤ € ð —O‘O d§o¡oÕ5ˆ ð
|
|||
|
|
$(×#5Ñ#5×#;Ñ#;Ô#=ô!
|
|||
|
|
á#=‘�Ø×"Ñ" XÑ-ô
|
|||
|
|
ˆSÓ Ù#=ð ñ !
|
|||
|
|
ð ×"Ñ"Ñ'>Ð"Ô?ð #ˆÛ 2‰MˆAØ × 4Ñ 4Õ 4ˆNØ Ö,Úñ 3ñ
|
|||
|
|
ùó!!
|
|||
|
|
s »B ÁB c óJ <€ V ^8„ d QhRS[ RS[ RS[ RS[RS[RS[RS[RS[/# ) r r r r r r r r r? )r r rP )r r s "€r r r0 ª se ø€ ÷ Fñ FáðFñ ðFñ ð Fñ
|
|||
|
|
ð Fñ ð
|
|||
|
|
Fñ ðFñ ðFñ
|
|||
|
|
ñFr c ƒ óX " € V P ;_uu_4 GRj x€L
|
|||
|
|
V P WWG4 w r‰V' g/ \ P RV RV 24 RRR4 GRj x€L
|
|||
|
|
R# V P Wt4 \ VVVVVV\ P ! 4 VR7 p
|
|||
|
|
V P P VR4 ' gA \ P RV R\ P V^ 4 R
|
|||
|
|
R 24 R
|
|||
|
|
V P V& VR 8X d R
|
|||
|
|
V n MVR 8X d R
|
|||
|
|
V n
|
|||
|
|
W P V& V ;P V,
|
|||
|
|
un \ P R
|
|||
|
|
V RV RV RVR
|
|||
|
|
RVR
|
|||
|
|
RVR
|
|||
|
|
R2
|
|||
|
|
4 RRR4 GRj x€L
|
|||
|
|
R
|
|||
|
|
# ELj EL% L + GRj x€L
|
|||
|
|
' g i R# ; i5i)aL Activate a glyph (reserve VRAM).
|
|||
|
|
|
|||
|
|
Args:
|
|||
|
|
glyph_id: Glyph identifier
|
|||
|
|
specialized_type: Glyph specialized type
|
|||
|
|
model: Model to use
|
|||
|
|
vram_budget: VRAM budget
|
|||
|
|
resonance_score: Resonance score (0-100)
|
|||
|
|
power_boost: Power boost multiplier
|
|||
|
|
priority: Priority level
|
|||
|
|
|
|||
|
|
Returns:
|
|||
|
|
True if activated, False if failed
|
|||
|
|
NzCannot activate z: F)r r r r r r r r zLoading model: z (estimated z.1frS Tr
|
|||
|
|
r u ✅ Activated glyph z (u ) → z model, rR zGB VRAM, resonance=z, boost=rc )r6 rY rV ÚerrorÚ_deactivate_lower_priorityr r Únowr7 ÚgetÚinfoÚMODEL_VRAM_ESTIMATESr8 r9 r2 r3 ) r: r r r r r r r Ú can_activateÚreasonrm s &&&&&&&& r Úactivate_glyphÚVRAMManager.activate_glyphª sŽ é € ð0 —:—:—:“:à#'×#:Ñ#:Ø ó$Ñ ˆL÷ Ü— ‘ Ð /°¨z¸¸F¸8Ð DÔEØ ÷ —:‘:ð
|
|||
|
|
× +Ñ +¨HÔ Bô )Ø!Ø!1ØØ 'Ø /Ø 'Ü %Ÿ\š\›^Ø!ô ˆJð ×%Ñ%×)Ñ)¨%°×7Ò7Ü— ‘ ˜o¨e¨W°LÔAU×AYÑAYÐZ_ÐabÓAcÐdgÐ@hÐhkÐ lÔmØ,0�×"Ñ" 5Ñ)ð ˜Ô Ø%)�Õ"ؘ'Ô!Ø%)�Ô"ð ,6× Ñ ˜xÑ (Ø �OŠO˜{Õ *�Oä �K‰KØ& x j°Ð3CÐ2Dð EØ �g˜X k°#Ð%6ð 7 Ø ,¨SÐ 1°¸+ÀcÐ9JÈ!ðMô
|
|||
|
|
ð ÷] —:—:—:—:—:“:üsi ‚F*›FœF*Ÿ9F
|
|||
|
|
Á F*Á#FÁ$F*Á*D F
|
|||
|
|
Å3 F*Å>F Å?F*ÆF*Æ F*Æ
|
|||
|
|
F' ÆFÆ
|
|||
|
|
F' Æ F' Æ! F*c ó& <€ V ^8„ d QhRS[ RS[/# )r r r? )r rP )r r s "€r r r0 ò s ø€ ÷ 'ñ '©sð '±tñ 'r c ƒ ó a" € V P ;_uu_4 GRj x€L
|
|||
|
|
WP 9 d RRR4 GRj x€L
|
|||
|
|
R# V P P V4 pV ;P VP , un VP
|
|||
|
|
oV P P SR4 ' d\ \ V3R lV P P 4 4 4 pV^ 8X d( \ P RS 24 RV P S& SR8X d RV n MSR8X d RV n
|
|||
|
|
\ P RV RVP R
|
|||
|
|
R
|
|||
|
|
24 RRR4 GRj x€L
|
|||
|
|
R # ELF EL( L + GRj x€L
|
|||
|
|
' g i R# ; i5i) zDeactivate a glyph (release VRAM).
|