cortex/crates/neuron/src/harness/llamacpp.rs at 142e91c3f7f0b6d941453f2270dd1f7c47f3725d - cortex - Gitea: Git with a cup of tea

helexa/cortex

Files

rob thijssen 6dc717ebcd

CI / Format, lint, build, test (push) Successful in 2m29s

Details

CI / Build SRPM (push) Has been skipped

Details

CI / Publish to COPR (push) Has been skipped

Details

feat: add neuron daemon with GPU discovery and health endpoints

Replace cortex-agent stub with neuron (cortex-neuron binary).

cortex-core additions:
- discovery.rs: DeviceInfo, DiscoveryResponse, DeviceHealth, HealthResponse
- harness.rs: Harness async trait, HarnessConfig, ModelSpec, ModelInfo

neuron crate (crates/neuron/):
- discovery.rs: nvidia-smi CSV parsing (pure functions) + system
  discovery via uname/nvidia-smi/nvcc
- health.rs: cached GPU health polling every 5s
- api.rs: GET /discovery and GET /health axum handlers
- main.rs: CLI entrypoint with --port flag (default 9090)
- harness stubs for mistralrs (Phase 8) and llamacpp (Phase 11)

12 new tests (9 unit + 3 integration), 35 total.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-04-15 14:23:42 +03:00

2 lines

50 B

XML

Raw Blame History

// llama.cpp harness implementation — Phase 11.