rob thijssen
ace6037a2d
All checks were successful
deploy-ui / build-and-deploy (push) Successful in 44s
Build separate packages for each GPU generation instead of a single cuda13 package: - mistralrs-ampere (sm_86, RTX 3060) - mistralrs-ada (sm_89, RTX 4090) - mistralrs-blackwell (sm_120, RTX 5090) All use the same CUDA 13.0 toolkit and features (cuda, cudnn, flash-attn, nccl), varying only the compute capability target. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
104 lines
3.7 KiB
TypeScript
104 lines
3.7 KiB
TypeScript
import { Card, Col, Row } from "react-bootstrap";
|
|
import { CodeBlock } from "../components/CodeBlock.tsx";
|
|
|
|
const GPG_KEY_URL = "https://rpm.lair.cafe/8b2023ce.gpg";
|
|
|
|
const REPO_FILE = `[lair-cafe]
|
|
name=lair.cafe RPM Repository
|
|
baseurl=https://rpm.lair.cafe/fedora/$releasever/$basearch/
|
|
enabled=1
|
|
gpgcheck=1
|
|
gpgkey=${GPG_KEY_URL}`;
|
|
|
|
const UNSTABLE_REPO_FILE = `[lair-cafe-unstable]
|
|
name=lair.cafe RPM Repository (unstable)
|
|
baseurl=https://rpm.lair.cafe/fedora/$releasever/$basearch/unstable/
|
|
enabled=0
|
|
gpgcheck=1
|
|
gpgkey=${GPG_KEY_URL}`;
|
|
|
|
export function Home() {
|
|
return (
|
|
<>
|
|
<h1 className="mb-3">rpm.lair.cafe</h1>
|
|
<p className="lead mb-4">
|
|
Self-hosted RPM repository for Fedora, currently hosting
|
|
CUDA-accelerated builds of{" "}
|
|
<a href="https://github.com/EricLBuehler/mistral.rs">mistral.rs</a>.
|
|
</p>
|
|
|
|
<Row className="g-4">
|
|
<Col lg={12}>
|
|
<Card>
|
|
<Card.Body>
|
|
<Card.Title>Quick start</Card.Title>
|
|
|
|
<h6 className="mt-4">1. Import the signing key</h6>
|
|
<CodeBlock language="bash">
|
|
{`sudo rpm --import ${GPG_KEY_URL}`}
|
|
</CodeBlock>
|
|
|
|
<h6 className="mt-4">2. Add the repository</h6>
|
|
<CodeBlock language="bash">
|
|
{`sudo dnf config-manager addrepo --from-repofile=/dev/stdin <<'EOF'\n${REPO_FILE}\nEOF`}
|
|
</CodeBlock>
|
|
|
|
<h6 className="mt-4">3. Install a package</h6>
|
|
<p className="text-body-secondary">
|
|
Choose the package matching your GPU generation:
|
|
</p>
|
|
<CodeBlock language="bash">
|
|
{`# RTX 3000 series (Ampere)\nsudo dnf install mistralrs-ampere\n\n# RTX 4000 series (Ada Lovelace)\nsudo dnf install mistralrs-ada\n\n# RTX 5000 series (Blackwell)\nsudo dnf install mistralrs-blackwell`}
|
|
</CodeBlock>
|
|
</Card.Body>
|
|
</Card>
|
|
</Col>
|
|
|
|
<Col lg={12}>
|
|
<Card>
|
|
<Card.Body>
|
|
<Card.Title>Unstable (prerelease) packages</Card.Title>
|
|
<p>
|
|
Unstable packages are built automatically from the latest
|
|
upstream <code>main</code> branch commit. They use the
|
|
next release version from <code>Cargo.toml</code> with a
|
|
prerelease suffix (e.g.{" "}
|
|
<code>0.8.1-0.1.20260511git1a2b3c4</code>). When the
|
|
upstream version is officially released, the stable package
|
|
will automatically supersede any installed prerelease.
|
|
</p>
|
|
|
|
<h6 className="mt-4">Add the unstable repository</h6>
|
|
<p className="text-body-secondary">
|
|
The unstable repo is disabled by default. Add it alongside the
|
|
stable repo:
|
|
</p>
|
|
<CodeBlock language="bash">
|
|
{`sudo dnf config-manager addrepo --from-repofile=/dev/stdin <<'EOF'\n${UNSTABLE_REPO_FILE}\nEOF`}
|
|
</CodeBlock>
|
|
|
|
<h6 className="mt-4">
|
|
Install or update from unstable
|
|
</h6>
|
|
<CodeBlock language="bash">
|
|
{`sudo dnf --enablerepo=lair-cafe-unstable install mistralrs-ada`}
|
|
</CodeBlock>
|
|
|
|
<h6 className="mt-4">
|
|
Pin to stable
|
|
</h6>
|
|
<p className="text-body-secondary">
|
|
If you have the unstable repo enabled and want to stay on
|
|
stable releases, exclude prerelease versions:
|
|
</p>
|
|
<CodeBlock language="bash">
|
|
{`sudo dnf --disablerepo=lair-cafe-unstable update mistralrs-ada`}
|
|
</CodeBlock>
|
|
</Card.Body>
|
|
</Card>
|
|
</Col>
|
|
</Row>
|
|
</>
|
|
);
|
|
}
|