Skip to content

Commit 58b40fd

Browse files
Deploying to gh-pages from @ dstackai/dstack@43ffb4d 🚀
1 parent e120c68 commit 58b40fd

35 files changed

Lines changed: 7029 additions & 611 deletions

assets/images/quotes/spott.jpg

12 MB
Loading

docs/guides/server-deployment.md

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,10 @@ description: Deploying the dstack server
55

66
The `dstack` server can run on your laptop or any environment with access to the cloud and on-prem clusters you plan to use.
77

8-
The minimum hardware requirements for running the server are 1 CPU and 1GB of RAM.
8+
??? info "Hardware requirements"
9+
The minimum hardware requirements for running the server are 1 CPU and 1GB of RAM. The recommended RAM is
10+
"8MB × number of active instances". For example, a server with 1000 active instances should have 8GB of RAM.
11+
You can set the `DSTACK_SERVER_SSH_POOL_DISABLED` env var to minimize RAM usage at the expense of slower processing.
912

1013
=== "pip"
1114
> The server can be set up via `pip` on Linux, macOS, and Windows (via WSL 2). It requires Git and OpenSSH.
@@ -43,7 +46,7 @@ The minimum hardware requirements for running the server are 1 CPU and 1GB of RA
4346
</div>
4447

4548
=== "Docker"
46-
> To deploy the server most reliably, it's recommended to use `dstackai/dstack` Docker image.
49+
> For production deployments, it's recommended to use `dstackai/dstack` Docker image.
4750

4851
<div class="termy">
4952

docs/guides/server-deployment/index.html

Lines changed: 7 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -5375,7 +5375,12 @@
53755375
<h1>Server deployment</h1>
53765376

53775377
<p>The <code>dstack</code> server can run on your laptop or any environment with access to the cloud and on-prem clusters you plan to use.</p>
5378-
<p>The minimum hardware requirements for running the server are 1 CPU and 1GB of RAM.</p>
5378+
<details class="info">
5379+
<summary>Hardware requirements</summary>
5380+
<p>The minimum hardware requirements for running the server are 1 CPU and 1GB of RAM. The recommended RAM is
5381+
"8MB × number of active instances". For example, a server with 1000 active instances should have 8GB of RAM.
5382+
You can set the <code>DSTACK_SERVER_SSH_POOL_DISABLED</code> env var to minimize RAM usage at the expense of slower processing.</p>
5383+
</details>
53795384
<div class="tabbed-set tabbed-alternate" data-tabs="1:3"><input checked="checked" id="pip" name="__tabbed_1" type="radio" /><input id="uv" name="__tabbed_1" type="radio" /><input id="docker" name="__tabbed_1" type="radio" /><div class="tabbed-labels"><label for="pip">pip</label><label for="uv">uv</label><label for="docker">Docker</label></div>
53805385
<div class="tabbed-content">
53815386
<div class="tabbed-block">
@@ -5410,7 +5415,7 @@ <h1>Server deployment</h1>
54105415
</div>
54115416
<div class="tabbed-block">
54125417
<blockquote>
5413-
<p>To deploy the server most reliably, it's recommended to use <code>dstackai/dstack</code> Docker image.</p>
5418+
<p>For production deployments, it's recommended to use <code>dstackai/dstack</code> Docker image.</p>
54145419
</blockquote>
54155420
<div class="termy">
54165421
<div class="highlight"><pre><span></span><code>$<span class="w"> </span>docker<span class="w"> </span>run<span class="w"> </span>-p<span class="w"> </span><span class="m">3000</span>:3000<span class="w"> </span><span class="se">\</span>

docs/reference/env.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -146,6 +146,8 @@ For more details on the options below, refer to the [server deployment](../guide
146146
- `DSTACK_SERVER_SSHPROXY_ENFORCED`{ #DSTACK_SERVER_SSHPROXY_ENFORCED } – When set to any value, restricts all SSH connections to go through the SSH proxy.
147147
- `DSTACK_SERVER_JOB_NETWORK_MODE`{ #DSTACK_SERVER_JOB_NETWORK_MODE } – Controls the network mode assigned to jobs. Accepts an integer value: `1` forces bridge networking for single-node jobs while distributed tasks still use host networking; `2` uses host networking whenever the job occupies a full instance (default); `3` forces bridge networking for all jobs including distributed tasks.
148148
- `DSTACK_SERVER_SSH_CONNECT_TIMEOUT`{ #DSTACK_SERVER_SSH_CONNECT_TIMEOUT } – The SSH `ConnectTimeout` for server-instance connections, in seconds. Defaults to `3`. Increase if there are high-latency links between the server and instances.
149+
- `DSTACK_SERVER_SSH_POOL_DISABLED`{ #DSTACK_SERVER_SSH_POOL_DISABLED } – Disables the reuse of server SSH connections to instances. If set, significantly decreases server RAM usage, but
150+
slows down processing and may cause CPU spikes due to frequent SSH-connection establishment.
149151

150152
??? info "Internal environment variables"
151153
The following environment variables are intended for development purposes:

docs/reference/env/index.html

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4998,6 +4998,8 @@ <h2 id="server">Server<a class="headerlink" href="#server" title="Permanent link
49984998
<li><code id="DSTACK_SERVER_SSHPROXY_ENFORCED">DSTACK_SERVER_SSHPROXY_ENFORCED</code> – When set to any value, restricts all SSH connections to go through the SSH proxy.</li>
49994999
<li><code id="DSTACK_SERVER_JOB_NETWORK_MODE">DSTACK_SERVER_JOB_NETWORK_MODE</code> – Controls the network mode assigned to jobs. Accepts an integer value: <code>1</code> forces bridge networking for single-node jobs while distributed tasks still use host networking; <code>2</code> uses host networking whenever the job occupies a full instance (default); <code>3</code> forces bridge networking for all jobs including distributed tasks.</li>
50005000
<li><code id="DSTACK_SERVER_SSH_CONNECT_TIMEOUT">DSTACK_SERVER_SSH_CONNECT_TIMEOUT</code> – The SSH <code>ConnectTimeout</code> for server-instance connections, in seconds. Defaults to <code>3</code>. Increase if there are high-latency links between the server and instances.</li>
5001+
<li><code id="DSTACK_SERVER_SSH_POOL_DISABLED">DSTACK_SERVER_SSH_POOL_DISABLED</code> – Disables the reuse of server SSH connections to instances. If set, significantly decreases server RAM usage, but
5002+
slows down processing and may cause CPU spikes due to frequent SSH-connection establishment.</li>
50015003
</ul>
50025004
<details class="info">
50035005
<summary>Internal environment variables</summary>

0 commit comments

Comments
 (0)