🐣 Please follow me for new updates https://twitter.com/camenduru 🔥 Please join our discord server https://discord.gg/k5BwmmvJJU 🥳 Please join my patreon community https://patreon.com/camenduru
https://twitter.com/camenduru/status/1747802652182737050
May Sponsor @0xKyon | https://x.com/camenduru/status/1786356739979313312
April Sponsor @0xKyon | https://x.com/camenduru/status/1777537399343513978
March Sponsor @adhik_Joshi | https://x.com/camenduru/status/1768848878017675430
February Sponsor @replicate | https://x.com/camenduru/status/1753460739954630776
artizen.fund @RJPinnell @ArtizenFund | https://twitter.com/camenduru/status/1760205819839144182
fictions.ai @thibaudz | https://twitter.com/camenduru/status/1749788882877448451
Chai Prize Grant @chai_research | https://twitter.com/chai_research/status/1702811327323070762
January Sponsor @adhik_Joshi | https://twitter.com/camenduru/status/1744371512981794865
December Sponsor @adhik_Joshi | https://twitter.com/camenduru/status/1729995264096641233
[Server 1] Total: $3485
https://tost.ai 2 Years Registration $138
[Server 2] Total: $3270
For the second server, we still need $644 😐
[Server 3] Total: $210
✔ Ram: 1 x 32GB Micron 32GB DDR4-3200 ECC-RDIMM 2Rx4 CL22 $88 ✔ Ram: 1 x 32GB Micron 32GB DDR4-3200 ECC-RDIMM 2Rx4 CL22 $88
✔ Ram: 1 x 32GB Micron 32GB DDR4-3200 ECC-RDIMM 2Rx4 CL22 $110 ✔ Ram: 1 x 32GB Micron 32GB DDR4-3200 ECC-RDIMM 2Rx4 CL22 $110
✔ Ram: 1 x 32GB Micron 32GB DDR4-3200 ECC-RDIMM 1Rx4 CL22 $107
✔ CPU Cooler: 4U Active CPU Heat Sink LGA3647 (Narrow) $63 ✔ Ram: 1 x 32GB Micron 32GB DDR4-3200 ECC-RDIMM 1Rx4 CL22 $107 ✔ SSD: Patriot Viper VP4300 Lite 4TB Gen 4x4 7400-6000 MB/s $262
✔ 3 x Case Fan: NZXT AER P - RF-AP140-FP $26 ✔ 3 x Case Fan: NZXT AER P - RF-AP140-FP $26 ✔ GPU1: Asus ROG Strix RTX3090 O24G (default 3-slot with Liquid Cooler 2-slot) $745
✔ CPU: Intel® Xeon® W-3235 Processor (64 Lane PCIe 3.0) (4 GPU Support) $190
✔ Motherboard2: Asus Pro WS C621-64L SAGE (4 GPU Support) $634
✔ CPU1: Intel® Xeon® W-3235 Processor (64 Lane PCIe 3.0) (4 GPU Support) $197 ✔ CPU2: Intel® Xeon® Silver 4110 Processor (48 Lane PCIe 3.0) (3 GPU Support) $33 ✔ RAM1: 1 x 32GB (Micron 32GB DDR4-3200 ECC-RDIMM 1Rx4 CL22) $95 ✔ SSD1: Lexar NM790 4TB M.2 NVMe PCIe Gen 4X4 7400-6500 MB/s $271
✔ Power Supply2: Corsair AX1500i 1500 Watt 80+ Titanium $227 ✔ Case2: (Antec P20C-W) $89
✔ GPU2: Asus ROG Strix RTX3090 O24G-W (default 3-slot with Liquid Cooler 2-slot) $790
✔ 🧿 The non-profit GPU cluster is now running instantid.github.io 🥳 (operating with an old motherboard and CPU because our new CPU has not arrived yet)
✔ 🧿 The non-profit GPU cluster is now running photo-maker.github.io 🥳 (operating with an old motherboard and CPU because our new CPU has not arrived yet)
✔ GPU1: Asus ROG Strix RTX3090 O24G (default 3-slot with Liquid Cooler 2-slot) $747 ✔ Power Supply1: Corsair AX1500i 1500 Watt 80+ Titanium $249 ✔ CPU Cooler1: 4U Active CPU Heat Sink LGA3647 (Narrow) $78
✔ Motherboard1: (Asus Pro WS C621-64L SAGE) $628 ✔ RAM1: 1 x 32GB (Micron 32GB DDR4-3200 ECC-RDIMM 1Rx4 CL22) $95 ✔ Case1: (Antec P20C-W) $89
sudo nano /etc/ssh/sshd_config
PermitRootLogin prohibit-password to PermitRootLogin yes
sudo systemctl restart ssh
sudo passwd
sudo ufw allow ssh
apt update
apt upgrade -y
apt install build-essential software-properties-common zlib1g-dev libncurses5-dev libgdbm-dev libnss3-dev libssl-dev libreadline-dev libffi-dev -y
apt install wget nvtop python-is-python3 python3-pip aria2 unrar -y
lsmod | grep nouveau
cat <<EOF | sudo tee /etc/modprobe.d/blacklist-nouveau.conf
blacklist nouveau
options nouveau modeset=0
EOF
sudo update-initramfs -u
sudo reboot
wget https://developer.download.nvidia.com/compute/cuda/12.1.0/local_installers/cuda_12.1.0_530.30.02_linux.run
sh cuda_12.1.0_530.30.02_linux.run
nvidia-smi
nano /etc/ld.so.conf
ldconfig
nano .bashrc
ldconfig
nvcc --version
nvidia-smi -q | grep -i bar -A 3
lsmod | grep -i nvidia
rmmod nvidia_drm nvidia_modeset nvidia_uvm nvidia
https://www.nvidia.com/en-us/geforce/news/geforce-rtx-30-series-resizable-bar-support/
https://forums.developer.nvidia.com/t/enabling-resizable-bar-on-rtx-30-series-gpus-in-linux/239950
pip install torch==2.4.0+cu124 torchvision==0.19.0+cu124 torchaudio==2.4.0+cu124 torchtext==0.18.0 torchdata==0.8.0 --extra-index-url https://download.pytorch.org/whl/cu124
pip install xformers==0.0.27.post2
pip install torch==2.3.1+cu121 torchvision==0.18.1+cu121 torchaudio==2.3.1+cu121 torchtext==0.18.0 torchdata==0.8.0 --extra-index-url https://download.pytorch.org/whl/cu121
pip install xformers==0.0.27
pip install torch==2.3.0+cu121 torchvision==0.18.0+cu121 torchaudio==2.3.0+cu121 torchtext==0.18.0 torchdata==0.7.1 --extra-index-url https://download.pytorch.org/whl/cu121
pip install xformers==0.0.26.post1
pip install torch==2.2.1+cu121 torchvision==0.17.1+cu121 torchaudio==2.2.1+cu121 torchtext==0.17.1 torchdata==0.7.1 --extra-index-url https://download.pytorch.org/whl/cu121
pip install xformers==0.0.25
pip install torch==2.1.0+cu121 torchvision==0.16.0+cu121 torchaudio==2.1.0+cu121 torchtext==0.16.0 torchdata==0.7.0 --extra-index-url https://download.pytorch.org/whl/cu121
pip install notebook
pip show torch notebook
nano /etc/netplan/00-installer-config.yaml
netplan apply
wget https://github.com/cloudflare/cloudflared/releases/latest/download/cloudflared-linux-amd64.deb
dpkg -i cloudflared-linux-amd64.deb
cloudflared service install TOKEN_HERE
https://docs.docker.com/engine/install/ubuntu/
https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html#installing-the-nvidia-container-toolkit
systemctl restart docker
https://github.com/jupyter/docker-stacks
https://github.com/camenduru/docker-stacks-foundation
https://github.com/camenduru/base-notebook
https://quay.io/repository/camenduru/docker-stacks-foundation
https://quay.io/repository/camenduru/base-notebook
docker build -t base-notebook .
Ubuntu 22.04 Python 3.10.11
timeout 4h docker container run -it --rm --gpus all -u root -e GRANT_SUDO=yes -p 1000:7860 quay.io/camenduru/base-notebook:latest
timeout 4h docker container run -it --rm --gpus device=0 -u root -e GRANT_SUDO=yes -p 1000:7860 registry.hf.space/camenduru-base-notebook:latest
timeout 4h docker container run -it --rm --gpus device=1 -u root -e GRANT_SUDO=yes -p 1000:7860 camenduru/base-notebook:latest
docker system prune -a
docker cp /content/test.rar 76e35c4a6e8f:/home/jovyan/test.rar
docker exec -it 76e35c4a6e8f bash
tmux ls
tmux a
tmux attach-session -t 0
tmux capture-pane -pS - > ~/tmux-buffer.txt
wget https://openrgb.org/releases/release_0.9/openrgb_0.9_amd64_bookworm_b5f46e3.deb
dpkg -i openrgb_0.9_amd64_bookworm_b5f46e3.deb
apt --fix-broken install
openrgb -m off
find / -type f -exec du -h {} + | sort -rh | head -n 20
git clone https://github.com/aristocratos/btop
cd btop
make
make install PREFIX=/usr
git clone https://github.com/aristocratos/btop && cd btop && make && make install
https://github.com/raboof/nethogs
https://github.com/jupyterlab/jupyterlab
mkdir /content
nano /etc/systemd/system/jupyter-lab.service
systemctl daemon-reload
systemctl start jupyter-lab
systemctl enable jupyter-lab
systemctl list-unit-files --type=service --state=enabled
pip install pickleshare ipywidgets
https://github.com/coder/code-server
curl -fsSL https://code-server.dev/install.sh | sh
nano /etc/systemd/system/default.target.wants/[email protected]
systemctl enable --now code-server@$USER
systemctl status code-server@$USER
systemctl enable code-server@$USER
systemctl list-unit-files --type=service --state=enabled
nano /root/.config/code-server/config.yaml
bind-addr: 0.0.0.0:8080
auth: none
disable-telemetry: true
cert: false
chrome://flags/#unsafely-treat-insecure-origin-as-secure
apt install openjdk-21-jdk
https://www.mongodb.com/docs/manual/tutorial/install-mongodb-on-ubuntu/
curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.39.7/install.sh | bash
export NVM_DIR="$HOME/.nvm"
[ -s "$NVM_DIR/nvm.sh" ] && \. "$NVM_DIR/nvm.sh"
nvm install 18.20.3
npm install -g generator-jhipster
npm install -g yo
./mvnw
npm start
sftp [email protected]
get -r /content/folder /content/folder
mongodump --db=web --out=/content/folder/db
mongorestore --db=web /content/folder/db/web
pip install pymongo
journalctl -u dispatcher-web-name.service
systemctl list-units --type=service --state=running
https://docs.nvidia.com/video-technologies/index.html
!mkdir /content/ffmpeg
%cd /content/ffmpeg
!git clone https://git.videolan.org/git/ffmpeg/nv-codec-headers.git
%cd nv-codec-headers
!sudo make install
%cd /content/ffmpeg
!git clone https://git.ffmpeg.org/ffmpeg.git /content/ffmpeg/ffmpeg
%cd /content/ffmpeg/ffmpeg
!apt install build-essential pkg-config yasm cmake libtool libc6 libc6-dev unzip wget libnuma1 libnuma-dev libfdk-aac-dev libmp3lame-dev libopus-dev libx264-dev libx265-dev -y
!./configure --enable-nonfree --enable-cuda-nvcc --enable-nvenc --enable-libnpp --extra-cflags=-I/usr/local/cuda/include --extra-ldflags=-L/usr/local/cuda/lib64 --disable-static --enable-shared --enable-libmp3lame --enable-gpl --enable-libfdk-aac --enable-libopus --enable-libx264 --enable-openssl
!make -j 24
!make install
!ldconfig
Environment="IMAGEIO_FFMPEG_EXE=ffmpeg"