common-linux-commands-data-engineering

A few examples of common Linux Commands for Data Engineering

Useful Commands

Time and Date:

• cal
• date

Disk Usage or File Size:

• df -h
• du -sh *

System Performance

• top

Using the Shell

Exploring:

• pwd
• ls -lah
• cd /tmp
• cd ~
• which python3

Viewing files:

• less /etc/password
• cat /etc/password

Counting lines

• wc -l /etc/passwd

Modifying Files and Directories

• touch newfile.txt
• mkdir newdir
• mkdir -p moredir/dir1/dir2
• rm -rf moredir

Processes

• ps
• ./sleeper.sh &
• fg 1

Learning from Dockerfiles

• Explore Python Dockerhub