cosmopolitan

• 1df4296208 Fix stdio for character device regression

• cf70a44756 Support shebang on Windows
• ed93fc3dd7 Fix fread() with 2gb+ sizes
• 5f61d273e4 Add hwap constants to sys/auxv.h
• 2f3c6e7cc3 Revert "Remove zlib namespacing (#1142)"
• 65c9b28e99 Fix buffer overflow in Lua os.tmpname (#1180)
• bf3531de81 Make crash reports reliable in multithreaded case
• 13b9ecd537 Remove outdated restriction on -Werror on cosmocc
• 624119ea38 Fix NT accept/connect not initializing with SO_UPDATE_*_CONTEXT (#1164)
• 0768807935 Rename python -> python3 (closes #1144) (#1187)
• 4292348707 Import libbsd readpassphrase (#1182)
• 42891e82bb Fix #959 (typo in cosmocc --version)
• 0b59f01b43 Put confstr() in unistd.h
• f029375d39 Introduce MAP_HUGETLB
• 47183551d6 Fix sleb64 (#1179)

• ae2a7ac844 Fix thread-local storage bugs on aarch64
• 793393a341 Polyfill SA_RESETHAND on MacOS ARM64

• b0df6c1fce Implement proper time zone support
• 19c81863a3 Improve crash backtrace reliability
• 7d31fc311a Loaders rewrite argv[0] for old binaries (#1170)
• 57c0b065c8 Make old C++ demangler asynchronous signal safe
• a6ecbb747d Introduce libc/mem/tinymalloc.inc
• 3bf95ae7ec Invent tool for renaming ELF object symbols
• 5fd7b07fac Improve AVX512 feature detection
• 317c8bc312 Update MODE=tiny time zone list (#1167)
• d5ebb1fa5b Add MapViewOfFile3 WIN32 API
• 06d916b449 Add VirtualAlloc2 WIN32 API

• 5c6877b02b Introduce support for trapping math
• 403bc25412 Make MXCSR editable by signal handlers on Windows
• 8f6bc9dabc Let signals interrupt fgets unless SA_RESTART set (#1152)
• deff138e7e recvfrom: don't convert address if addrsize is 0 (#1153)
• b6e40a3a58 Add /dev/(u)random on NT (#1163)
• 5488f0b2ca Remove zlib namespacing (#1142)
• 181cd4cbe8 Add sysctlbyname() for MacOS
• 3bcd40be12 Fix regression in apeinstall.sh (#1161)
• fcfdd26b72 Fix wrong parameter type in redbean documentation (#1162)
• ff2b6fc0b0 Add munlock() and mlock2() to pledge
• 0eef971494 Add much of C11 threads.h API
• 2bfd6b37c1 Various paginate improvements (#1148)
• 69db501c68 Fix fork locking on win32 (#1141)
• 6e6fc38935 Apply clang-format update to repo (#1154)
• 342d0c81e5 vim spells the c++ filetype 'cpp'
• cec4c04aa1 Remove .com logic from GetProgramExecutableName (#1134)
• f8c0186221 Fix calling __dns_parse with potentially too large rlen
• 6992d8c195 Remove arbitrary limit from DNS result parsing
• 1a6b4ab627 Import mntent bug fixes from Musl Libc
• 223eb358c4 Import compiler warning fix from Musl
• ea3cc4ea0b math: fix fma(x,y,0) when x*y rounds to -0
• 01267ea0f5 Update GetRemoteAddr documentation to clarify that it may return nil. (#1149)
• bc6c18368f Update .clang-format
• 06839ab301 Change loop bound on uuidv4 test (#1143)
• 39dde41516 [Redbean] Add UuidV4 method (#1140)
• 3e16e59f72 Move store after __asan_unpoison in __zipos_alloc (#1135)
• b9d6e6e348 Standardize on -fsigned-char
• 49a32136f8 Upgrade the One True Awk

• 9ff65cff63 Fix ZipOS extraction of ZIP64 assets
• bef2cb05ff Fix AVX512_BF16
• 43885a76e4 Fix binary formatting for integers 2 and 3 (#1123)
• 74a85087de Support -S in cosmocross
• 045632a743 Make fixupobj work on Windows
• 9a10adac35 Remove .com from README
• 0c12c26e1d Update Emacs config
• 40b7da8422 Speed up fmaf() on x86
• 640668931d Clarify MacOS supported versions
• 1c34088ba0 Ignore -pie and -fpie in cosmocc
• bb92347158 Add deprecated stubs for _bsf / _bsr
• 8bfd56b59e Rename _bsr/_bsf to bsr/bsf
• a6baba1b07 Stop using .com extension in monorepo

This release fixes two issues with the recent 3.3.1 cosmocc release.

• 64a9e6fe5 Fix compiler runtime for _Float16 type
• 0ef36489c Walk back most uses of __STRICT_ANSI__

Please see the previous release for the latest cosmos and further details.

This release fixes regressions introduced by v3.3, squashes additional bugs,
makes reliability and quality improvements, makes math better, and introduces
the getcpu() system call.

• 77ddf4cb0 Fix cosmocc on MacOS ARM64
• 29eac8e2a Fix regression in logger functions
• f7ff51596 *scanf() fixes to make TeX work (#1109)
• 77a92f517 Introduce getcpu() system call from glibc
• a5a3e78fc Make ftrace/strace C APIs work with cosmocc
• e9a756e78 Make --ftrace more crash proof with foreign code
• 7c7bf4bb9 Upgrade to superconfigure z0.0.34
• fc3c536ec Make --ftrace work better with cosmocc
• 38af54a2d Fix GCC version in cosmocc wrapper script
• 99f0491f0 Fix invalid XNU binaries generated by apelink in some edge cases (#1106)
• 38bceaeb8 Give up on making clock_nanosleep() precise
• 592f6ebc2 Address the Musl complex math FIXME comments
• 592f6ebc2 Some libm funcs like pow() now support setting errno
• 592f6ebc2 Use more accurate atan2f() and log1pf() implementations
• 592f6ebc2 atoi() and atol() will no longer saturate or clobber errno
• 592f6ebc2 Import the latest and greatest math functions from ARM Ltd.
• 9b4701b3b e72a88ea7 Don't include <crypt.h> from <stdlib.h> (#1112)
• 3eb405e0e Resurrect <windows.h> as <windowsesque.h>
• 68b9479f0 Make cosmo.h work a little better
• 592f6ebc2 memcpy() on ARM is now faster
• af8f2bd19 Shave 4kb off each binary
• ad3944a3b Support any HTTP method

Known Issues

• OpenMP is hairy on MacOS ARM for nontrivial applications.
• Compiling the mono repo on Windows is currently broken due to https://github.com/jart/cosmopolitan/issues/1010. In the meantime, use cosmopolitan-3.2.tar.gz

Mirrors

• https://cosmo.zip/pub/cosmocc/cosmocc-3.3.1.zip
• https://cosmo.zip/pub/cosmo/cosmopolitan-3.3.1.tar.gz
• https://cosmo.zip/pub/cosmos/zip/cosmos-3.3.1.zip
• https://cosmo.zip/pub/cosmos/v/3.3.1/bin/

Cosmopolitan Libc makes C a build-once run-anywhere language, like Java, except it doesn't need an interpreter or virtual machine. Instead, it reconfigures stock GCC and Clang to output a POSIX-approved polyglot format that runs natively on Linux + Mac + Windows + FreeBSD + OpenBSD + NetBSD + BIOS with the best possible performance and the tiniest footprint imaginable. For further details, read Cosmopolitan Third Edition, the Cosmo README, and the Cosmopolitan Toolchain README.

Major Changes

This release upgrades us to GCC 12.3 and binutils 2.42. The GNU linker
appears to have changed things so that only a single de-duplicated str
table is present in the binary, and it gets placed wherever the linker
wants, regardless of what the linker script says. To cope with that we
need to stop using .ident to embed licenses. As such, this change does
significant work to revamp how third party licenses are defined in the
codebase, using .section .notice,"aR",@progbits.

This new GCC 12.3 toolchain has support for GNU indirect functions. It
lets us support __target_clones__ for the first time. It is used for
optimizing the performance of libc string functions such as strlen and
friends so far on x86, by ensuring AVX systems favor a second codepath
that uses VEX encoding. It shaves some latency off certain operations.
It's a useful feature to have for scientific computing for the reasons
explained by the test/libcxx/openmp_test.cc example which compiles for
fifteen different microarchitectures. Thanks to the upgrades, it's now
also possible to use newer instruction sets, such as AVX512FP16, VNNI.

Experimental support has been added for OpenMP, which lets you whip up
multithreaded mathematical code very easily. It works on all supported
platforms for simple examples like openmp_test.cc but you may run into
issues on MacOS ARM64 with more complicated usage.

Cosmo now uses the %gs register on x86 by default for TLS. Doing it is
helpful for any program that links cosmo_dlopen(). Such programs had
to recompile their binaries at startup to change the TLS instructions.
That's not great, since it means every page in the executable needs to
be faulted. The work of rewriting TLS-related x86 opcodes, is moved to
fixupobj.com instead. This is great news for MacOS x86 users, since we
previously needed to morph the binary every time for that platform but
now that's no longer necessary. The only platforms where we need fixup
of TLS x86 opcodes at runtime are now Windows, OpenBSD, and NetBSD. On
Windows we morph TLS to point deeper into the TIB, based on a TlsAlloc
assignment, and on OpenBSD/NetBSD we morph %gs back into %fs since the
kernels do not allow us to specify a value for the %gs register.

OpenBSD users are now required to use APE Loader to run Cosmo binaries
and assimilation is no longer possible. OpenBSD kernel needs to change
to allow programs to specify a value for the %gs register, or it needs
to stop marking executable pages loaded by the kernel as mimmutable().

Other Changes

• This release fixes __constructor__, .ctor, .init_array, and .preinit_array so they behave the exact same way as glibc.
• The math.h constants no longer use hex notation.
• WinMain() will now ensure $HOME and $USER are always defined.
• Redbean Fetch redirect with relative URLs has been fixed (#1034)
• The complex.h header now works and support is added for struct ipv6_mreq (#1100)
• MODE=dbg support is now restored, as of c1e18e790
• The static yoinks for blink, i.e. __static_yoink("blink_linux_aarch64"), and __static_yoink("blink_xnu_aarch64"), have been removed. Please build blink from source on your platform to use blink to run cosmo binaries.
• There's a now Curve25519() API added to redbean in d50064a77 and #1096
• Calling pthread_create() will no longer raise an assertion error if it fails, as of 8ebe2e902
• cosmocc now properly handles dependency output in #1091
• The __cxa_thread_atexit prototype has been fixed in #1088
• The final remaining libcxx source files have been added in #1089
• cosmocc is now fixed so that it doesn't run fixupobj on text output in #1084
• The STL is now conformant since std::pair can now be trivial fd75fd146
• Most libc functions are now annotated as dontthrow, to save on size.

Notes

Cosmopolitan no longer distributes cosmo binaries for QuickJS, because
Fabrice Bellard is now doing it himself on his website. You should use
his binaries instead: https://bellard.org/quickjs/

Cosmopolitan Libc makes C a build-once run-anywhere language, like Java, except it doesn't need an interpreter or virtual machine. Instead, it reconfigures stock GCC and Clang to output a POSIX-approved polyglot format that runs natively on Linux + Mac + Windows + FreeBSD + OpenBSD + NetBSD + BIOS with the best possible performance and the tiniest footprint imaginable. For further details, read Cosmopolitan Third Edition, the Cosmo README, and the Cosmopolitan Toolchain README.

This v3.2.4 release of Cosmopolitan introduces C++ exceptions and RTTI,
which can be enabled by passing the -fexceptions and/or -rtti flags
to your cosmocc compiler.

• b580080af tool/cosmocc: Allow exceptions and rtti (#1074)
• b0566348b third_party/libcxxabi: Add test suite (#1076)
• b09096691 third_party: Add libunwind (#1053)
• 81ce2e4cb Call thread finalizers on exit()
• 94bab1618 Add fixes to libunwind (#1069)
• 8b33204f3 Add LLVM libcxxabi (#1063)
• 6ab01716c Fix aarch64 setjmp abi

If C is your preferred language, then you can use Cosmopolitan garbage
collection via our new gc() macro. To enable this feature, you need to
pass the -mcosmo flag to cosmocc. For example, to say gc(malloc(32))
means that memory will be reclaimed when your function returns, and it
will be reclaimed by pthread_exit() too. There's also defer() which is
generalized and allows any callback. Pointers exist on a shadow stack.

• a4b455185 Bring back gc() function

Here's some additional developments since the last release:

• df648fb17 Revert apeinstall.sh binfmt flags (#1072)
• cafea9a0a Flesh out tool/zsh/mkofs
• 6cb0354e1 mkofs improvements
• 16099801c zsh mkofs tool

Known Issues

• Compiling the mono repo on Windows is currently broken due to #1010. In the meantime, use cosmopolitan-3.2.tar.gz

This release introduces two new features:

• b3fb6cff4 Add /dev/fd support to Windows
• ce17ed60d Support -MF and -MT in cosmocc

Your cosmo_dlsym() function now returns the raw symbols. You need to
update your code to call cosmo_dltramp() on the result, otherwise it
will crash on Windows.

• 5e7137097 Make breaking change to cosmo_dlsym()

The following fixes have been implemented:

• 5ae2554c1 Have cosmo_dlopen() request -z execstack on Linux
• aa37a327e Make $prog.ape more reliable on Apple Silicon (#1071)
• 390335eb4 apeinstall/uninstall.sh can use doas (#1062)
• d27a47b0e Bugfix: ape --help should exit 0 (#1060)

Function pointers are now safer when using dynamically linked libraries.

• fad1279c6 Make cosmo_dlopen() safer and faster

• 0e49bed66 Support 40 cosmo_dlopen() function parameters
• 2d93788ce Fix --ftrace with cosmo_dlopen()
• 44a463e4d Invent *cosmo_dltramp() function
• 15548b523 Cleanup apeinstall.sh (#1057)
• 412a200ae Support binfmt_misc P flag in APE loader (#1058)
• a334f9cc3 Update redbean ProgramDirectory to return a list of previously set directories (#1021)
• 3315b6ef1 Store StrlenDevFd in n (#1056)

Cosmopolitan Libc makes C a build-once run-anywhere language, like Java, except it doesn't need an interpreter or virtual machine. Instead, it reconfigures stock GCC and Clang to output a POSIX-approved polyglot format that runs natively on Linux + Mac + Windows + FreeBSD + OpenBSD + NetBSD + BIOS with the best possible performance and the tiniest footprint imaginable. For further details, read Cosmopolitan Third Edition, the Cosmo README, and the Cosmopolitan Toolchain README.

Our latest 3.2 release features exciting fixes and improvements.

• 83107f78e Introduce FreeBSD ARM64 support
• 43fe5956a Use DNS implementation from Musl Libc
• 796148790 Remove hard coded paths from APE bootloader (NixOS)
• f8ea02d4d Import /etc/shadow support from Musl for Linux
• ce0143e2a Fix madvise() on Windows
• 873069fcd Fix -Xaarch64 in cosmocc
• 1a28e35c6 Use good locks in dlmalloc
• cd52c5955 Allow MAP_POPULATE under pledge()
• e36283f1d Support double parameters in dlsym() imports
• 6be9477b9 Fix redbean to only check additional content types when Lua is present (#1033)

We've fixed important threading bugs on /zip/... file descriptors.

• 53357aa26 Fix __zipos_close (#984)
• 8a10ccf9c Fix ZipOS deadlock/segfault (#1011)
• 5c3586352 Rename __zipos_free -> __zipos_drop (#1043)
• 4c6f928fb Disable argv[0] tests on non-XnuSilicon (#1015)

We now have a hack that lets you use cosmo binaries as a login shell.
Setuid security is improved. Executable path self-detection is better.
There's a new APE loader version as a result. If you have a systemwide
APE loader install, it's recommended that you upgrade, but not required.

• 81949f038 Mint APE Loader v1.10
• 2a3813c6c $prog.ape support (#977)
• f94c11d97 Loader path security (#1012)
• 68dbe5312 Prepend getcwd to exename early in init (#1048)
• b02d13ccd Re-enable/fix non-argv[0] exe name tests (#1046)
• 10b4693e3 Sanity-check set-id interpreter script paths (#1029)
• 77facc4f7 Cover more cases for detecting ape loader (#1022)
• 2a11a09d9 Remove realpath/getcwd from loaders (#1024)
• d8ad34686 Implement issetugid() on NetBSD

Our public header files now have better open source compatibility.

• 8874a37ab Add <link.h> for absl
• 221a27836 Define max_align_t in <stddef.h>
• 06ace4e7b Always use compiler builtin for offsetof()
• a11016e59 Use gid_t and uid_t in passwd.h (#995)
• b0cced855 Move tcgetpgrp and tcsetpgrp decls to unistd.h (#996) (#997)

• 69ba51646 Revert "Re-enable apelink size optimization"

• d1a745c17 Implement __zipos_dup (#972)
• 4b7ba9a4c Fix some bugs with dup2() and ZipOS
• 7845495a9 Get tool/cosmocc/package.sh working on M1 (#970)
• 14bf57180 Make cosmocc make work right on aarch64
• 7b3d7ee07 Re-enable apelink size optimization
• ff955aaa0 Make memcmp() and memchr() go fast again
• 70155df7a Avoid linking win32 signals impl
• 2b960bb24 Exclude strace from MODE=tiny builds

• 41c06c632 Make cosmocc 100x faster on MacOS
• 43de12db5 Introduce forkpty()
• cc5c5319b Linux: Add cachestat, fchmodat2 syscalls (#958)
• 0bffd0943 Allow redbean to accept --assimilate option without complaining (#916)
• 96185e1ac Fix MODE=aarch64 cross-compiling
• ca5e36191 Don't show (win32 error 0)
• 9cad66aa1 Freshen bootstrap binaries for MacOS + SIP
• 96f979dfc Rename makefiles BUILD.mk

Cosmopolitan Libc makes C a build-once run-anywhere language, like Java, except it doesn't need an interpreter or virtual machine. Instead, it reconfigures stock GCC and Clang to output a POSIX-approved polyglot format that runs natively on Linux + Mac + Windows + FreeBSD + OpenBSD + NetBSD + BIOS with the best possible performance and the tiniest footprint imaginable.

Overview

This release fixes issues with the 3.0.x series. A new cosmo_dlopen() function is now provided that's good enough to load nontrivial dynamic libraries on all platforms except OpenBSD. Cosmos binaries are now being distributed on our new online service https://cosmo.zip/ that's operated by the Cosmopolitan authors. This release was made possible thanks to the testing and contribution efforts of our GitHub and Discord communities https://discord.gg/FwAVVu7eJ4. Thank you!

Changes

• 5330442d8 Avoid APE fork bomb
• 291103ad8 Redesign cosmocc toolchain
• 751d20d98 Fix nsync_mu_unlock_slow_() on Apple Silicon
• 3ac473df3 Floating point parsing support for scanf family (#924)
• 8caf1b48a Improve time/sleep accuracy on Windows
• e4dea37b8 Make clock_nanosleep() cancel faster
• 32b97f2d2 Improve execve() path argument munging
• bcf268adf Don't modify argument block on MacOS Arm64
• 0863427b3 Make development more pleasant on MacOS Arm64
• 48bd3d85d Fix sigaction() return handler address on XNU/BSD
• 3e6d53682 Correct misunderstanding with zip64 extra records
• 0c89516ac Fix unzip warning with apelink generated symtabs
• f25beb341 Add architecture flag to zipobj
• 736fdb757 Implement raise() with getcontext() / setcontext
• bd56a9cf5 Rename dlopen() to cosmo_dlopen()
• f7cfe0388 Fix dlopen() for FreeBSD and NetBSD
• 529cb4817 Improve dlopen() on Apple Silicon
• dffee606c Run host compiler to create dlopen helper
• e4584ace8 Get cosmo_dlopen() working better on System Five
• ac125d3e1 Fix console copy/paste issue on Windows
• e961385e5 Put more thought into Windows i/o polyfills
• 7138399f9 Close Lua state before exiting redbean worker to allow GC to collect (#941)
• 5c1fdc981 Fix session changeset procesing (reverting some of 0d748ad5 changes) (#949)
• ddc08dc97 [metal] Make deathstar.com draw onto both VGA and serial consoles (#955)
• eea601f34 [metal] Some minor fixes and tweaks (#933)
• 545a8f4cb Add more sched.h content
• 7a9e176ec Improve debug binary location detection
• 68c7c9c1e Make strerror() conform more to other libc impls and introduce __clear_cache()
• 8f5e516b3 Remove sync_file_range
• 1351d3ced Remove bool from public headers
• 1c2e7c133 Introduce SIP_DISABLED compile option for ape-m1.c
• 3b15d3124 Fix #include <shared_mutex>
• c6d3802d3 Add more fixes for new cosmocc toolchain
• cdbd10c9d Introduce X86_CHECK() macro
• d2f49ca17 Improve mkdeps
• 15af5c2d7 Fix ucontext_t alignment in strict ansi mode
• b8d1377ae Give new wait4() another review pass
• ea28f93a2 Support includes in monorepo
• cc3e3de04 Make args replace ... only at the end of file (#909)

Known Issues

Shells

If you use zsh and have trouble running APE programs try sh -c ./prog or simply upgrade to zsh 5.9+ (since we patched it two years ago). The same is the case for Python subprocess, old versions of fish, etc.

Linux

Some Linux systems are configured to launch MZ executables under WINE or run-detectors. You can fix that by registering APE with binfmt_misc:

sudo wget -O /usr/bin/ape https://cosmo.zip/pub/cosmos/bin/ape-$(uname -m).elf
sudo sh -c "echo ':APE:M::MZqFpD::/usr/bin/ape:' >/proc/sys/fs/binfmt_misc/register"
sudo sh -c "echo ':APE-jart:M::jartsr::/usr/bin/ape:' >/proc/sys/fs/binfmt_misc/register"

If things still aren't working, it's also possible to disable binfmt_misc as follows:

sudo sh -c 'echo -1 > /proc/sys/fs/binfmt_misc/cli'     # remove Ubuntu's MZ interpreter
sudo sh -c 'echo -1 > /proc/sys/fs/binfmt_misc/status'  # remove ALL binfmt_misc entries

WSL

WSL tries to run MZ executables as WIN32 binaries within the WSL environment. In order to make it safe to use Cosmopolitan software on WSL, run this:

sudo sh -c "echo -1 > /proc/sys/fs/binfmt_misc/WSLInterop"

Features

• Introduce getifaddrs() 024be3b009d500970168e41f375ff8f0c79c80b0
• Introduce very primitive dlopen() support 5e8c928f1a37349a8c72f0b6aae5e535eace3f41
• Make it possible to use APE Loader on Apple Silicon systems with SIP enabled a12ad17291e6ce688ce1d997e90b3f971852359c

Bug Fixes

• Fix APE Loader CRT bugs which caused crashes for MacOS x86-64 users (#931)
• Fix getcwd() on Windows which was causing weirdness with bash 1eb6484c9c89b3cf85cd9f235aef70e1e5ed1776
• Embed GNU TLS in Cosmos Emacs so M-x package-list-packages will work on Windows
• Use /usr/local/bin/ape (instead of /usr/bin/ape) on Apple Silicon for systemwide APE.
• Add database and statement readonly checks to sqlite in redbean (#914)
• Make WIN32 i/o signals more atomic and longjmp() safe d7917ea076df24967ec578c5dabe1ce30b93793d
• Support \n in /zip/.args files 585c86e2a439d5df23595b249eb28554764ec6b4
• Make cosmocc -dumpmachine work

Upgrade Notes

If you've used ape-install or ape/ape-install.sh in the past (to install the system-wide APE Loader) then you need to run it again so that your system can use APE Loader v1.9. This new release of APE Loader fixes bugs. Apple M1 systems need it to run the APE binaries in this release..It's also backwards compatible with all APE and static ELF binaries ever made with Cosmo. Any of your own programs which you've compiled before on Apple Silicon which use execve() may need to be recompiled in order to run the latest APE executables unless you've installed a system-wide APE Loader.

It's recommended that cosmocc users run:

cd /opt/cosmo
rm -rf o/third_party/gcc
unzip -vl cosmocc-0.0.18.zip

To get the latest build of Cosmopolitan's toolchain.

Release notes: https://justine.lol/cosmo3/