Daniel Lemire

Daniel Lemire is a computer science professor. His research is on software performance in data engineering.

Ecosystems: Node.js, Java, C++, C, Go, Linux, JSON, macOS, Apache Spark

Projects

SIMDCompressionAndIntersection

A C++ library to compress and intersect sorted lists of integers using SIMD instructions

C++ - Released: 16 Dec 2013 - 417

cbitset

A simple bitset library in C

C - Released: 02 May 2016 - 117

MaskedVByte

Fast decoder for VByte-compressed integers

C - Released: 19 Nov 2014 - 113

fastvalidate-utf-8

header-only library to validate utf-8 strings at high speeds (using SIMD instructions)

C - Released: 15 May 2018 - 286

TypedFastBitSet.js

Speed-optimized BitSet implementation for modern browsers and JavaScript engines, uses typed arrays

TypeScript - Released: 13 Oct 2018 - 100

clhash

C library implementing the ridiculously fast CLHash hashing function

C - Released: 25 Apr 2016 - 266

fastrand

Fast random number generation in an interval in Python: Up to 10x faster than random.randint.

C - Released: 19 Feb 2016 - 83

rollinghashcpp

Rolling Hash C++ Library

C++ - Released: 11 Mar 2011 - 179

fastrange

A fast alternative to the modulo reduction

C - Released: 14 Oct 2016 - 294

testingRNG

Testing common random-number generators (RNG)

C++ - Released: 16 Aug 2017 - 166

despacer

C library to remove white space from strings as fast as possible

C - Released: 19 Jan 2017 - 147

StablePriorityQueue.js

A stable heap-based priority queue in JavaScript

JavaScript - Released: 13 Mar 2017 - 28

validateutf8-experiments

Reproducible experimeents on UTF-8 validation using SIMD instructions

C++ - Released: 20 May 2020 - 39

StronglyUniversalStringHashing

Benchmark showing the we can randomly hash strings very quickly with good universality

C++ - Released: 13 May 2013 - 131

SIMDxorshift

Fast random number generators: Vectorized (SIMD) version of xorshift128+

C - Released: 06 Apr 2016 - 108

lbimproved

Dynamic Time Warping (DTW) library implementing lower bounds (LB_Keogh, LB_Improved...)

C++ - Released: 12 Mar 2015 - 109

csharpewah

Compressed bitmaps in C#

C# - Released: 02 Feb 2012 - 82

LittleIntPacker

C library to pack and unpack short arrays of integers as fast as possible

C - Released: 05 Apr 2016 - 83

simple_fastfloat_benchmark

C - Released: 04 Sep 2020 - 22

testingmlp

Testing memory-level parallelism

C - Released: 01 Oct 2019 - 62

talks

Random material having to do with Daniel Lemire's talks

C++ - Released: 14 Dec 2015 - 20

crackingxoroshiro128plus

How to "crack" xoroshiro128+: from two outputs, derive a possible seed

Python - Released: 22 Aug 2017 - 21

dictionary

High-performance dictionary coding

C++ - Released: 11 Aug 2016 - 102

simdprune

Pruning elements in SIMD vectors (i.e., packing left elements)

C - Released: 25 Apr 2017 - 58

FrameOfReference

C++ library to pack and unpack vectors of integers having a small range of values using a technique called Frame of Reference

C - Released: 01 May 2015 - 47