The Frontier

FFmpeg prioritizes excellent code quality and contributors' technical skill over their background or institutional affiliation, fostering a diverse community.

FFmpeg is a massive global CPU user, running on billions of devices for video decoding (e.g., 30% of Netflix, 50% of YouTube video). Its codebase is 79.9% assembly, 19.6% C, underscoring its low-level optimization.

VLC, an open-source media player, has been downloaded over 6.5 billion times and can play virtually any media format across any operating system without ads or tracking. Jean Baptiste Kemp states it can even record VHS tapes via capture cards and supports DVD audio.

VLC's distinctive traffic cone logo is globally recognized, with 25% of its website traffic searching for "cone player." An April Fool's joke about changing it prompted 10,000 user emails demanding it remain.

Both FFmpeg and VLC are engineered to handle broken or untrusted files, a philosophical approach rooted in VLC's origin streaming damaged UDP network data. They discard file extensions and analyze content directly.

Karen explains that up to 45% of video files are not GPU-decodable. Video codecs achieve 100x to 200x compression by removing data imperceptible to humans, mimicking how the eye processes luminance and color (YUV).

FFmpeg is the de facto collection of low-level libraries for multimedia processing, including codecs, muxers, demuxers, and filters. It is integrated into almost every video platform, from YouTube to OBS.

FFmpeg democratized high-end video processing, shifting it from expensive, car-sized studio equipment to accessible software, thus enabling the YouTube and podcasting revolutions for individuals.

Jean Baptiste Kemp changed VLC's core from GPL to LGPL to enable commercial integration, like in game engines, without forcing open-source for the entire product. This required contacting over 350 contributors for their agreement.

Jean Baptiste Kemp refused "dozens of millions of dollars" in offers to monetize VLC with toolbars or ads, stating it was unethical and would betray the volunteer work and user trust.

With 2,000-3,000 past contributors, FFmpeg's small core (10-15 people) and VLC's (five people) emphasize maintainable code and rigorous standards. Jean Baptiste Kemp notes that Linus Torvalds sets a similar high bar for Linux.

Karen criticizes Google security engineers for using AI to find open-source vulnerabilities, publicizing them before fixes, and offering limited funding, noting verbose reports on niche codecs. Microsoft Teams also requested urgent support from FFmpeg volunteers and offered minimal compensation.

Jean Baptiste Kemp and Karen successfully used "spicy tweets" to pressure large companies like Google and Microsoft, resolving bugs for VLC on Android and Windows Store and increasing FFmpeg donations and awareness.

Contributors are motivated by a passion for video and movies, the intellectual challenge of working on excellent, low-level code, and the pride of contributing to software used by billions. Jean Baptiste Kemp advises working on projects one loves.

FFmpeg is an "excellent school" for programmers, demanding a deep understanding of computer architecture, CPU pipelining, SIMD, and IO for its performance-critical environment. Its review process offers seasoned mentorship.

Karen describes VLC and FFmpeg as a "binary star system," coexisting and succeeding due to mutual dependence, akin to Android and Linux. VLC utilizes FFmpeg, which in turn integrates VideoLAN projects like x264.

Fabric Bellard originated FFmpeg's concept. Michael Neidmayr later provided exhaustive support for diverse proprietary codecs like DivX, Xvid, and MPEG-4 Part 2, eliminating the need for separate media players in the 2000s.

The maturation of H.264 around 2008-2010 spurred significant high-definition video reverse engineering, notably by developers like Kostya, who was capable of reverse engineering extremely complex binary blobs.