A hallmark of inflammasome activation is the ASC speck, a micrometre-sized structure formed by the inflammasome adaptor protein ASC (apoptosis-associated speck-like protein containing a CARD), which consists of a pyrin domain (PYD) and a caspase recruitment domain (CARD). Here we show that assembly of the ASC speck involves oligomerization of ASC(PYD) into filaments and cross-linking of these filaments by ASC(CARD). ASC mutants with a non-functional CARD only assemble filaments but not specks, and moreover disrupt endogenous specks in primary macrophages. Systematic site-directed mutagenesis of ASC(PYD) is used to identify oligomerization-deficient ASC mutants and demonstrate that ASC speck formation is required for efficient processing of IL-1β, but dispensable for gasdermin-D cleavage and pyroptosis induction. Our results suggest that the oligomerization of ASC creates a multitude of potential caspase-1 activation sites, thus serving as a signal amplification mechanism for inflammasome-mediated cytokine production.