Mechanical responsiveness is essential to all biological systems down to the level of tissues and cells. The intra- and extracellular mechanics of such systems are governed by a series of proteins, such as microtubules, actin, intermediate filaments and collagen. As a general design motif, these proteins self-assemble into helical structures and superstructures that differ in diameter and persistence length to cover the full mechanical spectrum. Gels of cytoskeletal proteins display particular mechanical responses (stress stiffening) that until now have been absent in synthetic polymeric and low-molar-mass gels. Here we present synthetic gels that mimic in nearly all aspects gels prepared from intermediate filaments. They are prepared from polyisocyanopeptides grafted with oligo(ethylene glycol) side chains. These responsive polymers possess a stiff and helical architecture, and show a tunable thermal transition where the chains bundle together to generate transparent gels at extremely low concentrations. Using characterization techniques operating at different length scales (for example, macroscopic rheology, atomic force microscopy and molecular force spectroscopy) combined with an appropriate theoretical network model, we establish the hierarchical relationship between the bulk mechanical properties and the single-molecule parameters. Our results show that to develop artificial cytoskeletal or extracellular matrix mimics, the essential design parameters are not only the molecular stiffness, but also the extent of bundling. In contrast to the peptidic materials, our polyisocyanide polymers are readily modified, giving a starting point for functional biomimetic hydrogels with potentially a wide variety of applications, in particular in the biomedical field.