Bacterial colonization and biofilm formation on medical devices constitute major challenges in clinical long-term use of e.g. catheters due to the risk of (re)infection of patients, which would result in additional use of antibiotics risking bacterial resistance development. The aim of the present project was to introduce a novel antibacterial approach involving an advanced composite material applicable for medical devices. The polymeric composites investigated consisted of a hydrogel network of cross-linked poly(2-hydroxyethyl methacrylate) (PHEMA) embedded in a poly(dimethylsiloxane) (PDMS) silicone elastomer produced using supercritical carbon dioxide (scCO2). In these materials, the hydrogel may contain an active pharmaceutical ingredient while the silicone elastomer provides the sufficient mechanical stability of the material. In these conceptual studies, the antimicrobial agent ciprofloxacin was loaded into the polymer matrix by a post-polymerization loading procedure. Sustained release of ciprofloxacin was demonstrated, and the release could be controlled by varying the hydrogel content in the range 13–38% (w/w) and by changing the concentration of ciprofloxacin during loading in the range of 1–20 mg/mL. Devices containing 25% (w/w) hydrogel and loaded with ciprofloxacin displayed a strong antibacterial effect against Staphylococcus aureus bacterial colonization and subsequent biofilm formation on the device material was inhibited for 29 days. In conclusion, the hydrogel/silicone composite represents a promising candidate material for medical devices that prevent bacterial colonization during long-term use.