Batteries and supercapacitors are electrochemical energy storage systems which involve multiple time-scales and length-scales. In terms of the electrolyte which serves as the ionic conductor, a molecular-level understanding of the corresponding transport phenomena, electrochemical (thermal) stability and interfacial properties is crucial for optimizing the device performance and achieving safety requirements. To this end, atomistic machine learning is a promising technology for bridging microscopic models and macroscopic phenomena. Here, we provide a timely snapshot of recent advances in this area. This includes technical considerations that are particularly relevant for modelling electrolytes as well as specific examples of both bulk electrolytes and associated interfaces. A perspective on methodological challenges and new applications is also discussed.