Covariant conserved 2-form currents for linearised gravity are constructed by contracting the linearised curvature with conformal Killing-Yano tensors. The corresponding conserved charges were originally introduced by Penrose and have recently been interpreted as the generators of generalised symmetries of the graviton. We introduce an off-shell refinement of these charges and find the relation between these improved Penrose charges and the linearised version of the ADM momentum and angular momentum. If the graviton field is globally well-defined on a background Minkowski space then some of the Penrose charges give the momentum and angular momentum while the remainder vanish. We consider the generalisation in which the graviton has Dirac string singularities or is defined locally in patches, in which case the conventional ADM expressions are not invariant under the graviton gauge symmetry in general. We modify them to render them gauge-invariant and show that the Penrose charges give these modified charges plus certain magnetic gravitational charges. We discuss properties of the Penrose charges, generalise to toroidal Kaluza-Klein compactifications and check our results in a number of examples.