"Im not doing any damage but i think there's a slightly more efficient way."
You may not be visually damaging the sprocket but what about inside of the motor? With the correct tools you do no damage. The correct tools needed are
To remove the damper
1) puller 1026 (other pullers work well)
To remove the sprocket
1) Special tool 6793
2) Special tool C-4685-C2
To install the sprocket
1) Special tool 6792
To install the damper
1) Special tool 6792
You can see that one tool installs both the damper and the sprocket correctly. The tool is listed here for $37.47
SPX Miller Special Tools | Detail: 6792 - INSTALLER,CRANK SPROCKET