Thanks for the tips, really helpful !

Ended up using a bash loop to prevent opening too much files at once :
for i in *.svg; do inkscape --verb=FitCanvasToDrawing --verb=FileSave --verb=FileQuit "$i"; done