Back then: 1 target language * 1 big project * 1/2 hours
Times are changing and the instance hosted on Mozilla grew to 61 languages. For each language I run an import on 4 big projects.
Right now: 61 target languages * 4 big projects * 1/2 hours
As you see, running the import process in these conditions is almost impossible, so the much postponed step of optimizing the code is absolutely necessary right now.
Note that the import process is running in background and eating up all the CPU power available on the server.
Fortunately, the code is ready for such optimizations which are:
- cache database results whenever possible
- do stuff only when necessary
- use regular expressions only when really needed