woodie pdf build step errors out (unknown error)

[strk]

See ​https://woodie.osgeo.org/postgis/postgis/build/591/10

[strk]

I connected to the machine (osgeo8-woodie-server) and got an interactive bash shell inside the docker container running the job. There I see this process being executed:

pdflatex -interaction=batchmode postgis-out.tex

The version of pdlatex is pdfTeX 3.14159265-2.6-1.40.20 (TeX Live 2019/Debian)

At the moment of writing multiple pdfs have been created, about one every 3 minutes:

-rw-r--r-- 1 root root 5383393 Jul  8 09:40 ./po/pt_BR/postgis-3.4.0dev-br.pdf
-rw-r--r-- 1 root root 5483288 Jul  8 09:43 ./po/fr/postgis-3.4.0dev-fr.pdf
-rw-r--r-- 1 root root 5345350 Jul  8 09:48 ./po/pl/postgis-3.4.0dev-pl.pdf
-rw-r--r-- 1 root root 5349839 Jul  8 09:45 ./po/es/postgis-3.4.0dev-es.pdf
-rw-r--r-- 1 root root 5542413 Jul  8 09:50 ./po/ko_KR/postgis-3.4.0dev-ko_KR.pdf
-rw-r--r-- 1 root root 5332001 Jul  8 09:38 ./po/it_IT/postgis-3.4.0dev-it.pdf
-rw-r--r-- 1 root root 5308009 Jul  8 09:35 ./postgis-3.4.0dev-en.pdf

The logs of the corresponding build are being received: ​https://woodie.osgeo.org/postgis/postgis/build/592/10

[strk]

the container disappeared while I was attached to it (via docker exec -ti 9d1577d0cdea /bin/sh) -- the logs disappeared from the job page ​https://woodie.osgeo.org/postgis/postgis/build/592/10 and were replaced by a single line saying exit code 2

[strk]

I've filed upstream ticket at ​https://github.com/woodpecker-ci/woodpecker/issues/1951

[strk]

Last lines from my terminal showing _how_ the docker containiner running the CI step was pulled off my feet:

root@9d1577d0cdea:/woodpecker/src/git.osgeo.org/gitea/postgis/postgis/build-docs/doc# find . -name '*.pdf' -exec ls -l {} \;
-rw-r--r-- 1 root root 5383393 Jul  8 09:40 ./po/pt_BR/postgis-3.4.0dev-br.pdf
-rw-r--r-- 1 root root 5483288 Jul  8 09:43 ./po/fr/postgis-3.4.0dev-fr.pdf
-rw-r--r-- 1 root root 5345350 Jul  8 09:48 ./po/pl/postgis-3.4.0dev-pl.pdf
-rw-r--r-- 1 root root 5349839 Jul  8 09:45 ./po/es/postgis-3.4.0dev-es.pdf
-rw-r--r-- 1 root root 5542413 Jul  8 09:50 ./po/ko_KR/postgis-3.4.0dev-ko_KR.pdf
-rw-r--r-- 1 root root 5332001 Jul  8 09:38 ./po/it_IT/postgis-3.4.0dev-it.pdf
-rw-r--r-- 1 root root 5308009 Jul  8 09:35 ./postgis-3.4.0dev-en.pdf
root@9d1577d0cdea:/woodpe
root@woodie-server:/tmp# docker exec -ti 9d1577d0cdea /usr/bin/bash
Error response from daemon: No such container: 9d1577d0cdea

[strk]

Running the offending job manually in the appropriate container shows a useful failure message:

ostgis-out.tex:58: Undefined control sequence \cyro.
postgis-out.tex:58: leading text: ...{PostgreSQL}, \cyrchar\cyrk{}\cyrchar\cyro

Transformation failure might be caused by handling a cyrillic document
without the XeTeX backend

Error: pdflatex compilation failed

[strk]

Use of xetex was initially pushed with [db1537723b0bc92ec6065677e27a9a374578e9c2/git] referencing #5419 but was then reverted to pdftex to fix the french translation with [5054c1d51b8f53b7d7485fd73316fdef8bc47ba6/git].

I guess we could make backend configurable on a per-language basis

[Sandro Santilli <strk@…>]

In 53b3282/git:

Allow per-language dblatex options, use xetex for russian

Should fix #5438

[strk]

Fix was effective: ​https://woodie.osgeo.org/postgis/postgis/build/593

Future problems may be spotted more easily with ​https://git.osgeo.org/gitea/postgis/postgis/pulls/131

[strk]

While the fix was effective (tested locally) the green on woodie was a false negative, as a split organization of jobs show that the japanese translation still fails: ​https://woodie.osgeo.org/postgis/postgis/build/594/61

When trying to compare the logs from the green job, I got the "unknown error occurred" message back: ​https://woodie.osgeo.org/postgis/postgis/build/593/10

[strk]

The "unkonwn error" issue might have been fixed upstream, so upgrade would be useful: ​https://trac.osgeo.org/osgeo/ticket/2947#ticket

The next error about PDF is in the japanese translation: ​https://woodie.osgeo.org/postgis/postgis/build/594

I've tried the xetex backend but didn't help.

We need to try something else.

[strk]

I've isolated the problem being in release_notes.xml, that is, taking out &release_notes; from postgis-out.xml makes the japanese translation complete successfully

[strk]

I've filed #5439 to be specific about the Japanese translation

[lnicola]

Replying to strk:

Use of xetex was initially pushed with [db1537723b0bc92ec6065677e27a9a374578e9c2/git] referencing #5419 but was then reverted to pdftex to fix the french translation with [5054c1d51b8f53b7d7485fd73316fdef8bc47ba6/git].

The reason it failed is the presence of some "NARROW NO-BREAK SPACE" (U+202F) characters in the code listings. Replacing them with spaces fixes the build. Same as with the Japanese translation, I think we want to keep the listings ASCII-only.

[strk]

woodie japanese build is now ok so I'm closing this out. For the ASCII in listing let's refer to #5440 And let's file new ticket for more specific issues